-- Logs begin at Tue 2021-11-23 18:43:26 UTC, end at Tue 2021-11-23 19:50:28 UTC. -- Nov 23 19:24:54.094201 dv-cinder-819011-1-iscsi systemd[1]: Started Devstack devstack@q-svc.service. Nov 23 19:24:56.842252 dv-cinder-819011-1-iscsi neutron-server[102881]: INFO neutron.common.config [-] Logging enabled! Nov 23 19:24:56.842744 dv-cinder-819011-1-iscsi neutron-server[102881]: INFO neutron.common.config [-] /usr/local/bin/neutron-server version 19.1.0.dev223 Nov 23 19:24:56.843052 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG neutron.common.config [-] command line: /usr/local/bin/neutron-server --config-file /etc/neutron/neutron.conf --config-file /etc/neutron/plugins/ml2/ml2_conf.ini {{(pid=102881) setup_logging /opt/stack/neutron/neutron/common/config.py:112}} Nov 23 19:24:56.846330 dv-cinder-819011-1-iscsi neutron-server[102881]: INFO neutron.common.config [-] Logging enabled! Nov 23 19:24:56.846597 dv-cinder-819011-1-iscsi neutron-server[102881]: INFO neutron.common.config [-] /usr/local/bin/neutron-server version 19.1.0.dev223 Nov 23 19:24:56.846920 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG neutron.common.config [-] command line: /usr/local/bin/neutron-server --config-file /etc/neutron/neutron.conf --config-file /etc/neutron/plugins/ml2/ml2_conf.ini {{(pid=102881) setup_logging /opt/stack/neutron/neutron/common/config.py:112}} Nov 23 19:24:56.847897 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG neutron.common.config [-] ******************************************************************************** {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Nov 23 19:24:56.848308 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG neutron.common.config [-] Configuration options gathered from: {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Nov 23 19:24:56.848496 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG neutron.common.config [-] command line args: ['--config-file', '/etc/neutron/neutron.conf', '--config-file', '/etc/neutron/plugins/ml2/ml2_conf.ini'] {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Nov 23 19:24:56.848741 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG neutron.common.config [-] config files: ['/etc/neutron/neutron.conf', '/etc/neutron/plugins/ml2/ml2_conf.ini'] {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Nov 23 19:24:56.848977 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG neutron.common.config [-] ================================================================================ {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Nov 23 19:24:56.849308 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG neutron.common.config [-] allow_bulk = True {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 19:24:56.849767 dv-cinder-819011-1-iscsi neutron-server[102881]: WARNING oslo_config.cfg [-] Deprecated: Option "allow_overlapping_ips" from group "DEFAULT" is deprecated for removal. Its value may be silently ignored in the future. Nov 23 19:24:56.850094 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG neutron.common.config [-] allow_overlapping_ips = True {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 19:24:56.850406 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG neutron.common.config [-] api_extensions_path = {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 19:24:56.850709 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG neutron.common.config [-] api_paste_config = api-paste.ini {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 19:24:56.851013 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG neutron.common.config [-] api_workers = 2 {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 19:24:56.851316 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG neutron.common.config [-] auth_strategy = keystone {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 19:24:56.851613 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG neutron.common.config [-] backlog = 4096 {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 19:24:56.851915 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG neutron.common.config [-] base_mac = fa:16:3e:00:00:00 {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 19:24:56.852228 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG neutron.common.config [-] bind_host = 0.0.0.0 {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 19:24:56.852527 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG neutron.common.config [-] bind_port = 9696 {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 19:24:56.852819 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG neutron.common.config [-] client_socket_timeout = 900 {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 19:24:56.853114 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG neutron.common.config [-] config_dir = [] {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 19:24:56.853425 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG neutron.common.config [-] config_file = ['/etc/neutron/neutron.conf', '/etc/neutron/plugins/ml2/ml2_conf.ini'] {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 19:24:56.853743 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG neutron.common.config [-] config_source = [] {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 19:24:56.854045 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG neutron.common.config [-] control_exchange = neutron {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 19:24:56.854346 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG neutron.common.config [-] core_plugin = ml2 {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 19:24:56.854643 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG neutron.common.config [-] debug = True {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 19:24:56.854935 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG neutron.common.config [-] default_availability_zones = [] {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 19:24:56.855384 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG neutron.common.config [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'OFPHandler=INFO', 'OfctlService=INFO', 'os_ken.base.app_manager=INFO', 'os_ken.controller.controller=INFO'] {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 19:24:56.855806 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG neutron.common.config [-] dhcp_agent_notification = True {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 19:24:56.856100 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG neutron.common.config [-] dhcp_lease_duration = 86400 {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 19:24:56.856399 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG neutron.common.config [-] dns_domain = openstacklocal {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 19:24:56.856689 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG neutron.common.config [-] enable_traditional_dhcp = True {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 19:24:56.856970 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG neutron.common.config [-] external_dns_driver = None {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 19:24:56.857255 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG neutron.common.config [-] filter_validation = True {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 19:24:56.857576 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG neutron.common.config [-] global_physnet_mtu = 1500 {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 19:24:56.857922 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG neutron.common.config [-] host = dv-cinder-819011-1-iscsi {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 19:24:56.858212 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG neutron.common.config [-] http_retries = 3 {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 19:24:56.858513 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG neutron.common.config [-] instance_format = [instance: %(uuid)s] {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 19:24:56.858809 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG neutron.common.config [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 19:24:56.859105 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG neutron.common.config [-] ipam_driver = internal {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 19:24:56.859390 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG neutron.common.config [-] ipv6_pd_enabled = False {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 19:24:56.859677 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG neutron.common.config [-] log_config_append = None {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 19:24:56.859973 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG neutron.common.config [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 19:24:56.860263 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG neutron.common.config [-] log_dir = None {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 19:24:56.860544 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG neutron.common.config [-] log_file = None {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 19:24:56.860829 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG neutron.common.config [-] log_rotate_interval = 1 {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 19:24:56.861127 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG neutron.common.config [-] log_rotate_interval_type = days {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 19:24:56.861504 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG neutron.common.config [-] log_rotation_type = none {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 19:24:56.861822 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG neutron.common.config [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 19:24:56.862058 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG neutron.common.config [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 19:24:56.862289 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG neutron.common.config [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 19:24:56.862589 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG neutron.common.config [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 19:24:56.862886 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG neutron.common.config [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 19:24:56.863172 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG neutron.common.config [-] max_dns_nameservers = 5 {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 19:24:56.863456 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG neutron.common.config [-] max_header_line = 16384 {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 19:24:56.864276 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG neutron.common.config [-] max_logfile_count = 30 {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 19:24:56.864557 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG neutron.common.config [-] max_logfile_size_mb = 200 {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 19:24:56.864842 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG neutron.common.config [-] max_subnet_host_routes = 20 {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 19:24:56.865121 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG neutron.common.config [-] network_link_prefix = None {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 19:24:56.865436 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG neutron.common.config [-] notify_nova_on_port_data_changes = True {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 19:24:56.865730 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG neutron.common.config [-] notify_nova_on_port_status_changes = True {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 19:24:56.866028 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG neutron.common.config [-] pagination_max_limit = -1 {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 19:24:56.866314 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG neutron.common.config [-] periodic_fuzzy_delay = 5 {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 19:24:56.866598 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG neutron.common.config [-] periodic_interval = 40 {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 19:24:56.866878 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG neutron.common.config [-] publish_errors = False {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 19:24:56.867157 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG neutron.common.config [-] rate_limit_burst = 0 {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 19:24:56.867450 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG neutron.common.config [-] rate_limit_except_level = CRITICAL {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 19:24:56.867732 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG neutron.common.config [-] rate_limit_interval = 0 {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 19:24:56.868012 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG neutron.common.config [-] retry_until_window = 30 {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 19:24:56.868295 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG neutron.common.config [-] rpc_response_max_timeout = 600 {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 19:24:56.868596 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG neutron.common.config [-] rpc_state_report_workers = 0 {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 19:24:56.868873 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG neutron.common.config [-] rpc_workers = None {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 19:24:56.869156 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG neutron.common.config [-] send_events_interval = 2 {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 19:24:56.869490 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG neutron.common.config [-] service_plugins = ['router', 'neutron.services.metering.metering_plugin.MeteringPlugin'] {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 19:24:56.869785 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG neutron.common.config [-] setproctitle = on {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 19:24:56.870079 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG neutron.common.config [-] state_path = /opt/stack/data/neutron {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 19:24:56.870373 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG neutron.common.config [-] syslog_log_facility = LOG_USER {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 19:24:56.870663 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG neutron.common.config [-] tcp_keepidle = 600 {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 19:24:56.870956 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG neutron.common.config [-] transport_url = **** {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 19:24:56.871239 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG neutron.common.config [-] use_eventlog = False {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 19:24:56.871521 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG neutron.common.config [-] use_journal = False {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 19:24:56.871800 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG neutron.common.config [-] use_json = False {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 19:24:56.872080 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG neutron.common.config [-] use_ssl = False {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 19:24:56.872359 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG neutron.common.config [-] use_stderr = False {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 19:24:56.872650 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG neutron.common.config [-] use_syslog = False {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 19:24:56.872933 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG neutron.common.config [-] vlan_transparent = False {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 19:24:56.873213 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG neutron.common.config [-] watch_log_file = False {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 19:24:56.873523 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG neutron.common.config [-] wsgi_default_pool_size = 100 {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 19:24:56.873804 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG neutron.common.config [-] wsgi_keep_alive = True {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 19:24:56.874096 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG neutron.common.config [-] wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 19:24:56.874402 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG neutron.common.config [-] oslo_concurrency.disable_process_locking = False {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:24:56.874710 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG neutron.common.config [-] oslo_concurrency.lock_path = /opt/stack/data/neutron/lock {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:24:56.875021 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG neutron.common.config [-] profiler.connection_string = messaging:// {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:24:56.875314 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG neutron.common.config [-] profiler.enabled = False {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:24:56.875626 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG neutron.common.config [-] profiler.es_doc_type = notification {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:24:56.875916 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG neutron.common.config [-] profiler.es_scroll_size = 10000 {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:24:56.876215 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG neutron.common.config [-] profiler.es_scroll_time = 2m {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:24:56.876503 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG neutron.common.config [-] profiler.filter_error_trace = False {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:24:56.876801 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG neutron.common.config [-] profiler.hmac_keys = SECRET_KEY {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:24:56.877098 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG neutron.common.config [-] profiler.sentinel_service_name = mymaster {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:24:56.877393 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG neutron.common.config [-] profiler.socket_timeout = 0.1 {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:24:56.877703 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG neutron.common.config [-] profiler.trace_sqlalchemy = False {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:24:56.877999 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG neutron.common.config [-] oslo_policy.enforce_new_defaults = False {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:24:56.878285 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG neutron.common.config [-] oslo_policy.enforce_scope = False {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:24:56.878590 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG neutron.common.config [-] oslo_policy.policy_default_rule = default {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:24:56.878903 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG neutron.common.config [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:24:56.880023 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG neutron.common.config [-] oslo_policy.policy_file = /etc/neutron/policy.json {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:24:56.880337 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG neutron.common.config [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:24:56.880627 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG neutron.common.config [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:24:56.880917 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG neutron.common.config [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:24:56.881206 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG neutron.common.config [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:24:56.881579 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG neutron.common.config [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:24:56.881883 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG neutron.common.config [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:24:56.882175 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG neutron.common.config [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:24:56.882476 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG neutron.common.config [-] oslo_messaging_metrics.metrics_process_name = {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:24:56.882777 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG neutron.common.config [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:24:56.883069 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG neutron.common.config [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:24:56.883377 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG neutron.common.config [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:24:56.883681 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG neutron.common.config [-] nova.auth_section = None {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:24:56.883986 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG neutron.common.config [-] nova.auth_type = password {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:24:56.884286 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG neutron.common.config [-] nova.cafile = /opt/stack/data/ca-bundle.pem {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:24:56.884572 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG neutron.common.config [-] nova.certfile = None {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:24:56.884863 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG neutron.common.config [-] nova.collect_timing = False {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:24:56.885163 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG neutron.common.config [-] nova.endpoint_type = public {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:24:56.885478 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG neutron.common.config [-] nova.insecure = False {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:24:56.885765 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG neutron.common.config [-] nova.keyfile = None {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:24:56.886052 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG neutron.common.config [-] nova.live_migration_events = False {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:24:56.886352 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG neutron.common.config [-] nova.region_name = RegionOne {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:24:56.886638 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG neutron.common.config [-] nova.split_loggers = False {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:24:56.886920 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG neutron.common.config [-] nova.timeout = None {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:24:56.887213 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG neutron.common.config [-] placement.auth_section = None {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:24:56.887502 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG neutron.common.config [-] placement.auth_type = None {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:24:56.887784 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG neutron.common.config [-] placement.cafile = None {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:24:56.888066 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG neutron.common.config [-] placement.certfile = None {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:24:56.888353 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG neutron.common.config [-] placement.collect_timing = False {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:24:56.888652 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG neutron.common.config [-] placement.endpoint_type = public {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:24:56.888941 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG neutron.common.config [-] placement.insecure = False {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:24:56.889218 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG neutron.common.config [-] placement.keyfile = None {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:24:56.889522 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG neutron.common.config [-] placement.region_name = None {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:24:56.889810 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG neutron.common.config [-] placement.split_loggers = False {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:24:56.890091 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG neutron.common.config [-] placement.timeout = None {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:24:56.890385 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG neutron.common.config [-] ironic.auth_section = None {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:24:56.890671 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG neutron.common.config [-] ironic.auth_type = None {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:24:56.890952 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG neutron.common.config [-] ironic.cafile = None {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:24:56.891239 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG neutron.common.config [-] ironic.certfile = None {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:24:56.891528 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG neutron.common.config [-] ironic.collect_timing = False {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:24:56.891810 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG neutron.common.config [-] ironic.connect_retries = None {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:24:56.892094 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG neutron.common.config [-] ironic.connect_retry_delay = None {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:24:56.892381 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG neutron.common.config [-] ironic.enable_notifications = False {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:24:56.892663 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG neutron.common.config [-] ironic.endpoint_override = None {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:24:56.893008 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG neutron.common.config [-] ironic.insecure = False {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:24:56.893298 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG neutron.common.config [-] ironic.interface = None {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:24:56.893615 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG neutron.common.config [-] ironic.keyfile = None {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:24:56.893903 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG neutron.common.config [-] ironic.max_version = None {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:24:56.894188 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG neutron.common.config [-] ironic.min_version = None {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:24:56.894471 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG neutron.common.config [-] ironic.region_name = None {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:24:56.894781 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG neutron.common.config [-] ironic.service_name = None {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:24:56.895060 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG neutron.common.config [-] ironic.service_type = None {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:24:56.895510 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG neutron.common.config [-] ironic.split_loggers = False {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:24:56.895801 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG neutron.common.config [-] ironic.status_code_retries = None {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:24:56.896087 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG neutron.common.config [-] ironic.status_code_retry_delay = None {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:24:56.896372 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG neutron.common.config [-] ironic.timeout = None {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:24:56.896655 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG neutron.common.config [-] ironic.valid_interfaces = None {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:24:56.896939 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG neutron.common.config [-] ironic.version = None {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:24:56.897234 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG neutron.common.config [-] service_providers.service_provider = [] {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:24:56.897568 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:24:56.897859 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:24:56.898147 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:24:56.898436 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:24:56.898721 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:24:56.899008 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:24:56.899290 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:24:56.899577 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.heartbeat_rate = 2 {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:24:56.899864 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:24:56.900146 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:24:56.900444 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:24:56.900734 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:24:56.901027 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:24:56.901322 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:24:56.901654 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:24:56.901961 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:24:56.902249 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:24:56.902540 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:24:56.902824 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:24:56.903112 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:24:56.903402 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:24:56.903692 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.ssl = False {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:24:56.903993 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:24:56.904292 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:24:56.904592 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:24:56.904891 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.ssl_version = {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:24:56.905189 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG neutron.common.config [-] oslo_messaging_notifications.driver = [] {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:24:56.905503 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG neutron.common.config [-] oslo_messaging_notifications.retry = -1 {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:24:56.905821 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG neutron.common.config [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:24:56.906111 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG neutron.common.config [-] oslo_messaging_notifications.transport_url = **** {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:24:56.906338 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG neutron.common.config [-] ******************************************************************************** {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Nov 23 19:24:56.906586 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo.service.wsgi [-] Loading app neutron from /etc/neutron/api-paste.ini {{(pid=102881) load_app /usr/local/lib/python3.8/dist-packages/oslo_service/wsgi.py:349}} Nov 23 19:24:57.349842 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_concurrency.lockutils [-] Lock "plugin-directory" acquired by "neutron_lib.plugins.directory._create_plugin_directory" :: waited 0.000s {{(pid=102881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 19:24:57.350129 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_concurrency.lockutils [-] Lock "plugin-directory" "released" by "neutron_lib.plugins.directory._create_plugin_directory" :: held 0.001s {{(pid=102881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 19:24:57.350452 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_concurrency.lockutils [-] Lock "manager" acquired by "neutron.manager.NeutronManager._create_instance" :: waited 0.000s {{(pid=102881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 19:24:57.350797 dv-cinder-819011-1-iscsi neutron-server[102881]: INFO neutron.manager [-] Loading core plugin: ml2 Nov 23 19:24:57.680768 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_create 55550000 {{(pid=102881) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 23 19:24:57.680966 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_update 55550000 {{(pid=102881) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 23 19:24:57.681249 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_delete 55550000 {{(pid=102881) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 23 19:24:57.682481 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_create 55550000 {{(pid=102881) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 23 19:24:57.682774 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_update 55550000 {{(pid=102881) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 23 19:24:57.683050 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_delete 55550000 {{(pid=102881) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 23 19:24:57.719554 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_create 55550000 {{(pid=102881) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 23 19:24:57.719842 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_update 55550000 {{(pid=102881) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 23 19:24:57.720120 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_delete 55550000 {{(pid=102881) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 23 19:24:57.734900 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_create 55550000 {{(pid=102881) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 23 19:24:57.735192 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_update 55550000 {{(pid=102881) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 23 19:24:57.735474 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_delete 55550000 {{(pid=102881) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 23 19:24:57.764019 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_create 55550000 {{(pid=102881) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 23 19:24:57.764310 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_update 55550000 {{(pid=102881) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 23 19:24:57.764592 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_delete 55550000 {{(pid=102881) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 23 19:24:57.803854 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_create 55550000 {{(pid=102881) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 23 19:24:57.804149 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_update 55550000 {{(pid=102881) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 23 19:24:57.804432 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_delete 55550000 {{(pid=102881) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 23 19:24:58.050962 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: agent after_create 55550000 {{(pid=102881) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 23 19:24:58.051781 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: agent after_update 55550000 {{(pid=102881) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 23 19:24:58.051955 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: segment precommit_create 55550000 {{(pid=102881) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 23 19:24:58.052239 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: network precommit_delete 55550000 {{(pid=102881) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 23 19:24:58.052964 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: segment before_delete 55550000 {{(pid=102881) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 23 19:24:58.152697 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > network before_delete 55550000 {{(pid=102881) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 23 19:24:58.153024 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: agent before_delete 55550000 {{(pid=102881) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 23 19:24:58.153318 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > network before_create 55550000 {{(pid=102881) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 23 19:24:58.153646 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > port before_create 55550000 {{(pid=102881) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 23 19:24:58.153921 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > port before_update 55550000 {{(pid=102881) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 23 19:24:58.154241 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > segment precommit_create 55550000 {{(pid=102881) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 23 19:24:58.154509 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > segment precommit_delete 55550000 {{(pid=102881) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 23 19:24:58.154773 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > segment after_create 55550000 {{(pid=102881) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 23 19:24:58.155034 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > segment after_delete 55550000 {{(pid=102881) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 23 19:24:58.155323 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > network after_delete 55550000 {{(pid=102881) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 23 19:24:58.155591 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > network precommit_delete 0 {{(pid=102881) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 23 19:24:58.155863 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > port after_create 55550000 {{(pid=102881) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 23 19:24:58.156127 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > port after_update 55550000 {{(pid=102881) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 23 19:24:58.156386 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > port after_delete 55550000 {{(pid=102881) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 23 19:24:58.156649 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > port provisioning_complete 55550000 {{(pid=102881) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 23 19:24:58.156922 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_create 55550000 {{(pid=102881) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 23 19:24:58.157190 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy after_delete 55550000 {{(pid=102881) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 23 19:24:58.157495 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > agent after_update 55550000 {{(pid=102881) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 23 19:24:58.157774 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > subnet after_delete 55550000 {{(pid=102881) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 23 19:24:58.158040 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > subnet precommit_delete 0 {{(pid=102881) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 23 19:24:58.158319 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_update 55550000 {{(pid=102881) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 23 19:24:58.158576 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_delete 55550000 {{(pid=102881) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 23 19:24:58.158862 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > segment_host_mapping after_create 55550000 {{(pid=102881) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 23 19:24:58.159269 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_create 55550000 {{(pid=102881) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 23 19:24:58.159523 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_update 55550000 {{(pid=102881) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 23 19:24:58.159774 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_delete 55550000 {{(pid=102881) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 23 19:24:58.160175 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG neutron.quota.resource_registry [-] Tracking information for resource: network configured {{(pid=102881) set_tracked_resource /opt/stack/neutron/neutron/quota/resource_registry.py:205}} Nov 23 19:24:58.160519 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG neutron.quota.resource_registry [-] Tracking information for resource: port configured {{(pid=102881) set_tracked_resource /opt/stack/neutron/neutron/quota/resource_registry.py:205}} Nov 23 19:24:58.160882 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG neutron.quota.resource_registry [-] Tracking information for resource: subnet configured {{(pid=102881) set_tracked_resource /opt/stack/neutron/neutron/quota/resource_registry.py:205}} Nov 23 19:24:58.161130 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG neutron.quota.resource_registry [-] Tracking information for resource: subnetpool configured {{(pid=102881) set_tracked_resource /opt/stack/neutron/neutron/quota/resource_registry.py:205}} Nov 23 19:24:58.161374 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG neutron.quota.resource_registry [-] Tracking information for resource: security_group configured {{(pid=102881) set_tracked_resource /opt/stack/neutron/neutron/quota/resource_registry.py:205}} Nov 23 19:24:58.161645 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG neutron.quota.resource_registry [-] Tracking information for resource: security_group_rule configured {{(pid=102881) set_tracked_resource /opt/stack/neutron/neutron/quota/resource_registry.py:205}} Nov 23 19:24:58.162015 dv-cinder-819011-1-iscsi neutron-server[102881]: INFO neutron.plugins.ml2.managers [-] Configured type driver names: ['local', 'flat', 'vlan', 'gre', 'vxlan', 'geneve'] Nov 23 19:24:58.165133 dv-cinder-819011-1-iscsi neutron-server[102881]: INFO neutron.plugins.ml2.drivers.type_flat [-] Allowable flat physical_network names: ['physnet1'] Nov 23 19:24:58.169108 dv-cinder-819011-1-iscsi neutron-server[102881]: INFO neutron.plugins.ml2.drivers.type_local [-] ML2 LocalTypeDriver initialization complete Nov 23 19:24:58.172934 dv-cinder-819011-1-iscsi neutron-server[102881]: INFO neutron.plugins.ml2.drivers.type_vlan [-] Network VLAN ranges: OrderedDict([('physnet1', [(800, 849)])]) Nov 23 19:24:58.174843 dv-cinder-819011-1-iscsi neutron-server[102881]: INFO neutron.plugins.ml2.managers [-] Loaded type driver names: ['flat', 'geneve', 'gre', 'local', 'vlan', 'vxlan'] Nov 23 19:24:58.175314 dv-cinder-819011-1-iscsi neutron-server[102881]: INFO neutron.plugins.ml2.managers [-] Registered types: dict_keys(['flat', 'geneve', 'gre', 'local', 'vlan', 'vxlan']) Nov 23 19:24:58.175658 dv-cinder-819011-1-iscsi neutron-server[102881]: INFO neutron.plugins.ml2.managers [-] Tenant network_types: ['vlan'] Nov 23 19:24:58.176074 dv-cinder-819011-1-iscsi neutron-server[102881]: INFO neutron.plugins.ml2.managers [-] Configured extension driver names: ['port_security'] Nov 23 19:24:58.178937 dv-cinder-819011-1-iscsi neutron-server[102881]: INFO neutron.plugins.ml2.managers [-] Loaded extension driver names: ['port_security'] Nov 23 19:24:58.179197 dv-cinder-819011-1-iscsi neutron-server[102881]: INFO neutron.plugins.ml2.managers [-] Registered extension drivers: ['port_security'] Nov 23 19:24:58.179546 dv-cinder-819011-1-iscsi neutron-server[102881]: INFO neutron.plugins.ml2.managers [-] Configured mechanism driver names: ['openvswitch', 'hyperv'] Nov 23 19:24:58.184893 dv-cinder-819011-1-iscsi neutron-server[102881]: INFO neutron.plugins.ml2.drivers.mech_agent [-] HyperV agent's supported_vnic_types: ['normal', 'direct'] Nov 23 19:24:58.209062 dv-cinder-819011-1-iscsi neutron-server[102881]: INFO neutron.plugins.ml2.drivers.mech_agent [-] Open vSwitch agent's supported_vnic_types: ['normal', 'direct', 'smart-nic', 'vdpa'] Nov 23 19:24:58.209534 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > qos_plugin after_init 55550000 {{(pid=102881) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 23 19:24:58.209845 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG neutron.services.qos.drivers.openvswitch.driver [-] Open vSwitch QoS driver registered {{(pid=102881) register /opt/stack/neutron/neutron/services/qos/drivers/openvswitch/driver.py:88}} Nov 23 19:24:58.210219 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > logging-plugin after_init 55550000 {{(pid=102881) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 23 19:24:58.211612 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG neutron.services.logapi.drivers.openvswitch.driver [-] Open vSwitch logging driver registered {{(pid=102881) register /opt/stack/neutron/neutron/services/logapi/drivers/openvswitch/driver.py:69}} Nov 23 19:24:58.211900 dv-cinder-819011-1-iscsi neutron-server[102881]: INFO neutron.plugins.ml2.managers [-] Loaded mechanism driver names: ['openvswitch', 'hyperv'] Nov 23 19:24:58.212154 dv-cinder-819011-1-iscsi neutron-server[102881]: INFO neutron.plugins.ml2.managers [-] Registered mechanism drivers: ['openvswitch', 'hyperv'] Nov 23 19:24:58.215600 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > floatingip before_response 55550000 {{(pid=102881) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 23 19:24:58.215894 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > port before_response 55550000 {{(pid=102881) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 23 19:24:58.279479 dv-cinder-819011-1-iscsi neutron-server[102881]: INFO neutron.plugins.ml2.managers [-] Initializing driver for type 'flat' Nov 23 19:24:58.279729 dv-cinder-819011-1-iscsi neutron-server[102881]: INFO neutron.plugins.ml2.drivers.type_flat [-] ML2 FlatTypeDriver initialization complete Nov 23 19:24:58.279976 dv-cinder-819011-1-iscsi neutron-server[102881]: INFO neutron.plugins.ml2.managers [-] Initializing driver for type 'geneve' Nov 23 19:24:58.280362 dv-cinder-819011-1-iscsi neutron-server[102881]: INFO neutron.plugins.ml2.drivers.type_tunnel [-] geneve ID ranges: [(1, 1000)] Nov 23 19:24:58.302757 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_db.sqlalchemy.engines [None req-a17d3a60-359c-4f1e-b272-f8e10fa1ee6a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=102881) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 23 19:24:58.986748 dv-cinder-819011-1-iscsi neutron-server[102881]: INFO neutron.plugins.ml2.managers [None req-a17d3a60-359c-4f1e-b272-f8e10fa1ee6a None None] Initializing driver for type 'gre' Nov 23 19:24:58.987313 dv-cinder-819011-1-iscsi neutron-server[102881]: INFO neutron.plugins.ml2.drivers.type_tunnel [None req-a17d3a60-359c-4f1e-b272-f8e10fa1ee6a None None] gre ID ranges: [(1, 1000)] Nov 23 19:24:59.135201 dv-cinder-819011-1-iscsi neutron-server[102881]: INFO neutron.plugins.ml2.managers [None req-a17d3a60-359c-4f1e-b272-f8e10fa1ee6a None None] Initializing driver for type 'local' Nov 23 19:24:59.135774 dv-cinder-819011-1-iscsi neutron-server[102881]: INFO neutron.plugins.ml2.managers [None req-a17d3a60-359c-4f1e-b272-f8e10fa1ee6a None None] Initializing driver for type 'vlan' Nov 23 19:24:59.197990 dv-cinder-819011-1-iscsi neutron-server[102881]: INFO neutron.plugins.ml2.drivers.type_vlan [None req-a17d3a60-359c-4f1e-b272-f8e10fa1ee6a None None] VlanTypeDriver initialization complete Nov 23 19:24:59.198419 dv-cinder-819011-1-iscsi neutron-server[102881]: INFO neutron.plugins.ml2.managers [None req-a17d3a60-359c-4f1e-b272-f8e10fa1ee6a None None] Initializing driver for type 'vxlan' Nov 23 19:24:59.198973 dv-cinder-819011-1-iscsi neutron-server[102881]: INFO neutron.plugins.ml2.drivers.type_tunnel [None req-a17d3a60-359c-4f1e-b272-f8e10fa1ee6a None None] vxlan ID ranges: [(1, 1000)] Nov 23 19:24:59.398221 dv-cinder-819011-1-iscsi neutron-server[102881]: INFO neutron.plugins.ml2.managers [None req-a17d3a60-359c-4f1e-b272-f8e10fa1ee6a None None] Initializing extension driver 'port_security' Nov 23 19:24:59.398495 dv-cinder-819011-1-iscsi neutron-server[102881]: INFO neutron.plugins.ml2.extensions.port_security [None req-a17d3a60-359c-4f1e-b272-f8e10fa1ee6a None None] PortSecurityExtensionDriver initialization complete Nov 23 19:24:59.398839 dv-cinder-819011-1-iscsi neutron-server[102881]: INFO neutron.plugins.ml2.managers [None req-a17d3a60-359c-4f1e-b272-f8e10fa1ee6a None None] Initializing mechanism driver 'openvswitch' Nov 23 19:24:59.399169 dv-cinder-819011-1-iscsi neutron-server[102881]: INFO neutron.plugins.ml2.managers [None req-a17d3a60-359c-4f1e-b272-f8e10fa1ee6a None None] Initializing mechanism driver 'hyperv' Nov 23 19:24:59.409819 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG neutron.plugins.ml2.plugin [None req-a17d3a60-359c-4f1e-b272-f8e10fa1ee6a None None] neutron.plugins.ml2.plugin.Ml2Plugin method _start_rpc_notifiers called with arguments () {} {{(pid=102881) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 23 19:24:59.410588 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG neutron_lib.callbacks.manager [None req-a17d3a60-359c-4f1e-b272-f8e10fa1ee6a None None] Subscribe: > port after_create 55550000 {{(pid=102881) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 23 19:24:59.411013 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG neutron_lib.callbacks.manager [None req-a17d3a60-359c-4f1e-b272-f8e10fa1ee6a None None] Subscribe: > port after_update 55550000 {{(pid=102881) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 23 19:24:59.411211 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG neutron_lib.callbacks.manager [None req-a17d3a60-359c-4f1e-b272-f8e10fa1ee6a None None] Subscribe: > port after_delete 55550000 {{(pid=102881) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 23 19:24:59.411741 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG neutron.plugins.ml2.ovo_rpc [-] Thread ObjectChangeHandler[port] started {{(pid=102881) dispatch_events /opt/stack/neutron/neutron/plugins/ml2/ovo_rpc.py:105}} Nov 23 19:24:59.412177 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG neutron_lib.callbacks.manager [None req-a17d3a60-359c-4f1e-b272-f8e10fa1ee6a None None] Subscribe: > subnet after_create 55550000 {{(pid=102881) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 23 19:24:59.412535 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG neutron_lib.callbacks.manager [None req-a17d3a60-359c-4f1e-b272-f8e10fa1ee6a None None] Subscribe: > subnet after_update 55550000 {{(pid=102881) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 23 19:24:59.412887 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG neutron_lib.callbacks.manager [None req-a17d3a60-359c-4f1e-b272-f8e10fa1ee6a None None] Subscribe: > subnet after_delete 55550000 {{(pid=102881) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 23 19:24:59.413291 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG neutron.plugins.ml2.ovo_rpc [-] Thread ObjectChangeHandler[subnet] started {{(pid=102881) dispatch_events /opt/stack/neutron/neutron/plugins/ml2/ovo_rpc.py:105}} Nov 23 19:24:59.413734 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG neutron_lib.callbacks.manager [None req-a17d3a60-359c-4f1e-b272-f8e10fa1ee6a None None] Subscribe: > network after_create 55550000 {{(pid=102881) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 23 19:24:59.414113 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG neutron_lib.callbacks.manager [None req-a17d3a60-359c-4f1e-b272-f8e10fa1ee6a None None] Subscribe: > network after_update 55550000 {{(pid=102881) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 23 19:24:59.414462 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG neutron_lib.callbacks.manager [None req-a17d3a60-359c-4f1e-b272-f8e10fa1ee6a None None] Subscribe: > network after_delete 55550000 {{(pid=102881) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 23 19:24:59.414863 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG neutron.plugins.ml2.ovo_rpc [-] Thread ObjectChangeHandler[network] started {{(pid=102881) dispatch_events /opt/stack/neutron/neutron/plugins/ml2/ovo_rpc.py:105}} Nov 23 19:24:59.415272 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG neutron_lib.callbacks.manager [None req-a17d3a60-359c-4f1e-b272-f8e10fa1ee6a None None] Subscribe: > security_group after_create 55550000 {{(pid=102881) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 23 19:24:59.415622 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG neutron_lib.callbacks.manager [None req-a17d3a60-359c-4f1e-b272-f8e10fa1ee6a None None] Subscribe: > security_group after_update 55550000 {{(pid=102881) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 23 19:24:59.415967 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG neutron_lib.callbacks.manager [None req-a17d3a60-359c-4f1e-b272-f8e10fa1ee6a None None] Subscribe: > security_group after_delete 55550000 {{(pid=102881) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 23 19:24:59.416502 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG neutron.plugins.ml2.ovo_rpc [-] Thread ObjectChangeHandler[security_group] started {{(pid=102881) dispatch_events /opt/stack/neutron/neutron/plugins/ml2/ovo_rpc.py:105}} Nov 23 19:24:59.416920 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG neutron_lib.callbacks.manager [None req-a17d3a60-359c-4f1e-b272-f8e10fa1ee6a None None] Subscribe: > security_group_rule after_create 55550000 {{(pid=102881) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 23 19:24:59.417278 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG neutron_lib.callbacks.manager [None req-a17d3a60-359c-4f1e-b272-f8e10fa1ee6a None None] Subscribe: > security_group_rule after_update 55550000 {{(pid=102881) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 23 19:24:59.417652 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG neutron_lib.callbacks.manager [None req-a17d3a60-359c-4f1e-b272-f8e10fa1ee6a None None] Subscribe: > security_group_rule after_delete 55550000 {{(pid=102881) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 23 19:24:59.418055 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG neutron.plugins.ml2.ovo_rpc [-] Thread ObjectChangeHandler[security_group_rule] started {{(pid=102881) dispatch_events /opt/stack/neutron/neutron/plugins/ml2/ovo_rpc.py:105}} Nov 23 19:24:59.418468 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG neutron_lib.callbacks.manager [None req-a17d3a60-359c-4f1e-b272-f8e10fa1ee6a None None] Subscribe: > address_group after_create 55550000 {{(pid=102881) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 23 19:24:59.418820 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG neutron_lib.callbacks.manager [None req-a17d3a60-359c-4f1e-b272-f8e10fa1ee6a None None] Subscribe: > address_group after_update 55550000 {{(pid=102881) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 23 19:24:59.419166 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG neutron_lib.callbacks.manager [None req-a17d3a60-359c-4f1e-b272-f8e10fa1ee6a None None] Subscribe: > address_group after_delete 55550000 {{(pid=102881) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 23 19:24:59.419569 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG neutron.plugins.ml2.ovo_rpc [-] Thread ObjectChangeHandler[address_group] started {{(pid=102881) dispatch_events /opt/stack/neutron/neutron/plugins/ml2/ovo_rpc.py:105}} Nov 23 19:24:59.419947 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG neutron.plugins.ml2.ovo_rpc [None req-a17d3a60-359c-4f1e-b272-f8e10fa1ee6a None None] ML2 OVO RPC backend initialized. {{(pid=102881) __init__ /opt/stack/neutron/neutron/plugins/ml2/ovo_rpc.py:154}} Nov 23 19:24:59.420642 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG neutron_lib.callbacks.manager [None req-a17d3a60-359c-4f1e-b272-f8e10fa1ee6a None None] Subscribe: > router_interface after_create 55550000 {{(pid=102881) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 23 19:24:59.421000 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG neutron_lib.callbacks.manager [None req-a17d3a60-359c-4f1e-b272-f8e10fa1ee6a None None] Subscribe: > router_interface after_delete 55550000 {{(pid=102881) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 23 19:24:59.421431 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG neutron_lib.callbacks.manager [None req-a17d3a60-359c-4f1e-b272-f8e10fa1ee6a None None] Subscribe: > network before_response 55550000 {{(pid=102881) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 23 19:24:59.421793 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG neutron_lib.callbacks.manager [None req-a17d3a60-359c-4f1e-b272-f8e10fa1ee6a None None] Subscribe: > networks before_response 55550000 {{(pid=102881) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 23 19:24:59.422146 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG neutron_lib.callbacks.manager [None req-a17d3a60-359c-4f1e-b272-f8e10fa1ee6a None None] Subscribe: > port before_response 55550000 {{(pid=102881) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 23 19:24:59.422495 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG neutron_lib.callbacks.manager [None req-a17d3a60-359c-4f1e-b272-f8e10fa1ee6a None None] Subscribe: > ports before_response 55550000 {{(pid=102881) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 23 19:24:59.422845 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG neutron_lib.callbacks.manager [None req-a17d3a60-359c-4f1e-b272-f8e10fa1ee6a None None] Subscribe: > subnet before_response 55550000 {{(pid=102881) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 23 19:24:59.423190 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG neutron_lib.callbacks.manager [None req-a17d3a60-359c-4f1e-b272-f8e10fa1ee6a None None] Subscribe: > subnets before_response 55550000 {{(pid=102881) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 23 19:24:59.423539 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG neutron_lib.callbacks.manager [None req-a17d3a60-359c-4f1e-b272-f8e10fa1ee6a None None] Subscribe: > network after_create 55550000 {{(pid=102881) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 23 19:24:59.423885 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG neutron_lib.callbacks.manager [None req-a17d3a60-359c-4f1e-b272-f8e10fa1ee6a None None] Subscribe: > network after_update 55550000 {{(pid=102881) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 23 19:24:59.424223 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG neutron_lib.callbacks.manager [None req-a17d3a60-359c-4f1e-b272-f8e10fa1ee6a None None] Subscribe: > network after_delete 55550000 {{(pid=102881) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 23 19:24:59.424563 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG neutron_lib.callbacks.manager [None req-a17d3a60-359c-4f1e-b272-f8e10fa1ee6a None None] Subscribe: > port after_create 55550000 {{(pid=102881) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 23 19:24:59.424902 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG neutron_lib.callbacks.manager [None req-a17d3a60-359c-4f1e-b272-f8e10fa1ee6a None None] Subscribe: > port after_update 55550000 {{(pid=102881) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 23 19:24:59.425238 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG neutron_lib.callbacks.manager [None req-a17d3a60-359c-4f1e-b272-f8e10fa1ee6a None None] Subscribe: > port after_delete 55550000 {{(pid=102881) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 23 19:24:59.425648 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG neutron_lib.callbacks.manager [None req-a17d3a60-359c-4f1e-b272-f8e10fa1ee6a None None] Subscribe: > subnet after_create 55550000 {{(pid=102881) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 23 19:24:59.425993 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG neutron_lib.callbacks.manager [None req-a17d3a60-359c-4f1e-b272-f8e10fa1ee6a None None] Subscribe: > subnet after_update 55550000 {{(pid=102881) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 23 19:24:59.426506 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG neutron_lib.callbacks.manager [None req-a17d3a60-359c-4f1e-b272-f8e10fa1ee6a None None] Subscribe: > subnet after_delete 55550000 {{(pid=102881) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 23 19:24:59.426892 dv-cinder-819011-1-iscsi neutron-server[102881]: INFO neutron.plugins.ml2.plugin [None req-a17d3a60-359c-4f1e-b272-f8e10fa1ee6a None None] Modular L2 Plugin initialization complete Nov 23 19:24:59.427225 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG neutron.manager [None req-a17d3a60-359c-4f1e-b272-f8e10fa1ee6a None None] Loading services supported by the core plugin {{(pid=102881) _load_services_from_core_plugin /opt/stack/neutron/neutron/manager.py:168}} Nov 23 19:24:59.427554 dv-cinder-819011-1-iscsi neutron-server[102881]: INFO neutron.plugins.ml2.managers [None req-a17d3a60-359c-4f1e-b272-f8e10fa1ee6a None None] Got port-security extension from driver 'port_security' Nov 23 19:24:59.428020 dv-cinder-819011-1-iscsi neutron-server[102881]: INFO neutron.extensions.vlantransparent [None req-a17d3a60-359c-4f1e-b272-f8e10fa1ee6a None None] Disabled vlantransparent extension. Nov 23 19:24:59.428501 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG neutron.manager [None req-a17d3a60-359c-4f1e-b272-f8e10fa1ee6a None None] Loading service plugins: ['router', 'neutron.services.metering.metering_plugin.MeteringPlugin', 'auto_allocate', 'tag', 'timestamp', 'network_ip_availability', 'flavors', 'revisions'] {{(pid=102881) _load_service_plugins /opt/stack/neutron/neutron/manager.py:194}} Nov 23 19:24:59.428817 dv-cinder-819011-1-iscsi neutron-server[102881]: INFO neutron.manager [None req-a17d3a60-359c-4f1e-b272-f8e10fa1ee6a None None] Loading Plugin: router Nov 23 19:24:59.465266 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG neutron_lib.callbacks.manager [None req-a17d3a60-359c-4f1e-b272-f8e10fa1ee6a None None] Subscribe: > router_interface before_create 55550000 {{(pid=102881) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 23 19:24:59.465695 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG neutron_lib.callbacks.manager [None req-a17d3a60-359c-4f1e-b272-f8e10fa1ee6a None None] Subscribe: > router after_create 55549900 {{(pid=102881) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 23 19:24:59.466070 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG neutron_lib.callbacks.manager [None req-a17d3a60-359c-4f1e-b272-f8e10fa1ee6a None None] Subscribe: > router before_create 55549900 {{(pid=102881) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 23 19:24:59.466442 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG neutron_lib.callbacks.manager [None req-a17d3a60-359c-4f1e-b272-f8e10fa1ee6a None None] Subscribe: > router_interface before_delete 55550000 {{(pid=102881) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 23 19:24:59.466817 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG neutron_lib.callbacks.manager [None req-a17d3a60-359c-4f1e-b272-f8e10fa1ee6a None None] Subscribe: > router_interface after_delete 55550000 {{(pid=102881) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 23 19:24:59.467176 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG neutron_lib.callbacks.manager [None req-a17d3a60-359c-4f1e-b272-f8e10fa1ee6a None None] Subscribe: > router after_delete 55549900 {{(pid=102881) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 23 19:24:59.467543 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG neutron_lib.callbacks.manager [None req-a17d3a60-359c-4f1e-b272-f8e10fa1ee6a None None] Subscribe: > floatingip after_create 55550000 {{(pid=102881) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 23 19:24:59.467902 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG neutron_lib.callbacks.manager [None req-a17d3a60-359c-4f1e-b272-f8e10fa1ee6a None None] Subscribe: > floatingip after_update 55550000 {{(pid=102881) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 23 19:24:59.468264 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG neutron_lib.callbacks.manager [None req-a17d3a60-359c-4f1e-b272-f8e10fa1ee6a None None] Subscribe: > router after_create 55549900 {{(pid=102881) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 23 19:24:59.468614 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG neutron_lib.callbacks.manager [None req-a17d3a60-359c-4f1e-b272-f8e10fa1ee6a None None] Subscribe: > router after_update 55549900 {{(pid=102881) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 23 19:24:59.468966 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG neutron_lib.callbacks.manager [None req-a17d3a60-359c-4f1e-b272-f8e10fa1ee6a None None] Subscribe: > router after_update 55549900 {{(pid=102881) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 23 19:24:59.469318 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG neutron_lib.callbacks.manager [None req-a17d3a60-359c-4f1e-b272-f8e10fa1ee6a None None] Subscribe: > router_gateway after_delete 55550000 {{(pid=102881) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 23 19:24:59.469709 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG neutron_lib.callbacks.manager [None req-a17d3a60-359c-4f1e-b272-f8e10fa1ee6a None None] Subscribe: > router after_update 55549900 {{(pid=102881) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 23 19:24:59.470126 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG neutron_lib.callbacks.manager [None req-a17d3a60-359c-4f1e-b272-f8e10fa1ee6a None None] Subscribe: > router precommit_update 55549900 {{(pid=102881) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 23 19:24:59.470498 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG neutron_lib.callbacks.manager [None req-a17d3a60-359c-4f1e-b272-f8e10fa1ee6a None None] Subscribe: port after_update 55550000 {{(pid=102881) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 23 19:24:59.470843 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG neutron_lib.callbacks.manager [None req-a17d3a60-359c-4f1e-b272-f8e10fa1ee6a None None] Subscribe: port after_delete 55550000 {{(pid=102881) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 23 19:24:59.471185 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG neutron_lib.callbacks.manager [None req-a17d3a60-359c-4f1e-b272-f8e10fa1ee6a None None] Subscribe: subnet after_update 55550000 {{(pid=102881) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 23 19:24:59.471529 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG neutron_lib.callbacks.manager [None req-a17d3a60-359c-4f1e-b272-f8e10fa1ee6a None None] Subscribe: subnetpool_address_scope after_update 55550000 {{(pid=102881) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 23 19:24:59.471884 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG neutron_lib.callbacks.manager [None req-a17d3a60-359c-4f1e-b272-f8e10fa1ee6a None None] Subscribe: > port precommit_delete 55550000 {{(pid=102881) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 23 19:24:59.472235 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG neutron_lib.callbacks.manager [None req-a17d3a60-359c-4f1e-b272-f8e10fa1ee6a None None] Subscribe: > router precommit_create 55549900 {{(pid=102881) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 23 19:24:59.472583 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG neutron_lib.callbacks.manager [None req-a17d3a60-359c-4f1e-b272-f8e10fa1ee6a None None] Subscribe: port before_delete 55550000 {{(pid=102881) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 23 19:24:59.473013 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG neutron_lib.callbacks.manager [None req-a17d3a60-359c-4f1e-b272-f8e10fa1ee6a None None] Subscribe: > router precommit_create 55550000 {{(pid=102881) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 23 19:24:59.473618 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG neutron_lib.callbacks.manager [None req-a17d3a60-359c-4f1e-b272-f8e10fa1ee6a None None] Subscribe: > router after_update 55549900 {{(pid=102881) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 23 19:24:59.473974 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG neutron_lib.callbacks.manager [None req-a17d3a60-359c-4f1e-b272-f8e10fa1ee6a None None] Subscribe: > router precommit_delete 55549900 {{(pid=102881) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 23 19:24:59.474337 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG neutron_lib.callbacks.manager [None req-a17d3a60-359c-4f1e-b272-f8e10fa1ee6a None None] Subscribe: > router precommit_create 55549900 {{(pid=102881) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 23 19:24:59.474707 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG neutron_lib.callbacks.manager [None req-a17d3a60-359c-4f1e-b272-f8e10fa1ee6a None None] Subscribe: > router_interface after_create 55550000 {{(pid=102881) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 23 19:24:59.475062 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG neutron_lib.callbacks.manager [None req-a17d3a60-359c-4f1e-b272-f8e10fa1ee6a None None] Subscribe: > router precommit_update 55549900 {{(pid=102881) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 23 19:24:59.475436 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG neutron_lib.callbacks.manager [None req-a17d3a60-359c-4f1e-b272-f8e10fa1ee6a None None] Subscribe: > agent after_create 55550000 {{(pid=102881) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 23 19:24:59.475793 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG neutron_lib.callbacks.manager [None req-a17d3a60-359c-4f1e-b272-f8e10fa1ee6a None None] Subscribe: > agent after_delete 55550000 {{(pid=102881) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 23 19:24:59.476144 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG neutron_lib.callbacks.manager [None req-a17d3a60-359c-4f1e-b272-f8e10fa1ee6a None None] Subscribe: > network after_delete 55550000 {{(pid=102881) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 23 19:24:59.477004 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG neutron.quota.resource_registry [None req-a17d3a60-359c-4f1e-b272-f8e10fa1ee6a None None] Tracking information for resource: router configured {{(pid=102881) set_tracked_resource /opt/stack/neutron/neutron/quota/resource_registry.py:205}} Nov 23 19:24:59.477345 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG neutron.quota.resource_registry [None req-a17d3a60-359c-4f1e-b272-f8e10fa1ee6a None None] Tracking information for resource: floatingip configured {{(pid=102881) set_tracked_resource /opt/stack/neutron/neutron/quota/resource_registry.py:205}} Nov 23 19:24:59.482368 dv-cinder-819011-1-iscsi neutron-server[102881]: INFO neutron.db.l3_agentschedulers_db [None req-a17d3a60-359c-4f1e-b272-f8e10fa1ee6a None None] Skipping period L3 agent status check because automatic router rescheduling is disabled. Nov 23 19:24:59.482934 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG neutron_lib.callbacks.manager [None req-a17d3a60-359c-4f1e-b272-f8e10fa1ee6a None None] Subscribe: port after_update 55550000 {{(pid=102881) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 23 19:24:59.483298 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG neutron_lib.callbacks.manager [None req-a17d3a60-359c-4f1e-b272-f8e10fa1ee6a None None] Subscribe: port after_create 55550000 {{(pid=102881) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 23 19:24:59.483655 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG neutron_lib.callbacks.manager [None req-a17d3a60-359c-4f1e-b272-f8e10fa1ee6a None None] Subscribe: port after_delete 55550000 {{(pid=102881) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 23 19:24:59.484010 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG neutron_lib.callbacks.manager [None req-a17d3a60-359c-4f1e-b272-f8e10fa1ee6a None None] Subscribe: port after_update 55550000 {{(pid=102881) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 23 19:24:59.484789 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG neutron_lib.callbacks.manager [None req-a17d3a60-359c-4f1e-b272-f8e10fa1ee6a None None] Subscribe: > router before_create 55550100 {{(pid=102881) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 23 19:24:59.485154 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG neutron_lib.callbacks.manager [None req-a17d3a60-359c-4f1e-b272-f8e10fa1ee6a None None] Subscribe: > router precommit_delete 55550100 {{(pid=102881) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 23 19:24:59.485543 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG neutron_lib.callbacks.manager [None req-a17d3a60-359c-4f1e-b272-f8e10fa1ee6a None None] Subscribe: > router precommit_create 55550100 {{(pid=102881) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 23 19:24:59.485905 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG neutron_lib.callbacks.manager [None req-a17d3a60-359c-4f1e-b272-f8e10fa1ee6a None None] Subscribe: > router precommit_update 55550100 {{(pid=102881) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 23 19:24:59.490935 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG neutron.services.provider_configuration [None req-a17d3a60-359c-4f1e-b272-f8e10fa1ee6a None None] Service providers = [] {{(pid=102881) parse_service_provider_opt /opt/stack/neutron/neutron/services/provider_configuration.py:171}} Nov 23 19:24:59.491302 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG neutron.db.servicetype_db [None req-a17d3a60-359c-4f1e-b272-f8e10fa1ee6a None None] Adding provider configuration for service L3_ROUTER_NAT {{(pid=102881) add_provider_configuration /opt/stack/neutron/neutron/db/servicetype_db.py:42}} Nov 23 19:24:59.494249 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG neutron.services.service_base [None req-a17d3a60-359c-4f1e-b272-f8e10fa1ee6a None None] Loaded 'neutron.services.l3_router.service_providers.dvrha.DvrHaDriver' provider for service L3_ROUTER_NAT {{(pid=102881) load_drivers /opt/stack/neutron/neutron/services/service_base.py:49}} Nov 23 19:24:59.494604 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG neutron.services.service_base [None req-a17d3a60-359c-4f1e-b272-f8e10fa1ee6a None None] Loaded 'neutron.services.l3_router.service_providers.dvr.DvrDriver' provider for service L3_ROUTER_NAT {{(pid=102881) load_drivers /opt/stack/neutron/neutron/services/service_base.py:49}} Nov 23 19:24:59.494951 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG neutron.services.service_base [None req-a17d3a60-359c-4f1e-b272-f8e10fa1ee6a None None] Loaded 'neutron.services.l3_router.service_providers.ha.HaDriver' provider for service L3_ROUTER_NAT {{(pid=102881) load_drivers /opt/stack/neutron/neutron/services/service_base.py:49}} Nov 23 19:24:59.495838 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG neutron.services.service_base [None req-a17d3a60-359c-4f1e-b272-f8e10fa1ee6a None None] Loaded 'neutron.services.l3_router.service_providers.single_node.SingleNodeDriver' provider for service L3_ROUTER_NAT {{(pid=102881) load_drivers /opt/stack/neutron/neutron/services/service_base.py:49}} Nov 23 19:24:59.496212 dv-cinder-819011-1-iscsi neutron-server[102881]: INFO neutron.services.service_base [None req-a17d3a60-359c-4f1e-b272-f8e10fa1ee6a None None] Default provider is not specified for service type L3_ROUTER_NAT Nov 23 19:24:59.496589 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG neutron.manager [None req-a17d3a60-359c-4f1e-b272-f8e10fa1ee6a None None] Successfully loaded L3_ROUTER_NAT plugin. Description: L3 Router Service Plugin for basic L3 forwarding between (L2) Neutron networks and access to external networks via a NAT gateway. {{(pid=102881) _create_and_add_service_plugin /opt/stack/neutron/neutron/manager.py:229}} Nov 23 19:24:59.496914 dv-cinder-819011-1-iscsi neutron-server[102881]: INFO neutron.manager [None req-a17d3a60-359c-4f1e-b272-f8e10fa1ee6a None None] Loading Plugin: neutron.services.metering.metering_plugin.MeteringPlugin Nov 23 19:24:59.508163 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG neutron.manager [None req-a17d3a60-359c-4f1e-b272-f8e10fa1ee6a None None] Successfully loaded METERING plugin. Description: METERING {{(pid=102881) _create_and_add_service_plugin /opt/stack/neutron/neutron/manager.py:229}} Nov 23 19:24:59.508509 dv-cinder-819011-1-iscsi neutron-server[102881]: INFO neutron.manager [None req-a17d3a60-359c-4f1e-b272-f8e10fa1ee6a None None] Loading Plugin: auto_allocate Nov 23 19:24:59.514330 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG neutron_lib.callbacks.manager [None req-a17d3a60-359c-4f1e-b272-f8e10fa1ee6a None None] Subscribe: network precommit_update 55550000 {{(pid=102881) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 23 19:24:59.514705 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG neutron_lib.callbacks.manager [None req-a17d3a60-359c-4f1e-b272-f8e10fa1ee6a None None] Subscribe: network precommit_create 55550000 {{(pid=102881) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 23 19:24:59.515222 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG neutron.manager [None req-a17d3a60-359c-4f1e-b272-f8e10fa1ee6a None None] Successfully loaded auto-allocated-topology plugin. Description: Auto Allocated Topology - aka get me a network. {{(pid=102881) _create_and_add_service_plugin /opt/stack/neutron/neutron/manager.py:229}} Nov 23 19:24:59.515547 dv-cinder-819011-1-iscsi neutron-server[102881]: INFO neutron.manager [None req-a17d3a60-359c-4f1e-b272-f8e10fa1ee6a None None] Loading Plugin: tag Nov 23 19:24:59.522712 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG neutron.manager [None req-a17d3a60-359c-4f1e-b272-f8e10fa1ee6a None None] Successfully loaded TAG plugin. Description: Tag support {{(pid=102881) _create_and_add_service_plugin /opt/stack/neutron/neutron/manager.py:229}} Nov 23 19:24:59.523046 dv-cinder-819011-1-iscsi neutron-server[102881]: INFO neutron.manager [None req-a17d3a60-359c-4f1e-b272-f8e10fa1ee6a None None] Loading Plugin: timestamp Nov 23 19:24:59.527083 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG neutron.manager [None req-a17d3a60-359c-4f1e-b272-f8e10fa1ee6a None None] Successfully loaded timestamp plugin. Description: Adds timestamps to Neutron resources with standard attributes {{(pid=102881) _create_and_add_service_plugin /opt/stack/neutron/neutron/manager.py:229}} Nov 23 19:24:59.527419 dv-cinder-819011-1-iscsi neutron-server[102881]: INFO neutron.manager [None req-a17d3a60-359c-4f1e-b272-f8e10fa1ee6a None None] Loading Plugin: network_ip_availability Nov 23 19:24:59.532841 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG neutron_lib.callbacks.manager [None req-a17d3a60-359c-4f1e-b272-f8e10fa1ee6a None None] Subscribe: > rbac-policy before_create 55550000 {{(pid=102881) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 23 19:24:59.540178 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG neutron_lib.callbacks.manager [None req-a17d3a60-359c-4f1e-b272-f8e10fa1ee6a None None] Subscribe: > rbac-policy before_update 55550000 {{(pid=102881) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 23 19:24:59.540178 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG neutron_lib.callbacks.manager [None req-a17d3a60-359c-4f1e-b272-f8e10fa1ee6a None None] Subscribe: > rbac-policy before_delete 55550000 {{(pid=102881) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 23 19:24:59.540178 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG neutron.manager [None req-a17d3a60-359c-4f1e-b272-f8e10fa1ee6a None None] Successfully loaded network-ip-availability plugin. Description: Provides IP availability data for each network and subnet. {{(pid=102881) _create_and_add_service_plugin /opt/stack/neutron/neutron/manager.py:229}} Nov 23 19:24:59.540178 dv-cinder-819011-1-iscsi neutron-server[102881]: INFO neutron.manager [None req-a17d3a60-359c-4f1e-b272-f8e10fa1ee6a None None] Loading Plugin: flavors Nov 23 19:24:59.544539 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG neutron.manager [None req-a17d3a60-359c-4f1e-b272-f8e10fa1ee6a None None] Successfully loaded FLAVORS plugin. Description: Neutron Flavors and Service Profiles manager plugin {{(pid=102881) _create_and_add_service_plugin /opt/stack/neutron/neutron/manager.py:229}} Nov 23 19:24:59.544880 dv-cinder-819011-1-iscsi neutron-server[102881]: INFO neutron.manager [None req-a17d3a60-359c-4f1e-b272-f8e10fa1ee6a None None] Loading Plugin: revisions Nov 23 19:24:59.549172 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG neutron.manager [None req-a17d3a60-359c-4f1e-b272-f8e10fa1ee6a None None] Successfully loaded revision_plugin plugin. Description: Adds revision numbers to resources. {{(pid=102881) _create_and_add_service_plugin /opt/stack/neutron/neutron/manager.py:229}} Nov 23 19:24:59.549605 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_concurrency.lockutils [None req-a17d3a60-359c-4f1e-b272-f8e10fa1ee6a None None] Lock "manager" "released" by "neutron.manager.NeutronManager._create_instance" :: held 2.199s {{(pid=102881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 19:24:59.550359 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG neutron.api.extensions [None req-a17d3a60-359c-4f1e-b272-f8e10fa1ee6a None None] get_extension_paths = OrderedDict([('/opt/stack/neutron/neutron/extensions', 1)]) {{(pid=102881) get_extensions_path /opt/stack/neutron/neutron/api/extensions.py:640}} Nov 23 19:24:59.550698 dv-cinder-819011-1-iscsi neutron-server[102881]: INFO neutron.api.extensions [None req-a17d3a60-359c-4f1e-b272-f8e10fa1ee6a None None] Initializing extension manager. Nov 23 19:24:59.551482 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG neutron.api.extensions [None req-a17d3a60-359c-4f1e-b272-f8e10fa1ee6a None None] Loading extension file: __init__.py {{(pid=102881) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 23 19:24:59.551668 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG neutron.api.extensions [None req-a17d3a60-359c-4f1e-b272-f8e10fa1ee6a None None] Loading extension file: __pycache__ {{(pid=102881) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 23 19:24:59.551940 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG neutron.api.extensions [None req-a17d3a60-359c-4f1e-b272-f8e10fa1ee6a None None] Loading extension file: _standard_attr_segment_lib.py {{(pid=102881) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 23 19:24:59.552273 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG neutron.api.extensions [None req-a17d3a60-359c-4f1e-b272-f8e10fa1ee6a None None] Loading extension file: address_group.py {{(pid=102881) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 23 19:24:59.553026 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG neutron.api.extensions [None req-a17d3a60-359c-4f1e-b272-f8e10fa1ee6a None None] Ext name="Address group" alias="address-group" description="Support address group" updated="2020-07-15T10:00:00-00:00" {{(pid=102881) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 23 19:24:59.553618 dv-cinder-819011-1-iscsi neutron-server[102881]: INFO neutron.api.extensions [None req-a17d3a60-359c-4f1e-b272-f8e10fa1ee6a None None] Loaded extension: address-group Nov 23 19:24:59.553945 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG neutron.api.extensions [None req-a17d3a60-359c-4f1e-b272-f8e10fa1ee6a None None] Loading extension file: address_scope.py {{(pid=102881) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 23 19:24:59.554840 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG neutron.api.extensions [None req-a17d3a60-359c-4f1e-b272-f8e10fa1ee6a None None] Ext name="Address scope" alias="address-scope" description="Address scopes extension." updated="2015-07-26T10:00:00-00:00" {{(pid=102881) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 23 19:24:59.555352 dv-cinder-819011-1-iscsi neutron-server[102881]: INFO neutron.api.extensions [None req-a17d3a60-359c-4f1e-b272-f8e10fa1ee6a None None] Loaded extension: address-scope Nov 23 19:24:59.555680 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG neutron.api.extensions [None req-a17d3a60-359c-4f1e-b272-f8e10fa1ee6a None None] Loading extension file: admin_state_down_before_update.py {{(pid=102881) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 23 19:24:59.567558 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG neutron.api.extensions [None req-a17d3a60-359c-4f1e-b272-f8e10fa1ee6a None None] Ext name="Enforce Router's Admin State Down Before Update Extension" alias="router-admin-state-down-before-update" description="Ensure that the admin state of a router is DOWN (admin_state_up=False) before updating the distributed attribute" updated="2019-07-02T15:56:00" {{(pid=102881) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 23 19:24:59.568078 dv-cinder-819011-1-iscsi neutron-server[102881]: INFO neutron.api.extensions [None req-a17d3a60-359c-4f1e-b272-f8e10fa1ee6a None None] Loaded extension: router-admin-state-down-before-update Nov 23 19:24:59.568406 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG neutron.api.extensions [None req-a17d3a60-359c-4f1e-b272-f8e10fa1ee6a None None] Loading extension file: agent.py {{(pid=102881) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 23 19:24:59.569111 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG neutron.api.extensions [None req-a17d3a60-359c-4f1e-b272-f8e10fa1ee6a None None] Ext name="agent" alias="agent" description="The agent management extension." updated="2013-02-03T10:00:00-00:00" {{(pid=102881) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 23 19:24:59.569654 dv-cinder-819011-1-iscsi neutron-server[102881]: INFO neutron.api.extensions [None req-a17d3a60-359c-4f1e-b272-f8e10fa1ee6a None None] Loaded extension: agent Nov 23 19:24:59.569982 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG neutron.api.extensions [None req-a17d3a60-359c-4f1e-b272-f8e10fa1ee6a None None] Loading extension file: agent_resources_synced.py {{(pid=102881) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 23 19:24:59.570888 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG neutron.api.extensions [None req-a17d3a60-359c-4f1e-b272-f8e10fa1ee6a None None] Ext name="Agent's Resource View Synced to Placement" alias="agent-resources-synced" description="Stores success/failure of last sync to Placement" updated="2018-12-19T00:00:00-00:00" {{(pid=102881) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 23 19:24:59.571399 dv-cinder-819011-1-iscsi neutron-server[102881]: INFO neutron.api.extensions [None req-a17d3a60-359c-4f1e-b272-f8e10fa1ee6a None None] Loaded extension: agent-resources-synced Nov 23 19:24:59.571724 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG neutron.api.extensions [None req-a17d3a60-359c-4f1e-b272-f8e10fa1ee6a None None] Loading extension file: allowedaddresspairs.py {{(pid=102881) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 23 19:24:59.573531 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG neutron.api.extensions [None req-a17d3a60-359c-4f1e-b272-f8e10fa1ee6a None None] Ext name="Allowed Address Pairs" alias="allowed-address-pairs" description="Provides allowed address pairs" updated="2013-07-23T10:00:00-00:00" {{(pid=102881) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 23 19:24:59.574063 dv-cinder-819011-1-iscsi neutron-server[102881]: INFO neutron.api.extensions [None req-a17d3a60-359c-4f1e-b272-f8e10fa1ee6a None None] Loaded extension: allowed-address-pairs Nov 23 19:24:59.574392 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG neutron.api.extensions [None req-a17d3a60-359c-4f1e-b272-f8e10fa1ee6a None None] Loading extension file: auto_allocated_topology.py {{(pid=102881) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 23 19:24:59.575462 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG neutron.api.extensions [None req-a17d3a60-359c-4f1e-b272-f8e10fa1ee6a None None] Ext name="Auto Allocated Topology Services" alias="auto-allocated-topology" description="Auto Allocated Topology Services." updated="2016-01-01T00:00:00-00:00" {{(pid=102881) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 23 19:24:59.575985 dv-cinder-819011-1-iscsi neutron-server[102881]: INFO neutron.api.extensions [None req-a17d3a60-359c-4f1e-b272-f8e10fa1ee6a None None] Loaded extension: auto-allocated-topology Nov 23 19:24:59.576315 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG neutron.api.extensions [None req-a17d3a60-359c-4f1e-b272-f8e10fa1ee6a None None] Loading extension file: availability_zone.py {{(pid=102881) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 23 19:24:59.577008 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG neutron.api.extensions [None req-a17d3a60-359c-4f1e-b272-f8e10fa1ee6a None None] Ext name="Availability Zone" alias="availability_zone" description="The availability zone extension." updated="2015-01-01T10:00:00-00:00" {{(pid=102881) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 23 19:24:59.577550 dv-cinder-819011-1-iscsi neutron-server[102881]: INFO neutron.api.extensions [None req-a17d3a60-359c-4f1e-b272-f8e10fa1ee6a None None] Loaded extension: availability_zone Nov 23 19:24:59.577877 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG neutron.api.extensions [None req-a17d3a60-359c-4f1e-b272-f8e10fa1ee6a None None] Loading extension file: availability_zone_filter.py {{(pid=102881) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 23 19:24:59.578827 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG neutron.api.extensions [None req-a17d3a60-359c-4f1e-b272-f8e10fa1ee6a None None] Ext name="Availability Zone Filter Extension" alias="availability_zone_filter" description="Add filter parameters to AvailabilityZone resource" updated="2018-06-22T10:00:00-00:00" {{(pid=102881) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 23 19:24:59.579339 dv-cinder-819011-1-iscsi neutron-server[102881]: INFO neutron.api.extensions [None req-a17d3a60-359c-4f1e-b272-f8e10fa1ee6a None None] Loaded extension: availability_zone_filter Nov 23 19:24:59.579664 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG neutron.api.extensions [None req-a17d3a60-359c-4f1e-b272-f8e10fa1ee6a None None] Loading extension file: data_plane_status.py {{(pid=102881) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 23 19:24:59.580559 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG neutron.api.extensions [None req-a17d3a60-359c-4f1e-b272-f8e10fa1ee6a None None] Ext name="Port data plane status extension" alias="data-plane-status" description="Expose status of underlying data plane" updated="2017-01-24T10:00:00-00:00" {{(pid=102881) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 23 19:24:59.581068 dv-cinder-819011-1-iscsi neutron-server[102881]: INFO neutron.api.extensions [None req-a17d3a60-359c-4f1e-b272-f8e10fa1ee6a None None] Extension data-plane-status not supported by any of loaded plugins Nov 23 19:24:59.581394 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG neutron.api.extensions [None req-a17d3a60-359c-4f1e-b272-f8e10fa1ee6a None None] Loading extension file: default_subnetpools.py {{(pid=102881) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 23 19:24:59.582906 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG neutron.api.extensions [None req-a17d3a60-359c-4f1e-b272-f8e10fa1ee6a None None] Ext name="Default Subnetpools" alias="default-subnetpools" description="Provides ability to mark and use a subnetpool as the default." updated="2016-02-18T18:00:00-00:00" {{(pid=102881) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 23 19:24:59.583418 dv-cinder-819011-1-iscsi neutron-server[102881]: INFO neutron.api.extensions [None req-a17d3a60-359c-4f1e-b272-f8e10fa1ee6a None None] Loaded extension: default-subnetpools Nov 23 19:24:59.583761 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG neutron.api.extensions [None req-a17d3a60-359c-4f1e-b272-f8e10fa1ee6a None None] Loading extension file: dhcpagentscheduler.py {{(pid=102881) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 23 19:24:59.584548 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG neutron.api.extensions [None req-a17d3a60-359c-4f1e-b272-f8e10fa1ee6a None None] Ext name="DHCP Agent Scheduler" alias="dhcp_agent_scheduler" description="Schedule networks among dhcp agents" updated="2013-02-07T10:00:00-00:00" {{(pid=102881) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 23 19:24:59.585093 dv-cinder-819011-1-iscsi neutron-server[102881]: INFO neutron.api.extensions [None req-a17d3a60-359c-4f1e-b272-f8e10fa1ee6a None None] Loaded extension: dhcp_agent_scheduler Nov 23 19:24:59.585427 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG neutron.api.extensions [None req-a17d3a60-359c-4f1e-b272-f8e10fa1ee6a None None] Loading extension file: dns.py {{(pid=102881) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 23 19:24:59.586345 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG neutron.api.extensions [None req-a17d3a60-359c-4f1e-b272-f8e10fa1ee6a None None] Ext name="DNS Integration" alias="dns-integration" description="Provides integration with DNS." updated="2015-08-15T18:00:00-00:00" {{(pid=102881) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 23 19:24:59.586852 dv-cinder-819011-1-iscsi neutron-server[102881]: INFO neutron.api.extensions [None req-a17d3a60-359c-4f1e-b272-f8e10fa1ee6a None None] Extension dns-integration not supported by any of loaded plugins Nov 23 19:24:59.587177 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG neutron.api.extensions [None req-a17d3a60-359c-4f1e-b272-f8e10fa1ee6a None None] Loading extension file: dns_domain_ports.py {{(pid=102881) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 23 19:24:59.588085 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG neutron.api.extensions [None req-a17d3a60-359c-4f1e-b272-f8e10fa1ee6a None None] Ext name="dns_domain for ports" alias="dns-domain-ports" description="Allows the DNS domain to be specified for a network port." updated="2017-04-24T10:00:00-00:00" {{(pid=102881) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 23 19:24:59.588592 dv-cinder-819011-1-iscsi neutron-server[102881]: INFO neutron.api.extensions [None req-a17d3a60-359c-4f1e-b272-f8e10fa1ee6a None None] Extension dns-domain-ports not supported by any of loaded plugins Nov 23 19:24:59.588920 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG neutron.api.extensions [None req-a17d3a60-359c-4f1e-b272-f8e10fa1ee6a None None] Loading extension file: dns_integration_domain_keywords.py {{(pid=102881) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 23 19:24:59.589860 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG neutron.api.extensions [None req-a17d3a60-359c-4f1e-b272-f8e10fa1ee6a None None] Ext name="DNS domain names with keywords allowed" alias="dns-integration-domain-keywords" description="Allows to use keywords like , , and as DNS domain name" updated="2020-06-15T18:00:00-00:00" {{(pid=102881) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 23 19:24:59.590367 dv-cinder-819011-1-iscsi neutron-server[102881]: INFO neutron.api.extensions [None req-a17d3a60-359c-4f1e-b272-f8e10fa1ee6a None None] Extension dns-integration-domain-keywords not supported by any of loaded plugins Nov 23 19:24:59.590691 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG neutron.api.extensions [None req-a17d3a60-359c-4f1e-b272-f8e10fa1ee6a None None] Loading extension file: dvr.py {{(pid=102881) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 23 19:24:59.591354 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG neutron.api.extensions [None req-a17d3a60-359c-4f1e-b272-f8e10fa1ee6a None None] Ext name="Distributed Virtual Router" alias="dvr" description="Enables configuration of Distributed Virtual Routers." updated="2014-06-1T10:00:00-00:00" {{(pid=102881) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 23 19:24:59.591862 dv-cinder-819011-1-iscsi neutron-server[102881]: INFO neutron.api.extensions [None req-a17d3a60-359c-4f1e-b272-f8e10fa1ee6a None None] Loaded extension: dvr Nov 23 19:24:59.592188 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG neutron.api.extensions [None req-a17d3a60-359c-4f1e-b272-f8e10fa1ee6a None None] Loading extension file: ecmp_routes.py {{(pid=102881) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 23 19:24:59.593096 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG neutron.api.extensions [None req-a17d3a60-359c-4f1e-b272-f8e10fa1ee6a None None] Ext name="Equal Cost Multipath Routing" alias="ecmp_routes" description="Allows traffic to reach thesame destination via multiple different links " updated="2020-11-26T18:00:00-00:00" {{(pid=102881) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 23 19:24:59.593636 dv-cinder-819011-1-iscsi neutron-server[102881]: INFO neutron.api.extensions [None req-a17d3a60-359c-4f1e-b272-f8e10fa1ee6a None None] Extension ecmp_routes not supported by any of loaded plugins Nov 23 19:24:59.593969 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG neutron.api.extensions [None req-a17d3a60-359c-4f1e-b272-f8e10fa1ee6a None None] Loading extension file: empty_string_filtering.py {{(pid=102881) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 23 19:24:59.594864 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG neutron.api.extensions [None req-a17d3a60-359c-4f1e-b272-f8e10fa1ee6a None None] Ext name="Empty String Filtering Extension" alias="empty-string-filtering" description="Allow filtering by attributes with empty string value" updated="2018-05-01T10:00:00-00:00" {{(pid=102881) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 23 19:24:59.595375 dv-cinder-819011-1-iscsi neutron-server[102881]: INFO neutron.api.extensions [None req-a17d3a60-359c-4f1e-b272-f8e10fa1ee6a None None] Loaded extension: empty-string-filtering Nov 23 19:24:59.595701 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG neutron.api.extensions [None req-a17d3a60-359c-4f1e-b272-f8e10fa1ee6a None None] Loading extension file: expose_l3_conntrack_helper.py {{(pid=102881) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 23 19:24:59.596603 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG neutron.api.extensions [None req-a17d3a60-359c-4f1e-b272-f8e10fa1ee6a None None] Ext name="Expose CT target rules for conntrack helper" alias="expose-l3-conntrack-helper" description="Expose allow adding CT target rules for conntrack helper" updated="2019-04-04T10:00:00-00:00" {{(pid=102881) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 23 19:24:59.597108 dv-cinder-819011-1-iscsi neutron-server[102881]: INFO neutron.api.extensions [None req-a17d3a60-359c-4f1e-b272-f8e10fa1ee6a None None] Extension expose-l3-conntrack-helper not supported by any of loaded plugins Nov 23 19:24:59.597458 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG neutron.api.extensions [None req-a17d3a60-359c-4f1e-b272-f8e10fa1ee6a None None] Loading extension file: expose_port_forwarding_in_fip.py {{(pid=102881) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 23 19:24:59.598405 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG neutron.api.extensions [None req-a17d3a60-359c-4f1e-b272-f8e10fa1ee6a None None] Ext name="Expose Floating IP port forwardings" alias="expose-port-forwarding-in-fip" description="Expose port forwarding fields in floating IP response" updated="2018-06-28T16:00:00-00:00" {{(pid=102881) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 23 19:24:59.598909 dv-cinder-819011-1-iscsi neutron-server[102881]: INFO neutron.api.extensions [None req-a17d3a60-359c-4f1e-b272-f8e10fa1ee6a None None] Extension expose-port-forwarding-in-fip not supported by any of loaded plugins Nov 23 19:24:59.599231 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG neutron.api.extensions [None req-a17d3a60-359c-4f1e-b272-f8e10fa1ee6a None None] Loading extension file: external_net.py {{(pid=102881) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 23 19:24:59.600161 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG neutron.api.extensions [None req-a17d3a60-359c-4f1e-b272-f8e10fa1ee6a None None] Ext name="Neutron external network" alias="external-net" description="Adds external network attribute to network resource." updated="2013-01-14T10:00:00-00:00" {{(pid=102881) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 23 19:24:59.600674 dv-cinder-819011-1-iscsi neutron-server[102881]: INFO neutron.api.extensions [None req-a17d3a60-359c-4f1e-b272-f8e10fa1ee6a None None] Loaded extension: external-net Nov 23 19:24:59.600998 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG neutron.api.extensions [None req-a17d3a60-359c-4f1e-b272-f8e10fa1ee6a None None] Loading extension file: extra_dhcp_opt.py {{(pid=102881) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 23 19:24:59.601933 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG neutron.api.extensions [None req-a17d3a60-359c-4f1e-b272-f8e10fa1ee6a None None] Ext name="Neutron Extra DHCP options" alias="extra_dhcp_opt" description="Extra options configuration for DHCP. For example PXE boot options to DHCP clients can be specified (e.g. tftp-server, server-ip-address, bootfile-name)" updated="2013-03-17T12:00:00-00:00" {{(pid=102881) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 23 19:24:59.602448 dv-cinder-819011-1-iscsi neutron-server[102881]: INFO neutron.api.extensions [None req-a17d3a60-359c-4f1e-b272-f8e10fa1ee6a None None] Loaded extension: extra_dhcp_opt Nov 23 19:24:59.602773 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG neutron.api.extensions [None req-a17d3a60-359c-4f1e-b272-f8e10fa1ee6a None None] Loading extension file: extraroute.py {{(pid=102881) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 23 19:24:59.603676 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG neutron.api.extensions [None req-a17d3a60-359c-4f1e-b272-f8e10fa1ee6a None None] Ext name="Neutron Extra Route" alias="extraroute" description="Extra routes configuration for L3 router" updated="2013-02-01T10:00:00-00:00" {{(pid=102881) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 23 19:24:59.604189 dv-cinder-819011-1-iscsi neutron-server[102881]: INFO neutron.api.extensions [None req-a17d3a60-359c-4f1e-b272-f8e10fa1ee6a None None] Loaded extension: extraroute Nov 23 19:24:59.604514 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG neutron.api.extensions [None req-a17d3a60-359c-4f1e-b272-f8e10fa1ee6a None None] Loading extension file: extraroute_atomic.py {{(pid=102881) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 23 19:24:59.605569 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG neutron.api.extensions [None req-a17d3a60-359c-4f1e-b272-f8e10fa1ee6a None None] Ext name="Atomically add/remove extra routes" alias="extraroute-atomic" description="Edit extra routes of a router on server side by atomically adding/removing extra routes" updated="2019-07-10T00:00:00+00:00" {{(pid=102881) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 23 19:24:59.606092 dv-cinder-819011-1-iscsi neutron-server[102881]: INFO neutron.api.extensions [None req-a17d3a60-359c-4f1e-b272-f8e10fa1ee6a None None] Loaded extension: extraroute-atomic Nov 23 19:24:59.612872 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG neutron.api.extensions [None req-a17d3a60-359c-4f1e-b272-f8e10fa1ee6a None None] Loading extension file: filter_validation.py {{(pid=102881) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 23 19:24:59.612872 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG neutron.api.extensions [None req-a17d3a60-359c-4f1e-b272-f8e10fa1ee6a None None] Ext name="Filter parameters validation" alias="filter-validation" description="Provides validation on filter parameters." updated="2018-07-04T10:00:00-00:00" {{(pid=102881) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 23 19:24:59.612872 dv-cinder-819011-1-iscsi neutron-server[102881]: INFO neutron.api.extensions [None req-a17d3a60-359c-4f1e-b272-f8e10fa1ee6a None None] Loaded extension: filter-validation Nov 23 19:24:59.612872 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG neutron.api.extensions [None req-a17d3a60-359c-4f1e-b272-f8e10fa1ee6a None None] Loading extension file: fip_pf_description.py {{(pid=102881) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 23 19:24:59.613617 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG neutron.api.extensions [None req-a17d3a60-359c-4f1e-b272-f8e10fa1ee6a None None] Ext name="Floating IP Port Forwarding new attribute description" alias="floating-ip-port-forwarding-description" description="Add a description field to Port Forwarding rules" updated="2019-11-01T10:00:00-00:00" {{(pid=102881) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 23 19:24:59.614132 dv-cinder-819011-1-iscsi neutron-server[102881]: INFO neutron.api.extensions [None req-a17d3a60-359c-4f1e-b272-f8e10fa1ee6a None None] Extension floating-ip-port-forwarding-description not supported by any of loaded plugins Nov 23 19:24:59.614454 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG neutron.api.extensions [None req-a17d3a60-359c-4f1e-b272-f8e10fa1ee6a None None] Loading extension file: fip_port_details.py {{(pid=102881) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 23 19:24:59.615367 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG neutron.api.extensions [None req-a17d3a60-359c-4f1e-b272-f8e10fa1ee6a None None] Ext name="Floating IP Port Details Extension" alias="fip-port-details" description="Add port_details attribute to Floating IP resource" updated="2018-04-09T10:00:00-00:00" {{(pid=102881) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 23 19:24:59.615877 dv-cinder-819011-1-iscsi neutron-server[102881]: INFO neutron.api.extensions [None req-a17d3a60-359c-4f1e-b272-f8e10fa1ee6a None None] Loaded extension: fip-port-details Nov 23 19:24:59.616201 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG neutron.api.extensions [None req-a17d3a60-359c-4f1e-b272-f8e10fa1ee6a None None] Loading extension file: flavors.py {{(pid=102881) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 23 19:24:59.617452 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG neutron.api.extensions [None req-a17d3a60-359c-4f1e-b272-f8e10fa1ee6a None None] Ext name="Neutron Service Flavors" alias="flavors" description="Flavor specification for Neutron advanced services." updated="2015-09-17T10:00:00-00:00" {{(pid=102881) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 23 19:24:59.617976 dv-cinder-819011-1-iscsi neutron-server[102881]: INFO neutron.api.extensions [None req-a17d3a60-359c-4f1e-b272-f8e10fa1ee6a None None] Loaded extension: flavors Nov 23 19:24:59.618304 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG neutron.api.extensions [None req-a17d3a60-359c-4f1e-b272-f8e10fa1ee6a None None] Loading extension file: floating_ip_port_forwarding.py {{(pid=102881) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 23 19:24:59.619968 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG neutron.api.extensions [None req-a17d3a60-359c-4f1e-b272-f8e10fa1ee6a None None] Ext name="Floating IP Port Forwarding" alias="floating-ip-port-forwarding" description="Allow port forwarding from floating IP port to an internal port" updated="2018-01-19T10:00:00-00:00" {{(pid=102881) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 23 19:24:59.620489 dv-cinder-819011-1-iscsi neutron-server[102881]: INFO neutron.api.extensions [None req-a17d3a60-359c-4f1e-b272-f8e10fa1ee6a None None] Extension floating-ip-port-forwarding not supported by any of loaded plugins Nov 23 19:24:59.620826 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG neutron.api.extensions [None req-a17d3a60-359c-4f1e-b272-f8e10fa1ee6a None None] Loading extension file: floatingip_pools.py {{(pid=102881) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 23 19:24:59.621555 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG neutron.api.extensions [None req-a17d3a60-359c-4f1e-b272-f8e10fa1ee6a None None] Ext name="Floating IP Pools Extension" alias="floatingip-pools" description="Provides a floating IP pools API." updated="2018-03-21T10:00:00-00:00" {{(pid=102881) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 23 19:24:59.622071 dv-cinder-819011-1-iscsi neutron-server[102881]: INFO neutron.api.extensions [None req-a17d3a60-359c-4f1e-b272-f8e10fa1ee6a None None] Loaded extension: floatingip-pools Nov 23 19:24:59.622402 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG neutron.api.extensions [None req-a17d3a60-359c-4f1e-b272-f8e10fa1ee6a None None] Loading extension file: ip_allocation.py {{(pid=102881) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 23 19:24:59.623329 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG neutron.api.extensions [None req-a17d3a60-359c-4f1e-b272-f8e10fa1ee6a None None] Ext name="IP Allocation" alias="ip_allocation" description="IP allocation extension." updated="2016-06-10T23:00:00-00:00" {{(pid=102881) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 23 19:24:59.623841 dv-cinder-819011-1-iscsi neutron-server[102881]: INFO neutron.api.extensions [None req-a17d3a60-359c-4f1e-b272-f8e10fa1ee6a None None] Extension ip_allocation not supported by any of loaded plugins Nov 23 19:24:59.624172 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG neutron.api.extensions [None req-a17d3a60-359c-4f1e-b272-f8e10fa1ee6a None None] Loading extension file: ip_substring_port_filtering.py {{(pid=102881) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 23 19:24:59.625089 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG neutron.api.extensions [None req-a17d3a60-359c-4f1e-b272-f8e10fa1ee6a None None] Ext name="IP address substring filtering" alias="ip-substring-filtering" description="Provides IP address substring filtering when listing ports" updated="2017-11-28T09:00:00-00:00" {{(pid=102881) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 23 19:24:59.625623 dv-cinder-819011-1-iscsi neutron-server[102881]: INFO neutron.api.extensions [None req-a17d3a60-359c-4f1e-b272-f8e10fa1ee6a None None] Loaded extension: ip-substring-filtering Nov 23 19:24:59.625958 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG neutron.api.extensions [None req-a17d3a60-359c-4f1e-b272-f8e10fa1ee6a None None] Loading extension file: l2_adjacency.py {{(pid=102881) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 23 19:24:59.626887 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG neutron.api.extensions [None req-a17d3a60-359c-4f1e-b272-f8e10fa1ee6a None None] Ext name="L2 Adjacency" alias="l2_adjacency" description="Display L2 Adjacency for Neutron Networks." updated="2016-04-12T16:00:00-00:00" {{(pid=102881) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 23 19:24:59.627398 dv-cinder-819011-1-iscsi neutron-server[102881]: INFO neutron.api.extensions [None req-a17d3a60-359c-4f1e-b272-f8e10fa1ee6a None None] Extension l2_adjacency not supported by any of loaded plugins Nov 23 19:24:59.627726 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG neutron.api.extensions [None req-a17d3a60-359c-4f1e-b272-f8e10fa1ee6a None None] Loading extension file: l3.py {{(pid=102881) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 23 19:24:59.628820 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG neutron.api.extensions [None req-a17d3a60-359c-4f1e-b272-f8e10fa1ee6a None None] Ext name="Neutron L3 Router" alias="router" description="Router abstraction for basic L3 forwarding between L2 Neutron networks and access to external networks via a NAT gateway." updated="2012-07-20T10:00:00-00:00" {{(pid=102881) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 23 19:24:59.629894 dv-cinder-819011-1-iscsi neutron-server[102881]: INFO neutron.api.extensions [None req-a17d3a60-359c-4f1e-b272-f8e10fa1ee6a None None] Loaded extension: router Nov 23 19:24:59.630224 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG neutron.api.extensions [None req-a17d3a60-359c-4f1e-b272-f8e10fa1ee6a None None] Loading extension file: l3_conntrack_helper.py {{(pid=102881) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 23 19:24:59.632442 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG neutron.api.extensions [None req-a17d3a60-359c-4f1e-b272-f8e10fa1ee6a None None] Ext name="L3 Conntrack helper" alias="l3-conntrack-helper" description="Allow adding CT target rules for conntrack helper" updated="2019-04-04T10:00:00-00:00" {{(pid=102881) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 23 19:24:59.632963 dv-cinder-819011-1-iscsi neutron-server[102881]: INFO neutron.api.extensions [None req-a17d3a60-359c-4f1e-b272-f8e10fa1ee6a None None] Extension l3-conntrack-helper not supported by any of loaded plugins Nov 23 19:24:59.633299 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG neutron.api.extensions [None req-a17d3a60-359c-4f1e-b272-f8e10fa1ee6a None None] Loading extension file: l3_ext_gw_mode.py {{(pid=102881) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 23 19:24:59.634274 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG neutron.api.extensions [None req-a17d3a60-359c-4f1e-b272-f8e10fa1ee6a None None] Ext name="Neutron L3 Configurable external gateway mode" alias="ext-gw-mode" description="Extension of the router abstraction for specifying whether SNAT should occur on the external gateway" updated="2013-03-28T10:00:00-00:00" {{(pid=102881) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 23 19:24:59.634789 dv-cinder-819011-1-iscsi neutron-server[102881]: INFO neutron.api.extensions [None req-a17d3a60-359c-4f1e-b272-f8e10fa1ee6a None None] Loaded extension: ext-gw-mode Nov 23 19:24:59.635119 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG neutron.api.extensions [None req-a17d3a60-359c-4f1e-b272-f8e10fa1ee6a None None] Loading extension file: l3_ext_ha_mode.py {{(pid=102881) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 23 19:24:59.636060 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG neutron.api.extensions [None req-a17d3a60-359c-4f1e-b272-f8e10fa1ee6a None None] Ext name="HA Router extension" alias="l3-ha" description="Adds HA capability to routers." updated="2014-04-26T00:00:00-00:00" {{(pid=102881) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 23 19:24:59.636573 dv-cinder-819011-1-iscsi neutron-server[102881]: INFO neutron.api.extensions [None req-a17d3a60-359c-4f1e-b272-f8e10fa1ee6a None None] Loaded extension: l3-ha Nov 23 19:24:59.636904 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG neutron.api.extensions [None req-a17d3a60-359c-4f1e-b272-f8e10fa1ee6a None None] Loading extension file: l3_flavors.py {{(pid=102881) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 23 19:24:59.642424 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG neutron.api.extensions [None req-a17d3a60-359c-4f1e-b272-f8e10fa1ee6a None None] Ext name="Router Flavor Extension" alias="l3-flavors" description="Flavor support for routers." updated="2016-05-17T00:00:00-00:00" {{(pid=102881) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 23 19:24:59.642930 dv-cinder-819011-1-iscsi neutron-server[102881]: INFO neutron.api.extensions [None req-a17d3a60-359c-4f1e-b272-f8e10fa1ee6a None None] Loaded extension: l3-flavors Nov 23 19:24:59.643256 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG neutron.api.extensions [None req-a17d3a60-359c-4f1e-b272-f8e10fa1ee6a None None] Loading extension file: l3_port_ip_change_not_allowed.py {{(pid=102881) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 23 19:24:59.644169 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG neutron.api.extensions [None req-a17d3a60-359c-4f1e-b272-f8e10fa1ee6a None None] Ext name="Prevent L3 router ports IP address change extension" alias="l3-port-ip-change-not-allowed" description="Prevent change of IP address for some L3 router ports" updated="2018-10-09T10:00:00-00:00" {{(pid=102881) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 23 19:24:59.644681 dv-cinder-819011-1-iscsi neutron-server[102881]: INFO neutron.api.extensions [None req-a17d3a60-359c-4f1e-b272-f8e10fa1ee6a None None] Loaded extension: l3-port-ip-change-not-allowed Nov 23 19:24:59.645601 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG neutron.api.extensions [None req-a17d3a60-359c-4f1e-b272-f8e10fa1ee6a None None] Loading extension file: l3agentscheduler.py {{(pid=102881) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 23 19:24:59.646615 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG neutron.api.extensions [None req-a17d3a60-359c-4f1e-b272-f8e10fa1ee6a None None] Ext name="L3 Agent Scheduler" alias="l3_agent_scheduler" description="Schedule routers among l3 agents" updated="2013-02-07T10:00:00-00:00" {{(pid=102881) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 23 19:24:59.647135 dv-cinder-819011-1-iscsi neutron-server[102881]: INFO neutron.api.extensions [None req-a17d3a60-359c-4f1e-b272-f8e10fa1ee6a None None] Loaded extension: l3_agent_scheduler Nov 23 19:24:59.647465 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG neutron.api.extensions [None req-a17d3a60-359c-4f1e-b272-f8e10fa1ee6a None None] Loading extension file: local_ip.py {{(pid=102881) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 23 19:24:59.649302 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG neutron.api.extensions [None req-a17d3a60-359c-4f1e-b272-f8e10fa1ee6a None None] Ext name="Local IP" alias="local_ip" description="Support Node Local Virtual IP" updated="2021-07-26T10:00:00-00:00" {{(pid=102881) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 23 19:24:59.649800 dv-cinder-819011-1-iscsi neutron-server[102881]: INFO neutron.api.extensions [None req-a17d3a60-359c-4f1e-b272-f8e10fa1ee6a None None] Extension local_ip not supported by any of loaded plugins Nov 23 19:24:59.650141 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG neutron.api.extensions [None req-a17d3a60-359c-4f1e-b272-f8e10fa1ee6a None None] Loading extension file: logging.py {{(pid=102881) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 23 19:24:59.651617 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG neutron.api.extensions [None req-a17d3a60-359c-4f1e-b272-f8e10fa1ee6a None None] Ext name="Logging API Extension" alias="logging" description="Provides a logging API for resources such as security group and firewall." updated="2017-01-01T10:00:00-00:00" {{(pid=102881) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 23 19:24:59.652144 dv-cinder-819011-1-iscsi neutron-server[102881]: INFO neutron.api.extensions [None req-a17d3a60-359c-4f1e-b272-f8e10fa1ee6a None None] Extension logging not supported by any of loaded plugins Nov 23 19:24:59.652480 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG neutron.api.extensions [None req-a17d3a60-359c-4f1e-b272-f8e10fa1ee6a None None] Loading extension file: metering.py {{(pid=102881) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 23 19:24:59.653258 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG neutron.api.extensions [None req-a17d3a60-359c-4f1e-b272-f8e10fa1ee6a None None] Ext name="Neutron Metering" alias="metering" description="Neutron Metering extension." updated="2013-06-12T10:00:00-00:00" {{(pid=102881) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 23 19:24:59.653893 dv-cinder-819011-1-iscsi neutron-server[102881]: INFO neutron.api.extensions [None req-a17d3a60-359c-4f1e-b272-f8e10fa1ee6a None None] Loaded extension: metering Nov 23 19:24:59.654229 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG neutron.api.extensions [None req-a17d3a60-359c-4f1e-b272-f8e10fa1ee6a None None] Loading extension file: metering_source_and_destination_fields.py {{(pid=102881) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 23 19:24:59.655332 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG neutron.api.extensions [None req-a17d3a60-359c-4f1e-b272-f8e10fa1ee6a None None] Ext name="Neutron Metering with source and destination filtering" alias="metering_source_and_destination_fields" description="Neutron Metering extension that enables the use of source and destination IP prefixes to create metering label rules." updated="2020-08-21T08:12:00-00:00" {{(pid=102881) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 23 19:24:59.655853 dv-cinder-819011-1-iscsi neutron-server[102881]: INFO neutron.api.extensions [None req-a17d3a60-359c-4f1e-b272-f8e10fa1ee6a None None] Loaded extension: metering_source_and_destination_fields Nov 23 19:24:59.656181 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG neutron.api.extensions [None req-a17d3a60-359c-4f1e-b272-f8e10fa1ee6a None None] Loading extension file: multiprovidernet.py {{(pid=102881) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 23 19:24:59.657099 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG neutron.api.extensions [None req-a17d3a60-359c-4f1e-b272-f8e10fa1ee6a None None] Ext name="Multi Provider Network" alias="multi-provider" description="Expose mapping of virtual networks to multiple physical networks" updated="2013-06-27T10:00:00-00:00" {{(pid=102881) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 23 19:24:59.657640 dv-cinder-819011-1-iscsi neutron-server[102881]: INFO neutron.api.extensions [None req-a17d3a60-359c-4f1e-b272-f8e10fa1ee6a None None] Loaded extension: multi-provider Nov 23 19:24:59.657967 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG neutron.api.extensions [None req-a17d3a60-359c-4f1e-b272-f8e10fa1ee6a None None] Loading extension file: netmtu.py {{(pid=102881) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 23 19:24:59.658881 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG neutron.api.extensions [None req-a17d3a60-359c-4f1e-b272-f8e10fa1ee6a None None] Ext name="Network MTU" alias="net-mtu" description="Provides MTU attribute for a network resource." updated="2015-03-25T10:00:00-00:00" {{(pid=102881) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 23 19:24:59.659393 dv-cinder-819011-1-iscsi neutron-server[102881]: INFO neutron.api.extensions [None req-a17d3a60-359c-4f1e-b272-f8e10fa1ee6a None None] Loaded extension: net-mtu Nov 23 19:24:59.659718 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG neutron.api.extensions [None req-a17d3a60-359c-4f1e-b272-f8e10fa1ee6a None None] Loading extension file: netmtu_writable.py {{(pid=102881) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 23 19:24:59.661171 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG neutron.api.extensions [None req-a17d3a60-359c-4f1e-b272-f8e10fa1ee6a None None] Ext name="Network MTU (writable)" alias="net-mtu-writable" description="Provides a writable MTU attribute for a network resource." updated="2017-07-12T00:00:00-00:00" {{(pid=102881) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 23 19:24:59.661798 dv-cinder-819011-1-iscsi neutron-server[102881]: INFO neutron.api.extensions [None req-a17d3a60-359c-4f1e-b272-f8e10fa1ee6a None None] Loaded extension: net-mtu-writable Nov 23 19:24:59.662126 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG neutron.api.extensions [None req-a17d3a60-359c-4f1e-b272-f8e10fa1ee6a None None] Loading extension file: network_availability_zone.py {{(pid=102881) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 23 19:24:59.662794 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG neutron.api.extensions [None req-a17d3a60-359c-4f1e-b272-f8e10fa1ee6a None None] Ext name="Network Availability Zone" alias="network_availability_zone" description="Availability zone support for network." updated="2015-01-01T10:00:00-00:00" {{(pid=102881) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 23 19:24:59.663302 dv-cinder-819011-1-iscsi neutron-server[102881]: INFO neutron.api.extensions [None req-a17d3a60-359c-4f1e-b272-f8e10fa1ee6a None None] Loaded extension: network_availability_zone Nov 23 19:24:59.663631 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG neutron.api.extensions [None req-a17d3a60-359c-4f1e-b272-f8e10fa1ee6a None None] Loading extension file: network_ip_availability.py {{(pid=102881) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 23 19:24:59.664737 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG neutron.api.extensions [None req-a17d3a60-359c-4f1e-b272-f8e10fa1ee6a None None] Ext name="Network IP Availability" alias="network-ip-availability" description="Provides IP availability data for each network and subnet." updated="2015-09-24T00:00:00-00:00" {{(pid=102881) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 23 19:24:59.665254 dv-cinder-819011-1-iscsi neutron-server[102881]: INFO neutron.api.extensions [None req-a17d3a60-359c-4f1e-b272-f8e10fa1ee6a None None] Loaded extension: network-ip-availability Nov 23 19:24:59.665613 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG neutron.api.extensions [None req-a17d3a60-359c-4f1e-b272-f8e10fa1ee6a None None] Loading extension file: network_segment_range.py {{(pid=102881) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 23 19:24:59.666383 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG neutron.api.extensions [None req-a17d3a60-359c-4f1e-b272-f8e10fa1ee6a None None] Ext name="Neutron Network Segment Range" alias="network-segment-range" description="Provides support for the network segment range management" updated="2018-11-29T00:00:00-00:00" {{(pid=102881) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 23 19:24:59.666893 dv-cinder-819011-1-iscsi neutron-server[102881]: INFO neutron.api.extensions [None req-a17d3a60-359c-4f1e-b272-f8e10fa1ee6a None None] Extension network-segment-range not supported by any of loaded plugins Nov 23 19:24:59.667215 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG neutron.api.extensions [None req-a17d3a60-359c-4f1e-b272-f8e10fa1ee6a None None] Loading extension file: pagination.py {{(pid=102881) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 23 19:24:59.669662 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG neutron.api.extensions [None req-a17d3a60-359c-4f1e-b272-f8e10fa1ee6a None None] Ext name="Pagination support" alias="pagination" description="Extension that indicates that pagination is enabled." updated="2016-06-12T00:00:00-00:00" {{(pid=102881) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 23 19:24:59.670017 dv-cinder-819011-1-iscsi neutron-server[102881]: INFO neutron.api.extensions [None req-a17d3a60-359c-4f1e-b272-f8e10fa1ee6a None None] Loaded extension: pagination Nov 23 19:24:59.670359 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG neutron.api.extensions [None req-a17d3a60-359c-4f1e-b272-f8e10fa1ee6a None None] Loading extension file: port_device_profile.py {{(pid=102881) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 23 19:24:59.671287 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG neutron.api.extensions [None req-a17d3a60-359c-4f1e-b272-f8e10fa1ee6a None None] Ext name="Port device profile" alias="port-device-profile" description="Expose the port device profile (Cyborg)" updated="2020-12-17T10:00:00-00:00" {{(pid=102881) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 23 19:24:59.671814 dv-cinder-819011-1-iscsi neutron-server[102881]: INFO neutron.api.extensions [None req-a17d3a60-359c-4f1e-b272-f8e10fa1ee6a None None] Loaded extension: port-device-profile Nov 23 19:24:59.672152 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG neutron.api.extensions [None req-a17d3a60-359c-4f1e-b272-f8e10fa1ee6a None None] Loading extension file: port_mac_address_regenerate.py {{(pid=102881) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 23 19:24:59.673082 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG neutron.api.extensions [None req-a17d3a60-359c-4f1e-b272-f8e10fa1ee6a None None] Ext name="Neutron Port MAC address regenerate" alias="port-mac-address-regenerate" description="Network port MAC address regenerate" updated="2018-05-03T10:00:00-00:00" {{(pid=102881) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 23 19:24:59.673641 dv-cinder-819011-1-iscsi neutron-server[102881]: INFO neutron.api.extensions [None req-a17d3a60-359c-4f1e-b272-f8e10fa1ee6a None None] Loaded extension: port-mac-address-regenerate Nov 23 19:24:59.673977 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG neutron.api.extensions [None req-a17d3a60-359c-4f1e-b272-f8e10fa1ee6a None None] Loading extension file: port_numa_affinity_policy.py {{(pid=102881) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 23 19:24:59.674888 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG neutron.api.extensions [None req-a17d3a60-359c-4f1e-b272-f8e10fa1ee6a None None] Ext name="Port NUMA affinity policy" alias="port-numa-affinity-policy" description="Expose the port NUMA affinity policy" updated="2020-07-08T10:00:00-00:00" {{(pid=102881) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 23 19:24:59.675406 dv-cinder-819011-1-iscsi neutron-server[102881]: INFO neutron.api.extensions [None req-a17d3a60-359c-4f1e-b272-f8e10fa1ee6a None None] Loaded extension: port-numa-affinity-policy Nov 23 19:24:59.675739 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG neutron.api.extensions [None req-a17d3a60-359c-4f1e-b272-f8e10fa1ee6a None None] Loading extension file: port_resource_request.py {{(pid=102881) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 23 19:24:59.677311 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG neutron.api.extensions [None req-a17d3a60-359c-4f1e-b272-f8e10fa1ee6a None None] Ext name="Port Resource Request" alias="port-resource-request" description="Expose resource request to Port" updated="2018-05-08T10:00:00-00:00" {{(pid=102881) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 23 19:24:59.677849 dv-cinder-819011-1-iscsi neutron-server[102881]: INFO neutron.api.extensions [None req-a17d3a60-359c-4f1e-b272-f8e10fa1ee6a None None] Extension port-resource-request not supported by any of loaded plugins Nov 23 19:24:59.678179 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG neutron.api.extensions [None req-a17d3a60-359c-4f1e-b272-f8e10fa1ee6a None None] Loading extension file: port_resource_request_groups.py {{(pid=102881) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 23 19:24:59.682975 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG neutron.api.extensions [None req-a17d3a60-359c-4f1e-b272-f8e10fa1ee6a None None] Ext name="Port Resource Request Groups" alias="port-resource-request-groups" description="Support requesting multiple groups of resources and traits from the same RP subtree in resource_request" updated="2021-08-02T10:00:00-00:00" {{(pid=102881) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 23 19:24:59.683486 dv-cinder-819011-1-iscsi neutron-server[102881]: INFO neutron.api.extensions [None req-a17d3a60-359c-4f1e-b272-f8e10fa1ee6a None None] Extension port-resource-request-groups not supported by any of loaded plugins Nov 23 19:24:59.683818 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG neutron.api.extensions [None req-a17d3a60-359c-4f1e-b272-f8e10fa1ee6a None None] Loading extension file: portbindings.py {{(pid=102881) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 23 19:24:59.684741 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG neutron.api.extensions [None req-a17d3a60-359c-4f1e-b272-f8e10fa1ee6a None None] Ext name="Port Binding" alias="binding" description="Expose port bindings of a virtual port to external application" updated="2014-02-03T10:00:00-00:00" {{(pid=102881) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 23 19:24:59.685256 dv-cinder-819011-1-iscsi neutron-server[102881]: INFO neutron.api.extensions [None req-a17d3a60-359c-4f1e-b272-f8e10fa1ee6a None None] Loaded extension: binding Nov 23 19:24:59.685617 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG neutron.api.extensions [None req-a17d3a60-359c-4f1e-b272-f8e10fa1ee6a None None] Loading extension file: portbindings_extended.py {{(pid=102881) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 23 19:24:59.686895 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG neutron.api.extensions [None req-a17d3a60-359c-4f1e-b272-f8e10fa1ee6a None None] Ext name="Port Bindings Extended" alias="binding-extended" description="Expose port bindings of a virtual port to external application" updated="2017-07-17T10:00:00-00:00" {{(pid=102881) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 23 19:24:59.687421 dv-cinder-819011-1-iscsi neutron-server[102881]: INFO neutron.api.extensions [None req-a17d3a60-359c-4f1e-b272-f8e10fa1ee6a None None] Loaded extension: binding-extended Nov 23 19:24:59.687754 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG neutron.api.extensions [None req-a17d3a60-359c-4f1e-b272-f8e10fa1ee6a None None] Loading extension file: portsecurity.py {{(pid=102881) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 23 19:24:59.688674 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG neutron.api.extensions [None req-a17d3a60-359c-4f1e-b272-f8e10fa1ee6a None None] Ext name="Port Security" alias="port-security" description="Provides port security" updated="2012-07-23T10:00:00-00:00" {{(pid=102881) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 23 19:24:59.689190 dv-cinder-819011-1-iscsi neutron-server[102881]: INFO neutron.api.extensions [None req-a17d3a60-359c-4f1e-b272-f8e10fa1ee6a None None] Loaded extension: port-security Nov 23 19:24:59.689550 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG neutron.api.extensions [None req-a17d3a60-359c-4f1e-b272-f8e10fa1ee6a None None] Loading extension file: project_id.py {{(pid=102881) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 23 19:24:59.690786 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG neutron.api.extensions [None req-a17d3a60-359c-4f1e-b272-f8e10fa1ee6a None None] Ext name="project_id field enabled" alias="project-id" description="Extension that indicates that project_id field is enabled." updated="2016-09-09T09:09:09-09:09" {{(pid=102881) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 23 19:24:59.691118 dv-cinder-819011-1-iscsi neutron-server[102881]: INFO neutron.api.extensions [None req-a17d3a60-359c-4f1e-b272-f8e10fa1ee6a None None] Loaded extension: project-id Nov 23 19:24:59.691446 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG neutron.api.extensions [None req-a17d3a60-359c-4f1e-b272-f8e10fa1ee6a None None] Loading extension file: providernet.py {{(pid=102881) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 23 19:24:59.692679 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG neutron.api.extensions [None req-a17d3a60-359c-4f1e-b272-f8e10fa1ee6a None None] Ext name="Provider Network" alias="provider" description="Expose mapping of virtual networks to physical networks" updated="2012-09-07T10:00:00-00:00" {{(pid=102881) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 23 19:24:59.693203 dv-cinder-819011-1-iscsi neutron-server[102881]: INFO neutron.api.extensions [None req-a17d3a60-359c-4f1e-b272-f8e10fa1ee6a None None] Loaded extension: provider Nov 23 19:24:59.693563 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG neutron.api.extensions [None req-a17d3a60-359c-4f1e-b272-f8e10fa1ee6a None None] Loading extension file: qos.py {{(pid=102881) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 23 19:24:59.697148 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG neutron.api.extensions [None req-a17d3a60-359c-4f1e-b272-f8e10fa1ee6a None None] Ext name="Quality of Service" alias="qos" description="The Quality of Service extension." updated="2015-06-08T10:00:00-00:00" {{(pid=102881) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 23 19:24:59.697698 dv-cinder-819011-1-iscsi neutron-server[102881]: INFO neutron.api.extensions [None req-a17d3a60-359c-4f1e-b272-f8e10fa1ee6a None None] Extension qos not supported by any of loaded plugins Nov 23 19:24:59.698036 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG neutron.api.extensions [None req-a17d3a60-359c-4f1e-b272-f8e10fa1ee6a None None] Loading extension file: qos_bw_limit_direction.py {{(pid=102881) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 23 19:24:59.699281 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG neutron.api.extensions [None req-a17d3a60-359c-4f1e-b272-f8e10fa1ee6a None None] Ext name="Direction for QoS bandwidth limit rule" alias="qos-bw-limit-direction" description="Allow to configure QoS bandwidth limit rule with specific direction: ingress or egress" updated="2017-04-10T10:00:00-00:00" {{(pid=102881) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 23 19:24:59.699801 dv-cinder-819011-1-iscsi neutron-server[102881]: INFO neutron.api.extensions [None req-a17d3a60-359c-4f1e-b272-f8e10fa1ee6a None None] Extension qos-bw-limit-direction not supported by any of loaded plugins Nov 23 19:24:59.700135 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG neutron.api.extensions [None req-a17d3a60-359c-4f1e-b272-f8e10fa1ee6a None None] Loading extension file: qos_bw_minimum_ingress.py {{(pid=102881) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 23 19:24:59.701046 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG neutron.api.extensions [None req-a17d3a60-359c-4f1e-b272-f8e10fa1ee6a None None] Ext name="Ingress direction for QoS minimum bandwidth rule" alias="qos-bw-minimum-ingress" description="Allow to configure QoS minumum bandwidth rule with ingress direction." updated="2018-07-09T10:00:00-00:00" {{(pid=102881) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 23 19:24:59.701597 dv-cinder-819011-1-iscsi neutron-server[102881]: INFO neutron.api.extensions [None req-a17d3a60-359c-4f1e-b272-f8e10fa1ee6a None None] Extension qos-bw-minimum-ingress not supported by any of loaded plugins Nov 23 19:24:59.701930 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG neutron.api.extensions [None req-a17d3a60-359c-4f1e-b272-f8e10fa1ee6a None None] Loading extension file: qos_default.py {{(pid=102881) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 23 19:24:59.702835 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG neutron.api.extensions [None req-a17d3a60-359c-4f1e-b272-f8e10fa1ee6a None None] Ext name="QoS default policy" alias="qos-default" description="Expose the QoS default policy per project" updated="2017-041-06T10:00:00-00:00" {{(pid=102881) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 23 19:24:59.703358 dv-cinder-819011-1-iscsi neutron-server[102881]: INFO neutron.api.extensions [None req-a17d3a60-359c-4f1e-b272-f8e10fa1ee6a None None] Extension qos-default not supported by any of loaded plugins Nov 23 19:24:59.703689 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG neutron.api.extensions [None req-a17d3a60-359c-4f1e-b272-f8e10fa1ee6a None None] Loading extension file: qos_fip.py {{(pid=102881) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 23 19:24:59.704348 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG neutron.api.extensions [None req-a17d3a60-359c-4f1e-b272-f8e10fa1ee6a None None] Ext name="Floating IP QoS" alias="qos-fip" description="The floating IP Quality of Service extension" updated="2017-07-20T00:00:00-00:00" {{(pid=102881) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 23 19:24:59.704859 dv-cinder-819011-1-iscsi neutron-server[102881]: INFO neutron.api.extensions [None req-a17d3a60-359c-4f1e-b272-f8e10fa1ee6a None None] Extension qos-fip not supported by any of loaded plugins Nov 23 19:24:59.705186 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG neutron.api.extensions [None req-a17d3a60-359c-4f1e-b272-f8e10fa1ee6a None None] Loading extension file: qos_gateway_ip.py {{(pid=102881) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 23 19:24:59.706135 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG neutron.api.extensions [None req-a17d3a60-359c-4f1e-b272-f8e10fa1ee6a None None] Ext name="Router gateway IP QoS" alias="qos-gateway-ip" description="The Router gateway IP Quality of Service extension" updated="2018-02-24T00:00:00-00:00" {{(pid=102881) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 23 19:24:59.706654 dv-cinder-819011-1-iscsi neutron-server[102881]: INFO neutron.api.extensions [None req-a17d3a60-359c-4f1e-b272-f8e10fa1ee6a None None] Extension qos-gateway-ip not supported by any of loaded plugins Nov 23 19:24:59.706980 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG neutron.api.extensions [None req-a17d3a60-359c-4f1e-b272-f8e10fa1ee6a None None] Loading extension file: qos_port_network_policy.py {{(pid=102881) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 23 19:24:59.708532 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG neutron.api.extensions [None req-a17d3a60-359c-4f1e-b272-f8e10fa1ee6a None None] Ext name="QoS port network policy ID" alias="qos-port-network-policy" description="Adds a the QoS network ID to the port definition" updated="2019-11-01T10:00:00-00:00" {{(pid=102881) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 23 19:24:59.709050 dv-cinder-819011-1-iscsi neutron-server[102881]: INFO neutron.api.extensions [None req-a17d3a60-359c-4f1e-b272-f8e10fa1ee6a None None] Extension qos-port-network-policy not supported by any of loaded plugins Nov 23 19:24:59.709378 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG neutron.api.extensions [None req-a17d3a60-359c-4f1e-b272-f8e10fa1ee6a None None] Loading extension file: qos_pps_minimum_rule.py {{(pid=102881) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 23 19:24:59.710509 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG neutron.api.extensions [None req-a17d3a60-359c-4f1e-b272-f8e10fa1ee6a None None] Ext name="QoS minimum packet rate rule" alias="qos-pps-minimum" description="Allow to configure QoS minimum packet rate rule." updated="2021-07-14T10:00:00-00:00" {{(pid=102881) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 23 19:24:59.711030 dv-cinder-819011-1-iscsi neutron-server[102881]: INFO neutron.api.extensions [None req-a17d3a60-359c-4f1e-b272-f8e10fa1ee6a None None] Extension qos-pps-minimum not supported by any of loaded plugins Nov 23 19:24:59.711409 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG neutron.api.extensions [None req-a17d3a60-359c-4f1e-b272-f8e10fa1ee6a None None] Loading extension file: qos_pps_rule.py {{(pid=102881) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 23 19:24:59.712571 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG neutron.api.extensions [None req-a17d3a60-359c-4f1e-b272-f8e10fa1ee6a None None] Ext name="QoS Rule Type Packet per Second Extension" alias="qos-pps" description="Add QoS Rule Type Packet per Second" updated="2021-05-12T10:00:00-00:00" {{(pid=102881) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 23 19:24:59.713092 dv-cinder-819011-1-iscsi neutron-server[102881]: INFO neutron.api.extensions [None req-a17d3a60-359c-4f1e-b272-f8e10fa1ee6a None None] Extension qos-pps not supported by any of loaded plugins Nov 23 19:24:59.713444 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG neutron.api.extensions [None req-a17d3a60-359c-4f1e-b272-f8e10fa1ee6a None None] Loading extension file: qos_rule_type_details.py {{(pid=102881) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 23 19:24:59.714373 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG neutron.api.extensions [None req-a17d3a60-359c-4f1e-b272-f8e10fa1ee6a None None] Ext name="Details of QoS rule types" alias="qos-rule-type-details" description="Expose details about QoS rule types supported by loaded backend drivers" updated="2017-06-22T10:00:00-00:00" {{(pid=102881) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 23 19:24:59.714905 dv-cinder-819011-1-iscsi neutron-server[102881]: INFO neutron.api.extensions [None req-a17d3a60-359c-4f1e-b272-f8e10fa1ee6a None None] Extension qos-rule-type-details not supported by any of loaded plugins Nov 23 19:24:59.715216 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG neutron.api.extensions [None req-a17d3a60-359c-4f1e-b272-f8e10fa1ee6a None None] Loading extension file: qos_rules_alias.py {{(pid=102881) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 23 19:24:59.716257 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG neutron.api.extensions [None req-a17d3a60-359c-4f1e-b272-f8e10fa1ee6a None None] Ext name="Quality of Service rules alias API" alias="qos-rules-alias" description="API to enable GET, PUT and DELETE operations on QoS policy rules without specifying policy ID" updated="2018-10-07T10:00:00-00:00" {{(pid=102881) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 23 19:24:59.716773 dv-cinder-819011-1-iscsi neutron-server[102881]: INFO neutron.api.extensions [None req-a17d3a60-359c-4f1e-b272-f8e10fa1ee6a None None] Extension qos-rules-alias not supported by any of loaded plugins Nov 23 19:24:59.717100 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG neutron.api.extensions [None req-a17d3a60-359c-4f1e-b272-f8e10fa1ee6a None None] Loading extension file: quota_check_limit.py {{(pid=102881) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 23 19:24:59.718052 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG neutron.api.extensions [None req-a17d3a60-359c-4f1e-b272-f8e10fa1ee6a None None] Ext name="Quota engine limit check" alias="quota-check-limit" description="Support for checking the resource usage before applying a new quota limit" updated="2021-09-08T16:00:00-00:00" {{(pid=102881) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 23 19:24:59.718569 dv-cinder-819011-1-iscsi neutron-server[102881]: INFO neutron.api.extensions [None req-a17d3a60-359c-4f1e-b272-f8e10fa1ee6a None None] Loaded extension: quota-check-limit Nov 23 19:24:59.718895 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG neutron.api.extensions [None req-a17d3a60-359c-4f1e-b272-f8e10fa1ee6a None None] Loading extension file: quotasv2.py {{(pid=102881) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 23 19:24:59.719820 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG neutron.api.extensions [None req-a17d3a60-359c-4f1e-b272-f8e10fa1ee6a None None] Ext name="Quota management support" alias="quotas" description="Expose functions for quotas management per project" updated="2012-07-29T10:00:00-00:00" {{(pid=102881) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 23 19:24:59.720151 dv-cinder-819011-1-iscsi neutron-server[102881]: INFO neutron.api.extensions [None req-a17d3a60-359c-4f1e-b272-f8e10fa1ee6a None None] Loaded extension: quotas Nov 23 19:24:59.720479 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG neutron.api.extensions [None req-a17d3a60-359c-4f1e-b272-f8e10fa1ee6a None None] Loading extension file: quotasv2_detail.py {{(pid=102881) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 23 19:24:59.724460 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG neutron.api.extensions [None req-a17d3a60-359c-4f1e-b272-f8e10fa1ee6a None None] Ext name="Quota details management support" alias="quota_details" description="Expose functions for quotas usage statistics per project" updated="2017-02-10T10:00:00-00:00" {{(pid=102881) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 23 19:24:59.724799 dv-cinder-819011-1-iscsi neutron-server[102881]: INFO neutron.api.extensions [None req-a17d3a60-359c-4f1e-b272-f8e10fa1ee6a None None] Loaded extension: quota_details Nov 23 19:24:59.725135 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG neutron.api.extensions [None req-a17d3a60-359c-4f1e-b272-f8e10fa1ee6a None None] Loading extension file: rbac.py {{(pid=102881) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 23 19:24:59.726214 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG neutron.api.extensions [None req-a17d3a60-359c-4f1e-b272-f8e10fa1ee6a None None] Ext name="RBAC Policies" alias="rbac-policies" description="Allows creation and modification of policies that control tenant access to resources." updated="2015-06-17T12:15:12-00:00" {{(pid=102881) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 23 19:24:59.726745 dv-cinder-819011-1-iscsi neutron-server[102881]: INFO neutron.api.extensions [None req-a17d3a60-359c-4f1e-b272-f8e10fa1ee6a None None] Loaded extension: rbac-policies Nov 23 19:24:59.727118 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG neutron.api.extensions [None req-a17d3a60-359c-4f1e-b272-f8e10fa1ee6a None None] Loading extension file: rbac_address_group.py {{(pid=102881) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 23 19:24:59.734886 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG neutron.api.extensions [None req-a17d3a60-359c-4f1e-b272-f8e10fa1ee6a None None] Ext name="Add address_group type to RBAC" alias="rbac-address-group" description="Add address_group type to network RBAC" updated="2021-01-20T00:00:00-00:00" {{(pid=102881) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 23 19:24:59.735448 dv-cinder-819011-1-iscsi neutron-server[102881]: INFO neutron.api.extensions [None req-a17d3a60-359c-4f1e-b272-f8e10fa1ee6a None None] Loaded extension: rbac-address-group Nov 23 19:24:59.735797 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG neutron.api.extensions [None req-a17d3a60-359c-4f1e-b272-f8e10fa1ee6a None None] Loading extension file: rbac_address_scope.py {{(pid=102881) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 23 19:24:59.736762 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG neutron.api.extensions [None req-a17d3a60-359c-4f1e-b272-f8e10fa1ee6a None None] Ext name="Add address_scope type to RBAC" alias="rbac-address-scope" description="Add address_scope type to RBAC" updated="2020-02-12T00:00:00-00:00" {{(pid=102881) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 23 19:24:59.737296 dv-cinder-819011-1-iscsi neutron-server[102881]: INFO neutron.api.extensions [None req-a17d3a60-359c-4f1e-b272-f8e10fa1ee6a None None] Loaded extension: rbac-address-scope Nov 23 19:24:59.737672 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG neutron.api.extensions [None req-a17d3a60-359c-4f1e-b272-f8e10fa1ee6a None None] Loading extension file: rbac_security_groups.py {{(pid=102881) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 23 19:24:59.738613 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG neutron.api.extensions [None req-a17d3a60-359c-4f1e-b272-f8e10fa1ee6a None None] Ext name="Add security_group type to network RBAC" alias="rbac-security-groups" description="Add security_group type to network RBAC" updated="2019-02-14T00:00:00-00:00" {{(pid=102881) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 23 19:24:59.739141 dv-cinder-819011-1-iscsi neutron-server[102881]: INFO neutron.api.extensions [None req-a17d3a60-359c-4f1e-b272-f8e10fa1ee6a None None] Loaded extension: rbac-security-groups Nov 23 19:24:59.739481 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG neutron.api.extensions [None req-a17d3a60-359c-4f1e-b272-f8e10fa1ee6a None None] Loading extension file: rbac_subnetpool.py {{(pid=102881) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 23 19:24:59.740453 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG neutron.api.extensions [None req-a17d3a60-359c-4f1e-b272-f8e10fa1ee6a None None] Ext name="Add subnetpool type to RBAC" alias="rbac-subnetpool" description="Add subnetpool type to RBAC" updated="2020-02-05T00:00:00-00:00" {{(pid=102881) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 23 19:24:59.740976 dv-cinder-819011-1-iscsi neutron-server[102881]: INFO neutron.api.extensions [None req-a17d3a60-359c-4f1e-b272-f8e10fa1ee6a None None] Loaded extension: rbac-subnetpool Nov 23 19:24:59.741311 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG neutron.api.extensions [None req-a17d3a60-359c-4f1e-b272-f8e10fa1ee6a None None] Loading extension file: revisionifmatch.py {{(pid=102881) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 23 19:24:59.742278 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG neutron.api.extensions [None req-a17d3a60-359c-4f1e-b272-f8e10fa1ee6a None None] Ext name="If-Match constraints based on revision_number" alias="revision-if-match" description="Extension indicating that If-Match based on revision_number is supported." updated="2016-12-11T00:00:00-00:00" {{(pid=102881) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 23 19:24:59.742800 dv-cinder-819011-1-iscsi neutron-server[102881]: INFO neutron.api.extensions [None req-a17d3a60-359c-4f1e-b272-f8e10fa1ee6a None None] Loaded extension: revision-if-match Nov 23 19:24:59.743137 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG neutron.api.extensions [None req-a17d3a60-359c-4f1e-b272-f8e10fa1ee6a None None] Loading extension file: revisions.py {{(pid=102881) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 23 19:24:59.744378 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG neutron.api.extensions [None req-a17d3a60-359c-4f1e-b272-f8e10fa1ee6a None None] Ext name="Resource revision numbers" alias="standard-attr-revisions" description="This extension will display the revision number of neutron resources." updated="2016-04-11T10:00:00-00:00" {{(pid=102881) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 23 19:24:59.744909 dv-cinder-819011-1-iscsi neutron-server[102881]: INFO neutron.api.extensions [None req-a17d3a60-359c-4f1e-b272-f8e10fa1ee6a None None] Loaded extension: standard-attr-revisions Nov 23 19:24:59.745288 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG neutron.api.extensions [None req-a17d3a60-359c-4f1e-b272-f8e10fa1ee6a None None] Loading extension file: router_availability_zone.py {{(pid=102881) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 23 19:24:59.745999 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG neutron.api.extensions [None req-a17d3a60-359c-4f1e-b272-f8e10fa1ee6a None None] Ext name="Router Availability Zone" alias="router_availability_zone" description="Availability zone support for router." updated="2015-01-01T10:00:00-00:00" {{(pid=102881) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 23 19:24:59.746525 dv-cinder-819011-1-iscsi neutron-server[102881]: INFO neutron.api.extensions [None req-a17d3a60-359c-4f1e-b272-f8e10fa1ee6a None None] Loaded extension: router_availability_zone Nov 23 19:24:59.746860 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG neutron.api.extensions [None req-a17d3a60-359c-4f1e-b272-f8e10fa1ee6a None None] Loading extension file: routerservicetype.py {{(pid=102881) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 23 19:24:59.747799 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG neutron.api.extensions [None req-a17d3a60-359c-4f1e-b272-f8e10fa1ee6a None None] Ext name="Router Service Type" alias="router-service-type" description="Provides router service type" updated="2013-01-29T00:00:00-00:00" {{(pid=102881) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 23 19:24:59.748320 dv-cinder-819011-1-iscsi neutron-server[102881]: INFO neutron.api.extensions [None req-a17d3a60-359c-4f1e-b272-f8e10fa1ee6a None None] Extension router-service-type not supported by any of loaded plugins Nov 23 19:24:59.748654 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG neutron.api.extensions [None req-a17d3a60-359c-4f1e-b272-f8e10fa1ee6a None None] Loading extension file: security_groups_normalized_cidr.py {{(pid=102881) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 23 19:24:59.749708 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG neutron.api.extensions [None req-a17d3a60-359c-4f1e-b272-f8e10fa1ee6a None None] Ext name="Normalized CIDR field for security group rules" alias="security-groups-normalized-cidr" description="Add new field with normalized remote_ip_prefix cidr in SG rule" updated="2020-07-28T10:00:00-00:00" {{(pid=102881) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 23 19:24:59.750231 dv-cinder-819011-1-iscsi neutron-server[102881]: INFO neutron.api.extensions [None req-a17d3a60-359c-4f1e-b272-f8e10fa1ee6a None None] Loaded extension: security-groups-normalized-cidr Nov 23 19:24:59.750566 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG neutron.api.extensions [None req-a17d3a60-359c-4f1e-b272-f8e10fa1ee6a None None] Loading extension file: security_groups_port_filtering.py {{(pid=102881) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 23 19:24:59.751511 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG neutron.api.extensions [None req-a17d3a60-359c-4f1e-b272-f8e10fa1ee6a None None] Ext name="Port filtering on security groups" alias="port-security-groups-filtering" description="Provides security groups filtering when listing ports" updated="2018-01-09T09:00:00-00:00" {{(pid=102881) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 23 19:24:59.752037 dv-cinder-819011-1-iscsi neutron-server[102881]: INFO neutron.api.extensions [None req-a17d3a60-359c-4f1e-b272-f8e10fa1ee6a None None] Loaded extension: port-security-groups-filtering Nov 23 19:24:59.752374 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG neutron.api.extensions [None req-a17d3a60-359c-4f1e-b272-f8e10fa1ee6a None None] Loading extension file: security_groups_remote_address_group.py {{(pid=102881) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 23 19:24:59.753321 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG neutron.api.extensions [None req-a17d3a60-359c-4f1e-b272-f8e10fa1ee6a None None] Ext name="Remote address group id field for security group rules" alias="security-groups-remote-address-group" description="Add new field of remote address group id in SG rules" updated="2020-08-25T10:00:00-00:00" {{(pid=102881) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 23 19:24:59.753884 dv-cinder-819011-1-iscsi neutron-server[102881]: INFO neutron.api.extensions [None req-a17d3a60-359c-4f1e-b272-f8e10fa1ee6a None None] Loaded extension: security-groups-remote-address-group Nov 23 19:24:59.754221 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG neutron.api.extensions [None req-a17d3a60-359c-4f1e-b272-f8e10fa1ee6a None None] Loading extension file: security_groups_shared_filtering.py {{(pid=102881) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 23 19:24:59.755254 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG neutron.api.extensions [None req-a17d3a60-359c-4f1e-b272-f8e10fa1ee6a None None] Ext name="Security group filtering on the shared field" alias="security-groups-shared-filtering" description="Support filtering security groups on the shared field" updated="2021-10-05T09:00:00-00:00" {{(pid=102881) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 23 19:24:59.755780 dv-cinder-819011-1-iscsi neutron-server[102881]: INFO neutron.api.extensions [None req-a17d3a60-359c-4f1e-b272-f8e10fa1ee6a None None] Loaded extension: security-groups-shared-filtering Nov 23 19:24:59.756114 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG neutron.api.extensions [None req-a17d3a60-359c-4f1e-b272-f8e10fa1ee6a None None] Loading extension file: security_groups_shared_filtering_lib.py {{(pid=102881) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 23 19:24:59.756718 dv-cinder-819011-1-iscsi neutron-server[102881]: WARNING neutron.api.extensions [None req-a17d3a60-359c-4f1e-b272-f8e10fa1ee6a None None] Did not find expected name "Security_groups_shared_filtering_lib" in /opt/stack/neutron/neutron/extensions/security_groups_shared_filtering_lib.py Nov 23 19:24:59.757083 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG neutron.api.extensions [None req-a17d3a60-359c-4f1e-b272-f8e10fa1ee6a None None] Loading extension file: securitygroup.py {{(pid=102881) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 23 19:24:59.767044 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG neutron.api.extensions [None req-a17d3a60-359c-4f1e-b272-f8e10fa1ee6a None None] Ext name="security-group" alias="security-group" description="The security groups extension." updated="2012-10-05T10:00:00-00:00" {{(pid=102881) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 23 19:24:59.771817 dv-cinder-819011-1-iscsi neutron-server[102881]: INFO neutron.api.extensions [None req-a17d3a60-359c-4f1e-b272-f8e10fa1ee6a None None] Loaded extension: security-group Nov 23 19:24:59.771817 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG neutron.api.extensions [None req-a17d3a60-359c-4f1e-b272-f8e10fa1ee6a None None] Loading extension file: segment.py {{(pid=102881) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 23 19:24:59.771817 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG neutron.api.extensions [None req-a17d3a60-359c-4f1e-b272-f8e10fa1ee6a None None] Ext name="Segment" alias="segment" description="Segments extension." updated="2016-02-24T17:00:00-00:00" {{(pid=102881) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 23 19:24:59.771817 dv-cinder-819011-1-iscsi neutron-server[102881]: INFO neutron.api.extensions [None req-a17d3a60-359c-4f1e-b272-f8e10fa1ee6a None None] Extension segment not supported by any of loaded plugins Nov 23 19:24:59.771817 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG neutron.api.extensions [None req-a17d3a60-359c-4f1e-b272-f8e10fa1ee6a None None] Loading extension file: segments_peer_subnet_host_routes.py {{(pid=102881) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 23 19:24:59.772624 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG neutron.api.extensions [None req-a17d3a60-359c-4f1e-b272-f8e10fa1ee6a None None] Ext name="Segments peer-subnet host routes" alias="segments-peer-subnet-host-routes" description="Add host routes to subnets on a routed network (segments)" updated="2018-06-12T10:00:00-00:00" {{(pid=102881) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 23 19:24:59.773151 dv-cinder-819011-1-iscsi neutron-server[102881]: INFO neutron.api.extensions [None req-a17d3a60-359c-4f1e-b272-f8e10fa1ee6a None None] Extension segments-peer-subnet-host-routes not supported by any of loaded plugins Nov 23 19:24:59.773525 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG neutron.api.extensions [None req-a17d3a60-359c-4f1e-b272-f8e10fa1ee6a None None] Loading extension file: servicetype.py {{(pid=102881) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 23 19:24:59.774694 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG neutron.api.extensions [None req-a17d3a60-359c-4f1e-b272-f8e10fa1ee6a None None] Ext name="Neutron Service Type Management" alias="service-type" description="API for retrieving service providers for Neutron advanced services" updated="2013-01-20T00:00:00-00:00" {{(pid=102881) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 23 19:24:59.775223 dv-cinder-819011-1-iscsi neutron-server[102881]: INFO neutron.api.extensions [None req-a17d3a60-359c-4f1e-b272-f8e10fa1ee6a None None] Loaded extension: service-type Nov 23 19:24:59.775566 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG neutron.api.extensions [None req-a17d3a60-359c-4f1e-b272-f8e10fa1ee6a None None] Loading extension file: sorting.py {{(pid=102881) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 23 19:24:59.776576 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG neutron.api.extensions [None req-a17d3a60-359c-4f1e-b272-f8e10fa1ee6a None None] Ext name="Sorting support" alias="sorting" description="Extension that indicates that sorting is enabled." updated="2016-06-12T00:00:00-00:00" {{(pid=102881) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 23 19:24:59.776921 dv-cinder-819011-1-iscsi neutron-server[102881]: INFO neutron.api.extensions [None req-a17d3a60-359c-4f1e-b272-f8e10fa1ee6a None None] Loaded extension: sorting Nov 23 19:24:59.777254 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG neutron.api.extensions [None req-a17d3a60-359c-4f1e-b272-f8e10fa1ee6a None None] Loading extension file: standard_attr_segment.py {{(pid=102881) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 23 19:24:59.778226 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG neutron.api.extensions [None req-a17d3a60-359c-4f1e-b272-f8e10fa1ee6a None None] Ext name="Standard Attribute Segment Extension" alias="standard-attr-segment" description="Add standard attributes to Segment resource" updated="2018-04-09T10:00:00-00:00" {{(pid=102881) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 23 19:24:59.778750 dv-cinder-819011-1-iscsi neutron-server[102881]: INFO neutron.api.extensions [None req-a17d3a60-359c-4f1e-b272-f8e10fa1ee6a None None] Extension standard-attr-segment not supported by any of loaded plugins Nov 23 19:24:59.779088 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG neutron.api.extensions [None req-a17d3a60-359c-4f1e-b272-f8e10fa1ee6a None None] Loading extension file: standardattrdescription.py {{(pid=102881) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 23 19:24:59.779751 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG neutron.api.extensions [None req-a17d3a60-359c-4f1e-b272-f8e10fa1ee6a None None] Ext name="standard-attr-description" alias="standard-attr-description" description="Extension to add descriptions to standard attributes" updated="2016-02-10T10:00:00-00:00" {{(pid=102881) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 23 19:24:59.780313 dv-cinder-819011-1-iscsi neutron-server[102881]: INFO neutron.api.extensions [None req-a17d3a60-359c-4f1e-b272-f8e10fa1ee6a None None] Loaded extension: standard-attr-description Nov 23 19:24:59.780644 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG neutron.api.extensions [None req-a17d3a60-359c-4f1e-b272-f8e10fa1ee6a None None] Loading extension file: stateful_security_group.py {{(pid=102881) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 23 19:24:59.781631 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG neutron.api.extensions [None req-a17d3a60-359c-4f1e-b272-f8e10fa1ee6a None None] Ext name="Stateful security group" alias="stateful-security-group" description="Indicates if the security group is stateful or not" updated="2019-11-26T09:00:00-00:00" {{(pid=102881) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 23 19:24:59.782169 dv-cinder-819011-1-iscsi neutron-server[102881]: INFO neutron.api.extensions [None req-a17d3a60-359c-4f1e-b272-f8e10fa1ee6a None None] Loaded extension: stateful-security-group Nov 23 19:24:59.782505 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG neutron.api.extensions [None req-a17d3a60-359c-4f1e-b272-f8e10fa1ee6a None None] Loading extension file: stdattrs_common.py {{(pid=102881) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 23 19:24:59.783091 dv-cinder-819011-1-iscsi neutron-server[102881]: WARNING neutron.api.extensions [None req-a17d3a60-359c-4f1e-b272-f8e10fa1ee6a None None] Did not find expected name "Stdattrs_common" in /opt/stack/neutron/neutron/extensions/stdattrs_common.py Nov 23 19:24:59.783425 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG neutron.api.extensions [None req-a17d3a60-359c-4f1e-b272-f8e10fa1ee6a None None] Loading extension file: subnet_dns_publish_fixed_ip.py {{(pid=102881) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 23 19:24:59.784422 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG neutron.api.extensions [None req-a17d3a60-359c-4f1e-b272-f8e10fa1ee6a None None] Ext name="Subnet DNS publish fixed IP" alias="subnet-dns-publish-fixed-ip" description="Support choosing to publish DNS records for IPs from a subnet" updated="2019-05-24T10:00:00-00:00" {{(pid=102881) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 23 19:24:59.784962 dv-cinder-819011-1-iscsi neutron-server[102881]: INFO neutron.api.extensions [None req-a17d3a60-359c-4f1e-b272-f8e10fa1ee6a None None] Extension subnet-dns-publish-fixed-ip not supported by any of loaded plugins Nov 23 19:24:59.785455 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG neutron.api.extensions [None req-a17d3a60-359c-4f1e-b272-f8e10fa1ee6a None None] Loading extension file: subnet_onboard.py {{(pid=102881) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 23 19:24:59.787264 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG neutron.api.extensions [None req-a17d3a60-359c-4f1e-b272-f8e10fa1ee6a None None] Ext name="Subnet Onboard" alias="subnet_onboard" description="Provides support for onboarding subnets into subnet pools" updated="2018-12-18T09:00:00-00:00" {{(pid=102881) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 23 19:24:59.787873 dv-cinder-819011-1-iscsi neutron-server[102881]: INFO neutron.api.extensions [None req-a17d3a60-359c-4f1e-b272-f8e10fa1ee6a None None] Loaded extension: subnet_onboard Nov 23 19:24:59.788143 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG neutron.api.extensions [None req-a17d3a60-359c-4f1e-b272-f8e10fa1ee6a None None] Loading extension file: subnet_segmentid_writable.py {{(pid=102881) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 23 19:24:59.789106 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG neutron.api.extensions [None req-a17d3a60-359c-4f1e-b272-f8e10fa1ee6a None None] Ext name="Subnet SegmentID (writable)" alias="subnet-segmentid-writable" description="Provides a writable segment_id attribute for a subnet resource." updated="2018-03-12T00:00:00-00:00" {{(pid=102881) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 23 19:24:59.789659 dv-cinder-819011-1-iscsi neutron-server[102881]: INFO neutron.api.extensions [None req-a17d3a60-359c-4f1e-b272-f8e10fa1ee6a None None] Extension subnet-segmentid-writable not supported by any of loaded plugins Nov 23 19:24:59.789996 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG neutron.api.extensions [None req-a17d3a60-359c-4f1e-b272-f8e10fa1ee6a None None] Loading extension file: subnet_service_types.py {{(pid=102881) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 23 19:24:59.790970 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG neutron.api.extensions [None req-a17d3a60-359c-4f1e-b272-f8e10fa1ee6a None None] Ext name="Subnet service types" alias="subnet-service-types" description="Provides ability to set the subnet service_types field" updated="2016-03-15T18:00:00-00:00" {{(pid=102881) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 23 19:24:59.791511 dv-cinder-819011-1-iscsi neutron-server[102881]: INFO neutron.api.extensions [None req-a17d3a60-359c-4f1e-b272-f8e10fa1ee6a None None] Loaded extension: subnet-service-types Nov 23 19:24:59.791844 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG neutron.api.extensions [None req-a17d3a60-359c-4f1e-b272-f8e10fa1ee6a None None] Loading extension file: subnetallocation.py {{(pid=102881) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 23 19:24:59.792966 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG neutron.api.extensions [None req-a17d3a60-359c-4f1e-b272-f8e10fa1ee6a None None] Ext name="Subnet Allocation" alias="subnet_allocation" description="Enables allocation of subnets from a subnet pool" updated="2015-03-30T10:00:00-00:00" {{(pid=102881) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 23 19:24:59.793517 dv-cinder-819011-1-iscsi neutron-server[102881]: INFO neutron.api.extensions [None req-a17d3a60-359c-4f1e-b272-f8e10fa1ee6a None None] Loaded extension: subnet_allocation Nov 23 19:24:59.793860 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG neutron.api.extensions [None req-a17d3a60-359c-4f1e-b272-f8e10fa1ee6a None None] Loading extension file: subnetpool_prefix_ops.py {{(pid=102881) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 23 19:24:59.794552 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG neutron.api.extensions [None req-a17d3a60-359c-4f1e-b272-f8e10fa1ee6a None None] Ext name="Subnet Pool Prefix Operations" alias="subnetpool-prefix-ops" description="Provides support for adjusting the prefix list of subnet pools" updated="2019-02-08T10:00:00-00:00" {{(pid=102881) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 23 19:24:59.795077 dv-cinder-819011-1-iscsi neutron-server[102881]: INFO neutron.api.extensions [None req-a17d3a60-359c-4f1e-b272-f8e10fa1ee6a None None] Loaded extension: subnetpool-prefix-ops Nov 23 19:24:59.795416 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG neutron.api.extensions [None req-a17d3a60-359c-4f1e-b272-f8e10fa1ee6a None None] Loading extension file: tag_ports_during_bulk_creation.py {{(pid=102881) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 23 19:24:59.801836 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG neutron.api.extensions [None req-a17d3a60-359c-4f1e-b272-f8e10fa1ee6a None None] Ext name="Tag Ports During Bulk Creation" alias="tag-ports-during-bulk-creation" description="Allow to tag ports during bulk creation" updated="2019-12-29T19:00:00-00:00" {{(pid=102881) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 23 19:24:59.802367 dv-cinder-819011-1-iscsi neutron-server[102881]: INFO neutron.api.extensions [None req-a17d3a60-359c-4f1e-b272-f8e10fa1ee6a None None] Extension tag-ports-during-bulk-creation not supported by any of loaded plugins Nov 23 19:24:59.802774 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG neutron.api.extensions [None req-a17d3a60-359c-4f1e-b272-f8e10fa1ee6a None None] Loading extension file: tagging.py {{(pid=102881) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 23 19:24:59.803895 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG neutron.api.extensions [None req-a17d3a60-359c-4f1e-b272-f8e10fa1ee6a None None] Ext name="Tag support for resources with standard attribute: port, subnet, subnetpool, network, security_group, router, floatingip, policy, trunk, network_segment_range" alias="standard-attr-tag" description="Enables to set tag on resources with standard attribute." updated="2017-01-01T00:00:00-00:00" {{(pid=102881) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 23 19:24:59.804442 dv-cinder-819011-1-iscsi neutron-server[102881]: INFO neutron.api.extensions [None req-a17d3a60-359c-4f1e-b272-f8e10fa1ee6a None None] Loaded extension: standard-attr-tag Nov 23 19:24:59.804781 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG neutron.api.extensions [None req-a17d3a60-359c-4f1e-b272-f8e10fa1ee6a None None] Loading extension file: timestamp.py {{(pid=102881) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 23 19:24:59.806054 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG neutron.api.extensions [None req-a17d3a60-359c-4f1e-b272-f8e10fa1ee6a None None] Ext name="Resource timestamps" alias="standard-attr-timestamp" description="Adds created_at and updated_at fields to all Neutron resources that have Neutron standard attributes." updated="2016-09-12T10:00:00-00:00" {{(pid=102881) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 23 19:24:59.806590 dv-cinder-819011-1-iscsi neutron-server[102881]: INFO neutron.api.extensions [None req-a17d3a60-359c-4f1e-b272-f8e10fa1ee6a None None] Loaded extension: standard-attr-timestamp Nov 23 19:24:59.806929 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG neutron.api.extensions [None req-a17d3a60-359c-4f1e-b272-f8e10fa1ee6a None None] Loading extension file: trunk.py {{(pid=102881) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 23 19:24:59.807984 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG neutron.api.extensions [None req-a17d3a60-359c-4f1e-b272-f8e10fa1ee6a None None] Ext name="Trunk Extension" alias="trunk" description="Provides support for trunk ports" updated="2016-01-01T10:00:00-00:00" {{(pid=102881) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 23 19:24:59.808549 dv-cinder-819011-1-iscsi neutron-server[102881]: INFO neutron.api.extensions [None req-a17d3a60-359c-4f1e-b272-f8e10fa1ee6a None None] Extension trunk not supported by any of loaded plugins Nov 23 19:24:59.808887 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG neutron.api.extensions [None req-a17d3a60-359c-4f1e-b272-f8e10fa1ee6a None None] Loading extension file: trunk_details.py {{(pid=102881) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 23 19:24:59.809882 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG neutron.api.extensions [None req-a17d3a60-359c-4f1e-b272-f8e10fa1ee6a None None] Ext name="Trunk port details" alias="trunk-details" description="Expose trunk port details" updated="2016-01-01T10:00:00-00:00" {{(pid=102881) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 23 19:24:59.810410 dv-cinder-819011-1-iscsi neutron-server[102881]: INFO neutron.api.extensions [None req-a17d3a60-359c-4f1e-b272-f8e10fa1ee6a None None] Extension trunk-details not supported by any of loaded plugins Nov 23 19:24:59.810749 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG neutron.api.extensions [None req-a17d3a60-359c-4f1e-b272-f8e10fa1ee6a None None] Loading extension file: uplink_status_propagation.py {{(pid=102881) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 23 19:24:59.811695 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG neutron.api.extensions [None req-a17d3a60-359c-4f1e-b272-f8e10fa1ee6a None None] Ext name="Uplink status propagation extension" alias="uplink-status-propagation" description="Provides ability to propagate port uplink status." updated="2018-05-31T18:00:00-00:00" {{(pid=102881) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 23 19:24:59.812220 dv-cinder-819011-1-iscsi neutron-server[102881]: INFO neutron.api.extensions [None req-a17d3a60-359c-4f1e-b272-f8e10fa1ee6a None None] Extension uplink-status-propagation not supported by any of loaded plugins Nov 23 19:24:59.812557 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG neutron.api.extensions [None req-a17d3a60-359c-4f1e-b272-f8e10fa1ee6a None None] Loading extension file: vlantransparent.py {{(pid=102881) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 23 19:24:59.813346 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG neutron.api.extensions [None req-a17d3a60-359c-4f1e-b272-f8e10fa1ee6a None None] Ext name="Vlantransparent" alias="vlan-transparent" description="Provides Vlan Transparent Networks" updated="2015-03-23T09:00:00-00:00" {{(pid=102881) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 23 19:24:59.813893 dv-cinder-819011-1-iscsi neutron-server[102881]: INFO neutron.api.extensions [None req-a17d3a60-359c-4f1e-b272-f8e10fa1ee6a None None] Extension vlan-transparent not supported by any of loaded plugins Nov 23 19:24:59.816828 dv-cinder-819011-1-iscsi neutron-server[102881]: INFO neutron.quota.resource_registry [None req-a17d3a60-359c-4f1e-b272-f8e10fa1ee6a None None] Creating instance of TrackedResource for resource:network Nov 23 19:24:59.817525 dv-cinder-819011-1-iscsi neutron-server[102881]: INFO neutron.quota.resource_registry [None req-a17d3a60-359c-4f1e-b272-f8e10fa1ee6a None None] Creating instance of TrackedResource for resource:subnet Nov 23 19:24:59.817941 dv-cinder-819011-1-iscsi neutron-server[102881]: INFO neutron.quota.resource_registry [None req-a17d3a60-359c-4f1e-b272-f8e10fa1ee6a None None] Creating instance of TrackedResource for resource:subnetpool Nov 23 19:24:59.818358 dv-cinder-819011-1-iscsi neutron-server[102881]: INFO neutron.quota.resource_registry [None req-a17d3a60-359c-4f1e-b272-f8e10fa1ee6a None None] Creating instance of TrackedResource for resource:port Nov 23 19:24:59.819682 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG neutron.api.v2.resource_helper [None req-a17d3a60-359c-4f1e-b272-f8e10fa1ee6a None None] Service L3_ROUTER_NAT assigned prefix: {{(pid=102881) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}} Nov 23 19:24:59.820127 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG neutron.api.v2.resource_helper [None req-a17d3a60-359c-4f1e-b272-f8e10fa1ee6a None None] Service FLAVORS assigned prefix: {{(pid=102881) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}} Nov 23 19:24:59.820748 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG neutron.api.v2.resource_helper [None req-a17d3a60-359c-4f1e-b272-f8e10fa1ee6a None None] Service L3_ROUTER_NAT assigned prefix: {{(pid=102881) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}} Nov 23 19:24:59.821180 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG neutron.api.v2.resource_helper [None req-a17d3a60-359c-4f1e-b272-f8e10fa1ee6a None None] Service L3_ROUTER_NAT assigned prefix: {{(pid=102881) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}} Nov 23 19:24:59.821569 dv-cinder-819011-1-iscsi neutron-server[102881]: INFO neutron.quota.resource_registry [None req-a17d3a60-359c-4f1e-b272-f8e10fa1ee6a None None] Creating instance of TrackedResource for resource:router Nov 23 19:24:59.822007 dv-cinder-819011-1-iscsi neutron-server[102881]: INFO neutron.quota.resource_registry [None req-a17d3a60-359c-4f1e-b272-f8e10fa1ee6a None None] Creating instance of TrackedResource for resource:floatingip Nov 23 19:24:59.822519 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG neutron.api.v2.resource_helper [None req-a17d3a60-359c-4f1e-b272-f8e10fa1ee6a None None] Service METERING assigned prefix: /metering {{(pid=102881) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}} Nov 23 19:24:59.823979 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG neutron_lib.callbacks.manager [None req-a17d3a60-359c-4f1e-b272-f8e10fa1ee6a None None] Subscribe: > rbac-policy before_create 55550000 {{(pid=102881) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 23 19:24:59.824366 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG neutron_lib.callbacks.manager [None req-a17d3a60-359c-4f1e-b272-f8e10fa1ee6a None None] Subscribe: > rbac-policy before_update 55550000 {{(pid=102881) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 23 19:24:59.824736 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG neutron_lib.callbacks.manager [None req-a17d3a60-359c-4f1e-b272-f8e10fa1ee6a None None] Subscribe: > rbac-policy before_delete 55550000 {{(pid=102881) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 23 19:24:59.825800 dv-cinder-819011-1-iscsi neutron-server[102881]: INFO neutron.quota.resource_registry [None req-a17d3a60-359c-4f1e-b272-f8e10fa1ee6a None None] Creating instance of CountableResource for resource:rbac_policy Nov 23 19:24:59.826257 dv-cinder-819011-1-iscsi neutron-server[102881]: INFO neutron.quota.resource_registry [None req-a17d3a60-359c-4f1e-b272-f8e10fa1ee6a None None] Creating instance of TrackedResource for resource:security_group Nov 23 19:24:59.830065 dv-cinder-819011-1-iscsi neutron-server[102881]: INFO neutron.quota.resource_registry [None req-a17d3a60-359c-4f1e-b272-f8e10fa1ee6a None None] Creating instance of TrackedResource for resource:security_group_rule Nov 23 19:24:59.830065 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG neutron.api.v2.resource_helper [None req-a17d3a60-359c-4f1e-b272-f8e10fa1ee6a None None] Service CORE assigned prefix: {{(pid=102881) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}} Nov 23 19:24:59.830065 dv-cinder-819011-1-iscsi neutron-server[102881]: INFO neutron.quota.resource_registry [None req-a17d3a60-359c-4f1e-b272-f8e10fa1ee6a None None] Creating instance of TrackedResource for resource:subnetpool Nov 23 19:24:59.830065 dv-cinder-819011-1-iscsi neutron-server[102881]: WARNING neutron.quota.resource_registry [None req-a17d3a60-359c-4f1e-b272-f8e10fa1ee6a None None] subnetpool is already registered Nov 23 19:24:59.830065 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG neutron.api.v2.resource_helper [None req-a17d3a60-359c-4f1e-b272-f8e10fa1ee6a None None] Service CORE assigned prefix: {{(pid=102881) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}} Nov 23 19:24:59.830065 dv-cinder-819011-1-iscsi neutron-server[102881]: INFO neutron.quota.resource_registry [None req-a17d3a60-359c-4f1e-b272-f8e10fa1ee6a None None] Creating instance of TrackedResource for resource:subnetpool Nov 23 19:24:59.830065 dv-cinder-819011-1-iscsi neutron-server[102881]: WARNING neutron.quota.resource_registry [None req-a17d3a60-359c-4f1e-b272-f8e10fa1ee6a None None] subnetpool is already registered Nov 23 19:24:59.831438 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG neutron.api.v2.resource_helper [None req-a17d3a60-359c-4f1e-b272-f8e10fa1ee6a None None] Service L3_ROUTER_NAT assigned prefix: {{(pid=102881) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}} Nov 23 19:24:59.831884 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG neutron.api.v2.resource_helper [None req-a17d3a60-359c-4f1e-b272-f8e10fa1ee6a None None] Service FLAVORS assigned prefix: {{(pid=102881) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}} Nov 23 19:24:59.833075 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG neutron.api.v2.resource_helper [None req-a17d3a60-359c-4f1e-b272-f8e10fa1ee6a None None] Service L3_ROUTER_NAT assigned prefix: {{(pid=102881) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}} Nov 23 19:24:59.833541 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG neutron.api.v2.resource_helper [None req-a17d3a60-359c-4f1e-b272-f8e10fa1ee6a None None] Service L3_ROUTER_NAT assigned prefix: {{(pid=102881) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}} Nov 23 19:24:59.833884 dv-cinder-819011-1-iscsi neutron-server[102881]: INFO neutron.quota.resource_registry [None req-a17d3a60-359c-4f1e-b272-f8e10fa1ee6a None None] Creating instance of TrackedResource for resource:router Nov 23 19:24:59.834232 dv-cinder-819011-1-iscsi neutron-server[102881]: WARNING neutron.quota.resource_registry [None req-a17d3a60-359c-4f1e-b272-f8e10fa1ee6a None None] router is already registered Nov 23 19:24:59.834650 dv-cinder-819011-1-iscsi neutron-server[102881]: INFO neutron.quota.resource_registry [None req-a17d3a60-359c-4f1e-b272-f8e10fa1ee6a None None] Creating instance of TrackedResource for resource:floatingip Nov 23 19:24:59.834996 dv-cinder-819011-1-iscsi neutron-server[102881]: WARNING neutron.quota.resource_registry [None req-a17d3a60-359c-4f1e-b272-f8e10fa1ee6a None None] floatingip is already registered Nov 23 19:24:59.835462 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG neutron.api.v2.resource_helper [None req-a17d3a60-359c-4f1e-b272-f8e10fa1ee6a None None] Service METERING assigned prefix: /metering {{(pid=102881) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}} Nov 23 19:24:59.836133 dv-cinder-819011-1-iscsi neutron-server[102881]: INFO neutron.quota.resource_registry [None req-a17d3a60-359c-4f1e-b272-f8e10fa1ee6a None None] Creating instance of CountableResource for resource:rbac_policy Nov 23 19:24:59.836471 dv-cinder-819011-1-iscsi neutron-server[102881]: WARNING neutron.quota.resource_registry [None req-a17d3a60-359c-4f1e-b272-f8e10fa1ee6a None None] rbac_policy is already registered Nov 23 19:24:59.836921 dv-cinder-819011-1-iscsi neutron-server[102881]: INFO neutron.quota.resource_registry [None req-a17d3a60-359c-4f1e-b272-f8e10fa1ee6a None None] Creating instance of TrackedResource for resource:security_group Nov 23 19:24:59.837265 dv-cinder-819011-1-iscsi neutron-server[102881]: WARNING neutron.quota.resource_registry [None req-a17d3a60-359c-4f1e-b272-f8e10fa1ee6a None None] security_group is already registered Nov 23 19:24:59.837717 dv-cinder-819011-1-iscsi neutron-server[102881]: INFO neutron.quota.resource_registry [None req-a17d3a60-359c-4f1e-b272-f8e10fa1ee6a None None] Creating instance of TrackedResource for resource:security_group_rule Nov 23 19:24:59.838061 dv-cinder-819011-1-iscsi neutron-server[102881]: WARNING neutron.quota.resource_registry [None req-a17d3a60-359c-4f1e-b272-f8e10fa1ee6a None None] security_group_rule is already registered Nov 23 19:24:59.838698 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG neutron.api.v2.resource_helper [None req-a17d3a60-359c-4f1e-b272-f8e10fa1ee6a None None] Service CORE assigned prefix: {{(pid=102881) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}} Nov 23 19:24:59.839041 dv-cinder-819011-1-iscsi neutron-server[102881]: INFO neutron.quota.resource_registry [None req-a17d3a60-359c-4f1e-b272-f8e10fa1ee6a None None] Creating instance of TrackedResource for resource:subnetpool Nov 23 19:24:59.839386 dv-cinder-819011-1-iscsi neutron-server[102881]: WARNING neutron.quota.resource_registry [None req-a17d3a60-359c-4f1e-b272-f8e10fa1ee6a None None] subnetpool is already registered Nov 23 19:24:59.839813 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG neutron.api.v2.resource_helper [None req-a17d3a60-359c-4f1e-b272-f8e10fa1ee6a None None] Service CORE assigned prefix: {{(pid=102881) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}} Nov 23 19:24:59.840149 dv-cinder-819011-1-iscsi neutron-server[102881]: INFO neutron.quota.resource_registry [None req-a17d3a60-359c-4f1e-b272-f8e10fa1ee6a None None] Creating instance of TrackedResource for resource:subnetpool Nov 23 19:24:59.840492 dv-cinder-819011-1-iscsi neutron-server[102881]: WARNING neutron.quota.resource_registry [None req-a17d3a60-359c-4f1e-b272-f8e10fa1ee6a None None] subnetpool is already registered Nov 23 19:24:59.840972 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG neutron.api.extensions [None req-a17d3a60-359c-4f1e-b272-f8e10fa1ee6a None None] Extended resource: extensions {{(pid=102881) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Nov 23 19:24:59.842635 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG neutron.api.extensions [None req-a17d3a60-359c-4f1e-b272-f8e10fa1ee6a None None] Extended resource: address-groups {{(pid=102881) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Nov 23 19:24:59.844138 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG neutron.api.extensions [None req-a17d3a60-359c-4f1e-b272-f8e10fa1ee6a None None] Extended resource: address-scopes {{(pid=102881) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Nov 23 19:24:59.845520 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG neutron.api.extensions [None req-a17d3a60-359c-4f1e-b272-f8e10fa1ee6a None None] Extended resource: agents {{(pid=102881) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Nov 23 19:24:59.846712 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG neutron.api.extensions [None req-a17d3a60-359c-4f1e-b272-f8e10fa1ee6a None None] Extended resource: auto-allocated-topology {{(pid=102881) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Nov 23 19:24:59.848723 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG neutron.api.extensions [None req-a17d3a60-359c-4f1e-b272-f8e10fa1ee6a None None] Extended resource: availability_zones {{(pid=102881) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Nov 23 19:24:59.850020 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG neutron.api.extensions [None req-a17d3a60-359c-4f1e-b272-f8e10fa1ee6a None None] Extended resource: dhcp-networks {{(pid=102881) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Nov 23 19:24:59.851569 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG neutron.api.extensions [None req-a17d3a60-359c-4f1e-b272-f8e10fa1ee6a None None] Extended resource: dhcp-agents {{(pid=102881) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Nov 23 19:24:59.853030 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG neutron.api.extensions [None req-a17d3a60-359c-4f1e-b272-f8e10fa1ee6a None None] Extended resource: routers {{(pid=102881) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Nov 23 19:24:59.855336 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG neutron.api.extensions [None req-a17d3a60-359c-4f1e-b272-f8e10fa1ee6a None None] Extended resource: flavors {{(pid=102881) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Nov 23 19:24:59.856523 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG neutron.api.extensions [None req-a17d3a60-359c-4f1e-b272-f8e10fa1ee6a None None] Extended resource: service_profiles {{(pid=102881) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Nov 23 19:24:59.859346 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG neutron.api.extensions [None req-a17d3a60-359c-4f1e-b272-f8e10fa1ee6a None None] Extended resource: next_providers {{(pid=102881) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Nov 23 19:24:59.859346 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG neutron.api.extensions [None req-a17d3a60-359c-4f1e-b272-f8e10fa1ee6a None None] Extended resource: service_profiles {{(pid=102881) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Nov 23 19:24:59.860918 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG neutron.api.extensions [None req-a17d3a60-359c-4f1e-b272-f8e10fa1ee6a None None] Extended resource: floatingip-pools {{(pid=102881) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Nov 23 19:24:59.862198 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG neutron.api.extensions [None req-a17d3a60-359c-4f1e-b272-f8e10fa1ee6a None None] Extended resource: routers {{(pid=102881) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Nov 23 19:24:59.864529 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG neutron.api.extensions [None req-a17d3a60-359c-4f1e-b272-f8e10fa1ee6a None None] Extended resource: floatingips {{(pid=102881) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Nov 23 19:24:59.866868 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG neutron.api.extensions [None req-a17d3a60-359c-4f1e-b272-f8e10fa1ee6a None None] Extended resource: l3-routers {{(pid=102881) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Nov 23 19:24:59.868289 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG neutron.api.extensions [None req-a17d3a60-359c-4f1e-b272-f8e10fa1ee6a None None] Extended resource: l3-agents {{(pid=102881) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Nov 23 19:24:59.869752 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG neutron.api.extensions [None req-a17d3a60-359c-4f1e-b272-f8e10fa1ee6a None None] Extended resource: metering-labels {{(pid=102881) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Nov 23 19:24:59.871159 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG neutron.api.extensions [None req-a17d3a60-359c-4f1e-b272-f8e10fa1ee6a None None] Extended resource: metering-label-rules {{(pid=102881) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Nov 23 19:24:59.872479 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG neutron.api.extensions [None req-a17d3a60-359c-4f1e-b272-f8e10fa1ee6a None None] Extended resource: network-ip-availabilities {{(pid=102881) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Nov 23 19:24:59.873797 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG neutron.api.extensions [None req-a17d3a60-359c-4f1e-b272-f8e10fa1ee6a None None] Extended resource: bindings {{(pid=102881) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Nov 23 19:24:59.875458 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG neutron.api.extensions [None req-a17d3a60-359c-4f1e-b272-f8e10fa1ee6a None None] Extended resource: quotas {{(pid=102881) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Nov 23 19:24:59.877029 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG neutron.api.extensions [None req-a17d3a60-359c-4f1e-b272-f8e10fa1ee6a None None] Extended resource: quotas {{(pid=102881) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Nov 23 19:24:59.878663 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG neutron.api.extensions [None req-a17d3a60-359c-4f1e-b272-f8e10fa1ee6a None None] Extended resource: rbac-policies {{(pid=102881) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Nov 23 19:24:59.880177 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG neutron.api.extensions [None req-a17d3a60-359c-4f1e-b272-f8e10fa1ee6a None None] Extended resource: security-groups {{(pid=102881) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Nov 23 19:24:59.881459 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG neutron.api.extensions [None req-a17d3a60-359c-4f1e-b272-f8e10fa1ee6a None None] Extended resource: security-group-rules {{(pid=102881) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Nov 23 19:24:59.887138 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG neutron.api.extensions [None req-a17d3a60-359c-4f1e-b272-f8e10fa1ee6a None None] Extended resource: service-providers {{(pid=102881) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Nov 23 19:24:59.887138 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG neutron.api.extensions [None req-a17d3a60-359c-4f1e-b272-f8e10fa1ee6a None None] Extended resource: subnetpools {{(pid=102881) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Nov 23 19:24:59.887138 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG neutron.api.extensions [None req-a17d3a60-359c-4f1e-b272-f8e10fa1ee6a None None] Extended resource: subnetpools {{(pid=102881) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Nov 23 19:24:59.887138 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG neutron.api.extensions [None req-a17d3a60-359c-4f1e-b272-f8e10fa1ee6a None None] Extended resource: tags {{(pid=102881) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Nov 23 19:24:59.888863 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG neutron.api.extensions [None req-a17d3a60-359c-4f1e-b272-f8e10fa1ee6a None None] Extended resource: tags {{(pid=102881) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Nov 23 19:24:59.890724 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG neutron.api.extensions [None req-a17d3a60-359c-4f1e-b272-f8e10fa1ee6a None None] Extended resource: tags {{(pid=102881) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Nov 23 19:24:59.892523 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG neutron.api.extensions [None req-a17d3a60-359c-4f1e-b272-f8e10fa1ee6a None None] Extended resource: tags {{(pid=102881) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Nov 23 19:24:59.894492 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG neutron.api.extensions [None req-a17d3a60-359c-4f1e-b272-f8e10fa1ee6a None None] Extended resource: tags {{(pid=102881) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Nov 23 19:24:59.896988 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG neutron.api.extensions [None req-a17d3a60-359c-4f1e-b272-f8e10fa1ee6a None None] Extended resource: tags {{(pid=102881) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Nov 23 19:24:59.898727 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG neutron.api.extensions [None req-a17d3a60-359c-4f1e-b272-f8e10fa1ee6a None None] Extended resource: tags {{(pid=102881) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Nov 23 19:24:59.900818 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG neutron.api.extensions [None req-a17d3a60-359c-4f1e-b272-f8e10fa1ee6a None None] Extended resource: tags {{(pid=102881) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Nov 23 19:24:59.902653 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG neutron.api.extensions [None req-a17d3a60-359c-4f1e-b272-f8e10fa1ee6a None None] Extended resource: tags {{(pid=102881) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Nov 23 19:24:59.904529 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG neutron.api.extensions [None req-a17d3a60-359c-4f1e-b272-f8e10fa1ee6a None None] Extended resource: tags {{(pid=102881) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Nov 23 19:24:59.911204 dv-cinder-819011-1-iscsi neutron-server[102881]: WARNING keystonemiddleware.auth_token [None req-a17d3a60-359c-4f1e-b272-f8e10fa1ee6a None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Nov 23 19:24:59.916024 dv-cinder-819011-1-iscsi neutron-server[102881]: WARNING keystonemiddleware.auth_token [None req-a17d3a60-359c-4f1e-b272-f8e10fa1ee6a None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Nov 23 19:24:59.924862 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_concurrency.lockutils [None req-a17d3a60-359c-4f1e-b272-f8e10fa1ee6a None None] Acquired lock "singleton_lock" {{(pid=102881) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Nov 23 19:24:59.925345 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_concurrency.lockutils [None req-a17d3a60-359c-4f1e-b272-f8e10fa1ee6a None None] Releasing lock "singleton_lock" {{(pid=102881) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Nov 23 19:24:59.926051 dv-cinder-819011-1-iscsi neutron-server[102881]: INFO oslo_service.service [None req-a17d3a60-359c-4f1e-b272-f8e10fa1ee6a None None] Starting 2 workers Nov 23 19:24:59.930930 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [None req-a17d3a60-359c-4f1e-b272-f8e10fa1ee6a None None] Started child 102992 {{(pid=102881) _start_child /usr/local/lib/python3.8/dist-packages/oslo_service/service.py:575}} Nov 23 19:24:59.935486 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [None req-a17d3a60-359c-4f1e-b272-f8e10fa1ee6a None None] Started child 102993 {{(pid=102881) _start_child /usr/local/lib/python3.8/dist-packages/oslo_service/service.py:575}} Nov 23 19:24:59.936614 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [-] Publish callbacks [] for process, after_init {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:24:59.937244 dv-cinder-819011-1-iscsi neutron-server[102881]: INFO neutron.service [None req-a17d3a60-359c-4f1e-b272-f8e10fa1ee6a None None] Neutron service started, listening on 0.0.0.0:9696 Nov 23 19:24:59.937746 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG neutron_lib.callbacks.manager [None req-a17d3a60-359c-4f1e-b272-f8e10fa1ee6a None None] Publish callbacks [] for process, before_spawn {{(pid=102881) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:24:59.938137 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [-] (102992) wsgi starting up on http://0.0.0.0:9696 Nov 23 19:24:59.940490 dv-cinder-819011-1-iscsi neutron-server[102881]: INFO oslo_service.service [None req-a17d3a60-359c-4f1e-b272-f8e10fa1ee6a None None] Starting 1 workers Nov 23 19:24:59.940597 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [-] Publish callbacks [] for process, after_init {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:24:59.941941 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [-] (102993) wsgi starting up on http://0.0.0.0:9696 Nov 23 19:24:59.945920 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [None req-a17d3a60-359c-4f1e-b272-f8e10fa1ee6a None None] Started child 102994 {{(pid=102881) _start_child /usr/local/lib/python3.8/dist-packages/oslo_service/service.py:575}} Nov 23 19:24:59.946480 dv-cinder-819011-1-iscsi neutron-server[102881]: INFO oslo_service.service [None req-a17d3a60-359c-4f1e-b272-f8e10fa1ee6a None None] Starting 1 workers Nov 23 19:24:59.949658 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.service [None req-a17d3a60-359c-4f1e-b272-f8e10fa1ee6a None None] calling RpcWorker wait() {{(pid=102994) _wait /opt/stack/neutron/neutron/service.py:128}} Nov 23 19:24:59.950218 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.service [None req-a17d3a60-359c-4f1e-b272-f8e10fa1ee6a None None] returning from RpcWorker wait() {{(pid=102994) _wait /opt/stack/neutron/neutron/service.py:135}} Nov 23 19:24:59.951052 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [None req-a17d3a60-359c-4f1e-b272-f8e10fa1ee6a None None] Started child 102995 {{(pid=102881) _start_child /usr/local/lib/python3.8/dist-packages/oslo_service/service.py:575}} Nov 23 19:24:59.951375 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron_lib.callbacks.manager [-] Publish callbacks [] for process, after_init {{(pid=102994) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:24:59.951889 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.plugins.ml2.plugin [-] neutron.plugins.ml2.plugin.Ml2Plugin method start_rpc_listeners called with arguments () {} {{(pid=102994) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 23 19:24:59.951997 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG neutron_lib.callbacks.manager [None req-a17d3a60-359c-4f1e-b272-f8e10fa1ee6a None None] Publish callbacks [] for process, after_spawn {{(pid=102881) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:24:59.953930 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] Full set of CONF: {{(pid=102881) wait /usr/local/lib/python3.8/dist-packages/oslo_service/service.py:649}} Nov 23 19:24:59.954170 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] ******************************************************************************** {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Nov 23 19:24:59.954363 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] Configuration options gathered from: {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Nov 23 19:24:59.954589 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] command line args: ['--config-file', '/etc/neutron/neutron.conf', '--config-file', '/etc/neutron/plugins/ml2/ml2_conf.ini'] {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Nov 23 19:24:59.954939 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] config files: ['/etc/neutron/neutron.conf', '/etc/neutron/plugins/ml2/ml2_conf.ini'] {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Nov 23 19:24:59.955126 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] ================================================================================ {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Nov 23 19:24:59.955651 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] agent_down_time = 75 {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 19:24:59.955950 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] allow_automatic_dhcp_failover = True {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 19:24:59.956206 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] allow_automatic_l3agent_failover = False {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 19:24:59.956474 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] allow_bulk = True {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 19:24:59.956779 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] allow_overlapping_ips = True {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 19:24:59.957187 dv-cinder-819011-1-iscsi neutron-server[102995]: DEBUG neutron_lib.callbacks.manager [-] Publish callbacks [] for process, after_init {{(pid=102995) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:24:59.958319 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] allowed_conntrack_helpers = [{'amanda': 'tcp'}, {'ftp': 'tcp'}, {'h323': 'udp'}, {'h323': 'tcp'}, {'irc': 'tcp'}, {'netbios-ns': 'udp'}, {'pptp': 'tcp'}, {'sane': 'tcp'}, {'sip': 'udp'}, {'sip': 'tcp'}, {'snmp': 'udp'}, {'tftp': 'udp'}] {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 19:24:59.958406 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] api_extensions_path = {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 19:24:59.958642 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] api_paste_config = api-paste.ini {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 19:24:59.958916 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] api_workers = 2 {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 19:24:59.959175 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] auth_strategy = keystone {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 19:24:59.959353 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] backdoor_port = None {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 19:24:59.959526 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] backdoor_socket = None {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 19:24:59.959778 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] backlog = 4096 {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 19:24:59.960040 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] base_mac = fa:16:3e:00:00:00 {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 19:24:59.960364 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] bind_host = 0.0.0.0 {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 19:24:59.960642 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] bind_port = 9696 {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 19:24:59.960898 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] client_socket_timeout = 900 {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 19:24:59.961153 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] config_dir = [] {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 19:24:59.961331 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] config_file = ['/etc/neutron/neutron.conf', '/etc/neutron/plugins/ml2/ml2_conf.ini'] {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 19:24:59.961604 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] config_source = [] {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 19:24:59.961878 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] control_exchange = neutron {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 19:24:59.962145 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] core_plugin = ml2 {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 19:24:59.962494 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] debug = True {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 19:24:59.962812 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] default_availability_zones = [] {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 19:24:59.963261 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'OFPHandler=INFO', 'OfctlService=INFO', 'os_ken.base.app_manager=INFO', 'os_ken.controller.controller=INFO'] {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 19:24:59.963516 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] dhcp_agent_notification = True {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 19:24:59.963770 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] dhcp_agents_per_network = 1 {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 19:24:59.964000 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] dhcp_lease_duration = 86400 {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 19:24:59.964268 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] dhcp_load_type = networks {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 19:24:59.964516 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] dns_domain = openstacklocal {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 19:24:59.964790 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] dvr_base_mac = fa:16:3f:00:00:00 {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 19:24:59.965032 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] enable_dvr = True {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 19:24:59.965287 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] enable_new_agents = True {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 19:24:59.965568 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] enable_services_on_agents_with_admin_state_down = False {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 19:24:59.965828 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] enable_snat_by_default = True {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 19:24:59.966068 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] enable_traditional_dhcp = True {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 19:24:59.966355 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] external_dns_driver = None {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 19:24:59.966532 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] fatal_deprecations = False {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 19:24:59.966769 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] filter_validation = True {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 19:24:59.967030 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] global_physnet_mtu = 1500 {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 19:24:59.967249 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] graceful_shutdown_timeout = 60 {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 19:24:59.967745 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] host = dv-cinder-819011-1-iscsi {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 19:24:59.968015 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] host_dvr_for_dhcp = True {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 19:24:59.968212 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] http_retries = 3 {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 19:24:59.968465 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] instance_format = [instance: %(uuid)s] {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 19:24:59.968740 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 19:24:59.969004 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] ipam_driver = internal {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 19:24:59.969223 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] ipv6_pd_enabled = False {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 19:24:59.969574 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] l3_ha = False {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 19:24:59.969772 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] l3_ha_net_cidr = 169.254.192.0/18 {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 19:24:59.970029 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] l3_ha_network_physical_name = {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 19:24:59.970291 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] l3_ha_network_type = {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 19:24:59.970479 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] log_config_append = None {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 19:24:59.970731 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 19:24:59.970948 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] log_dir = None {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 19:24:59.971209 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] log_file = None {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 19:24:59.971377 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] log_options = True {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 19:24:59.971619 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] log_rotate_interval = 1 {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 19:24:59.971911 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] log_rotate_interval_type = days {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 19:24:59.972189 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] log_rotation_type = none {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 19:24:59.972396 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 19:24:59.972570 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 19:24:59.972754 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 19:24:59.973626 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 19:24:59.973796 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 19:24:59.974050 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] max_allowed_address_pair = 10 {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 19:24:59.974277 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] max_dns_nameservers = 5 {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 19:24:59.974496 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] max_header_line = 16384 {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 19:24:59.974715 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] max_l3_agents_per_router = 3 {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 19:24:59.974941 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] max_logfile_count = 30 {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 19:24:59.975184 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] max_logfile_size_mb = 200 {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 19:24:59.975442 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] max_routes = 30 {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 19:24:59.975678 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] max_subnet_host_routes = 20 {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 19:24:59.975904 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] network_auto_schedule = True {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 19:24:59.976137 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] network_link_prefix = None {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 19:24:59.976487 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] network_scheduler_driver = neutron.scheduler.dhcp_agent_scheduler.WeightScheduler {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 19:24:59.976709 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] notify_nova_on_port_data_changes = True {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 19:24:59.976850 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] notify_nova_on_port_status_changes = True {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 19:24:59.977084 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] pagination_max_limit = -1 {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 19:24:59.977304 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] periodic_fuzzy_delay = 5 {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 19:24:59.977564 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] periodic_interval = 40 {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 19:24:59.977783 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] publish_errors = False {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 19:24:59.978001 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] rate_limit_burst = 0 {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 19:24:59.978237 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] rate_limit_except_level = CRITICAL {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 19:24:59.978473 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] rate_limit_interval = 0 {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 19:24:59.978695 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] retry_until_window = 30 {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 19:24:59.978957 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] router_auto_schedule = True {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 19:24:59.979182 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] router_distributed = False {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 19:24:59.979457 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] router_scheduler_driver = neutron.scheduler.l3_agent_scheduler.LeastRoutersScheduler {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 19:24:59.979701 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] rpc_resources_processing_step = 20 {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 19:24:59.980045 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] rpc_response_max_timeout = 600 {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 19:24:59.980213 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] rpc_response_timeout = 60 {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 19:24:59.980451 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] rpc_state_report_workers = 0 {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 19:24:59.980725 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] rpc_workers = None {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 19:24:59.980974 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] send_events_interval = 2 {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 19:24:59.981118 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] service_plugins = ['router', 'neutron.services.metering.metering_plugin.MeteringPlugin'] {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 19:24:59.981343 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] setproctitle = on {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 19:24:59.981627 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] state_path = /opt/stack/data/neutron {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 19:24:59.981881 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] syslog_log_facility = LOG_USER {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 19:24:59.982122 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] tcp_keepidle = 600 {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 19:24:59.982382 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] transport_url = **** {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 19:24:59.982602 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] use_eventlog = False {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 19:24:59.982840 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] use_journal = False {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 19:24:59.983074 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] use_json = False {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 19:24:59.983291 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] use_ssl = False {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 19:24:59.983546 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] use_stderr = False {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 19:24:59.983802 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] use_syslog = False {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 19:24:59.984023 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] vlan_transparent = False {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 19:24:59.984597 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] watch_log_file = False {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 19:24:59.984597 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] wsgi_default_pool_size = 100 {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 19:24:59.984851 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] wsgi_keep_alive = True {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 19:24:59.984956 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 19:24:59.985334 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] oslo_concurrency.disable_process_locking = False {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:24:59.985667 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] oslo_concurrency.lock_path = /opt/stack/data/neutron/lock {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:24:59.986166 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] profiler.connection_string = messaging:// {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:24:59.986166 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] profiler.enabled = False {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:24:59.986166 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] profiler.es_doc_type = notification {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:24:59.991427 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] profiler.es_scroll_size = 10000 {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:24:59.991427 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] profiler.es_scroll_time = 2m {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:24:59.991427 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] profiler.filter_error_trace = False {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:24:59.991427 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] profiler.hmac_keys = SECRET_KEY {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:24:59.991427 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] profiler.sentinel_service_name = mymaster {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:24:59.991427 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] profiler.socket_timeout = 0.1 {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:24:59.991427 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] profiler.trace_sqlalchemy = False {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:24:59.991427 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] oslo_policy.enforce_new_defaults = False {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:24:59.991981 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] oslo_policy.enforce_scope = False {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:24:59.991981 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] oslo_policy.policy_default_rule = default {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:24:59.991981 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:24:59.992201 dv-cinder-819011-1-iscsi neutron-server[102995]: DEBUG neutron.services.l3_router.l3_router_plugin [-] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method start_rpc_listeners called with arguments () {} {{(pid=102995) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 23 19:24:59.992287 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] oslo_policy.policy_file = /etc/neutron/policy.json {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:24:59.992287 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:24:59.992287 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:24:59.992287 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:24:59.992287 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:24:59.992287 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:24:59.992287 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:24:59.992287 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:24:59.992840 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] oslo_messaging_metrics.metrics_process_name = {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:24:59.992840 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:24:59.992840 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:24:59.992840 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] oslo_middleware.enable_proxy_headers_parsing = False {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:24:59.992840 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:24:59.993171 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] nova.auth_section = None {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:24:59.993171 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] nova.auth_type = password {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:24:59.993473 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] nova.auth_url = http://10.222.0.62/identity {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:24:59.993739 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] nova.cafile = /opt/stack/data/ca-bundle.pem {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:24:59.993955 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] nova.certfile = None {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:24:59.994216 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] nova.collect_timing = False {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:24:59.994435 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] nova.default_domain_id = None {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:24:59.994652 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] nova.default_domain_name = None {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:24:59.994878 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] nova.domain_id = None {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:24:59.995098 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] nova.domain_name = None {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:24:59.995381 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] nova.endpoint_type = public {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:24:59.995624 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] nova.insecure = False {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:24:59.995863 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] nova.keyfile = None {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:24:59.996108 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] nova.live_migration_events = False {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:24:59.996359 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] nova.password = **** {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:24:59.996578 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] nova.project_domain_id = None {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:24:59.996911 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] nova.project_domain_name = Default {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:24:59.997077 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] nova.project_id = None {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:24:59.997316 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] nova.project_name = service {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:24:59.997574 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] nova.region_name = RegionOne {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:24:59.997822 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] nova.split_loggers = False {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:24:59.998059 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] nova.system_scope = None {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:24:59.998277 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] nova.timeout = None {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:24:59.998496 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] nova.trust_id = None {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:24:59.998735 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] nova.user_domain_id = None {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:24:59.998983 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] nova.user_domain_name = Default {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:24:59.999202 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] nova.user_id = None {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:24:59.999593 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] nova.username = nova {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:25:00.001686 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] placement.auth_section = None {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:25:00.001686 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] placement.auth_type = None {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:25:00.001686 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] placement.cafile = None {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:25:00.001686 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] placement.certfile = None {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:25:00.001686 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] placement.collect_timing = False {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:25:00.001686 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] placement.endpoint_type = public {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:25:00.001686 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] placement.insecure = False {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:25:00.001686 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] placement.keyfile = None {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:25:00.001686 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] placement.region_name = None {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:25:00.002238 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] placement.split_loggers = False {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:25:00.002238 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] placement.timeout = None {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:25:00.002238 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] ironic.auth_section = None {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:25:00.002411 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] ironic.auth_type = None {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:25:00.002555 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] ironic.cafile = None {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:25:00.002867 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] ironic.certfile = None {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:25:00.003022 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] ironic.collect_timing = False {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:25:00.003291 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] ironic.connect_retries = None {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:25:00.003517 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] ironic.connect_retry_delay = None {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:25:00.003740 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] ironic.enable_notifications = False {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:25:00.003955 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] ironic.endpoint_override = None {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:25:00.004219 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] ironic.insecure = False {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:25:00.004495 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] ironic.interface = None {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:25:00.004730 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] ironic.keyfile = None {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:25:00.004890 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] ironic.max_version = None {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:25:00.005133 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] ironic.min_version = None {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:25:00.005307 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] ironic.region_name = None {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:25:00.006265 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] ironic.service_name = None {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:25:00.006265 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] ironic.service_type = None {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:25:00.006265 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] ironic.split_loggers = False {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:25:00.006265 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] ironic.status_code_retries = None {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:25:00.006557 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] ironic.status_code_retry_delay = None {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:25:00.006631 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] ironic.timeout = None {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:25:00.006820 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] ironic.valid_interfaces = None {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:25:00.007216 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] ironic.version = None {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:25:00.007645 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] service_providers.service_provider = [] {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:25:00.007975 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:25:00.008228 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:25:00.008603 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:25:00.008863 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:25:00.009131 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:25:00.009988 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:25:00.009988 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:25:00.009988 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.heartbeat_rate = 2 {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:25:00.013115 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:25:00.013115 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:25:00.013115 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:25:00.013115 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:25:00.013115 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:25:00.013115 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:25:00.013115 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:25:00.013115 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:25:00.020897 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:25:00.020897 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:25:00.020897 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:25:00.020897 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:25:00.020897 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:25:00.020897 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.ssl = False {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:25:00.020897 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:25:00.020897 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:25:00.021570 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:25:00.021570 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.ssl_version = {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:25:00.021570 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] oslo_messaging_notifications.driver = [] {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:25:00.021570 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] oslo_messaging_notifications.retry = -1 {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:25:00.021570 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:25:00.021570 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] oslo_messaging_notifications.transport_url = **** {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:25:00.021570 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:25:00.021570 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] QUOTAS.default_quota = -1 {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:25:00.022183 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] QUOTAS.quota_driver = neutron.db.quota.driver_nolock.DbQuotaNoLockDriver {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:25:00.022183 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] QUOTAS.quota_floatingip = 50 {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:25:00.022183 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] QUOTAS.quota_network = 100 {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:25:00.022183 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] QUOTAS.quota_port = 500 {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:25:00.022183 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] QUOTAS.quota_rbac_policy = 10 {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:25:00.022183 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] QUOTAS.quota_router = 100 {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:25:00.022183 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] QUOTAS.quota_security_group = 100 {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:25:00.022183 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] QUOTAS.quota_security_group_rule = 100 {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:25:00.022750 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] QUOTAS.quota_subnet = 100 {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:25:00.022750 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] QUOTAS.track_quota_usage = True {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:25:00.022750 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] healthcheck.backends = ['disable_by_file'] {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:25:00.022750 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] healthcheck.detailed = False {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:25:00.022750 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] healthcheck.disable_by_file_path = None {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:25:00.022750 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] healthcheck.path = /healthcheck {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:25:00.022750 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] keystone_authtoken.admin_password = **** {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:25:00.022750 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] keystone_authtoken.admin_tenant_name = admin {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:25:00.023292 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] keystone_authtoken.admin_token = **** {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:25:00.023292 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] keystone_authtoken.admin_user = None {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:25:00.023292 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] keystone_authtoken.auth_admin_prefix = {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:25:00.023292 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:25:00.023292 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] keystone_authtoken.auth_port = 35357 {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:25:00.023292 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] keystone_authtoken.auth_protocol = https {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:25:00.023292 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] keystone_authtoken.auth_section = None {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:25:00.023292 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] keystone_authtoken.auth_type = password {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:25:00.023839 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] keystone_authtoken.auth_uri = None {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:25:00.023839 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] keystone_authtoken.auth_url = http://10.222.0.62/identity {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:25:00.023839 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] keystone_authtoken.auth_version = None {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:25:00.023839 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] keystone_authtoken.cache = None {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:25:00.023839 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:25:00.023839 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] keystone_authtoken.certfile = None {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:25:00.023839 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] keystone_authtoken.default_domain_id = None {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:25:00.024333 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] keystone_authtoken.default_domain_name = None {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:25:00.024333 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] keystone_authtoken.delay_auth_decision = False {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:25:00.024486 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] keystone_authtoken.domain_id = None {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:25:00.024680 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] keystone_authtoken.domain_name = None {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:25:00.024943 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:25:00.025165 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] keystone_authtoken.http_connect_timeout = None {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:25:00.025432 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:25:00.025672 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] keystone_authtoken.identity_uri = None {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:25:00.025912 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] keystone_authtoken.include_service_catalog = True {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:25:00.026131 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] keystone_authtoken.insecure = False {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:25:00.026384 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] keystone_authtoken.interface = public {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:25:00.026607 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] keystone_authtoken.keyfile = None {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:25:00.026855 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:25:00.027097 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:25:00.027350 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:25:00.027568 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:25:00.027796 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:25:00.028014 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_secret_key = **** {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:25:00.028265 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_security_strategy = None {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:25:00.028480 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:25:00.028768 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:25:00.029020 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] keystone_authtoken.password = **** {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:25:00.029274 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] keystone_authtoken.project_domain_id = None {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:25:00.029553 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] keystone_authtoken.project_domain_name = Default {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:25:00.029810 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] keystone_authtoken.project_id = None {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:25:00.030062 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] keystone_authtoken.project_name = service {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:25:00.030311 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] keystone_authtoken.region_name = None {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:25:00.030576 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:25:00.030811 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] keystone_authtoken.service_token_roles_required = False {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:25:00.031023 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] keystone_authtoken.service_type = None {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:25:00.031238 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] keystone_authtoken.system_scope = None {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:25:00.031480 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] keystone_authtoken.token_cache_time = 300 {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:25:00.031695 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] keystone_authtoken.trust_id = None {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:25:00.031935 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] keystone_authtoken.user_domain_id = None {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:25:00.032165 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] keystone_authtoken.user_domain_name = Default {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:25:00.032399 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] keystone_authtoken.user_id = None {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:25:00.032635 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] keystone_authtoken.username = neutron {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:25:00.032886 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] keystone_authtoken.www_authenticate_uri = None {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:25:00.033214 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] cache.backend = dogpile.cache.null {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:25:00.033477 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] cache.backend_argument = **** {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:25:00.033710 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] cache.config_prefix = cache.oslo {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:25:00.033972 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] cache.debug_cache_backend = False {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:25:00.034210 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] cache.enabled = False {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:25:00.034447 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] cache.expiration_time = 600 {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:25:00.034688 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] cache.memcache_dead_retry = 300 {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:25:00.034927 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:25:00.035142 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:25:00.035404 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] cache.memcache_pool_maxsize = 10 {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:25:00.036236 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] cache.memcache_pool_unused_timeout = 60 {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:25:00.036509 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] cache.memcache_servers = ['localhost:11211'] {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:25:00.036763 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] cache.memcache_socket_timeout = 1.0 {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:25:00.037023 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] cache.proxies = [] {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:25:00.037239 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] cache.tls_allowed_ciphers = None {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:25:00.037479 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] cache.tls_cafile = None {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:25:00.037698 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] cache.tls_certfile = None {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:25:00.037919 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] cache.tls_enabled = False {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:25:00.038157 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] cache.tls_keyfile = None {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:25:00.038450 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] privsep.capabilities = [21, 12, 1, 2, 19] {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:25:00.038707 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] privsep.group = None {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:25:00.038946 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] privsep.helper_command = None {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:25:00.039206 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] privsep.logger_name = oslo_privsep.daemon {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:25:00.039426 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] privsep.thread_pool_size = 4 {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:25:00.039663 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] privsep.user = None {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:25:00.039893 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] privsep_dhcp_release.capabilities = [21, 12] {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:25:00.040105 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] privsep_dhcp_release.group = None {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:25:00.040323 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] privsep_dhcp_release.helper_command = None {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:25:00.040546 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] privsep_dhcp_release.logger_name = oslo_privsep.daemon {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:25:00.040774 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] privsep_dhcp_release.thread_pool_size = 4 {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:25:00.040987 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] privsep_dhcp_release.user = None {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:25:00.041239 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] privsep_ovs_vsctl.capabilities = [21, 12] {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:25:00.041473 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] privsep_ovs_vsctl.group = None {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:25:00.041713 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] privsep_ovs_vsctl.helper_command = None {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:25:00.041936 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] privsep_ovs_vsctl.logger_name = oslo_privsep.daemon {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:25:00.042155 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] privsep_ovs_vsctl.thread_pool_size = 4 {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:25:00.042423 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] privsep_ovs_vsctl.user = None {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:25:00.042657 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] privsep_namespace.capabilities = [21] {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:25:00.042893 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] privsep_namespace.group = None {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:25:00.043107 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] privsep_namespace.helper_command = None {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:25:00.043333 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] privsep_namespace.logger_name = oslo_privsep.daemon {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:25:00.043554 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] privsep_namespace.thread_pool_size = 4 {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:25:00.043773 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] privsep_namespace.user = None {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:25:00.044021 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] privsep_conntrack.capabilities = [12] {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:25:00.044255 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] privsep_conntrack.group = None {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:25:00.044468 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] privsep_conntrack.helper_command = None {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:25:00.044691 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] privsep_conntrack.logger_name = oslo_privsep.daemon {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:25:00.044911 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] privsep_conntrack.thread_pool_size = 4 {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:25:00.045588 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] privsep_conntrack.user = None {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:25:00.045588 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] privsep_link.capabilities = [12, 21] {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:25:00.045588 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] privsep_link.group = None {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:25:00.048978 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] privsep_link.helper_command = None {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:25:00.048978 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] privsep_link.logger_name = oslo_privsep.daemon {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:25:00.048978 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] privsep_link.thread_pool_size = 4 {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:25:00.048978 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] privsep_link.user = None {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:25:00.048978 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] AGENT.root_helper = sudo /usr/local/bin/neutron-rootwrap /etc/neutron/rootwrap.conf {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:25:00.048978 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] AGENT.root_helper_daemon = sudo /usr/local/bin/neutron-rootwrap-daemon /etc/neutron/rootwrap.conf {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:25:00.048978 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] AGENT.use_helper_for_ns_read = True {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:25:00.048978 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] SECURITYGROUP.enable_ipset = True {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:25:00.050108 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] SECURITYGROUP.enable_security_group = True {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:25:00.050108 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] SECURITYGROUP.firewall_driver = openvswitch {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:25:00.050108 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] SECURITYGROUP.permitted_ethertypes = [] {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:25:00.050108 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] ml2.extension_drivers = ['port_security'] {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:25:00.050108 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] ml2.external_network_type = None {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:25:00.050108 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] ml2.mechanism_drivers = ['openvswitch', 'hyperv'] {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:25:00.050108 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] ml2.overlay_ip_version = 4 {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:25:00.050108 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] ml2.path_mtu = 0 {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:25:00.051342 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] ml2.physical_network_mtus = [] {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:25:00.051342 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] ml2.tenant_network_types = ['vlan'] {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:25:00.051342 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] ml2.type_drivers = ['local', 'flat', 'vlan', 'gre', 'vxlan', 'geneve'] {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:25:00.051342 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] ml2_type_flat.flat_networks = ['physnet1'] {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:25:00.051342 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] ml2_type_geneve.max_header_size = 30 {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:25:00.051342 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] ml2_type_geneve.vni_ranges = ['1:1000'] {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:25:00.053042 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] ml2_type_gre.tunnel_id_ranges = ['1:1000'] {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:25:00.053042 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] ml2_type_vlan.network_vlan_ranges = ['physnet1:800:849'] {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:25:00.053042 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] ml2_type_vxlan.vni_ranges = ['1:1000'] {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:25:00.053042 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] ml2_type_vxlan.vxlan_group = None {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:25:00.053042 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] OVS_DRIVER.vnic_type_prohibit_list = [] {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:25:00.053434 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] database.backend = sqlalchemy {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:25:00.053593 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] database.connection = **** {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:25:00.053852 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] database.connection_debug = 0 {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:25:00.054127 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] database.connection_parameters = {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:25:00.054588 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] database.connection_recycle_time = 3600 {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:25:00.054846 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] database.connection_trace = False {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:25:00.055077 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] database.db_inc_retry_interval = True {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:25:00.055325 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] database.db_max_retries = 20 {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:25:00.055575 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] database.db_max_retry_interval = 10 {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:25:00.055805 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] database.db_retry_interval = 1 {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:25:00.056058 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] database.max_overflow = 50 {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:25:00.056298 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] database.max_pool_size = 50 {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:25:00.056535 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] database.max_retries = 10 {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:25:00.056780 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] database.mysql_enable_ndb = False {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:25:00.057019 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] database.mysql_sql_mode = TRADITIONAL {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:25:00.057247 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] database.pool_timeout = None {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:25:00.057529 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] database.retry_interval = 10 {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:25:00.057746 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] database.slave_connection = **** {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:25:00.057983 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] database.sqlite_synchronous = True {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:25:00.058207 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] database.use_db_reconnect = False {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:25:00.058369 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] ******************************************************************************** {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Nov 23 19:25:00.059044 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] Full set of CONF: {{(pid=102881) wait /usr/local/lib/python3.8/dist-packages/oslo_service/service.py:649}} Nov 23 19:25:00.059208 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] ******************************************************************************** {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Nov 23 19:25:00.059525 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] Configuration options gathered from: {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Nov 23 19:25:00.059704 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] command line args: ['--config-file', '/etc/neutron/neutron.conf', '--config-file', '/etc/neutron/plugins/ml2/ml2_conf.ini'] {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Nov 23 19:25:00.059880 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] config files: ['/etc/neutron/neutron.conf', '/etc/neutron/plugins/ml2/ml2_conf.ini'] {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Nov 23 19:25:00.060044 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] ================================================================================ {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Nov 23 19:25:00.060254 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] agent_down_time = 75 {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 19:25:00.060420 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] allow_automatic_dhcp_failover = True {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 19:25:00.060584 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] allow_automatic_l3agent_failover = False {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 19:25:00.060749 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] allow_bulk = True {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 19:25:00.061205 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] allow_overlapping_ips = True {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 19:25:00.061205 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] allowed_conntrack_helpers = [{'amanda': 'tcp'}, {'ftp': 'tcp'}, {'h323': 'udp'}, {'h323': 'tcp'}, {'irc': 'tcp'}, {'netbios-ns': 'udp'}, {'pptp': 'tcp'}, {'sane': 'tcp'}, {'sip': 'udp'}, {'sip': 'tcp'}, {'snmp': 'udp'}, {'tftp': 'udp'}] {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 19:25:00.061387 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] api_extensions_path = {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 19:25:00.061387 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] api_paste_config = api-paste.ini {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 19:25:00.061565 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] api_workers = 2 {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 19:25:00.061736 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] auth_strategy = keystone {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 19:25:00.061901 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] backdoor_port = None {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 19:25:00.062062 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] backdoor_socket = None {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 19:25:00.062224 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] backlog = 4096 {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 19:25:00.062387 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] base_mac = fa:16:3e:00:00:00 {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 19:25:00.062549 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] bind_host = 0.0.0.0 {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 19:25:00.062713 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] bind_port = 9696 {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 19:25:00.062874 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] client_socket_timeout = 900 {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 19:25:00.063038 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] config_dir = [] {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 19:25:00.063207 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] config_file = ['/etc/neutron/neutron.conf', '/etc/neutron/plugins/ml2/ml2_conf.ini'] {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 19:25:00.063370 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] config_source = [] {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 19:25:00.063532 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] control_exchange = neutron {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 19:25:00.063694 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] core_plugin = ml2 {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 19:25:00.063855 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] debug = True {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 19:25:00.064018 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] default_availability_zones = [] {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 19:25:00.064216 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'OFPHandler=INFO', 'OfctlService=INFO', 'os_ken.base.app_manager=INFO', 'os_ken.controller.controller=INFO'] {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 19:25:00.064383 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] dhcp_agent_notification = True {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 19:25:00.064543 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] dhcp_agents_per_network = 1 {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 19:25:00.064705 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] dhcp_lease_duration = 86400 {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 19:25:00.065154 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] dhcp_load_type = networks {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 19:25:00.065365 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] dns_domain = openstacklocal {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 19:25:00.065524 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] dvr_base_mac = fa:16:3f:00:00:00 {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 19:25:00.065641 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] enable_dvr = True {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 19:25:00.065803 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] enable_new_agents = True {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 19:25:00.065965 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] enable_services_on_agents_with_admin_state_down = False {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 19:25:00.066127 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] enable_snat_by_default = True {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 19:25:00.066291 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] enable_traditional_dhcp = True {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 19:25:00.066453 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] external_dns_driver = None {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 19:25:00.066652 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] fatal_deprecations = False {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 19:25:00.066831 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] filter_validation = True {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 19:25:00.066994 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] global_physnet_mtu = 1500 {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 19:25:00.067156 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] graceful_shutdown_timeout = 60 {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 19:25:00.067317 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] host = dv-cinder-819011-1-iscsi {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 19:25:00.067480 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] host_dvr_for_dhcp = True {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 19:25:00.067641 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] http_retries = 3 {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 19:25:00.067802 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] instance_format = [instance: %(uuid)s] {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 19:25:00.067964 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 19:25:00.068131 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] ipam_driver = internal {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 19:25:00.068277 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] ipv6_pd_enabled = False {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 19:25:00.068438 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] l3_ha = False {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 19:25:00.068599 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] l3_ha_net_cidr = 169.254.192.0/18 {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 19:25:00.068760 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] l3_ha_network_physical_name = {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 19:25:00.068921 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] l3_ha_network_type = {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 19:25:00.069081 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] log_config_append = None {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 19:25:00.069242 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 19:25:00.069425 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] log_dir = None {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 19:25:00.069585 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] log_file = None {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 19:25:00.069747 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] log_options = True {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 19:25:00.069908 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] log_rotate_interval = 1 {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 19:25:00.070070 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] log_rotate_interval_type = days {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 19:25:00.070232 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] log_rotation_type = none {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 19:25:00.070429 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 19:25:00.070598 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 19:25:00.070761 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 19:25:00.070925 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 19:25:00.071087 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 19:25:00.071253 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] max_allowed_address_pair = 10 {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 19:25:00.071523 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] max_dns_nameservers = 5 {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 19:25:00.071523 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] max_header_line = 16384 {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 19:25:00.071523 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] max_l3_agents_per_router = 3 {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 19:25:00.071523 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] max_logfile_count = 30 {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 19:25:00.072808 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] max_logfile_size_mb = 200 {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 19:25:00.072808 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] max_routes = 30 {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 19:25:00.072808 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] max_subnet_host_routes = 20 {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 19:25:00.072808 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] network_auto_schedule = True {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 19:25:00.072808 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] network_link_prefix = None {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 19:25:00.073332 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] network_scheduler_driver = neutron.scheduler.dhcp_agent_scheduler.WeightScheduler {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 19:25:00.073332 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] notify_nova_on_port_data_changes = True {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 19:25:00.073332 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] notify_nova_on_port_status_changes = True {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 19:25:00.073332 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] pagination_max_limit = -1 {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 19:25:00.073693 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] periodic_fuzzy_delay = 5 {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 19:25:00.073693 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] periodic_interval = 40 {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 19:25:00.073995 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] publish_errors = False {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 19:25:00.073995 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] rate_limit_burst = 0 {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 19:25:00.074260 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] rate_limit_except_level = CRITICAL {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 19:25:00.074260 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] rate_limit_interval = 0 {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 19:25:00.074405 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] retry_until_window = 30 {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 19:25:00.074567 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] router_auto_schedule = True {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 19:25:00.074729 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] router_distributed = False {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 19:25:00.074892 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] router_scheduler_driver = neutron.scheduler.l3_agent_scheduler.LeastRoutersScheduler {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 19:25:00.075054 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] rpc_resources_processing_step = 20 {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 19:25:00.075218 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] rpc_response_max_timeout = 600 {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 19:25:00.075378 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] rpc_response_timeout = 60 {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 19:25:00.075544 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] rpc_state_report_workers = 0 {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 19:25:00.075710 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] rpc_workers = None {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 19:25:00.075857 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] send_events_interval = 2 {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 19:25:00.076027 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] service_plugins = ['router', 'neutron.services.metering.metering_plugin.MeteringPlugin'] {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 19:25:00.076204 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] setproctitle = on {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 19:25:00.076334 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] state_path = /opt/stack/data/neutron {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 19:25:00.076489 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] syslog_log_facility = LOG_USER {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 19:25:00.076654 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] tcp_keepidle = 600 {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 19:25:00.076851 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] transport_url = **** {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 19:25:00.077013 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] use_eventlog = False {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 19:25:00.077176 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] use_journal = False {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 19:25:00.077338 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] use_json = False {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 19:25:00.077525 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] use_ssl = False {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 19:25:00.077688 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] use_stderr = False {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 19:25:00.077849 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] use_syslog = False {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 19:25:00.078029 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] vlan_transparent = False {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 19:25:00.078176 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] watch_log_file = False {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 19:25:00.078325 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] wsgi_default_pool_size = 100 {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 19:25:00.078486 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] wsgi_keep_alive = True {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 19:25:00.078649 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 19:25:00.078834 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] oslo_concurrency.disable_process_locking = False {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:25:00.079001 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] oslo_concurrency.lock_path = /opt/stack/data/neutron/lock {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:25:00.079179 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] profiler.connection_string = messaging:// {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:25:00.080100 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] profiler.enabled = False {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:25:00.080100 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] profiler.es_doc_type = notification {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:25:00.080100 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] profiler.es_scroll_size = 10000 {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:25:00.080100 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] profiler.es_scroll_time = 2m {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:25:00.080100 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] profiler.filter_error_trace = False {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:25:00.080100 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] profiler.hmac_keys = SECRET_KEY {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:25:00.080840 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] profiler.sentinel_service_name = mymaster {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:25:00.080840 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] profiler.socket_timeout = 0.1 {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:25:00.080840 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] profiler.trace_sqlalchemy = False {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:25:00.080840 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] oslo_policy.enforce_new_defaults = False {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:25:00.081109 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] oslo_policy.enforce_scope = False {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:25:00.081109 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] oslo_policy.policy_default_rule = default {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:25:00.081392 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:25:00.081392 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] oslo_policy.policy_file = /etc/neutron/policy.json {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:25:00.081707 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:25:00.081707 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:25:00.081898 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:25:00.082049 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:25:00.082189 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:25:00.082858 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:25:00.083226 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:25:00.083226 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] oslo_messaging_metrics.metrics_process_name = {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:25:00.083511 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:25:00.083669 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:25:00.083845 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] oslo_middleware.enable_proxy_headers_parsing = False {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:25:00.084011 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:25:00.084193 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] nova.auth_section = None {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:25:00.084363 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] nova.auth_type = password {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:25:00.084532 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] nova.auth_url = http://10.222.0.62/identity {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:25:00.084699 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] nova.cafile = /opt/stack/data/ca-bundle.pem {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:25:00.084864 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] nova.certfile = None {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:25:00.085031 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] nova.collect_timing = False {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:25:00.085196 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] nova.default_domain_id = None {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:25:00.085740 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] nova.default_domain_name = None {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:25:00.085740 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] nova.domain_id = None {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:25:00.085740 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] nova.domain_name = None {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:25:00.085959 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] nova.endpoint_type = public {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:25:00.086038 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] nova.insecure = False {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:25:00.086157 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] nova.keyfile = None {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:25:00.086321 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] nova.live_migration_events = False {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:25:00.086486 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] nova.password = **** {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:25:00.086650 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] nova.project_domain_id = None {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:25:00.086998 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] nova.project_domain_name = Default {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:25:00.086998 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] nova.project_id = None {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:25:00.087156 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] nova.project_name = service {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:25:00.087273 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] nova.region_name = RegionOne {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:25:00.087437 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] nova.split_loggers = False {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:25:00.087603 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] nova.system_scope = None {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:25:00.087771 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] nova.timeout = None {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:25:00.087964 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] nova.trust_id = None {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:25:00.088130 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] nova.user_domain_id = None {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:25:00.088273 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] nova.user_domain_name = Default {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:25:00.088439 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] nova.user_id = None {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:25:00.088604 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] nova.username = nova {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:25:00.088780 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] placement.auth_section = None {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:25:00.088943 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] placement.auth_type = None {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:25:00.089108 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] placement.cafile = None {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:25:00.089272 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] placement.certfile = None {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:25:00.089457 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] placement.collect_timing = False {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:25:00.089623 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] placement.endpoint_type = public {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:25:00.089788 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] placement.insecure = False {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:25:00.089954 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] placement.keyfile = None {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:25:00.090142 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] placement.region_name = None {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:25:00.090306 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] placement.split_loggers = False {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:25:00.090438 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] placement.timeout = None {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:25:00.090616 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] ironic.auth_section = None {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:25:00.090780 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] ironic.auth_type = None {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:25:00.090944 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] ironic.cafile = None {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:25:00.091109 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] ironic.certfile = None {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:25:00.091274 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] ironic.collect_timing = False {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:25:00.091438 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] ironic.connect_retries = None {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:25:00.091602 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] ironic.connect_retry_delay = None {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:25:00.091767 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] ironic.enable_notifications = False {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:25:00.091930 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] ironic.endpoint_override = None {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:25:00.092100 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] ironic.insecure = False {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:25:00.092264 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] ironic.interface = None {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:25:00.092429 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] ironic.keyfile = None {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:25:00.092592 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] ironic.max_version = None {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:25:00.092758 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] ironic.min_version = None {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:25:00.092922 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] ironic.region_name = None {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:25:00.093086 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] ironic.service_name = None {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:25:00.093250 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] ironic.service_type = None {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:25:00.093432 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] ironic.split_loggers = False {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:25:00.093602 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] ironic.status_code_retries = None {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:25:00.093766 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] ironic.status_code_retry_delay = None {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:25:00.093930 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] ironic.timeout = None {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:25:00.094093 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] ironic.valid_interfaces = None {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:25:00.094257 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] ironic.version = None {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:25:00.094431 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] service_providers.service_provider = [] {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:25:00.094610 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:25:00.094775 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:25:00.094939 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:25:00.095103 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:25:00.095267 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:25:00.095492 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:25:00.095629 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:25:00.095754 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.heartbeat_rate = 2 {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:25:00.095897 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:25:00.096061 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:25:00.096225 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:25:00.096389 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:25:00.096556 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:25:00.096720 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:25:00.096883 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:25:00.097048 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:25:00.097211 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:25:00.097375 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:25:00.097621 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:25:00.097747 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:25:00.097946 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:25:00.100134 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.ssl = False {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:25:00.100134 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:25:00.100134 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:25:00.100134 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:25:00.100134 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.ssl_version = {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:25:00.100134 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] oslo_messaging_notifications.driver = [] {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:25:00.100134 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] oslo_messaging_notifications.retry = -1 {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:25:00.100134 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:25:00.101036 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] oslo_messaging_notifications.transport_url = **** {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:25:00.101036 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:25:00.101036 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] QUOTAS.default_quota = -1 {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:25:00.101036 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] QUOTAS.quota_driver = neutron.db.quota.driver_nolock.DbQuotaNoLockDriver {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:25:00.101036 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] QUOTAS.quota_floatingip = 50 {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:25:00.101036 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] QUOTAS.quota_network = 100 {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:25:00.101036 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] QUOTAS.quota_port = 500 {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:25:00.101821 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] QUOTAS.quota_rbac_policy = 10 {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:25:00.101821 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] QUOTAS.quota_router = 100 {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:25:00.101821 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] QUOTAS.quota_security_group = 100 {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:25:00.101821 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] QUOTAS.quota_security_group_rule = 100 {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:25:00.101821 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] QUOTAS.quota_subnet = 100 {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:25:00.102302 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] QUOTAS.track_quota_usage = True {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:25:00.102302 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] healthcheck.backends = ['disable_by_file'] {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:25:00.102302 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] healthcheck.detailed = False {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:25:00.102643 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] healthcheck.disable_by_file_path = None {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:25:00.102643 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] healthcheck.path = /healthcheck {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:25:00.102874 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] keystone_authtoken.admin_password = **** {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:25:00.103102 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] keystone_authtoken.admin_tenant_name = admin {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:25:00.103102 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] keystone_authtoken.admin_token = **** {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:25:00.103557 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] keystone_authtoken.admin_user = None {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:25:00.103557 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] keystone_authtoken.auth_admin_prefix = {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:25:00.103557 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:25:00.103773 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] keystone_authtoken.auth_port = 35357 {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:25:00.103852 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] keystone_authtoken.auth_protocol = https {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:25:00.103994 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] keystone_authtoken.auth_section = None {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:25:00.104157 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] keystone_authtoken.auth_type = password {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:25:00.104321 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] keystone_authtoken.auth_uri = None {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:25:00.104486 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] keystone_authtoken.auth_url = http://10.222.0.62/identity {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:25:00.104651 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] keystone_authtoken.auth_version = None {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:25:00.104815 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] keystone_authtoken.cache = None {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:25:00.105354 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:25:00.105354 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] keystone_authtoken.certfile = None {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:25:00.105354 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] keystone_authtoken.default_domain_id = None {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:25:00.105863 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] keystone_authtoken.default_domain_name = None {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:25:00.105863 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] keystone_authtoken.delay_auth_decision = False {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:25:00.105863 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] keystone_authtoken.domain_id = None {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:25:00.106089 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] keystone_authtoken.domain_name = None {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:25:00.106089 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:25:00.106258 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] keystone_authtoken.http_connect_timeout = None {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:25:00.106421 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:25:00.106760 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] keystone_authtoken.identity_uri = None {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:25:00.106760 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] keystone_authtoken.include_service_catalog = True {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:25:00.107063 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] keystone_authtoken.insecure = False {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:25:00.107063 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] keystone_authtoken.interface = public {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:25:00.107295 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] keystone_authtoken.keyfile = None {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:25:00.107427 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:25:00.107672 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:25:00.107672 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:25:00.107878 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:25:00.108001 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:25:00.108126 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_secret_key = **** {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:25:00.108250 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_security_strategy = None {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:25:00.108397 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:25:00.108582 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:25:00.108721 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] keystone_authtoken.password = **** {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:25:00.108880 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] keystone_authtoken.project_domain_id = None {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:25:00.109044 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] keystone_authtoken.project_domain_name = Default {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:25:00.109210 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] keystone_authtoken.project_id = None {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:25:00.109372 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] keystone_authtoken.project_name = service {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:25:00.109561 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] keystone_authtoken.region_name = None {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:25:00.109730 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:25:00.109895 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] keystone_authtoken.service_token_roles_required = False {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:25:00.110059 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] keystone_authtoken.service_type = None {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:25:00.110224 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] keystone_authtoken.system_scope = None {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:25:00.110390 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] keystone_authtoken.token_cache_time = 300 {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:25:00.110557 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] keystone_authtoken.trust_id = None {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:25:00.110725 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] keystone_authtoken.user_domain_id = None {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:25:00.110866 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] keystone_authtoken.user_domain_name = Default {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:25:00.111049 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] keystone_authtoken.user_id = None {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:25:00.111192 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] keystone_authtoken.username = neutron {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:25:00.111360 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] keystone_authtoken.www_authenticate_uri = None {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:25:00.111489 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] cache.backend = dogpile.cache.null {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:25:00.111640 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] cache.backend_argument = **** {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:25:00.111784 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] cache.config_prefix = cache.oslo {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:25:00.111948 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] cache.debug_cache_backend = False {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:25:00.112118 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] cache.enabled = False {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:25:00.112291 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] cache.expiration_time = 600 {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:25:00.112473 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] cache.memcache_dead_retry = 300 {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:25:00.112614 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:25:00.112788 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:25:00.112930 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] cache.memcache_pool_maxsize = 10 {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:25:00.113114 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] cache.memcache_pool_unused_timeout = 60 {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:25:00.113259 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] cache.memcache_servers = ['localhost:11211'] {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:25:00.113514 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] cache.memcache_socket_timeout = 1.0 {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:25:00.113654 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] cache.proxies = [] {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:25:00.113761 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] cache.tls_allowed_ciphers = None {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:25:00.113930 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] cache.tls_cafile = None {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:25:00.114112 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] cache.tls_certfile = None {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:25:00.114285 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] cache.tls_enabled = False {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:25:00.114451 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] cache.tls_keyfile = None {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:25:00.114654 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] privsep.capabilities = [21, 12, 1, 2, 19] {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:25:00.114797 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] privsep.group = None {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:25:00.114970 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] privsep.helper_command = None {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:25:00.115108 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] privsep.logger_name = oslo_privsep.daemon {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:25:00.115246 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] privsep.thread_pool_size = 4 {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:25:00.115383 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] privsep.user = None {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:25:00.115553 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] privsep_dhcp_release.capabilities = [21, 12] {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:25:00.115795 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] privsep_dhcp_release.group = None {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:25:00.115992 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] privsep_dhcp_release.helper_command = None {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:25:00.116214 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] privsep_dhcp_release.logger_name = oslo_privsep.daemon {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:25:00.116214 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] privsep_dhcp_release.thread_pool_size = 4 {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:25:00.116536 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] privsep_dhcp_release.user = None {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:25:00.116536 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] privsep_ovs_vsctl.capabilities = [21, 12] {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:25:00.116739 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] privsep_ovs_vsctl.group = None {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:25:00.116821 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] privsep_ovs_vsctl.helper_command = None {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:25:00.117017 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] privsep_ovs_vsctl.logger_name = oslo_privsep.daemon {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:25:00.117141 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] privsep_ovs_vsctl.thread_pool_size = 4 {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:25:00.117265 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] privsep_ovs_vsctl.user = None {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:25:00.117547 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] privsep_namespace.capabilities = [21] {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:25:00.117716 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] privsep_namespace.group = None {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:25:00.118010 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] privsep_namespace.helper_command = None {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:25:00.118010 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] privsep_namespace.logger_name = oslo_privsep.daemon {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:25:00.118210 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] privsep_namespace.thread_pool_size = 4 {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:25:00.118336 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] privsep_namespace.user = None {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:25:00.119140 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] privsep_conntrack.capabilities = [12] {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:25:00.119140 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] privsep_conntrack.group = None {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:25:00.119140 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] privsep_conntrack.helper_command = None {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:25:00.119140 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] privsep_conntrack.logger_name = oslo_privsep.daemon {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:25:00.119140 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] privsep_conntrack.thread_pool_size = 4 {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:25:00.119505 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] privsep_conntrack.user = None {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:25:00.119505 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] privsep_link.capabilities = [12, 21] {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:25:00.119747 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] privsep_link.group = None {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:25:00.119747 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] privsep_link.helper_command = None {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:25:00.120003 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] privsep_link.logger_name = oslo_privsep.daemon {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:25:00.120152 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] privsep_link.thread_pool_size = 4 {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:25:00.120276 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] privsep_link.user = None {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:25:00.120369 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] AGENT.root_helper = sudo /usr/local/bin/neutron-rootwrap /etc/neutron/rootwrap.conf {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:25:00.120497 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] AGENT.root_helper_daemon = sudo /usr/local/bin/neutron-rootwrap-daemon /etc/neutron/rootwrap.conf {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:25:00.121288 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] AGENT.use_helper_for_ns_read = True {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:25:00.121288 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] SECURITYGROUP.enable_ipset = True {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:25:00.121288 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] SECURITYGROUP.enable_security_group = True {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:25:00.121288 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] SECURITYGROUP.firewall_driver = openvswitch {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:25:00.121288 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] SECURITYGROUP.permitted_ethertypes = [] {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:25:00.121935 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] ml2.extension_drivers = ['port_security'] {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:25:00.121935 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] ml2.external_network_type = None {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:25:00.121935 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] ml2.mechanism_drivers = ['openvswitch', 'hyperv'] {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:25:00.121935 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] ml2.overlay_ip_version = 4 {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:25:00.122522 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] ml2.path_mtu = 0 {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:25:00.122522 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] ml2.physical_network_mtus = [] {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:25:00.122522 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] ml2.tenant_network_types = ['vlan'] {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:25:00.122879 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.services.l3_router.l3_router_plugin [-] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method start_rpc_listeners called with arguments () {} {{(pid=102994) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 23 19:25:00.123007 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] ml2.type_drivers = ['local', 'flat', 'vlan', 'gre', 'vxlan', 'geneve'] {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:25:00.123007 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] ml2_type_flat.flat_networks = ['physnet1'] {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:25:00.123007 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] ml2_type_geneve.max_header_size = 30 {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:25:00.123360 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] ml2_type_geneve.vni_ranges = ['1:1000'] {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:25:00.123360 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] ml2_type_gre.tunnel_id_ranges = ['1:1000'] {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:25:00.123360 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] ml2_type_vlan.network_vlan_ranges = ['physnet1:800:849'] {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:25:00.123698 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] ml2_type_vxlan.vni_ranges = ['1:1000'] {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:25:00.123698 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] ml2_type_vxlan.vxlan_group = None {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:25:00.123930 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] OVS_DRIVER.vnic_type_prohibit_list = [] {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:25:00.124053 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] database.backend = sqlalchemy {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:25:00.124175 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] database.connection = **** {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:25:00.124306 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] database.connection_debug = 0 {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:25:00.124469 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] database.connection_parameters = {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:25:00.124634 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] database.connection_recycle_time = 3600 {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:25:00.124799 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] database.connection_trace = False {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:25:00.124963 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] database.db_inc_retry_interval = True {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:25:00.125126 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] database.db_max_retries = 20 {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:25:00.125290 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] database.db_max_retry_interval = 10 {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:25:00.125475 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] database.db_retry_interval = 1 {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:25:00.125640 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] database.max_overflow = 50 {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:25:00.125804 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] database.max_pool_size = 50 {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:25:00.125969 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] database.max_retries = 10 {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:25:00.126134 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] database.mysql_enable_ndb = False {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:25:00.126298 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] database.mysql_sql_mode = TRADITIONAL {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:25:00.126462 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] database.pool_timeout = None {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:25:00.126626 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] database.retry_interval = 10 {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:25:00.126789 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] database.slave_connection = **** {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:25:00.126954 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] database.sqlite_synchronous = True {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:25:00.127119 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] database.use_db_reconnect = False {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:25:00.127268 dv-cinder-819011-1-iscsi neutron-server[102881]: DEBUG oslo_service.service [-] ******************************************************************************** {{(pid=102881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Nov 23 19:25:00.294554 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.wsgi [-] (102993) accepted ('10.222.0.62', 39314) {{(pid=102993) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 23 19:25:00.303231 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [-] 10.222.0.62 "GET / HTTP/1.1" status: 200 len: 253 time: 0.0064945 Nov 23 19:25:11.730825 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-68f51241-8aba-4fd0-8de5-e4b5e15162f4 None None] get_active_networks_info from dv-cinder-819011-1-iscsi {{(pid=102994) get_active_networks_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:158}} Nov 23 19:25:11.829598 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-68f51241-8aba-4fd0-8de5-e4b5e15162f4 None None] No non-hosted networks {{(pid=102994) auto_schedule_networks /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:60}} Nov 23 19:25:11.845498 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.db.agentschedulers_db [None req-68f51241-8aba-4fd0-8de5-e4b5e15162f4 None None] DHCP Agent not found on host dv-cinder-819011-1-iscsi {{(pid=102994) list_active_networks_on_active_dhcp_agent /opt/stack/neutron/neutron/db/agentschedulers_db.py:455}} Nov 23 19:25:12.082529 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron_lib.callbacks.manager [None req-e0ea4f10-4a7f-4396-9677-3fcd053d26cd None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8783631323329', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.create_fip_agent_gw_ports-933164'] for agent, after_create {{(pid=102994) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:25:14.212121 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron_lib.callbacks.manager [None req-0c480d7b-155d-443e-90d9-fb4b4d1ab7d7 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8783631323329', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.create_fip_agent_gw_ports-933164'] for agent, after_create {{(pid=102994) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:25:14.250967 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron_lib.db.api [None req-ce47f82e-f498-41b0-8d5e-eed5d5aac3e3 None None] Retry wrapper got retriable exception: Failed to create a duplicate Agent: for attribute(s) ['agent_type', 'host'] with value(s) L3 agent-dv-cinder-819011-1-iscsi {{(pid=102994) wrapped /usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py:183}} Nov 23 19:25:14.252354 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG oslo_db.api [None req-ce47f82e-f498-41b0-8d5e-eed5d5aac3e3 None None] Performing DB retry for function neutron.db.agents_db.AgentDbMixin.create_or_update_agent {{(pid=102994) wrapper /usr/local/lib/python3.8/dist-packages/oslo_db/api.py:155}} Nov 23 19:25:14.838193 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron_lib.callbacks.manager [None req-ce47f82e-f498-41b0-8d5e-eed5d5aac3e3 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8783631323329', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7978582'] for agent, after_update {{(pid=102994) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:25:15.072595 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron_lib.callbacks.manager [None req-8346ef05-f685-4c3d-af3d-a159b683bec2 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8783631323329', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.create_fip_agent_gw_ports-933164'] for agent, after_create {{(pid=102994) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:25:16.604037 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron_lib.callbacks.manager [None req-785c1d26-11ba-42d8-b5a6-51a8b3daeef0 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8783631323329', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.create_fip_agent_gw_ports-933164'] for agent, after_create {{(pid=102994) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:25:17.444509 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron_lib.callbacks.manager [None req-eb87b2c3-3339-4249-8b85-e695b5b4e1f9 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8783631323329', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.create_fip_agent_gw_ports-933164'] for agent, after_create {{(pid=102994) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:25:17.445470 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-eb87b2c3-3339-4249-8b85-e695b5b4e1f9 None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-819011-1-iscsi {{(pid=102994) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 23 19:25:17.446064 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-eb87b2c3-3339-4249-8b85-e695b5b4e1f9 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-819011-1-iscsi {{(pid=102994) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 23 19:25:17.446801 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-eb87b2c3-3339-4249-8b85-e695b5b4e1f9 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-819011-1-iscsi {{(pid=102994) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 23 19:25:17.449375 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-eb87b2c3-3339-4249-8b85-e695b5b4e1f9 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-819011-1-iscsi {{(pid=102994) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 23 19:25:17.450019 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-eb87b2c3-3339-4249-8b85-e695b5b4e1f9 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-819011-1-iscsi {{(pid=102994) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 23 19:25:17.450521 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-eb87b2c3-3339-4249-8b85-e695b5b4e1f9 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-819011-1-iscsi {{(pid=102994) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 23 19:25:17.451353 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-eb87b2c3-3339-4249-8b85-e695b5b4e1f9 None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-819011-1-iscsi {{(pid=102994) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 23 19:25:17.452508 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-eb87b2c3-3339-4249-8b85-e695b5b4e1f9 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-819011-1-iscsi {{(pid=102994) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 23 19:25:17.455765 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-eb87b2c3-3339-4249-8b85-e695b5b4e1f9 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-819011-1-iscsi {{(pid=102994) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 23 19:25:17.456358 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-eb87b2c3-3339-4249-8b85-e695b5b4e1f9 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-819011-1-iscsi {{(pid=102994) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 23 19:25:17.466973 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-eb87b2c3-3339-4249-8b85-e695b5b4e1f9 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-819011-1-iscsi {{(pid=102994) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 23 19:25:17.466973 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-eb87b2c3-3339-4249-8b85-e695b5b4e1f9 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-819011-1-iscsi {{(pid=102994) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 23 19:25:17.466973 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-eb87b2c3-3339-4249-8b85-e695b5b4e1f9 None None] neutron.api.rpc.handlers.resources_rpc.ResourcesPushToServersRpcApi method report_agent_resource_versions called with arguments (, 'Open vSwitch agent', 'dv-cinder-819011-1-iscsi', {'QosPolicy': '1.10', 'Trunk': '1.1', 'SubPort': '1.0', 'Port': '1.7', 'Subnet': '1.1', 'Network': '1.1', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'Log': '1.0', 'PortForwarding': '1.2', 'ConntrackHelper': '1.0', 'AddressGroup': '1.2'}) {} {{(pid=102994) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 23 19:25:17.476767 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-eb87b2c3-3339-4249-8b85-e695b5b4e1f9 None None] neutron.api.rpc.handlers.resources_rpc.ResourcesPushToServerRpcCallback method report_agent_resource_versions called with arguments (,) {'agent_type': 'Open vSwitch agent', 'agent_host': 'dv-cinder-819011-1-iscsi', 'version_map': {'QosPolicy': '1.10', 'Trunk': '1.1', 'SubPort': '1.0', 'Port': '1.7', 'Subnet': '1.1', 'Network': '1.1', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'Log': '1.0', 'PortForwarding': '1.2', 'ConntrackHelper': '1.0', 'AddressGroup': '1.2'}} {{(pid=102994) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 23 19:25:17.852227 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.wsgi [-] (102993) accepted ('10.222.0.62', 39404) {{(pid=102993) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 23 19:25:18.371974 dv-cinder-819011-1-iscsi neutron-server[102993]: WARNING oslo_policy.policy [None req-68faf762-dd65-4fc0-86ce-bea102772a01 admin admin] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html. Nov 23 19:25:18.372571 dv-cinder-819011-1-iscsi neutron-server[102993]: WARNING oslo_policy.policy [None req-68faf762-dd65-4fc0-86ce-bea102772a01 admin admin] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html. Nov 23 19:25:18.598852 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.wsgi [None req-68faf762-dd65-4fc0-86ce-bea102772a01 admin admin] http://10.222.0.62:9696/v2.0/extensions returned with HTTP 200 {{(pid=102993) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Nov 23 19:25:18.608603 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [None req-68faf762-dd65-4fc0-86ce-bea102772a01 admin admin] 10.222.0.62 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 14082 time: 0.7471569 Nov 23 19:25:19.635999 dv-cinder-819011-1-iscsi neutron-server[102994]: INFO neutron.db.l3_hamode_db [None req-32eca36d-33a9-4988-9619-1c2a7a2bd495 None None] Number of active agents lower than max_l3_agents_per_router. L3 agents available: 1 Nov 23 19:25:19.713823 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.db.l3_dvrscheduler_db [None req-32eca36d-33a9-4988-9619-1c2a7a2bd495 None None] Routers set() bound to L3 agent in host dv-cinder-819011-1-iscsi {{(pid=102994) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 23 19:25:19.714213 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.db.l3_dvrscheduler_db [None req-32eca36d-33a9-4988-9619-1c2a7a2bd495 None None] Router IDs set() for agent in host dv-cinder-819011-1-iscsi {{(pid=102994) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:462}} Nov 23 19:25:21.187115 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.wsgi [-] (102993) accepted ('10.222.0.62', 39420) {{(pid=102993) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 23 19:25:21.497117 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.api.v2.base [None req-a54b3a81-c077-46a0-87e4-542fa2ac033f admin admin] Request body: {'subnetpool': {'is_default': True, 'default_prefixlen': 26, 'shared': True, 'name': 'shared-default-subnetpool-v4', 'prefixes': ['172.20.0.0/16']}} {{(pid=102993) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 23 19:25:21.613000 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.policy [None req-a54b3a81-c077-46a0-87e4-542fa2ac033f admin admin] Loaded default policies from ['neutron'] under neutron.policies entry points {{(pid=102993) register_rules /opt/stack/neutron/neutron/policy.py:73}} Nov 23 19:25:21.660962 dv-cinder-819011-1-iscsi neutron-server[102993]: WARNING oslo_policy.policy [None req-a54b3a81-c077-46a0-87e4-542fa2ac033f admin admin] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html. Nov 23 19:25:21.661285 dv-cinder-819011-1-iscsi neutron-server[102993]: WARNING oslo_policy.policy [None req-a54b3a81-c077-46a0-87e4-542fa2ac033f admin admin] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html. Nov 23 19:25:21.670040 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.quota [None req-a54b3a81-c077-46a0-87e4-542fa2ac033f admin admin] Loaded quota_driver: . Nov 23 19:25:21.821157 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-a54b3a81-c077-46a0-87e4-542fa2ac033f admin admin] Publish callbacks ['neutron.objects.securitygroup.RbacNeutronDbObjectMixin.validate_rbac_policy_change-8783633945647', 'neutron.objects.address_group.RbacNeutronDbObjectMixin.validate_rbac_policy_change-8783633946224', 'neutron.objects.network.RbacNeutronDbObjectMixin.validate_rbac_policy_change-8783633859458', 'neutron.objects.qos.policy.RbacNeutronDbObjectMixin.validate_rbac_policy_change-8783633861771', 'neutron.objects.subnetpool.RbacNeutronDbObjectMixin.validate_rbac_policy_change-8783633872204', 'neutron.objects.address_scope.RbacNeutronDbObjectMixin.validate_rbac_policy_change-8783633847896', 'neutron.plugins.ml2.plugin.External_net_db_mixin._process_ext_policy_create-8133011', 'neutron.plugins.ml2.plugin.NeutronDbPluginV2.validate_network_rbac_policy_change-8153336', 'neutron.services.network_ip_availability.plugin.NeutronDbPluginV2.validate_network_rbac_policy_change-877093', 'neutron.services.network_ip_availability.plugin.NeutronDbPluginV2.validate_network_rbac_policy_change-675057'] for rbac-policy, before_create {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:25:22.023173 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-a54b3a81-c077-46a0-87e4-542fa2ac033f admin admin] Publish callbacks [] for subnetpool, before_response {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:25:22.024445 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [None req-a54b3a81-c077-46a0-87e4-542fa2ac033f admin admin] 10.222.0.62 "POST /v2.0/subnetpools HTTP/1.1" status: 201 len: 739 time: 0.8362696 Nov 23 19:25:24.707413 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.wsgi [-] (102992) accepted ('10.222.0.62', 39432) {{(pid=102992) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 23 19:25:25.214980 dv-cinder-819011-1-iscsi neutron-server[102992]: WARNING oslo_policy.policy [None req-5dedd2ea-daab-41c5-abcd-47c7f14528d2 admin admin] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html. Nov 23 19:25:25.215599 dv-cinder-819011-1-iscsi neutron-server[102992]: WARNING oslo_policy.policy [None req-5dedd2ea-daab-41c5-abcd-47c7f14528d2 admin admin] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html. Nov 23 19:25:25.438058 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.api.v2.base [None req-5dedd2ea-daab-41c5-abcd-47c7f14528d2 admin admin] Request body: {'network': {'tenant_id': 'febc4f33fba1433992fc8e043a47dd5c', 'admin_state_up': True, 'name': 'private', 'project_id': 'febc4f33fba1433992fc8e043a47dd5c'}} {{(pid=102992) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 23 19:25:25.439757 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.quota [None req-5dedd2ea-daab-41c5-abcd-47c7f14528d2 admin admin] Loaded quota_driver: . Nov 23 19:25:25.563876 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-5dedd2ea-daab-41c5-abcd-47c7f14528d2 admin admin] Made reservation on behalf of febc4f33fba1433992fc8e043a47dd5c for: {'network': 1} {{(pid=102992) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 23 19:25:25.635487 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.policy [None req-5dedd2ea-daab-41c5-abcd-47c7f14528d2 admin admin] Loaded default policies from ['neutron'] under neutron.policies entry points {{(pid=102992) register_rules /opt/stack/neutron/neutron/policy.py:73}} Nov 23 19:25:25.682074 dv-cinder-819011-1-iscsi neutron-server[102992]: WARNING oslo_policy.policy [None req-5dedd2ea-daab-41c5-abcd-47c7f14528d2 admin admin] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html. Nov 23 19:25:25.682478 dv-cinder-819011-1-iscsi neutron-server[102992]: WARNING oslo_policy.policy [None req-5dedd2ea-daab-41c5-abcd-47c7f14528d2 admin admin] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html. Nov 23 19:25:25.693727 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [None req-5dedd2ea-daab-41c5-abcd-47c7f14528d2 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7921281'] for network, before_create {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:25:25.715036 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [None req-5dedd2ea-daab-41c5-abcd-47c7f14528d2 admin admin] Publish callbacks [] for security_group, before_create {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:25:25.829186 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [None req-5dedd2ea-daab-41c5-abcd-47c7f14528d2 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:25:25.895101 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [None req-5dedd2ea-daab-41c5-abcd-47c7f14528d2 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-623933'] for security_group, after_create {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:25:25.915320 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-5dedd2ea-daab-41c5-abcd-47c7f14528d2 admin admin] vlan segment allocate from pool success with {'vlan_id': 820, 'physical_network': 'physnet1'} {{(pid=102992) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 23 19:25:25.944581 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [None req-5dedd2ea-daab-41c5-abcd-47c7f14528d2 admin admin] Publish callbacks ['neutron.services.segments.db._add_segment_host_mapping_for_segment-8783631323311', 'neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7982218'] for segment, precommit_create {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:25:25.945110 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [None req-5dedd2ea-daab-41c5-abcd-47c7f14528d2 admin admin] Unsubscribe: segment precommit_create {{(pid=102992) unsubscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:83}} Nov 23 19:25:25.945627 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.db.segments_db [None req-5dedd2ea-daab-41c5-abcd-47c7f14528d2 admin admin] Added segment fcd294cd-e58a-4ca0-987d-1fee2a47a5f4 of type vlan for network 9af0bb9f-7449-41c2-abfb-77fb4d8d059e Nov 23 19:25:25.966751 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5dedd2ea-daab-41c5-abcd-47c7f14528d2 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=9ea1b849-6321-46ee-ae03-0bda0d1f4636,revision_number=1']} {{(pid=102992) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 23 19:25:26.000938 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5dedd2ea-daab-41c5-abcd-47c7f14528d2 admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-819011-1-iscsi {{(pid=102992) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 23 19:25:26.001303 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5dedd2ea-daab-41c5-abcd-47c7f14528d2 admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-819011-1-iscsi {{(pid=102992) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 23 19:25:26.001681 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5dedd2ea-daab-41c5-abcd-47c7f14528d2 admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-819011-1-iscsi {{(pid=102992) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 23 19:25:26.002023 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5dedd2ea-daab-41c5-abcd-47c7f14528d2 admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-819011-1-iscsi {{(pid=102992) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 23 19:25:26.002360 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5dedd2ea-daab-41c5-abcd-47c7f14528d2 admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-819011-1-iscsi {{(pid=102992) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 23 19:25:26.002714 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5dedd2ea-daab-41c5-abcd-47c7f14528d2 admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-819011-1-iscsi {{(pid=102992) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 23 19:25:26.003051 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5dedd2ea-daab-41c5-abcd-47c7f14528d2 admin admin] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-819011-1-iscsi {{(pid=102992) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 23 19:25:26.003397 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5dedd2ea-daab-41c5-abcd-47c7f14528d2 admin admin] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-819011-1-iscsi {{(pid=102992) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 23 19:25:26.003745 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5dedd2ea-daab-41c5-abcd-47c7f14528d2 admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-819011-1-iscsi {{(pid=102992) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 23 19:25:26.004080 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5dedd2ea-daab-41c5-abcd-47c7f14528d2 admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-819011-1-iscsi {{(pid=102992) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 23 19:25:26.004420 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5dedd2ea-daab-41c5-abcd-47c7f14528d2 admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-819011-1-iscsi {{(pid=102992) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 23 19:25:26.004728 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5dedd2ea-daab-41c5-abcd-47c7f14528d2 admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-819011-1-iscsi {{(pid=102992) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 23 19:25:26.006495 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5dedd2ea-daab-41c5-abcd-47c7f14528d2 admin admin] Tracked resource versions report: Nov 23 19:25:26.006495 dv-cinder-819011-1-iscsi neutron-server[102992]: pushed versions: Nov 23 19:25:26.006495 dv-cinder-819011-1-iscsi neutron-server[102992]: { 'AddressGroup': {'1.2'}, Nov 23 19:25:26.006495 dv-cinder-819011-1-iscsi neutron-server[102992]: 'ConntrackHelper': {'1.0'}, Nov 23 19:25:26.006495 dv-cinder-819011-1-iscsi neutron-server[102992]: 'Log': {'1.0'}, Nov 23 19:25:26.006495 dv-cinder-819011-1-iscsi neutron-server[102992]: 'Network': {'1.1'}, Nov 23 19:25:26.006495 dv-cinder-819011-1-iscsi neutron-server[102992]: 'Port': {'1.7'}, Nov 23 19:25:26.006495 dv-cinder-819011-1-iscsi neutron-server[102992]: 'PortForwarding': {'1.2'}, Nov 23 19:25:26.006495 dv-cinder-819011-1-iscsi neutron-server[102992]: 'QosPolicy': {'1.10'}, Nov 23 19:25:26.006495 dv-cinder-819011-1-iscsi neutron-server[102992]: 'SecurityGroup': {'1.5'}, Nov 23 19:25:26.006495 dv-cinder-819011-1-iscsi neutron-server[102992]: 'SecurityGroupRule': {'1.2'}, Nov 23 19:25:26.006495 dv-cinder-819011-1-iscsi neutron-server[102992]: 'SubPort': {'1.0'}, Nov 23 19:25:26.006495 dv-cinder-819011-1-iscsi neutron-server[102992]: 'Subnet': {'1.1'}, Nov 23 19:25:26.006495 dv-cinder-819011-1-iscsi neutron-server[102992]: 'Trunk': {'1.1'}} Nov 23 19:25:26.006495 dv-cinder-819011-1-iscsi neutron-server[102992]: consumer versions: Nov 23 19:25:26.006495 dv-cinder-819011-1-iscsi neutron-server[102992]: { DHCP agent@dv-cinder-819011-1-iscsi: {}, Nov 23 19:25:26.006495 dv-cinder-819011-1-iscsi neutron-server[102992]: L3 agent@dv-cinder-819011-1-iscsi: {}, Nov 23 19:25:26.006495 dv-cinder-819011-1-iscsi neutron-server[102992]: Metadata agent@dv-cinder-819011-1-iscsi: {}, Nov 23 19:25:26.006495 dv-cinder-819011-1-iscsi neutron-server[102992]: Metering agent@dv-cinder-819011-1-iscsi: {}, Nov 23 19:25:26.006495 dv-cinder-819011-1-iscsi neutron-server[102992]: Open vSwitch agent@dv-cinder-819011-1-iscsi: { 'AddressGroup': '1.2', Nov 23 19:25:26.006495 dv-cinder-819011-1-iscsi neutron-server[102992]: 'ConntrackHelper': '1.0', Nov 23 19:25:26.006495 dv-cinder-819011-1-iscsi neutron-server[102992]: 'Log': '1.0', Nov 23 19:25:26.006495 dv-cinder-819011-1-iscsi neutron-server[102992]: 'Network': '1.1', Nov 23 19:25:26.006495 dv-cinder-819011-1-iscsi neutron-server[102992]: 'Port': '1.7', Nov 23 19:25:26.006495 dv-cinder-819011-1-iscsi neutron-server[102992]: 'PortForwarding': '1.2', Nov 23 19:25:26.006495 dv-cinder-819011-1-iscsi neutron-server[102992]: 'QosPolicy': '1.10', Nov 23 19:25:26.006495 dv-cinder-819011-1-iscsi neutron-server[102992]: 'SecurityGroup': '1.5', Nov 23 19:25:26.006495 dv-cinder-819011-1-iscsi neutron-server[102992]: 'SecurityGroupRule': '1.2', Nov 23 19:25:26.006495 dv-cinder-819011-1-iscsi neutron-server[102992]: 'SubPort': '1.0', Nov 23 19:25:26.006495 dv-cinder-819011-1-iscsi neutron-server[102992]: 'Subnet': '1.1', Nov 23 19:25:26.006495 dv-cinder-819011-1-iscsi neutron-server[102992]: 'Trunk': '1.1'}} Nov 23 19:25:26.006495 dv-cinder-819011-1-iscsi neutron-server[102992]: {{(pid=102992) report /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:175}} Nov 23 19:25:26.079333 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [None req-5dedd2ea-daab-41c5-abcd-47c7f14528d2 admin admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8783630993713'] for network, precommit_create {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:25:26.169580 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [None req-5dedd2ea-daab-41c5-abcd-47c7f14528d2 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-554949', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560168'] for network, after_create {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:25:26.170817 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-5dedd2ea-daab-41c5-abcd-47c7f14528d2 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102992) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:25:26.171544 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [None req-5dedd2ea-daab-41c5-abcd-47c7f14528d2 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-560186'] for network, before_response {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:25:26.273840 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5dedd2ea-daab-41c5-abcd-47c7f14528d2 admin admin] Pushing event updated for resources: {'Network': ['ID=9af0bb9f-7449-41c2-abfb-77fb4d8d059e,revision_number=1']} {{(pid=102992) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 23 19:25:26.284813 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.plugins.ml2.rpc [None req-eb87b2c3-3339-4249-8b85-e695b5b4e1f9 None None] Network 9af0bb9f-7449-41c2-abfb-77fb4d8d059e details requested by agent ovs-agent-dv-cinder-819011-1-iscsi with host dv-cinder-819011-1-iscsi {{(pid=102994) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Nov 23 19:25:26.305455 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [None req-5dedd2ea-daab-41c5-abcd-47c7f14528d2 admin admin] 10.222.0.62 "POST /v2.0/networks HTTP/1.1" status: 201 len: 849 time: 1.5886731 Nov 23 19:25:29.062768 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.wsgi [-] (102992) accepted ('10.222.0.62', 39454) {{(pid=102992) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 23 19:25:29.453141 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-4d9a33cf-b39d-4fba-b66b-abbce9596629 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102992) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:25:29.454565 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [None req-4d9a33cf-b39d-4fba-b66b-abbce9596629 admin admin] 10.222.0.62 "GET /v2.0/networks/9af0bb9f-7449-41c2-abfb-77fb4d8d059e HTTP/1.1" status: 200 len: 825 time: 0.3907912 Nov 23 19:25:29.493108 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [None req-5f099950-d9fc-4753-8f7b-bf930c85f8de admin admin] 10.222.0.62 "GET /v2.0/subnetpools/6e3a70a1-07d7-4781-9446-b7052eb2106a HTTP/1.1" status: 200 len: 734 time: 0.0316892 Nov 23 19:25:29.502118 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.api.v2.base [None req-703199f8-a8aa-439d-8624-58ebe04018d1 admin admin] Request body: {'subnet': {'subnetpool_id': '6e3a70a1-07d7-4781-9446-b7052eb2106a', 'ip_version': 4, 'network_id': '9af0bb9f-7449-41c2-abfb-77fb4d8d059e', 'tenant_id': 'febc4f33fba1433992fc8e043a47dd5c', 'name': 'private-subnet', 'gateway_ip': '172.20.0.1'}} {{(pid=102992) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 23 19:25:29.592090 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-703199f8-a8aa-439d-8624-58ebe04018d1 admin admin] Made reservation on behalf of febc4f33fba1433992fc8e043a47dd5c for: {'subnet': 1} {{(pid=102992) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 23 19:25:29.594404 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [None req-703199f8-a8aa-439d-8624-58ebe04018d1 admin admin] Publish callbacks [] for subnet, before_create {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:25:29.941603 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [None req-703199f8-a8aa-439d-8624-58ebe04018d1 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-554858', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560168'] for subnet, after_create {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:25:30.009524 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-703199f8-a8aa-439d-8624-58ebe04018d1 admin admin] Pushing event updated for resources: {'Subnet': ['ID=d96c8e74-eccf-40d7-8588-0d6d07c85013,revision_number=0']} {{(pid=102992) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 23 19:25:30.011474 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-703199f8-a8aa-439d-8624-58ebe04018d1 admin admin] Checking segment: {'id': 'fcd294cd-e58a-4ca0-987d-1fee2a47a5f4', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 820, 'network_id': '9af0bb9f-7449-41c2-abfb-77fb4d8d059e'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102992) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 23 19:25:30.011828 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-703199f8-a8aa-439d-8624-58ebe04018d1 admin admin] Network hostable DHCP agents. Network: 9af0bb9f-7449-41c2-abfb-77fb4d8d059e, hostable agents: ['e51c95c7-6a36-4263-ba47-1839054f3e7a'], hosted agents: [] {{(pid=102992) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 23 19:25:30.066692 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-703199f8-a8aa-439d-8624-58ebe04018d1 admin admin] Network 9af0bb9f-7449-41c2-abfb-77fb4d8d059e is scheduled to be hosted by DHCP agent e51c95c7-6a36-4263-ba47-1839054f3e7a with binding_index 1 {{(pid=102992) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 23 19:25:30.118087 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.scheduler.base_scheduler [None req-703199f8-a8aa-439d-8624-58ebe04018d1 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-819011-1-iscsi, 9af0bb9f-7449-41c2-abfb-77fb4d8d059e) {{(pid=102992) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 23 19:25:30.122530 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-703199f8-a8aa-439d-8624-58ebe04018d1 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'network'] {{(pid=102992) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:25:30.123118 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [None req-703199f8-a8aa-439d-8624-58ebe04018d1 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-560186'] for subnet, before_response {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:25:30.127281 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-51406a55-027d-462f-8103-73f206a80bf1 None None] Network 9af0bb9f-7449-41c2-abfb-77fb4d8d059e requested from dv-cinder-819011-1-iscsi {{(pid=102994) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 23 19:25:30.178911 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [None req-703199f8-a8aa-439d-8624-58ebe04018d1 admin admin] 10.222.0.62 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 854 time: 0.6799269 Nov 23 19:25:30.456156 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-d3c3024b-4c2b-4f68-82fa-56e493d25fb0 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp8353ff9b-e01d-5e31-ab2d-60a764783255-9af0bb9f-7449-41c2-abfb-77fb4d8d059e', 'network_id': '9af0bb9f-7449-41c2-abfb-77fb4d8d059e', 'tenant_id': 'febc4f33fba1433992fc8e043a47dd5c', 'fixed_ips': [{'subnet_id': 'd96c8e74-eccf-40d7-8588-0d6d07c85013'}]}} from dv-cinder-819011-1-iscsi. {{(pid=102994) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:285}} Nov 23 19:25:30.457356 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron_lib.callbacks.manager [None req-d3c3024b-4c2b-4f68-82fa-56e493d25fb0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7921281'] for port, before_create {{(pid=102994) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:25:30.755479 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.db.db_base_plugin_common [None req-d3c3024b-4c2b-4f68-82fa-56e493d25fb0 None None] Allocated IP 172.20.0.2 (9af0bb9f-7449-41c2-abfb-77fb4d8d059e/d96c8e74-eccf-40d7-8588-0d6d07c85013/ae655a48-f49a-4d6f-a3a3-e224020a779e) {{(pid=102994) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 23 19:25:30.960136 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron_lib.callbacks.manager [None req-d3c3024b-4c2b-4f68-82fa-56e493d25fb0 None None] Publish callbacks [] for port, precommit_create {{(pid=102994) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:25:31.060616 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron_lib.callbacks.manager [None req-d3c3024b-4c2b-4f68-82fa-56e493d25fb0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7918660', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-15067', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560168', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8783631008714'] for port, after_create {{(pid=102994) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:25:31.129854 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-d3c3024b-4c2b-4f68-82fa-56e493d25fb0 None None] Network 9af0bb9f-7449-41c2-abfb-77fb4d8d059e is already hosted by enough agents. {{(pid=102994) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 23 19:25:31.137217 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.scheduler.base_scheduler [None req-d3c3024b-4c2b-4f68-82fa-56e493d25fb0 None None] Resources bound (agent type, host, resource id): {{(pid=102994) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 23 19:25:31.148108 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.db.l3_dvrscheduler_db [None req-d3c3024b-4c2b-4f68-82fa-56e493d25fb0 None None] Received port after_create {{(pid=102994) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 23 19:25:31.155849 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d3c3024b-4c2b-4f68-82fa-56e493d25fb0 None None] Pushing event updated for resources: {'Port': ['ID=ae655a48-f49a-4d6f-a3a3-e224020a779e,revision_number=1']} {{(pid=102994) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 23 19:25:31.205714 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d3c3024b-4c2b-4f68-82fa-56e493d25fb0 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-819011-1-iscsi {{(pid=102994) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 23 19:25:31.206092 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d3c3024b-4c2b-4f68-82fa-56e493d25fb0 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-819011-1-iscsi {{(pid=102994) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 23 19:25:31.206448 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d3c3024b-4c2b-4f68-82fa-56e493d25fb0 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-819011-1-iscsi {{(pid=102994) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 23 19:25:31.206801 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d3c3024b-4c2b-4f68-82fa-56e493d25fb0 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-819011-1-iscsi {{(pid=102994) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 23 19:25:31.207134 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d3c3024b-4c2b-4f68-82fa-56e493d25fb0 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-819011-1-iscsi {{(pid=102994) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 23 19:25:31.207470 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d3c3024b-4c2b-4f68-82fa-56e493d25fb0 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-819011-1-iscsi {{(pid=102994) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 23 19:25:31.207807 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d3c3024b-4c2b-4f68-82fa-56e493d25fb0 None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-819011-1-iscsi {{(pid=102994) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 23 19:25:31.208139 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d3c3024b-4c2b-4f68-82fa-56e493d25fb0 None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-819011-1-iscsi {{(pid=102994) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 23 19:25:31.208485 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d3c3024b-4c2b-4f68-82fa-56e493d25fb0 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-819011-1-iscsi {{(pid=102994) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 23 19:25:31.208900 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d3c3024b-4c2b-4f68-82fa-56e493d25fb0 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-819011-1-iscsi {{(pid=102994) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 23 19:25:31.209771 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d3c3024b-4c2b-4f68-82fa-56e493d25fb0 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-819011-1-iscsi {{(pid=102994) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 23 19:25:31.210104 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d3c3024b-4c2b-4f68-82fa-56e493d25fb0 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-819011-1-iscsi {{(pid=102994) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 23 19:25:31.211235 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d3c3024b-4c2b-4f68-82fa-56e493d25fb0 None None] Tracked resource versions report: Nov 23 19:25:31.211235 dv-cinder-819011-1-iscsi neutron-server[102994]: pushed versions: Nov 23 19:25:31.211235 dv-cinder-819011-1-iscsi neutron-server[102994]: { 'AddressGroup': {'1.2'}, Nov 23 19:25:31.211235 dv-cinder-819011-1-iscsi neutron-server[102994]: 'ConntrackHelper': {'1.0'}, Nov 23 19:25:31.211235 dv-cinder-819011-1-iscsi neutron-server[102994]: 'Log': {'1.0'}, Nov 23 19:25:31.211235 dv-cinder-819011-1-iscsi neutron-server[102994]: 'Network': {'1.1'}, Nov 23 19:25:31.211235 dv-cinder-819011-1-iscsi neutron-server[102994]: 'Port': {'1.7'}, Nov 23 19:25:31.211235 dv-cinder-819011-1-iscsi neutron-server[102994]: 'PortForwarding': {'1.2'}, Nov 23 19:25:31.211235 dv-cinder-819011-1-iscsi neutron-server[102994]: 'QosPolicy': {'1.10'}, Nov 23 19:25:31.211235 dv-cinder-819011-1-iscsi neutron-server[102994]: 'SecurityGroup': {'1.5'}, Nov 23 19:25:31.211235 dv-cinder-819011-1-iscsi neutron-server[102994]: 'SecurityGroupRule': {'1.2'}, Nov 23 19:25:31.211235 dv-cinder-819011-1-iscsi neutron-server[102994]: 'SubPort': {'1.0'}, Nov 23 19:25:31.211235 dv-cinder-819011-1-iscsi neutron-server[102994]: 'Subnet': {'1.1'}, Nov 23 19:25:31.211235 dv-cinder-819011-1-iscsi neutron-server[102994]: 'Trunk': {'1.1'}} Nov 23 19:25:31.211235 dv-cinder-819011-1-iscsi neutron-server[102994]: consumer versions: Nov 23 19:25:31.211235 dv-cinder-819011-1-iscsi neutron-server[102994]: { DHCP agent@dv-cinder-819011-1-iscsi: {}, Nov 23 19:25:31.211235 dv-cinder-819011-1-iscsi neutron-server[102994]: L3 agent@dv-cinder-819011-1-iscsi: {}, Nov 23 19:25:31.211235 dv-cinder-819011-1-iscsi neutron-server[102994]: Metadata agent@dv-cinder-819011-1-iscsi: {}, Nov 23 19:25:31.211235 dv-cinder-819011-1-iscsi neutron-server[102994]: Metering agent@dv-cinder-819011-1-iscsi: {}, Nov 23 19:25:31.211235 dv-cinder-819011-1-iscsi neutron-server[102994]: Open vSwitch agent@dv-cinder-819011-1-iscsi: { 'AddressGroup': '1.2', Nov 23 19:25:31.211235 dv-cinder-819011-1-iscsi neutron-server[102994]: 'ConntrackHelper': '1.0', Nov 23 19:25:31.211235 dv-cinder-819011-1-iscsi neutron-server[102994]: 'Log': '1.0', Nov 23 19:25:31.211235 dv-cinder-819011-1-iscsi neutron-server[102994]: 'Network': '1.1', Nov 23 19:25:31.211235 dv-cinder-819011-1-iscsi neutron-server[102994]: 'Port': '1.7', Nov 23 19:25:31.211235 dv-cinder-819011-1-iscsi neutron-server[102994]: 'PortForwarding': '1.2', Nov 23 19:25:31.211235 dv-cinder-819011-1-iscsi neutron-server[102994]: 'QosPolicy': '1.10', Nov 23 19:25:31.211235 dv-cinder-819011-1-iscsi neutron-server[102994]: 'SecurityGroup': '1.5', Nov 23 19:25:31.211235 dv-cinder-819011-1-iscsi neutron-server[102994]: 'SecurityGroupRule': '1.2', Nov 23 19:25:31.211235 dv-cinder-819011-1-iscsi neutron-server[102994]: 'SubPort': '1.0', Nov 23 19:25:31.211235 dv-cinder-819011-1-iscsi neutron-server[102994]: 'Subnet': '1.1', Nov 23 19:25:31.211235 dv-cinder-819011-1-iscsi neutron-server[102994]: 'Trunk': '1.1'}} Nov 23 19:25:31.211235 dv-cinder-819011-1-iscsi neutron-server[102994]: {{(pid=102994) report /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:175}} Nov 23 19:25:31.237327 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.plugins.ml2.managers [None req-d3c3024b-4c2b-4f68-82fa-56e493d25fb0 None None] Attempting to bind port ae655a48-f49a-4d6f-a3a3-e224020a779e on host dv-cinder-819011-1-iscsi for vnic_type normal with profile {{(pid=102994) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 23 19:25:31.237756 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.plugins.ml2.managers [None req-d3c3024b-4c2b-4f68-82fa-56e493d25fb0 None None] Attempting to bind port ae655a48-f49a-4d6f-a3a3-e224020a779e by drivers openvswitch,hyperv on host dv-cinder-819011-1-iscsi at level 0 using segments [{'id': 'fcd294cd-e58a-4ca0-987d-1fee2a47a5f4', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 820, 'network_id': '9af0bb9f-7449-41c2-abfb-77fb4d8d059e'}] {{(pid=102994) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 23 19:25:31.238167 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-d3c3024b-4c2b-4f68-82fa-56e493d25fb0 None None] Attempting to bind port ae655a48-f49a-4d6f-a3a3-e224020a779e on network 9af0bb9f-7449-41c2-abfb-77fb4d8d059e {{(pid=102994) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 23 19:25:31.243637 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-d3c3024b-4c2b-4f68-82fa-56e493d25fb0 None None] Checking agent: {'id': '668c8953-047c-499e-8c0d-db838fac1668', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-819011-1-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 23, 19, 25, 17), 'started_at': datetime.datetime(2021, 11, 23, 19, 25, 17), 'heartbeat_timestamp': datetime.datetime(2021, 11, 23, 19, 25, 17), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-819011-1-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=102994) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 23 19:25:31.244028 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-d3c3024b-4c2b-4f68-82fa-56e493d25fb0 None None] Checking segment: {'id': 'fcd294cd-e58a-4ca0-987d-1fee2a47a5f4', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 820, 'network_id': '9af0bb9f-7449-41c2-abfb-77fb4d8d059e'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102994) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 23 19:25:31.244511 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron_lib.callbacks.manager [None req-d3c3024b-4c2b-4f68-82fa-56e493d25fb0 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=102994) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:25:31.244902 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-d3c3024b-4c2b-4f68-82fa-56e493d25fb0 None None] Bound using segment: {'id': 'fcd294cd-e58a-4ca0-987d-1fee2a47a5f4', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 820, 'network_id': '9af0bb9f-7449-41c2-abfb-77fb4d8d059e'} {{(pid=102994) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 23 19:25:31.245383 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.plugins.ml2.managers [None req-d3c3024b-4c2b-4f68-82fa-56e493d25fb0 None None] Bound port: ae655a48-f49a-4d6f-a3a3-e224020a779e, host: dv-cinder-819011-1-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'fcd294cd-e58a-4ca0-987d-1fee2a47a5f4', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 820, 'network_id': '9af0bb9f-7449-41c2-abfb-77fb4d8d059e'}}] {{(pid=102994) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 23 19:25:31.245830 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron_lib.callbacks.manager [None req-d3c3024b-4c2b-4f68-82fa-56e493d25fb0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7921281'] for port, before_update {{(pid=102994) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:25:31.307342 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.plugins.ml2.db [None req-d3c3024b-4c2b-4f68-82fa-56e493d25fb0 None None] For port ae655a48-f49a-4d6f-a3a3-e224020a779e, host dv-cinder-819011-1-iscsi, cleared binding levels {{(pid=102994) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 23 19:25:31.311521 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.plugins.ml2.db [None req-d3c3024b-4c2b-4f68-82fa-56e493d25fb0 None None] For port ae655a48-f49a-4d6f-a3a3-e224020a779e, host dv-cinder-819011-1-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-819011-1-iscsi',level=0,port_id=ae655a48-f49a-4d6f-a3a3-e224020a779e,segment=NetworkSegment(fcd294cd-e58a-4ca0-987d-1fee2a47a5f4),segment_id=fcd294cd-e58a-4ca0-987d-1fee2a47a5f4)] {{(pid=102994) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 23 19:25:31.364149 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron_lib.callbacks.manager [None req-d3c3024b-4c2b-4f68-82fa-56e493d25fb0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7918660', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-15067', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560168', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8783631423946', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8783631008732', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8783631008750'] for port, after_update {{(pid=102994) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:25:31.433914 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d3c3024b-4c2b-4f68-82fa-56e493d25fb0 None None] Pushing event updated for resources: {'Port': ['ID=ae655a48-f49a-4d6f-a3a3-e224020a779e,revision_number=2']} {{(pid=102994) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 23 19:25:32.727596 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.wsgi [-] (102992) accepted ('10.222.0.62', 39462) {{(pid=102992) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 23 19:25:33.045511 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.wsgi [None req-6819ddf2-2b0f-4f3d-b0ea-9ccf28f1d28e admin admin] http://10.222.0.62:9696/v2.0/extensions returned with HTTP 200 {{(pid=102992) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Nov 23 19:25:33.046506 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [None req-6819ddf2-2b0f-4f3d-b0ea-9ccf28f1d28e admin admin] 10.222.0.62 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 14082 time: 0.3179481 Nov 23 19:25:35.571763 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.wsgi [-] (102992) accepted ('10.222.0.62', 39470) {{(pid=102992) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 23 19:25:35.890489 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.wsgi [None req-fccfefb1-6c3b-4cb5-aebf-87b5f58b7b5b admin admin] http://10.222.0.62:9696/v2.0/extensions returned with HTTP 200 {{(pid=102992) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Nov 23 19:25:35.891476 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [None req-fccfefb1-6c3b-4cb5-aebf-87b5f58b7b5b admin admin] 10.222.0.62 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 14082 time: 0.3187470 Nov 23 19:25:38.670853 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.wsgi [-] (102992) accepted ('10.222.0.62', 39480) {{(pid=102992) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 23 19:25:38.977939 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.api.v2.base [None req-f33ec7b8-9717-472e-8dbe-23eeb15324a7 admin admin] Request body: {'router': {'tenant_id': 'febc4f33fba1433992fc8e043a47dd5c', 'admin_state_up': True, 'name': 'router1'}} {{(pid=102992) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 23 19:25:39.066961 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [None req-f33ec7b8-9717-472e-8dbe-23eeb15324a7 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-933550', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-13503'] for router, before_create {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:25:39.068789 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [None req-f33ec7b8-9717-472e-8dbe-23eeb15324a7 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-933038', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-927700', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-622769', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-13448'] for router, precommit_create {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:25:39.211400 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [None req-f33ec7b8-9717-472e-8dbe-23eeb15324a7 admin admin] Publish callbacks [] for router_controller, precommit_add_association {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:25:39.274433 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [None req-f33ec7b8-9717-472e-8dbe-23eeb15324a7 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-932875', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-926501'] for router, after_create {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:25:39.365739 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [None req-f33ec7b8-9717-472e-8dbe-23eeb15324a7 admin admin] Publish callbacks [] for router, before_response {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:25:39.366930 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [None req-f33ec7b8-9717-472e-8dbe-23eeb15324a7 admin admin] 10.222.0.62 "POST /v2.0/routers HTTP/1.1" status: 201 len: 709 time: 0.6950326 Nov 23 19:25:40.466521 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-eebadc5b-5257-4bd9-ba58-141c9f4c96d6 None None] Network 9af0bb9f-7449-41c2-abfb-77fb4d8d059e requested from dv-cinder-819011-1-iscsi {{(pid=102994) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 23 19:25:40.591583 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.db.provisioning_blocks [None req-e1859733-4bac-4974-be23-c1503e446802 None None] Provisioning complete for port ae655a48-f49a-4d6f-a3a3-e224020a779e triggered by entity DHCP. {{(pid=102994) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 23 19:25:40.591966 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron_lib.callbacks.manager [None req-e1859733-4bac-4974-be23-c1503e446802 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-8355713'] for port, provisioning_complete {{(pid=102994) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:25:40.774893 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron_lib.callbacks.manager [None req-e1859733-4bac-4974-be23-c1503e446802 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7921281'] for port, before_update {{(pid=102994) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:25:40.810674 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.plugins.ml2.db [None req-e1859733-4bac-4974-be23-c1503e446802 None None] For port ae655a48-f49a-4d6f-a3a3-e224020a779e, host dv-cinder-819011-1-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-819011-1-iscsi',level=0,port_id=ae655a48-f49a-4d6f-a3a3-e224020a779e,segment=NetworkSegment(fcd294cd-e58a-4ca0-987d-1fee2a47a5f4),segment_id=fcd294cd-e58a-4ca0-987d-1fee2a47a5f4)] {{(pid=102994) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 23 19:25:40.883861 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron_lib.callbacks.manager [None req-e1859733-4bac-4974-be23-c1503e446802 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7918660', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-15067', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560168', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8783631423946', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8783631008732', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8783631008750'] for port, after_update {{(pid=102994) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:25:40.932789 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e1859733-4bac-4974-be23-c1503e446802 None None] Pushing event updated for resources: {'Port': ['ID=ae655a48-f49a-4d6f-a3a3-e224020a779e,revision_number=3']} {{(pid=102994) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 23 19:25:41.003751 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.db.provisioning_blocks [None req-dc174541-305d-438a-af0d-61dc6fc8756f None None] Provisioning complete for port ae655a48-f49a-4d6f-a3a3-e224020a779e triggered by entity DHCP. {{(pid=102994) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 23 19:25:41.004123 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron_lib.callbacks.manager [None req-dc174541-305d-438a-af0d-61dc6fc8756f None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-8355713'] for port, provisioning_complete {{(pid=102994) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:25:41.182062 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.plugins.ml2.rpc [None req-eb87b2c3-3339-4249-8b85-e695b5b4e1f9 None None] Device ae655a48-f49a-4d6f-a3a3-e224020a779e up at agent ovs-agent-dv-cinder-819011-1-iscsi {{(pid=102994) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 23 19:25:41.231853 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.db.provisioning_blocks [None req-eb87b2c3-3339-4249-8b85-e695b5b4e1f9 None None] Provisioning complete for port ae655a48-f49a-4d6f-a3a3-e224020a779e triggered by entity L2. {{(pid=102994) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 23 19:25:41.232230 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron_lib.callbacks.manager [None req-eb87b2c3-3339-4249-8b85-e695b5b4e1f9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-8355713'] for port, provisioning_complete {{(pid=102994) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:25:41.666265 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron_lib.callbacks.manager [None req-d497628f-d748-4e5e-8b57-7d8855dd635d None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8783631323329', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7978582'] for agent, after_update {{(pid=102994) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:25:41.877722 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.wsgi [-] (102993) accepted ('10.222.0.62', 39492) {{(pid=102993) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 23 19:25:42.184053 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.wsgi [None req-e4fcdd6a-01cc-4598-a887-919f115fecde admin admin] http://10.222.0.62:9696/v2.0/extensions returned with HTTP 200 {{(pid=102993) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Nov 23 19:25:42.185114 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [None req-e4fcdd6a-01cc-4598-a887-919f115fecde admin admin] 10.222.0.62 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 14082 time: 0.3064716 Nov 23 19:25:44.192225 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron_lib.callbacks.manager [None req-1cb30c6a-7f2a-42e4-b774-44000c2de90f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8783631323329', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7978582'] for agent, after_update {{(pid=102994) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:25:44.675744 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.wsgi [-] (102993) accepted ('10.222.0.62', 39500) {{(pid=102993) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 23 19:25:44.994246 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.api.v2.base [None req-ace09494-baee-40fc-9364-37b433c87c78 admin admin] Request body: {'network': {'provider:network_type': 'flat', 'name': 'public', 'provider:physical_network': 'physnet1', 'admin_state_up': True, 'router:external': True, 'is_default': True}} {{(pid=102993) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 23 19:25:45.054901 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron_lib.callbacks.manager [None req-8346ef05-f685-4c3d-af3d-a159b683bec2 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8783631323329', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7978582'] for agent, after_update {{(pid=102994) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:25:45.111903 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-ace09494-baee-40fc-9364-37b433c87c78 admin admin] Made reservation on behalf of bbbece3b7f8c49dc96e2d01b1a42f43c for: {'network': 1} {{(pid=102993) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 23 19:25:45.114726 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-ace09494-baee-40fc-9364-37b433c87c78 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7921281'] for network, before_create {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:25:45.131073 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-ace09494-baee-40fc-9364-37b433c87c78 admin admin] Publish callbacks [] for security_group, before_create {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:25:45.243622 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-ace09494-baee-40fc-9364-37b433c87c78 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:25:45.300732 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-ace09494-baee-40fc-9364-37b433c87c78 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-623933'] for security_group, after_create {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:25:45.312491 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.plugins.ml2.drivers.type_flat [None req-ace09494-baee-40fc-9364-37b433c87c78 admin admin] Reserving flat network on physical network physnet1 {{(pid=102993) reserve_provider_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_flat.py:100}} Nov 23 19:25:45.344094 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-ace09494-baee-40fc-9364-37b433c87c78 admin admin] Publish callbacks ['neutron.services.segments.db._add_segment_host_mapping_for_segment-8783631323311', 'neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7982218'] for segment, precommit_create {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:25:45.344677 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-ace09494-baee-40fc-9364-37b433c87c78 admin admin] Unsubscribe: segment precommit_create {{(pid=102993) unsubscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:83}} Nov 23 19:25:45.345180 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.db.segments_db [None req-ace09494-baee-40fc-9364-37b433c87c78 admin admin] Added segment 3cb5e60b-103a-47d0-a28b-d68e3159d032 of type flat for network a93e254e-aac9-4233-9e4d-4290fd0458e4 Nov 23 19:25:45.361215 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ace09494-baee-40fc-9364-37b433c87c78 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=0c64ba65-517f-4d78-a13d-78040c91615c,revision_number=1']} {{(pid=102993) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 23 19:25:45.409693 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ace09494-baee-40fc-9364-37b433c87c78 admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-819011-1-iscsi {{(pid=102993) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 23 19:25:45.410054 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ace09494-baee-40fc-9364-37b433c87c78 admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-819011-1-iscsi {{(pid=102993) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 23 19:25:45.410395 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ace09494-baee-40fc-9364-37b433c87c78 admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-819011-1-iscsi {{(pid=102993) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 23 19:25:45.410730 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ace09494-baee-40fc-9364-37b433c87c78 admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-819011-1-iscsi {{(pid=102993) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 23 19:25:45.411061 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ace09494-baee-40fc-9364-37b433c87c78 admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-819011-1-iscsi {{(pid=102993) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 23 19:25:45.411407 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ace09494-baee-40fc-9364-37b433c87c78 admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-819011-1-iscsi {{(pid=102993) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 23 19:25:45.411741 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ace09494-baee-40fc-9364-37b433c87c78 admin admin] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-819011-1-iscsi {{(pid=102993) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 23 19:25:45.412626 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ace09494-baee-40fc-9364-37b433c87c78 admin admin] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-819011-1-iscsi {{(pid=102993) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 23 19:25:45.412969 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ace09494-baee-40fc-9364-37b433c87c78 admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-819011-1-iscsi {{(pid=102993) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 23 19:25:45.413301 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ace09494-baee-40fc-9364-37b433c87c78 admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-819011-1-iscsi {{(pid=102993) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 23 19:25:45.413656 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ace09494-baee-40fc-9364-37b433c87c78 admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-819011-1-iscsi {{(pid=102993) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 23 19:25:45.413978 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ace09494-baee-40fc-9364-37b433c87c78 admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-819011-1-iscsi {{(pid=102993) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 23 19:25:45.415359 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ace09494-baee-40fc-9364-37b433c87c78 admin admin] Tracked resource versions report: Nov 23 19:25:45.415359 dv-cinder-819011-1-iscsi neutron-server[102993]: pushed versions: Nov 23 19:25:45.415359 dv-cinder-819011-1-iscsi neutron-server[102993]: { 'AddressGroup': {'1.2'}, Nov 23 19:25:45.415359 dv-cinder-819011-1-iscsi neutron-server[102993]: 'ConntrackHelper': {'1.0'}, Nov 23 19:25:45.415359 dv-cinder-819011-1-iscsi neutron-server[102993]: 'Log': {'1.0'}, Nov 23 19:25:45.415359 dv-cinder-819011-1-iscsi neutron-server[102993]: 'Network': {'1.1'}, Nov 23 19:25:45.415359 dv-cinder-819011-1-iscsi neutron-server[102993]: 'Port': {'1.7'}, Nov 23 19:25:45.415359 dv-cinder-819011-1-iscsi neutron-server[102993]: 'PortForwarding': {'1.2'}, Nov 23 19:25:45.415359 dv-cinder-819011-1-iscsi neutron-server[102993]: 'QosPolicy': {'1.10'}, Nov 23 19:25:45.415359 dv-cinder-819011-1-iscsi neutron-server[102993]: 'SecurityGroup': {'1.5'}, Nov 23 19:25:45.415359 dv-cinder-819011-1-iscsi neutron-server[102993]: 'SecurityGroupRule': {'1.2'}, Nov 23 19:25:45.415359 dv-cinder-819011-1-iscsi neutron-server[102993]: 'SubPort': {'1.0'}, Nov 23 19:25:45.415359 dv-cinder-819011-1-iscsi neutron-server[102993]: 'Subnet': {'1.1'}, Nov 23 19:25:45.415359 dv-cinder-819011-1-iscsi neutron-server[102993]: 'Trunk': {'1.1'}} Nov 23 19:25:45.415359 dv-cinder-819011-1-iscsi neutron-server[102993]: consumer versions: Nov 23 19:25:45.415359 dv-cinder-819011-1-iscsi neutron-server[102993]: { DHCP agent@dv-cinder-819011-1-iscsi: {}, Nov 23 19:25:45.415359 dv-cinder-819011-1-iscsi neutron-server[102993]: L3 agent@dv-cinder-819011-1-iscsi: {}, Nov 23 19:25:45.415359 dv-cinder-819011-1-iscsi neutron-server[102993]: Metadata agent@dv-cinder-819011-1-iscsi: {}, Nov 23 19:25:45.415359 dv-cinder-819011-1-iscsi neutron-server[102993]: Metering agent@dv-cinder-819011-1-iscsi: {}, Nov 23 19:25:45.415359 dv-cinder-819011-1-iscsi neutron-server[102993]: Open vSwitch agent@dv-cinder-819011-1-iscsi: { 'AddressGroup': '1.2', Nov 23 19:25:45.415359 dv-cinder-819011-1-iscsi neutron-server[102993]: 'ConntrackHelper': '1.0', Nov 23 19:25:45.415359 dv-cinder-819011-1-iscsi neutron-server[102993]: 'Log': '1.0', Nov 23 19:25:45.415359 dv-cinder-819011-1-iscsi neutron-server[102993]: 'Network': '1.1', Nov 23 19:25:45.415359 dv-cinder-819011-1-iscsi neutron-server[102993]: 'Port': '1.7', Nov 23 19:25:45.415359 dv-cinder-819011-1-iscsi neutron-server[102993]: 'PortForwarding': '1.2', Nov 23 19:25:45.415359 dv-cinder-819011-1-iscsi neutron-server[102993]: 'QosPolicy': '1.10', Nov 23 19:25:45.415359 dv-cinder-819011-1-iscsi neutron-server[102993]: 'SecurityGroup': '1.5', Nov 23 19:25:45.415359 dv-cinder-819011-1-iscsi neutron-server[102993]: 'SecurityGroupRule': '1.2', Nov 23 19:25:45.415359 dv-cinder-819011-1-iscsi neutron-server[102993]: 'SubPort': '1.0', Nov 23 19:25:45.415359 dv-cinder-819011-1-iscsi neutron-server[102993]: 'Subnet': '1.1', Nov 23 19:25:45.415359 dv-cinder-819011-1-iscsi neutron-server[102993]: 'Trunk': '1.1'}} Nov 23 19:25:45.415359 dv-cinder-819011-1-iscsi neutron-server[102993]: {{(pid=102993) report /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:175}} Nov 23 19:25:45.471160 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-ace09494-baee-40fc-9364-37b433c87c78 admin admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8783630993713'] for network, precommit_create {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:25:45.580200 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-ace09494-baee-40fc-9364-37b433c87c78 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-554949', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560168'] for network, after_create {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:25:45.581183 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-ace09494-baee-40fc-9364-37b433c87c78 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102993) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:25:45.581883 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-ace09494-baee-40fc-9364-37b433c87c78 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-560186'] for network, before_response {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:25:45.676421 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ace09494-baee-40fc-9364-37b433c87c78 admin admin] Pushing event updated for resources: {'Network': ['ID=a93e254e-aac9-4233-9e4d-4290fd0458e4,revision_number=1']} {{(pid=102993) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 23 19:25:45.687435 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.plugins.ml2.rpc [None req-eb87b2c3-3339-4249-8b85-e695b5b4e1f9 None None] Network a93e254e-aac9-4233-9e4d-4290fd0458e4 details requested by agent ovs-agent-dv-cinder-819011-1-iscsi with host dv-cinder-819011-1-iscsi {{(pid=102994) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Nov 23 19:25:45.732045 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [None req-ace09494-baee-40fc-9364-37b433c87c78 admin admin] 10.222.0.62 "POST /v2.0/networks HTTP/1.1" status: 201 len: 847 time: 1.0552299 Nov 23 19:25:46.489613 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron_lib.callbacks.manager [None req-785c1d26-11ba-42d8-b5a6-51a8b3daeef0 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8783631323329', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7978582'] for agent, after_update {{(pid=102994) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:25:47.312261 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron_lib.callbacks.manager [None req-eb87b2c3-3339-4249-8b85-e695b5b4e1f9 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8783631323329', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7978582'] for agent, after_update {{(pid=102994) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:25:48.175050 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.wsgi [-] (102993) accepted ('10.222.0.62', 39522) {{(pid=102993) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 23 19:25:48.390109 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-a0de84b0-ab3b-45c8-a9ce-26105266d71f admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=102993) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:25:48.391465 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [None req-a0de84b0-ab3b-45c8-a9ce-26105266d71f admin admin] 10.222.0.62 "GET /v2.0/subnets/d96c8e74-eccf-40d7-8588-0d6d07c85013 HTTP/1.1" status: 200 len: 849 time: 0.2154505 Nov 23 19:25:48.569282 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [None req-7ff4bb9f-8a35-4044-b42b-b6391f29c440 admin admin] 10.222.0.62 "GET /v2.0/routers/9ac8505b-79fe-4486-9f30-bae91a9edb90 HTTP/1.1" status: 200 len: 704 time: 0.1701367 Nov 23 19:25:48.842291 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-46c5d832-8f41-4287-b433-7672c742c869 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7921281'] for port, before_create {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:25:49.142060 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.db.db_base_plugin_common [None req-46c5d832-8f41-4287-b433-7672c742c869 admin admin] Allocated IP 172.20.0.1 (9af0bb9f-7449-41c2-abfb-77fb4d8d059e/d96c8e74-eccf-40d7-8588-0d6d07c85013/3ac6433f-1952-4367-aa14-02d21397951c) {{(pid=102993) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 23 19:25:49.327699 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-46c5d832-8f41-4287-b433-7672c742c869 admin admin] Publish callbacks [] for port, precommit_create {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:25:49.426959 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-46c5d832-8f41-4287-b433-7672c742c869 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7918660', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-15067', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560168', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8783631008714'] for port, after_create {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:25:49.505140 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-46c5d832-8f41-4287-b433-7672c742c869 admin admin] Network 9af0bb9f-7449-41c2-abfb-77fb4d8d059e is already hosted by enough agents. {{(pid=102993) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 23 19:25:49.514116 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.scheduler.base_scheduler [None req-46c5d832-8f41-4287-b433-7672c742c869 admin admin] Resources bound (agent type, host, resource id): {{(pid=102993) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 23 19:25:49.519776 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-46c5d832-8f41-4287-b433-7672c742c869 admin admin] Pushing event updated for resources: {'Port': ['ID=3ac6433f-1952-4367-aa14-02d21397951c,revision_number=1']} {{(pid=102993) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 23 19:25:49.531474 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.db.l3_dvrscheduler_db [None req-46c5d832-8f41-4287-b433-7672c742c869 admin admin] Received port after_create {{(pid=102993) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 23 19:25:49.531769 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-46c5d832-8f41-4287-b433-7672c742c869 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-926676'] for router_interface, before_create {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:25:49.753531 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.db.provisioning_blocks [None req-a411857c-3338-47af-af04-49681233c1f4 None None] Provisioning complete for port 3ac6433f-1952-4367-aa14-02d21397951c triggered by entity DHCP. {{(pid=102994) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 23 19:25:49.754079 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron_lib.callbacks.manager [None req-a411857c-3338-47af-af04-49681233c1f4 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-8355713'] for port, provisioning_complete {{(pid=102994) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:25:49.788528 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.plugins.ml2.plugin [None req-a411857c-3338-47af-af04-49681233c1f4 None None] Port 3ac6433f-1952-4367-aa14-02d21397951c cannot update to ACTIVE because it is not bound. {{(pid=102994) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 23 19:25:49.824613 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-46c5d832-8f41-4287-b433-7672c742c869 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7921281'] for port, before_update {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:25:50.013921 dv-cinder-819011-1-iscsi neutron-server[102995]: DEBUG neutron.db.agents_db [None req-84bdc9b2-57ea-4bdb-a245-07c78d37cea8 None None] Agent healthcheck: found 5 active agents {{(pid=102995) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 23 19:25:50.082664 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-46c5d832-8f41-4287-b433-7672c742c869 admin admin] Publish callbacks [] for port, precommit_update {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:25:50.146753 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-46c5d832-8f41-4287-b433-7672c742c869 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7918660', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-15067', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560168', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8783631423946', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8783631008732', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8783631008750'] for port, after_update {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:25:50.147531 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-46c5d832-8f41-4287-b433-7672c742c869 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-553426', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-932964'] for router_interface, after_create {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:25:50.207672 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-46c5d832-8f41-4287-b433-7672c742c869 admin admin] Pushing event updated for resources: {'Port': ['ID=3ac6433f-1952-4367-aa14-02d21397951c,revision_number=2']} {{(pid=102993) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 23 19:25:50.272921 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-46c5d832-8f41-4287-b433-7672c742c869 admin admin] Network 9af0bb9f-7449-41c2-abfb-77fb4d8d059e is already hosted by enough agents. {{(pid=102993) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 23 19:25:50.274211 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.scheduler.base_scheduler [None req-46c5d832-8f41-4287-b433-7672c742c869 admin admin] Resources bound (agent type, host, resource id): {{(pid=102993) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 23 19:25:50.489792 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-46c5d832-8f41-4287-b433-7672c742c869 admin admin] Router 9ac8505b-79fe-4486-9f30-bae91a9edb90 is scheduled to L3 agent 1b20f2c4-70b6-43c3-b9bd-0062cc9e57ac with binding_index 1 {{(pid=102993) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Nov 23 19:25:50.511009 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.db.provisioning_blocks [None req-691a0aff-aa12-43bd-929d-2fdee4749b1a None None] Provisioning complete for port 3ac6433f-1952-4367-aa14-02d21397951c triggered by entity DHCP. {{(pid=102994) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 23 19:25:50.511438 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron_lib.callbacks.manager [None req-691a0aff-aa12-43bd-929d-2fdee4749b1a None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-8355713'] for port, provisioning_complete {{(pid=102994) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:25:50.587450 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-46c5d832-8f41-4287-b433-7672c742c869 admin admin] Notify agent at l3_agent.dv-cinder-819011-1-iscsi the message routers_updated {{(pid=102993) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 23 19:25:50.593887 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [None req-46c5d832-8f41-4287-b433-7672c742c869 admin admin] 10.222.0.62 "PUT /v2.0/routers/9ac8505b-79fe-4486-9f30-bae91a9edb90/add_router_interface HTTP/1.1" status: 200 len: 508 time: 2.0191851 Nov 23 19:25:50.594338 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.plugins.ml2.plugin [None req-691a0aff-aa12-43bd-929d-2fdee4749b1a None None] Port 3ac6433f-1952-4367-aa14-02d21397951c cannot update to ACTIVE because it is not bound. {{(pid=102994) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 23 19:25:50.599009 dv-cinder-819011-1-iscsi neutron-server[102995]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-23474605-b16c-4459-87da-fa22a8e7be32 None None] Sync routers for ids ['9ac8505b-79fe-4486-9f30-bae91a9edb90'] in dv-cinder-819011-1-iscsi {{(pid=102995) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 23 19:25:50.611481 dv-cinder-819011-1-iscsi neutron-server[102995]: DEBUG neutron.db.l3_dvrscheduler_db [None req-23474605-b16c-4459-87da-fa22a8e7be32 None None] Routers {'9ac8505b-79fe-4486-9f30-bae91a9edb90'} bound to L3 agent in host dv-cinder-819011-1-iscsi {{(pid=102995) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 23 19:25:50.612354 dv-cinder-819011-1-iscsi neutron-server[102995]: DEBUG neutron.db.l3_hamode_db [None req-23474605-b16c-4459-87da-fa22a8e7be32 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-819011-1-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 0, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 0, "log_agent_heartbeats": false, "routers": 0},created_at=2021-11-23T19:25:14Z,description=,heartbeat_timestamp=2021-11-23T19:25:44Z,host='dv-cinder-819011-1-iscsi',id=1b20f2c4-70b6-43c3-b9bd-0062cc9e57ac,load=0,resource_versions=,resources_synced=,started_at=2021-11-23T19:25:15Z,topic='l3_agent')) {'router_ids': ['9ac8505b-79fe-4486-9f30-bae91a9edb90'], 'active': True} {{(pid=102995) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 23 19:25:50.805672 dv-cinder-819011-1-iscsi neutron-server[102995]: DEBUG neutron.db.l3_dvr_db [None req-23474605-b16c-4459-87da-fa22a8e7be32 None None] Set router 9ac8505b-79fe-4486-9f30-bae91a9edb90 gateway port host: None {{(pid=102995) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 23 19:25:51.245078 dv-cinder-819011-1-iscsi neutron-server[102995]: DEBUG neutron.db.l3_hamode_db [None req-23474605-b16c-4459-87da-fa22a8e7be32 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '9ac8505b-79fe-4486-9f30-bae91a9edb90', 'name': 'router1', 'tenant_id': 'febc4f33fba1433992fc8e043a47dd5c', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-23T19:25:39Z', 'updated_at': '2021-11-23T19:25:49Z', 'revision_number': 2, 'project_id': 'febc4f33fba1433992fc8e043a47dd5c', 'gw_port_host': None, '_interfaces': [{'id': '3ac6433f-1952-4367-aa14-02d21397951c', 'name': '', 'network_id': '9af0bb9f-7449-41c2-abfb-77fb4d8d059e', 'tenant_id': 'febc4f33fba1433992fc8e043a47dd5c', 'mac_address': 'fa:16:3e:07:7d:49', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '9ac8505b-79fe-4486-9f30-bae91a9edb90', 'device_owner': 'network:router_interface', 'standard_attr_id': 19, 'fixed_ips': [{'subnet_id': 'd96c8e74-eccf-40d7-8588-0d6d07c85013', 'ip_address': '172.20.0.1', 'prefixlen': 26}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-23T19:25:48Z', 'updated_at': '2021-11-23T19:25:49Z', 'revision_number': 2, 'project_id': 'febc4f33fba1433992fc8e043a47dd5c', 'subnets': [{'id': 'd96c8e74-eccf-40d7-8588-0d6d07c85013', 'cidr': '172.20.0.0/26', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': '6e3a70a1-07d7-4781-9446-b7052eb2106a'}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-819011-1-iscsi', False) {} {{(pid=102995) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 23 19:25:51.295941 dv-cinder-819011-1-iscsi neutron-server[102995]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-23474605-b16c-4459-87da-fa22a8e7be32 None None] Checking router: 9ac8505b-79fe-4486-9f30-bae91a9edb90 for host: dv-cinder-819011-1-iscsi {{(pid=102995) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 23 19:25:51.296321 dv-cinder-819011-1-iscsi neutron-server[102995]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-23474605-b16c-4459-87da-fa22a8e7be32 None None] Updating router 9ac8505b-79fe-4486-9f30-bae91a9edb90 port 3ac6433f-1952-4367-aa14-02d21397951c binding host dv-cinder-819011-1-iscsi {{(pid=102995) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Nov 23 19:25:51.345136 dv-cinder-819011-1-iscsi neutron-server[102995]: DEBUG neutron_lib.callbacks.manager [None req-23474605-b16c-4459-87da-fa22a8e7be32 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7921281'] for port, before_update {{(pid=102995) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:25:51.867830 dv-cinder-819011-1-iscsi neutron-server[102995]: DEBUG neutron_lib.callbacks.manager [None req-23474605-b16c-4459-87da-fa22a8e7be32 None None] Publish callbacks [] for port, precommit_update {{(pid=102995) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:25:51.923483 dv-cinder-819011-1-iscsi neutron-server[102995]: DEBUG neutron_lib.callbacks.manager [None req-23474605-b16c-4459-87da-fa22a8e7be32 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7918660', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-15067', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560168', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8783631423946', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8783631008732', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8783631008750'] for port, after_update {{(pid=102995) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:25:52.095582 dv-cinder-819011-1-iscsi neutron-server[102995]: DEBUG neutron.plugins.ml2.managers [None req-23474605-b16c-4459-87da-fa22a8e7be32 None None] Attempting to bind port 3ac6433f-1952-4367-aa14-02d21397951c on host dv-cinder-819011-1-iscsi for vnic_type normal with profile {{(pid=102995) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 23 19:25:52.096002 dv-cinder-819011-1-iscsi neutron-server[102995]: DEBUG neutron.plugins.ml2.managers [None req-23474605-b16c-4459-87da-fa22a8e7be32 None None] Attempting to bind port 3ac6433f-1952-4367-aa14-02d21397951c by drivers openvswitch,hyperv on host dv-cinder-819011-1-iscsi at level 0 using segments [{'id': 'fcd294cd-e58a-4ca0-987d-1fee2a47a5f4', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 820, 'network_id': '9af0bb9f-7449-41c2-abfb-77fb4d8d059e'}] {{(pid=102995) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 23 19:25:52.096462 dv-cinder-819011-1-iscsi neutron-server[102995]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-23474605-b16c-4459-87da-fa22a8e7be32 None None] Attempting to bind port 3ac6433f-1952-4367-aa14-02d21397951c on network 9af0bb9f-7449-41c2-abfb-77fb4d8d059e {{(pid=102995) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 23 19:25:52.101267 dv-cinder-819011-1-iscsi neutron-server[102995]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c2333ea0-81b7-4a89-9cb3-87e0553e7887 None None] Pushing event updated for resources: {'Port': ['ID=3ac6433f-1952-4367-aa14-02d21397951c,revision_number=3']} {{(pid=102995) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 23 19:25:52.104673 dv-cinder-819011-1-iscsi neutron-server[102995]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-23474605-b16c-4459-87da-fa22a8e7be32 None None] Checking agent: {'id': '668c8953-047c-499e-8c0d-db838fac1668', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-819011-1-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 23, 19, 25, 17), 'started_at': datetime.datetime(2021, 11, 23, 19, 25, 47), 'heartbeat_timestamp': datetime.datetime(2021, 11, 23, 19, 25, 47), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-819011-1-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=102995) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 23 19:25:52.105086 dv-cinder-819011-1-iscsi neutron-server[102995]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-23474605-b16c-4459-87da-fa22a8e7be32 None None] Checking segment: {'id': 'fcd294cd-e58a-4ca0-987d-1fee2a47a5f4', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 820, 'network_id': '9af0bb9f-7449-41c2-abfb-77fb4d8d059e'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102995) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 23 19:25:52.105599 dv-cinder-819011-1-iscsi neutron-server[102995]: DEBUG neutron_lib.callbacks.manager [None req-23474605-b16c-4459-87da-fa22a8e7be32 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=102995) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:25:52.106004 dv-cinder-819011-1-iscsi neutron-server[102995]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-23474605-b16c-4459-87da-fa22a8e7be32 None None] Bound using segment: {'id': 'fcd294cd-e58a-4ca0-987d-1fee2a47a5f4', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 820, 'network_id': '9af0bb9f-7449-41c2-abfb-77fb4d8d059e'} {{(pid=102995) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 23 19:25:52.106496 dv-cinder-819011-1-iscsi neutron-server[102995]: DEBUG neutron.plugins.ml2.managers [None req-23474605-b16c-4459-87da-fa22a8e7be32 None None] Bound port: 3ac6433f-1952-4367-aa14-02d21397951c, host: dv-cinder-819011-1-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'fcd294cd-e58a-4ca0-987d-1fee2a47a5f4', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 820, 'network_id': '9af0bb9f-7449-41c2-abfb-77fb4d8d059e'}}] {{(pid=102995) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 23 19:25:52.106915 dv-cinder-819011-1-iscsi neutron-server[102995]: DEBUG neutron_lib.callbacks.manager [None req-23474605-b16c-4459-87da-fa22a8e7be32 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7921281'] for port, before_update {{(pid=102995) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:25:52.121342 dv-cinder-819011-1-iscsi neutron-server[102995]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c2333ea0-81b7-4a89-9cb3-87e0553e7887 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-819011-1-iscsi {{(pid=102995) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 23 19:25:52.121746 dv-cinder-819011-1-iscsi neutron-server[102995]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c2333ea0-81b7-4a89-9cb3-87e0553e7887 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-819011-1-iscsi {{(pid=102995) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 23 19:25:52.121884 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.db.provisioning_blocks [None req-bf393221-32d0-4508-afe9-4e27bb27a3ec None None] Provisioning complete for port 3ac6433f-1952-4367-aa14-02d21397951c triggered by entity DHCP. {{(pid=102994) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 23 19:25:52.122349 dv-cinder-819011-1-iscsi neutron-server[102995]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c2333ea0-81b7-4a89-9cb3-87e0553e7887 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-819011-1-iscsi {{(pid=102995) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 23 19:25:52.122439 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron_lib.callbacks.manager [None req-bf393221-32d0-4508-afe9-4e27bb27a3ec None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-8355713'] for port, provisioning_complete {{(pid=102994) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:25:52.122513 dv-cinder-819011-1-iscsi neutron-server[102995]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c2333ea0-81b7-4a89-9cb3-87e0553e7887 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-819011-1-iscsi {{(pid=102995) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 23 19:25:52.122759 dv-cinder-819011-1-iscsi neutron-server[102995]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c2333ea0-81b7-4a89-9cb3-87e0553e7887 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-819011-1-iscsi {{(pid=102995) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 23 19:25:52.123102 dv-cinder-819011-1-iscsi neutron-server[102995]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c2333ea0-81b7-4a89-9cb3-87e0553e7887 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-819011-1-iscsi {{(pid=102995) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 23 19:25:52.123435 dv-cinder-819011-1-iscsi neutron-server[102995]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c2333ea0-81b7-4a89-9cb3-87e0553e7887 None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-819011-1-iscsi {{(pid=102995) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 23 19:25:52.123771 dv-cinder-819011-1-iscsi neutron-server[102995]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c2333ea0-81b7-4a89-9cb3-87e0553e7887 None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-819011-1-iscsi {{(pid=102995) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 23 19:25:52.124109 dv-cinder-819011-1-iscsi neutron-server[102995]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c2333ea0-81b7-4a89-9cb3-87e0553e7887 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-819011-1-iscsi {{(pid=102995) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 23 19:25:52.124439 dv-cinder-819011-1-iscsi neutron-server[102995]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c2333ea0-81b7-4a89-9cb3-87e0553e7887 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-819011-1-iscsi {{(pid=102995) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 23 19:25:52.124769 dv-cinder-819011-1-iscsi neutron-server[102995]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c2333ea0-81b7-4a89-9cb3-87e0553e7887 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-819011-1-iscsi {{(pid=102995) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 23 19:25:52.125098 dv-cinder-819011-1-iscsi neutron-server[102995]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c2333ea0-81b7-4a89-9cb3-87e0553e7887 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-819011-1-iscsi {{(pid=102995) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 23 19:25:52.126250 dv-cinder-819011-1-iscsi neutron-server[102995]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c2333ea0-81b7-4a89-9cb3-87e0553e7887 None None] Tracked resource versions report: Nov 23 19:25:52.126250 dv-cinder-819011-1-iscsi neutron-server[102995]: pushed versions: Nov 23 19:25:52.126250 dv-cinder-819011-1-iscsi neutron-server[102995]: { 'AddressGroup': {'1.2'}, Nov 23 19:25:52.126250 dv-cinder-819011-1-iscsi neutron-server[102995]: 'ConntrackHelper': {'1.0'}, Nov 23 19:25:52.126250 dv-cinder-819011-1-iscsi neutron-server[102995]: 'Log': {'1.0'}, Nov 23 19:25:52.126250 dv-cinder-819011-1-iscsi neutron-server[102995]: 'Network': {'1.1'}, Nov 23 19:25:52.126250 dv-cinder-819011-1-iscsi neutron-server[102995]: 'Port': {'1.7'}, Nov 23 19:25:52.126250 dv-cinder-819011-1-iscsi neutron-server[102995]: 'PortForwarding': {'1.2'}, Nov 23 19:25:52.126250 dv-cinder-819011-1-iscsi neutron-server[102995]: 'QosPolicy': {'1.10'}, Nov 23 19:25:52.126250 dv-cinder-819011-1-iscsi neutron-server[102995]: 'SecurityGroup': {'1.5'}, Nov 23 19:25:52.126250 dv-cinder-819011-1-iscsi neutron-server[102995]: 'SecurityGroupRule': {'1.2'}, Nov 23 19:25:52.126250 dv-cinder-819011-1-iscsi neutron-server[102995]: 'SubPort': {'1.0'}, Nov 23 19:25:52.126250 dv-cinder-819011-1-iscsi neutron-server[102995]: 'Subnet': {'1.1'}, Nov 23 19:25:52.126250 dv-cinder-819011-1-iscsi neutron-server[102995]: 'Trunk': {'1.1'}} Nov 23 19:25:52.126250 dv-cinder-819011-1-iscsi neutron-server[102995]: consumer versions: Nov 23 19:25:52.126250 dv-cinder-819011-1-iscsi neutron-server[102995]: { DHCP agent@dv-cinder-819011-1-iscsi: {}, Nov 23 19:25:52.126250 dv-cinder-819011-1-iscsi neutron-server[102995]: L3 agent@dv-cinder-819011-1-iscsi: {}, Nov 23 19:25:52.126250 dv-cinder-819011-1-iscsi neutron-server[102995]: Metadata agent@dv-cinder-819011-1-iscsi: {}, Nov 23 19:25:52.126250 dv-cinder-819011-1-iscsi neutron-server[102995]: Metering agent@dv-cinder-819011-1-iscsi: {}, Nov 23 19:25:52.126250 dv-cinder-819011-1-iscsi neutron-server[102995]: Open vSwitch agent@dv-cinder-819011-1-iscsi: { 'AddressGroup': '1.2', Nov 23 19:25:52.126250 dv-cinder-819011-1-iscsi neutron-server[102995]: 'ConntrackHelper': '1.0', Nov 23 19:25:52.126250 dv-cinder-819011-1-iscsi neutron-server[102995]: 'Log': '1.0', Nov 23 19:25:52.126250 dv-cinder-819011-1-iscsi neutron-server[102995]: 'Network': '1.1', Nov 23 19:25:52.126250 dv-cinder-819011-1-iscsi neutron-server[102995]: 'Port': '1.7', Nov 23 19:25:52.126250 dv-cinder-819011-1-iscsi neutron-server[102995]: 'PortForwarding': '1.2', Nov 23 19:25:52.126250 dv-cinder-819011-1-iscsi neutron-server[102995]: 'QosPolicy': '1.10', Nov 23 19:25:52.126250 dv-cinder-819011-1-iscsi neutron-server[102995]: 'SecurityGroup': '1.5', Nov 23 19:25:52.126250 dv-cinder-819011-1-iscsi neutron-server[102995]: 'SecurityGroupRule': '1.2', Nov 23 19:25:52.126250 dv-cinder-819011-1-iscsi neutron-server[102995]: 'SubPort': '1.0', Nov 23 19:25:52.126250 dv-cinder-819011-1-iscsi neutron-server[102995]: 'Subnet': '1.1', Nov 23 19:25:52.126250 dv-cinder-819011-1-iscsi neutron-server[102995]: 'Trunk': '1.1'}} Nov 23 19:25:52.126250 dv-cinder-819011-1-iscsi neutron-server[102995]: {{(pid=102995) report /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:175}} Nov 23 19:25:52.158123 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.plugins.ml2.plugin [None req-bf393221-32d0-4508-afe9-4e27bb27a3ec None None] Port 3ac6433f-1952-4367-aa14-02d21397951c cannot update to ACTIVE because it is not bound. {{(pid=102994) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 23 19:25:52.191428 dv-cinder-819011-1-iscsi neutron-server[102995]: DEBUG neutron.plugins.ml2.db [None req-23474605-b16c-4459-87da-fa22a8e7be32 None None] For port 3ac6433f-1952-4367-aa14-02d21397951c, host dv-cinder-819011-1-iscsi, cleared binding levels {{(pid=102995) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 23 19:25:52.211859 dv-cinder-819011-1-iscsi neutron-server[102995]: DEBUG neutron.plugins.ml2.db [None req-23474605-b16c-4459-87da-fa22a8e7be32 None None] For port 3ac6433f-1952-4367-aa14-02d21397951c, host dv-cinder-819011-1-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-819011-1-iscsi',level=0,port_id=3ac6433f-1952-4367-aa14-02d21397951c,segment=NetworkSegment(fcd294cd-e58a-4ca0-987d-1fee2a47a5f4),segment_id=fcd294cd-e58a-4ca0-987d-1fee2a47a5f4)] {{(pid=102995) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 23 19:25:52.255346 dv-cinder-819011-1-iscsi neutron-server[102995]: DEBUG neutron_lib.callbacks.manager [None req-23474605-b16c-4459-87da-fa22a8e7be32 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7918660', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-15067', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560168', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8783631423946', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8783631008732', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8783631008750'] for port, after_update {{(pid=102995) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:25:52.313171 dv-cinder-819011-1-iscsi neutron-server[102995]: DEBUG neutron.db.l3_dvrscheduler_db [None req-23474605-b16c-4459-87da-fa22a8e7be32 None None] Routers {'9ac8505b-79fe-4486-9f30-bae91a9edb90'} bound to L3 agent in host dv-cinder-819011-1-iscsi {{(pid=102995) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 23 19:25:52.313823 dv-cinder-819011-1-iscsi neutron-server[102995]: DEBUG neutron.db.l3_hamode_db [None req-23474605-b16c-4459-87da-fa22a8e7be32 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-819011-1-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 0, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 0, "log_agent_heartbeats": false, "routers": 0},created_at=2021-11-23T19:25:14Z,description=,heartbeat_timestamp=2021-11-23T19:25:44Z,host='dv-cinder-819011-1-iscsi',id=1b20f2c4-70b6-43c3-b9bd-0062cc9e57ac,load=0,resource_versions=,resources_synced=,started_at=2021-11-23T19:25:15Z,topic='l3_agent')) {'router_ids': ['9ac8505b-79fe-4486-9f30-bae91a9edb90'], 'active': True} {{(pid=102995) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 23 19:25:52.352034 dv-cinder-819011-1-iscsi neutron-server[102995]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c2333ea0-81b7-4a89-9cb3-87e0553e7887 None None] Pushing event updated for resources: {'Port': ['ID=3ac6433f-1952-4367-aa14-02d21397951c,revision_number=4']} {{(pid=102995) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 23 19:25:52.406430 dv-cinder-819011-1-iscsi neutron-server[102995]: DEBUG neutron.db.l3_dvr_db [None req-23474605-b16c-4459-87da-fa22a8e7be32 None None] Set router 9ac8505b-79fe-4486-9f30-bae91a9edb90 gateway port host: None {{(pid=102995) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 23 19:25:52.477378 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.db.provisioning_blocks [None req-0905481f-370d-479c-87e5-55f8158e5f89 None None] Provisioning complete for port 3ac6433f-1952-4367-aa14-02d21397951c triggered by entity DHCP. {{(pid=102994) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 23 19:25:52.477864 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron_lib.callbacks.manager [None req-0905481f-370d-479c-87e5-55f8158e5f89 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-8355713'] for port, provisioning_complete {{(pid=102994) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:25:52.559238 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron_lib.callbacks.manager [None req-0905481f-370d-479c-87e5-55f8158e5f89 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7921281'] for port, before_update {{(pid=102994) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:25:52.591606 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.plugins.ml2.db [None req-0905481f-370d-479c-87e5-55f8158e5f89 None None] For port 3ac6433f-1952-4367-aa14-02d21397951c, host dv-cinder-819011-1-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-819011-1-iscsi',level=0,port_id=3ac6433f-1952-4367-aa14-02d21397951c,segment=NetworkSegment(fcd294cd-e58a-4ca0-987d-1fee2a47a5f4),segment_id=fcd294cd-e58a-4ca0-987d-1fee2a47a5f4)] {{(pid=102994) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 23 19:25:52.625908 dv-cinder-819011-1-iscsi neutron-server[102995]: DEBUG neutron.db.l3_hamode_db [None req-23474605-b16c-4459-87da-fa22a8e7be32 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '9ac8505b-79fe-4486-9f30-bae91a9edb90', 'name': 'router1', 'tenant_id': 'febc4f33fba1433992fc8e043a47dd5c', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-23T19:25:39Z', 'updated_at': '2021-11-23T19:25:49Z', 'revision_number': 2, 'project_id': 'febc4f33fba1433992fc8e043a47dd5c', 'gw_port_host': None, '_interfaces': [{'id': '3ac6433f-1952-4367-aa14-02d21397951c', 'name': '', 'network_id': '9af0bb9f-7449-41c2-abfb-77fb4d8d059e', 'tenant_id': 'febc4f33fba1433992fc8e043a47dd5c', 'mac_address': 'fa:16:3e:07:7d:49', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '9ac8505b-79fe-4486-9f30-bae91a9edb90', 'device_owner': 'network:router_interface', 'standard_attr_id': 19, 'fixed_ips': [{'subnet_id': 'd96c8e74-eccf-40d7-8588-0d6d07c85013', 'ip_address': '172.20.0.1', 'prefixlen': 26}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-819011-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-23T19:25:48Z', 'updated_at': '2021-11-23T19:25:52Z', 'revision_number': 4, 'project_id': 'febc4f33fba1433992fc8e043a47dd5c', 'subnets': [{'id': 'd96c8e74-eccf-40d7-8588-0d6d07c85013', 'cidr': '172.20.0.0/26', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': '6e3a70a1-07d7-4781-9446-b7052eb2106a'}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-819011-1-iscsi', False) {} {{(pid=102995) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 23 19:25:52.651343 dv-cinder-819011-1-iscsi neutron-server[102995]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-23474605-b16c-4459-87da-fa22a8e7be32 None None] The sync data for ids ['9ac8505b-79fe-4486-9f30-bae91a9edb90'] in dv-cinder-819011-1-iscsi is: [{'id': '9ac8505b-79fe-4486-9f30-bae91a9edb90', 'name': 'router1', 'tenant_id': 'febc4f33fba1433992fc8e043a47dd5c', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-23T19:25:39Z', 'updated_at': '2021-11-23T19:25:49Z', 'revision_number': 2, 'project_id': 'febc4f33fba1433992fc8e043a47dd5c', 'gw_port_host': None, '_interfaces': [{'id': '3ac6433f-1952-4367-aa14-02d21397951c', 'name': '', 'network_id': '9af0bb9f-7449-41c2-abfb-77fb4d8d059e', 'tenant_id': 'febc4f33fba1433992fc8e043a47dd5c', 'mac_address': 'fa:16:3e:07:7d:49', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '9ac8505b-79fe-4486-9f30-bae91a9edb90', 'device_owner': 'network:router_interface', 'standard_attr_id': 19, 'fixed_ips': [{'subnet_id': 'd96c8e74-eccf-40d7-8588-0d6d07c85013', 'ip_address': '172.20.0.1', 'prefixlen': 26}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-819011-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-23T19:25:48Z', 'updated_at': '2021-11-23T19:25:52Z', 'revision_number': 4, 'project_id': 'febc4f33fba1433992fc8e043a47dd5c', 'subnets': [{'id': 'd96c8e74-eccf-40d7-8588-0d6d07c85013', 'cidr': '172.20.0.0/26', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': '6e3a70a1-07d7-4781-9446-b7052eb2106a'}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=102995) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 23 19:25:52.655508 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron_lib.callbacks.manager [None req-0905481f-370d-479c-87e5-55f8158e5f89 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7918660', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-15067', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560168', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8783631423946', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8783631008732', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8783631008750'] for port, after_update {{(pid=102994) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:25:52.708089 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0905481f-370d-479c-87e5-55f8158e5f89 None None] Pushing event updated for resources: {'Port': ['ID=3ac6433f-1952-4367-aa14-02d21397951c,revision_number=5']} {{(pid=102994) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 23 19:25:52.946931 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.wsgi [-] (102993) accepted ('10.222.0.62', 39544) {{(pid=102993) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 23 19:25:53.057737 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-4ed721a1-b1ba-4d1f-8a29-982dbaa9e754 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102993) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:25:53.059136 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [None req-4ed721a1-b1ba-4d1f-8a29-982dbaa9e754 admin admin] 10.222.0.62 "GET /v2.0/networks/a93e254e-aac9-4233-9e4d-4290fd0458e4 HTTP/1.1" status: 200 len: 842 time: 0.1112478 Nov 23 19:25:53.069206 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.api.v2.base [None req-2fcc4476-dd46-4b9b-b3f1-a9aab94c1bd7 admin admin] Request body: {'subnet': {'network_id': 'a93e254e-aac9-4233-9e4d-4290fd0458e4', 'gateway_ip': '172.27.1.1', 'cidr': '172.27.1.0/24', 'ip_version': 4, 'name': 'public-subnet', 'enable_dhcp': False}} {{(pid=102993) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 23 19:25:53.181023 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-2fcc4476-dd46-4b9b-b3f1-a9aab94c1bd7 admin admin] Made reservation on behalf of bbbece3b7f8c49dc96e2d01b1a42f43c for: {'subnet': 1} {{(pid=102993) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 23 19:25:53.183329 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-2fcc4476-dd46-4b9b-b3f1-a9aab94c1bd7 admin admin] Publish callbacks [] for subnet, before_create {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:25:53.566808 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.objects.ports [None req-2fcc4476-dd46-4b9b-b3f1-a9aab94c1bd7 admin admin] Time-cost: Fetching 0 ports in 0 security groups {{(pid=102993) get_objects /opt/stack/neutron/neutron/objects/ports.py:462}} Nov 23 19:25:53.567254 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-2fcc4476-dd46-4b9b-b3f1-a9aab94c1bd7 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-554858', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560168'] for subnet, after_create {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:25:53.621644 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2fcc4476-dd46-4b9b-b3f1-a9aab94c1bd7 admin admin] Pushing event updated for resources: {'Subnet': ['ID=e0b32f3d-83d6-439a-bbed-01df7cf01051,revision_number=0']} {{(pid=102993) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 23 19:25:53.632487 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-2fcc4476-dd46-4b9b-b3f1-a9aab94c1bd7 admin admin] Checking segment: {'id': '3cb5e60b-103a-47d0-a28b-d68e3159d032', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'a93e254e-aac9-4233-9e4d-4290fd0458e4'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102993) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 23 19:25:53.632839 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-2fcc4476-dd46-4b9b-b3f1-a9aab94c1bd7 admin admin] Network hostable DHCP agents. Network: a93e254e-aac9-4233-9e4d-4290fd0458e4, hostable agents: ['e51c95c7-6a36-4263-ba47-1839054f3e7a'], hosted agents: [] {{(pid=102993) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 23 19:25:53.729841 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-2fcc4476-dd46-4b9b-b3f1-a9aab94c1bd7 admin admin] Network a93e254e-aac9-4233-9e4d-4290fd0458e4 is scheduled to be hosted by DHCP agent e51c95c7-6a36-4263-ba47-1839054f3e7a with binding_index 1 {{(pid=102993) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 23 19:25:53.804557 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.scheduler.base_scheduler [None req-2fcc4476-dd46-4b9b-b3f1-a9aab94c1bd7 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-819011-1-iscsi, a93e254e-aac9-4233-9e4d-4290fd0458e4) {{(pid=102993) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 23 19:25:53.808829 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-2fcc4476-dd46-4b9b-b3f1-a9aab94c1bd7 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'network'] {{(pid=102993) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:25:53.809478 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-2fcc4476-dd46-4b9b-b3f1-a9aab94c1bd7 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-560186'] for subnet, before_response {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:25:53.818068 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-9019f81d-87a9-43d1-a908-15a4eba9d5fa None None] Network a93e254e-aac9-4233-9e4d-4290fd0458e4 requested from dv-cinder-819011-1-iscsi {{(pid=102994) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 23 19:25:53.899941 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [None req-2fcc4476-dd46-4b9b-b3f1-a9aab94c1bd7 admin admin] 10.222.0.62 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 821 time: 0.8228378 Nov 23 19:25:53.953717 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-46bc37e7-4e6d-4562-aaab-46c343830e78 None None] Network a93e254e-aac9-4233-9e4d-4290fd0458e4 requested from dv-cinder-819011-1-iscsi {{(pid=102994) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 23 19:25:56.292374 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.wsgi [-] (102993) accepted ('10.222.0.62', 39552) {{(pid=102993) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 23 19:25:56.442590 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [None req-3c3cc2e9-850f-42b7-86cd-23e9a37781ec admin admin] 10.222.0.62 "GET /v2.0/routers/9ac8505b-79fe-4486-9f30-bae91a9edb90 HTTP/1.1" status: 200 len: 710 time: 0.1490583 Nov 23 19:25:56.545025 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-91d90620-f0c2-48a4-a471-1b2cf444af53 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102993) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:25:56.546366 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [None req-91d90620-f0c2-48a4-a471-1b2cf444af53 admin admin] 10.222.0.62 "GET /v2.0/networks/a93e254e-aac9-4233-9e4d-4290fd0458e4 HTTP/1.1" status: 200 len: 886 time: 0.0976734 Nov 23 19:25:56.556742 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.api.v2.base [None req-ee7f2242-e838-4572-a608-42694adeb94c admin admin] Request body: {'router': {'external_gateway_info': {'network_id': 'a93e254e-aac9-4233-9e4d-4290fd0458e4'}}} {{(pid=102993) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 23 19:25:56.886301 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-ee7f2242-e838-4572-a608-42694adeb94c admin admin] Publish callbacks [] for router_gateway, precommit_update {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:25:57.199128 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-ee7f2242-e838-4572-a608-42694adeb94c admin admin] Publish callbacks [] for router_gateway, before_create {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:25:57.280504 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-ee7f2242-e838-4572-a608-42694adeb94c admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7921281'] for port, before_create {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:25:57.385151 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.db.db_base_plugin_common [None req-ee7f2242-e838-4572-a608-42694adeb94c admin admin] Allocated IP 172.27.1.131 (a93e254e-aac9-4233-9e4d-4290fd0458e4/e0b32f3d-83d6-439a-bbed-01df7cf01051/6e82a030-9ee9-478c-9708-d03948f485cc) {{(pid=102993) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 23 19:25:57.487488 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-ee7f2242-e838-4572-a608-42694adeb94c admin admin] Publish callbacks [] for port, precommit_create {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:25:57.604152 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-ee7f2242-e838-4572-a608-42694adeb94c admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7918660', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-15067', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560168', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8783631008714'] for port, after_create {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:25:57.644238 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-ee7f2242-e838-4572-a608-42694adeb94c admin admin] Network a93e254e-aac9-4233-9e4d-4290fd0458e4 is already hosted by enough agents. {{(pid=102993) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 23 19:25:57.646964 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.scheduler.base_scheduler [None req-ee7f2242-e838-4572-a608-42694adeb94c admin admin] Resources bound (agent type, host, resource id): {{(pid=102993) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 23 19:25:57.650474 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.db.l3_dvrscheduler_db [None req-ee7f2242-e838-4572-a608-42694adeb94c admin admin] Received port after_create {{(pid=102993) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 23 19:25:57.655777 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ee7f2242-e838-4572-a608-42694adeb94c admin admin] Pushing event updated for resources: {'Port': ['ID=6e82a030-9ee9-478c-9708-d03948f485cc,revision_number=1']} {{(pid=102993) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 23 19:25:58.002188 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-ee7f2242-e838-4572-a608-42694adeb94c admin admin] Publish callbacks [] for router_gateway, after_create {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:25:58.213597 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-ee7f2242-e838-4572-a608-42694adeb94c admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._handle_distributed_migration-926526', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._validate_migration-932882', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._update_router_provider-13466'] for router, precommit_update {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:25:58.217229 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-ee7f2242-e838-4572-a608-42694adeb94c admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-926501', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_distributed_port_bindings_after_change-926519', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_snat_interfaces_after_change-926508', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._reconfigure_ha_resources-932901'] for router, after_update {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:25:58.326971 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-ee7f2242-e838-4572-a608-42694adeb94c admin admin] Router 9ac8505b-79fe-4486-9f30-bae91a9edb90 has already been hosted by L3 agent 1b20f2c4-70b6-43c3-b9bd-0062cc9e57ac {{(pid=102993) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 23 19:25:58.526805 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-ee7f2242-e838-4572-a608-42694adeb94c admin admin] Notify agent at l3_agent.dv-cinder-819011-1-iscsi the message routers_updated {{(pid=102993) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 23 19:25:58.531054 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-ee7f2242-e838-4572-a608-42694adeb94c admin admin] Publish callbacks [] for router, before_response {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:25:58.532258 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [None req-ee7f2242-e838-4572-a608-42694adeb94c admin admin] 10.222.0.62 "PUT /v2.0/routers/9ac8505b-79fe-4486-9f30-bae91a9edb90 HTTP/1.1" status: 200 len: 890 time: 1.9795661 Nov 23 19:25:59.180850 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.plugins.ml2.rpc [None req-eb87b2c3-3339-4249-8b85-e695b5b4e1f9 None None] Device 3ac6433f-1952-4367-aa14-02d21397951c up at agent ovs-agent-dv-cinder-819011-1-iscsi {{(pid=102994) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 23 19:25:59.231384 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.db.provisioning_blocks [None req-eb87b2c3-3339-4249-8b85-e695b5b4e1f9 None None] Provisioning complete for port 3ac6433f-1952-4367-aa14-02d21397951c triggered by entity L2. {{(pid=102994) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 23 19:25:59.231840 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron_lib.callbacks.manager [None req-eb87b2c3-3339-4249-8b85-e695b5b4e1f9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-8355713'] for port, provisioning_complete {{(pid=102994) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:25:59.738665 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-d4ac8da0-d9f3-4e4d-bc8f-da8c9ffd19f8 None None] Sync routers for ids ['9ac8505b-79fe-4486-9f30-bae91a9edb90'] in dv-cinder-819011-1-iscsi {{(pid=102994) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 23 19:25:59.750162 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.db.l3_dvrscheduler_db [None req-d4ac8da0-d9f3-4e4d-bc8f-da8c9ffd19f8 None None] Routers {'9ac8505b-79fe-4486-9f30-bae91a9edb90'} bound to L3 agent in host dv-cinder-819011-1-iscsi {{(pid=102994) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 23 19:25:59.750820 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.db.l3_hamode_db [None req-d4ac8da0-d9f3-4e4d-bc8f-da8c9ffd19f8 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-819011-1-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 0, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 0, "log_agent_heartbeats": false, "routers": 0},created_at=2021-11-23T19:25:14Z,description=,heartbeat_timestamp=2021-11-23T19:25:44Z,host='dv-cinder-819011-1-iscsi',id=1b20f2c4-70b6-43c3-b9bd-0062cc9e57ac,load=0,resource_versions=,resources_synced=,started_at=2021-11-23T19:25:15Z,topic='l3_agent')) {'router_ids': ['9ac8505b-79fe-4486-9f30-bae91a9edb90'], 'active': True} {{(pid=102994) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 23 19:25:59.968590 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.db.l3_dvr_db [None req-d4ac8da0-d9f3-4e4d-bc8f-da8c9ffd19f8 None None] Set router 9ac8505b-79fe-4486-9f30-bae91a9edb90 gateway port host: dv-cinder-819011-1-iscsi {{(pid=102994) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 23 19:26:00.369452 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.db.l3_hamode_db [None req-d4ac8da0-d9f3-4e4d-bc8f-da8c9ffd19f8 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '9ac8505b-79fe-4486-9f30-bae91a9edb90', 'name': 'router1', 'tenant_id': 'febc4f33fba1433992fc8e043a47dd5c', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'a93e254e-aac9-4233-9e4d-4290fd0458e4', 'external_fixed_ips': [{'subnet_id': 'e0b32f3d-83d6-439a-bbed-01df7cf01051', 'ip_address': '172.27.1.131'}], 'enable_snat': True}, 'gw_port_id': '6e82a030-9ee9-478c-9708-d03948f485cc', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-23T19:25:39Z', 'updated_at': '2021-11-23T19:25:57Z', 'revision_number': 4, 'project_id': 'febc4f33fba1433992fc8e043a47dd5c', 'gw_port': {'id': '6e82a030-9ee9-478c-9708-d03948f485cc', 'name': '', 'network_id': 'a93e254e-aac9-4233-9e4d-4290fd0458e4', 'tenant_id': '', 'mac_address': 'fa:16:3e:c9:34:ca', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '9ac8505b-79fe-4486-9f30-bae91a9edb90', 'device_owner': 'network:router_gateway', 'standard_attr_id': 21, 'fixed_ips': [{'subnet_id': 'e0b32f3d-83d6-439a-bbed-01df7cf01051', 'ip_address': '172.27.1.131', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-23T19:25:57Z', 'updated_at': '2021-11-23T19:25:57Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': 'e0b32f3d-83d6-439a-bbed-01df7cf01051', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-819011-1-iscsi', '_interfaces': [{'id': '3ac6433f-1952-4367-aa14-02d21397951c', 'name': '', 'network_id': '9af0bb9f-7449-41c2-abfb-77fb4d8d059e', 'tenant_id': 'febc4f33fba1433992fc8e043a47dd5c', 'mac_address': 'fa:16:3e:07:7d:49', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '9ac8505b-79fe-4486-9f30-bae91a9edb90', 'device_owner': 'network:router_interface', 'standard_attr_id': 19, 'fixed_ips': [{'subnet_id': 'd96c8e74-eccf-40d7-8588-0d6d07c85013', 'ip_address': '172.20.0.1', 'prefixlen': 26}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-819011-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-23T19:25:48Z', 'updated_at': '2021-11-23T19:25:52Z', 'revision_number': 5, 'project_id': 'febc4f33fba1433992fc8e043a47dd5c', 'subnets': [{'id': 'd96c8e74-eccf-40d7-8588-0d6d07c85013', 'cidr': '172.20.0.0/26', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': '6e3a70a1-07d7-4781-9446-b7052eb2106a'}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-819011-1-iscsi', False) {} {{(pid=102994) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 23 19:26:00.489017 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-d4ac8da0-d9f3-4e4d-bc8f-da8c9ffd19f8 None None] Checking router: 9ac8505b-79fe-4486-9f30-bae91a9edb90 for host: dv-cinder-819011-1-iscsi {{(pid=102994) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 23 19:26:00.489376 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-d4ac8da0-d9f3-4e4d-bc8f-da8c9ffd19f8 None None] Updating router 9ac8505b-79fe-4486-9f30-bae91a9edb90 port 6e82a030-9ee9-478c-9708-d03948f485cc binding host dv-cinder-819011-1-iscsi {{(pid=102994) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Nov 23 19:26:00.537492 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron_lib.callbacks.manager [None req-d4ac8da0-d9f3-4e4d-bc8f-da8c9ffd19f8 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7921281'] for port, before_update {{(pid=102994) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:26:00.888301 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron_lib.callbacks.manager [None req-d4ac8da0-d9f3-4e4d-bc8f-da8c9ffd19f8 None None] Publish callbacks [] for port, precommit_update {{(pid=102994) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:26:00.952142 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron_lib.callbacks.manager [None req-d4ac8da0-d9f3-4e4d-bc8f-da8c9ffd19f8 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7918660', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-15067', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560168', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8783631423946', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8783631008732', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8783631008750'] for port, after_update {{(pid=102994) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:26:01.002093 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.plugins.ml2.managers [None req-d4ac8da0-d9f3-4e4d-bc8f-da8c9ffd19f8 None None] Attempting to bind port 6e82a030-9ee9-478c-9708-d03948f485cc on host dv-cinder-819011-1-iscsi for vnic_type normal with profile {{(pid=102994) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 23 19:26:01.002496 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.plugins.ml2.managers [None req-d4ac8da0-d9f3-4e4d-bc8f-da8c9ffd19f8 None None] Attempting to bind port 6e82a030-9ee9-478c-9708-d03948f485cc by drivers openvswitch,hyperv on host dv-cinder-819011-1-iscsi at level 0 using segments [{'id': '3cb5e60b-103a-47d0-a28b-d68e3159d032', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'a93e254e-aac9-4233-9e4d-4290fd0458e4'}] {{(pid=102994) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 23 19:26:01.002874 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-d4ac8da0-d9f3-4e4d-bc8f-da8c9ffd19f8 None None] Attempting to bind port 6e82a030-9ee9-478c-9708-d03948f485cc on network a93e254e-aac9-4233-9e4d-4290fd0458e4 {{(pid=102994) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 23 19:26:01.009975 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-51961a14-05de-4a9a-8d46-1f09ece1634b None None] Pushing event updated for resources: {'Port': ['ID=6e82a030-9ee9-478c-9708-d03948f485cc,revision_number=2']} {{(pid=102994) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 23 19:26:01.012587 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-d4ac8da0-d9f3-4e4d-bc8f-da8c9ffd19f8 None None] Checking agent: {'id': '668c8953-047c-499e-8c0d-db838fac1668', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-819011-1-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 23, 19, 25, 17), 'started_at': datetime.datetime(2021, 11, 23, 19, 25, 47), 'heartbeat_timestamp': datetime.datetime(2021, 11, 23, 19, 25, 47), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-819011-1-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=102994) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 23 19:26:01.012766 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-d4ac8da0-d9f3-4e4d-bc8f-da8c9ffd19f8 None None] Checking segment: {'id': '3cb5e60b-103a-47d0-a28b-d68e3159d032', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'a93e254e-aac9-4233-9e4d-4290fd0458e4'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102994) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 23 19:26:01.013175 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron_lib.callbacks.manager [None req-d4ac8da0-d9f3-4e4d-bc8f-da8c9ffd19f8 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=102994) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:26:01.013591 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-d4ac8da0-d9f3-4e4d-bc8f-da8c9ffd19f8 None None] Bound using segment: {'id': '3cb5e60b-103a-47d0-a28b-d68e3159d032', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'a93e254e-aac9-4233-9e4d-4290fd0458e4'} {{(pid=102994) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 23 19:26:01.014071 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.plugins.ml2.managers [None req-d4ac8da0-d9f3-4e4d-bc8f-da8c9ffd19f8 None None] Bound port: 6e82a030-9ee9-478c-9708-d03948f485cc, host: dv-cinder-819011-1-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '3cb5e60b-103a-47d0-a28b-d68e3159d032', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'a93e254e-aac9-4233-9e4d-4290fd0458e4'}}] {{(pid=102994) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 23 19:26:01.014475 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron_lib.callbacks.manager [None req-d4ac8da0-d9f3-4e4d-bc8f-da8c9ffd19f8 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7921281'] for port, before_update {{(pid=102994) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:26:01.037926 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.wsgi [-] (102992) accepted ('10.222.0.62', 39564) {{(pid=102992) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 23 19:26:01.065729 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.plugins.ml2.db [None req-d4ac8da0-d9f3-4e4d-bc8f-da8c9ffd19f8 None None] For port 6e82a030-9ee9-478c-9708-d03948f485cc, host dv-cinder-819011-1-iscsi, cleared binding levels {{(pid=102994) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 23 19:26:01.068824 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.plugins.ml2.db [None req-d4ac8da0-d9f3-4e4d-bc8f-da8c9ffd19f8 None None] For port 6e82a030-9ee9-478c-9708-d03948f485cc, host dv-cinder-819011-1-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-819011-1-iscsi',level=0,port_id=6e82a030-9ee9-478c-9708-d03948f485cc,segment=NetworkSegment(3cb5e60b-103a-47d0-a28b-d68e3159d032),segment_id=3cb5e60b-103a-47d0-a28b-d68e3159d032)] {{(pid=102994) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 23 19:26:01.158410 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron_lib.callbacks.manager [None req-d4ac8da0-d9f3-4e4d-bc8f-da8c9ffd19f8 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7918660', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-15067', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560168', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8783631423946', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8783631008732', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8783631008750'] for port, after_update {{(pid=102994) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:26:01.159570 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [None req-d8be14a9-a34c-4bfa-97a6-5e86a30ecb20 admin admin] 10.222.0.62 "GET /v2.0/ports?device_owner=network%3Arouter_gateway&fields=id&fields=name&fields=mac_address&fields=fixed_ips&fields=status HTTP/1.1" status: 200 len: 411 time: 0.1205463 Nov 23 19:26:01.226429 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.db.l3_dvrscheduler_db [None req-d4ac8da0-d9f3-4e4d-bc8f-da8c9ffd19f8 None None] Routers {'9ac8505b-79fe-4486-9f30-bae91a9edb90'} bound to L3 agent in host dv-cinder-819011-1-iscsi {{(pid=102994) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 23 19:26:01.227088 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.db.l3_hamode_db [None req-d4ac8da0-d9f3-4e4d-bc8f-da8c9ffd19f8 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-819011-1-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 0, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 0, "log_agent_heartbeats": false, "routers": 0},created_at=2021-11-23T19:25:14Z,description=,heartbeat_timestamp=2021-11-23T19:25:44Z,host='dv-cinder-819011-1-iscsi',id=1b20f2c4-70b6-43c3-b9bd-0062cc9e57ac,load=0,resource_versions=,resources_synced=,started_at=2021-11-23T19:25:15Z,topic='l3_agent')) {'router_ids': ['9ac8505b-79fe-4486-9f30-bae91a9edb90'], 'active': True} {{(pid=102994) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 23 19:26:01.230579 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-51961a14-05de-4a9a-8d46-1f09ece1634b None None] Pushing event updated for resources: {'Port': ['ID=6e82a030-9ee9-478c-9708-d03948f485cc,revision_number=3']} {{(pid=102994) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 23 19:26:01.340918 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.db.l3_dvr_db [None req-d4ac8da0-d9f3-4e4d-bc8f-da8c9ffd19f8 None None] Set router 9ac8505b-79fe-4486-9f30-bae91a9edb90 gateway port host: dv-cinder-819011-1-iscsi {{(pid=102994) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 23 19:26:01.553246 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.db.l3_hamode_db [None req-d4ac8da0-d9f3-4e4d-bc8f-da8c9ffd19f8 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '9ac8505b-79fe-4486-9f30-bae91a9edb90', 'name': 'router1', 'tenant_id': 'febc4f33fba1433992fc8e043a47dd5c', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'a93e254e-aac9-4233-9e4d-4290fd0458e4', 'external_fixed_ips': [{'subnet_id': 'e0b32f3d-83d6-439a-bbed-01df7cf01051', 'ip_address': '172.27.1.131'}], 'enable_snat': True}, 'gw_port_id': '6e82a030-9ee9-478c-9708-d03948f485cc', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-23T19:25:39Z', 'updated_at': '2021-11-23T19:25:57Z', 'revision_number': 4, 'project_id': 'febc4f33fba1433992fc8e043a47dd5c', 'gw_port': {'id': '6e82a030-9ee9-478c-9708-d03948f485cc', 'name': '', 'network_id': 'a93e254e-aac9-4233-9e4d-4290fd0458e4', 'tenant_id': '', 'mac_address': 'fa:16:3e:c9:34:ca', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '9ac8505b-79fe-4486-9f30-bae91a9edb90', 'device_owner': 'network:router_gateway', 'standard_attr_id': 21, 'fixed_ips': [{'subnet_id': 'e0b32f3d-83d6-439a-bbed-01df7cf01051', 'ip_address': '172.27.1.131', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-819011-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-23T19:25:57Z', 'updated_at': '2021-11-23T19:26:01Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'e0b32f3d-83d6-439a-bbed-01df7cf01051', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-819011-1-iscsi', '_interfaces': [{'id': '3ac6433f-1952-4367-aa14-02d21397951c', 'name': '', 'network_id': '9af0bb9f-7449-41c2-abfb-77fb4d8d059e', 'tenant_id': 'febc4f33fba1433992fc8e043a47dd5c', 'mac_address': 'fa:16:3e:07:7d:49', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '9ac8505b-79fe-4486-9f30-bae91a9edb90', 'device_owner': 'network:router_interface', 'standard_attr_id': 19, 'fixed_ips': [{'subnet_id': 'd96c8e74-eccf-40d7-8588-0d6d07c85013', 'ip_address': '172.20.0.1', 'prefixlen': 26}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-819011-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-23T19:25:48Z', 'updated_at': '2021-11-23T19:25:52Z', 'revision_number': 5, 'project_id': 'febc4f33fba1433992fc8e043a47dd5c', 'subnets': [{'id': 'd96c8e74-eccf-40d7-8588-0d6d07c85013', 'cidr': '172.20.0.0/26', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': '6e3a70a1-07d7-4781-9446-b7052eb2106a'}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-819011-1-iscsi', False) {} {{(pid=102994) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 23 19:26:01.579756 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-d4ac8da0-d9f3-4e4d-bc8f-da8c9ffd19f8 None None] The sync data for ids ['9ac8505b-79fe-4486-9f30-bae91a9edb90'] in dv-cinder-819011-1-iscsi is: [{'id': '9ac8505b-79fe-4486-9f30-bae91a9edb90', 'name': 'router1', 'tenant_id': 'febc4f33fba1433992fc8e043a47dd5c', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'a93e254e-aac9-4233-9e4d-4290fd0458e4', 'external_fixed_ips': [{'subnet_id': 'e0b32f3d-83d6-439a-bbed-01df7cf01051', 'ip_address': '172.27.1.131'}], 'enable_snat': True}, 'gw_port_id': '6e82a030-9ee9-478c-9708-d03948f485cc', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-23T19:25:39Z', 'updated_at': '2021-11-23T19:25:57Z', 'revision_number': 4, 'project_id': 'febc4f33fba1433992fc8e043a47dd5c', 'gw_port': {'id': '6e82a030-9ee9-478c-9708-d03948f485cc', 'name': '', 'network_id': 'a93e254e-aac9-4233-9e4d-4290fd0458e4', 'tenant_id': '', 'mac_address': 'fa:16:3e:c9:34:ca', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '9ac8505b-79fe-4486-9f30-bae91a9edb90', 'device_owner': 'network:router_gateway', 'standard_attr_id': 21, 'fixed_ips': [{'subnet_id': 'e0b32f3d-83d6-439a-bbed-01df7cf01051', 'ip_address': '172.27.1.131', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-819011-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-23T19:25:57Z', 'updated_at': '2021-11-23T19:26:01Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'e0b32f3d-83d6-439a-bbed-01df7cf01051', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-819011-1-iscsi', '_interfaces': [{'id': '3ac6433f-1952-4367-aa14-02d21397951c', 'name': '', 'network_id': '9af0bb9f-7449-41c2-abfb-77fb4d8d059e', 'tenant_id': 'febc4f33fba1433992fc8e043a47dd5c', 'mac_address': 'fa:16:3e:07:7d:49', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '9ac8505b-79fe-4486-9f30-bae91a9edb90', 'device_owner': 'network:router_interface', 'standard_attr_id': 19, 'fixed_ips': [{'subnet_id': 'd96c8e74-eccf-40d7-8588-0d6d07c85013', 'ip_address': '172.20.0.1', 'prefixlen': 26}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-819011-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-23T19:25:48Z', 'updated_at': '2021-11-23T19:25:52Z', 'revision_number': 5, 'project_id': 'febc4f33fba1433992fc8e043a47dd5c', 'subnets': [{'id': 'd96c8e74-eccf-40d7-8588-0d6d07c85013', 'cidr': '172.20.0.0/26', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': '6e3a70a1-07d7-4781-9446-b7052eb2106a'}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=102994) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 23 19:26:03.228541 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.plugins.ml2.rpc [None req-eb87b2c3-3339-4249-8b85-e695b5b4e1f9 None None] Device 6e82a030-9ee9-478c-9708-d03948f485cc up at agent ovs-agent-dv-cinder-819011-1-iscsi {{(pid=102994) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 23 19:26:03.285837 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.db.provisioning_blocks [None req-eb87b2c3-3339-4249-8b85-e695b5b4e1f9 None None] Provisioning complete for port 6e82a030-9ee9-478c-9708-d03948f485cc triggered by entity L2. {{(pid=102994) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 23 19:26:03.286356 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron_lib.callbacks.manager [None req-eb87b2c3-3339-4249-8b85-e695b5b4e1f9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-8355713'] for port, provisioning_complete {{(pid=102994) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:26:03.377012 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron_lib.callbacks.manager [None req-eb87b2c3-3339-4249-8b85-e695b5b4e1f9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7921281'] for port, before_update {{(pid=102994) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:26:03.399770 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.plugins.ml2.db [None req-eb87b2c3-3339-4249-8b85-e695b5b4e1f9 None None] For port 6e82a030-9ee9-478c-9708-d03948f485cc, host dv-cinder-819011-1-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-819011-1-iscsi',level=0,port_id=6e82a030-9ee9-478c-9708-d03948f485cc,segment=NetworkSegment(3cb5e60b-103a-47d0-a28b-d68e3159d032),segment_id=3cb5e60b-103a-47d0-a28b-d68e3159d032)] {{(pid=102994) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 23 19:26:03.478470 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron_lib.callbacks.manager [None req-eb87b2c3-3339-4249-8b85-e695b5b4e1f9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7918660', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-15067', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560168', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8783631423946', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8783631008732', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8783631008750'] for port, after_update {{(pid=102994) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:26:03.532646 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-eb87b2c3-3339-4249-8b85-e695b5b4e1f9 None None] Pushing event updated for resources: {'Port': ['ID=6e82a030-9ee9-478c-9708-d03948f485cc,revision_number=4']} {{(pid=102994) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 23 19:26:05.217605 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.plugins.ml2.rpc [None req-eb87b2c3-3339-4249-8b85-e695b5b4e1f9 None None] Device 6e82a030-9ee9-478c-9708-d03948f485cc up at agent ovs-agent-dv-cinder-819011-1-iscsi {{(pid=102994) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 23 19:26:05.309510 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.db.provisioning_blocks [None req-eb87b2c3-3339-4249-8b85-e695b5b4e1f9 None None] Provisioning complete for port 6e82a030-9ee9-478c-9708-d03948f485cc triggered by entity L2. {{(pid=102994) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 23 19:26:05.310201 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron_lib.callbacks.manager [None req-eb87b2c3-3339-4249-8b85-e695b5b4e1f9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-8355713'] for port, provisioning_complete {{(pid=102994) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:26:11.695387 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron_lib.callbacks.manager [None req-690ff663-3c97-4e55-ba7f-83a1b88bc253 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8783631323329', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7978582'] for agent, after_update {{(pid=102994) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:26:14.169580 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron_lib.callbacks.manager [None req-535e0c5a-6018-4e70-adc8-a673bd573b9f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8783631323329', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7978582'] for agent, after_update {{(pid=102994) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:26:15.021144 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron_lib.callbacks.manager [None req-8346ef05-f685-4c3d-af3d-a159b683bec2 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8783631323329', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7978582'] for agent, after_update {{(pid=102994) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:26:16.507296 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron_lib.callbacks.manager [None req-785c1d26-11ba-42d8-b5a6-51a8b3daeef0 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8783631323329', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7978582'] for agent, after_update {{(pid=102994) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:26:17.290156 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron_lib.callbacks.manager [None req-eb87b2c3-3339-4249-8b85-e695b5b4e1f9 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8783631323329', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7978582'] for agent, after_update {{(pid=102994) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:26:27.020642 dv-cinder-819011-1-iscsi neutron-server[102995]: DEBUG neutron.db.agents_db [None req-84bdc9b2-57ea-4bdb-a245-07c78d37cea8 None None] Agent healthcheck: found 5 active agents {{(pid=102995) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 23 19:26:42.107036 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron_lib.callbacks.manager [None req-96d049d8-0ba4-4203-a54b-dcc51cfd8f24 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8783631323329', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7978582'] for agent, after_update {{(pid=102994) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:26:44.169782 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron_lib.callbacks.manager [None req-3e325917-030a-4a01-96f4-4abf1ae2f663 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8783631323329', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7978582'] for agent, after_update {{(pid=102994) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:26:45.028466 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron_lib.callbacks.manager [None req-8346ef05-f685-4c3d-af3d-a159b683bec2 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8783631323329', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7978582'] for agent, after_update {{(pid=102994) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:26:46.495520 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron_lib.callbacks.manager [None req-785c1d26-11ba-42d8-b5a6-51a8b3daeef0 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8783631323329', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7978582'] for agent, after_update {{(pid=102994) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:26:48.032659 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron_lib.callbacks.manager [None req-eb87b2c3-3339-4249-8b85-e695b5b4e1f9 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8783631323329', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7978582'] for agent, after_update {{(pid=102994) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:27:04.015045 dv-cinder-819011-1-iscsi neutron-server[102995]: DEBUG neutron.db.agents_db [None req-84bdc9b2-57ea-4bdb-a245-07c78d37cea8 None None] Agent healthcheck: found 5 active agents {{(pid=102995) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 23 19:27:11.696054 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron_lib.callbacks.manager [None req-ed2fec3b-0ad6-4f8c-9df2-42a30eb73019 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8783631323329', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7978582'] for agent, after_update {{(pid=102994) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:27:14.170001 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron_lib.callbacks.manager [None req-15c750b4-4954-45d3-8628-25a8fe42fba9 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8783631323329', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7978582'] for agent, after_update {{(pid=102994) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:27:15.015511 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron_lib.callbacks.manager [None req-8346ef05-f685-4c3d-af3d-a159b683bec2 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8783631323329', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7978582'] for agent, after_update {{(pid=102994) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:27:16.495430 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron_lib.callbacks.manager [None req-785c1d26-11ba-42d8-b5a6-51a8b3daeef0 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8783631323329', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7978582'] for agent, after_update {{(pid=102994) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:27:17.266957 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron_lib.callbacks.manager [None req-eb87b2c3-3339-4249-8b85-e695b5b4e1f9 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8783631323329', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7978582'] for agent, after_update {{(pid=102994) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:27:22.582212 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.wsgi [-] (102992) accepted ('10.222.0.62', 40048) {{(pid=102992) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 23 19:27:22.642691 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.pecan_wsgi.hooks.translation [None req-41980a6c-01d2-407f-a0b4-7f273f0622c7 admin admin] GET failed (client error): The resource could not be found. Nov 23 19:27:22.643960 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [None req-41980a6c-01d2-407f-a0b4-7f273f0622c7 admin admin] 10.222.0.62 "GET /v2.0/networks/private HTTP/1.1" status: 404 len: 315 time: 0.0607750 Nov 23 19:27:22.805945 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-9454947b-bea8-4d20-8c68-4e8dbea77999 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102992) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:27:22.807947 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [None req-9454947b-bea8-4d20-8c68-4e8dbea77999 admin admin] 10.222.0.62 "GET /v2.0/networks?name=private HTTP/1.1" status: 200 len: 872 time: 0.1587036 Nov 23 19:27:25.110662 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.wsgi [-] (102992) accepted ('10.222.0.62', 40058) {{(pid=102992) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 23 19:27:25.206112 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-6208b2f3-abd8-43d5-864f-f072e0ad03ed admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=102992) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:27:25.207463 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [None req-6208b2f3-abd8-43d5-864f-f072e0ad03ed admin admin] 10.222.0.62 "GET /v2.0/subnets/d96c8e74-eccf-40d7-8588-0d6d07c85013 HTTP/1.1" status: 200 len: 849 time: 0.0958505 Nov 23 19:27:25.217288 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.api.v2.base [None req-455dba43-300e-4c61-b77a-ee41ee27f125 admin admin] Request body: {'subnet': {'dns_nameservers': ['8.8.8.8', '8.8.4.4']}} {{(pid=102992) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 23 19:27:25.300610 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [None req-455dba43-300e-4c61-b77a-ee41ee27f125 admin admin] Publish callbacks [] for subnet, before_update {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:27:25.530199 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [None req-455dba43-300e-4c61-b77a-ee41ee27f125 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-554858', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560168', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_subnet_gateway_ip_update-8783631424633'] for subnet, after_update {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:27:25.566923 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-455dba43-300e-4c61-b77a-ee41ee27f125 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=102992) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:27:25.567520 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [None req-455dba43-300e-4c61-b77a-ee41ee27f125 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-560186'] for subnet, before_response {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:27:25.568848 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [None req-455dba43-300e-4c61-b77a-ee41ee27f125 admin admin] 10.222.0.62 "PUT /v2.0/subnets/d96c8e74-eccf-40d7-8588-0d6d07c85013 HTTP/1.1" status: 200 len: 868 time: 0.3551950 Nov 23 19:27:25.588145 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-455dba43-300e-4c61-b77a-ee41ee27f125 admin admin] Pushing event updated for resources: {'Subnet': ['ID=d96c8e74-eccf-40d7-8588-0d6d07c85013,revision_number=1']} {{(pid=102992) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 23 19:27:25.592477 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-0d302c18-2d2f-41a9-ac5a-2d4815da129c None None] Network 9af0bb9f-7449-41c2-abfb-77fb4d8d059e requested from dv-cinder-819011-1-iscsi {{(pid=102994) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 23 19:27:25.595844 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-455dba43-300e-4c61-b77a-ee41ee27f125 admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-819011-1-iscsi {{(pid=102992) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 23 19:27:25.596233 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-455dba43-300e-4c61-b77a-ee41ee27f125 admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-819011-1-iscsi {{(pid=102992) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 23 19:27:25.596589 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-455dba43-300e-4c61-b77a-ee41ee27f125 admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-819011-1-iscsi {{(pid=102992) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 23 19:27:25.597000 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-455dba43-300e-4c61-b77a-ee41ee27f125 admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-819011-1-iscsi {{(pid=102992) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 23 19:27:25.597278 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-455dba43-300e-4c61-b77a-ee41ee27f125 admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-819011-1-iscsi {{(pid=102992) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 23 19:27:25.598806 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-455dba43-300e-4c61-b77a-ee41ee27f125 admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-819011-1-iscsi {{(pid=102992) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 23 19:27:25.598806 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-455dba43-300e-4c61-b77a-ee41ee27f125 admin admin] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-819011-1-iscsi {{(pid=102992) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 23 19:27:25.598806 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-455dba43-300e-4c61-b77a-ee41ee27f125 admin admin] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-819011-1-iscsi {{(pid=102992) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 23 19:27:25.598806 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-455dba43-300e-4c61-b77a-ee41ee27f125 admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-819011-1-iscsi {{(pid=102992) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 23 19:27:25.599962 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-455dba43-300e-4c61-b77a-ee41ee27f125 admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-819011-1-iscsi {{(pid=102992) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 23 19:27:25.600311 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-455dba43-300e-4c61-b77a-ee41ee27f125 admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-819011-1-iscsi {{(pid=102992) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 23 19:27:25.600651 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-455dba43-300e-4c61-b77a-ee41ee27f125 admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-819011-1-iscsi {{(pid=102992) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 23 19:27:26.006573 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.db.provisioning_blocks [None req-c719a6b2-f3dd-4cad-9d3d-9170f7525412 None None] Provisioning complete for port ae655a48-f49a-4d6f-a3a3-e224020a779e triggered by entity DHCP. {{(pid=102994) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 23 19:27:26.006946 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron_lib.callbacks.manager [None req-c719a6b2-f3dd-4cad-9d3d-9170f7525412 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-8355713'] for port, provisioning_complete {{(pid=102994) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:27:26.097534 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.db.provisioning_blocks [None req-c719a6b2-f3dd-4cad-9d3d-9170f7525412 None None] Provisioning complete for port 3ac6433f-1952-4367-aa14-02d21397951c triggered by entity DHCP. {{(pid=102994) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 23 19:27:26.097808 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron_lib.callbacks.manager [None req-c719a6b2-f3dd-4cad-9d3d-9170f7525412 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-8355713'] for port, provisioning_complete {{(pid=102994) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:27:27.888923 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.wsgi [-] (102993) accepted ('10.222.0.62', 40066) {{(pid=102993) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 23 19:27:28.105089 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-0c16d068-a187-44d3-8ad1-5f6787f7d7a4 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102993) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:27:28.105525 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-0c16d068-a187-44d3-8ad1-5f6787f7d7a4 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102993) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:27:28.107067 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [None req-0c16d068-a187-44d3-8ad1-5f6787f7d7a4 admin admin] 10.222.0.62 "GET /v2.0/networks HTTP/1.1" status: 200 len: 1549 time: 0.2171745 Nov 23 19:27:30.426933 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.wsgi [-] (102992) accepted ('10.222.0.62', 40076) {{(pid=102992) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 23 19:27:30.626001 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-b5c64ac5-2281-4276-9c8d-ce43c2711756 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102992) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:27:30.626380 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-b5c64ac5-2281-4276-9c8d-ce43c2711756 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102992) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:27:30.627900 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [None req-b5c64ac5-2281-4276-9c8d-ce43c2711756 admin admin] 10.222.0.62 "GET /v2.0/networks HTTP/1.1" status: 200 len: 1549 time: 0.2000246 Nov 23 19:27:32.919405 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.wsgi [-] (102993) accepted ('10.222.0.62', 40084) {{(pid=102993) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 23 19:27:33.049507 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-275f3385-1ec1-4d78-817e-43ef40ab0bac admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102993) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:27:33.050851 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [None req-275f3385-1ec1-4d78-817e-43ef40ab0bac admin admin] 10.222.0.62 "GET /v2.0/networks/9af0bb9f-7449-41c2-abfb-77fb4d8d059e HTTP/1.1" status: 200 len: 869 time: 0.1305013 Nov 23 19:27:35.339197 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.wsgi [-] (102992) accepted ('10.222.0.62', 40092) {{(pid=102992) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 23 19:27:35.493130 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-6c16ca4d-a89e-4d28-bad2-e0a0feb921b7 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102992) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:27:35.494644 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [None req-6c16ca4d-a89e-4d28-bad2-e0a0feb921b7 admin admin] 10.222.0.62 "GET /v2.0/networks/a93e254e-aac9-4233-9e4d-4290fd0458e4 HTTP/1.1" status: 200 len: 886 time: 0.1543944 Nov 23 19:27:37.777529 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.wsgi [-] (102993) accepted ('10.222.0.62', 40100) {{(pid=102993) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 23 19:27:37.902307 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-504798df-d2b4-47a7-89a3-c8f4f697fa03 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=102993) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:27:37.902758 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-504798df-d2b4-47a7-89a3-c8f4f697fa03 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=102993) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:27:37.904304 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [None req-504798df-d2b4-47a7-89a3-c8f4f697fa03 admin admin] 10.222.0.62 "GET /v2.0/subnets HTTP/1.1" status: 200 len: 1479 time: 0.1257913 Nov 23 19:27:40.196845 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.wsgi [-] (102993) accepted ('10.222.0.62', 40108) {{(pid=102993) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 23 19:27:40.286419 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-067ffb6c-190f-4714-b827-deac348f5526 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=102993) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:27:40.286877 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-067ffb6c-190f-4714-b827-deac348f5526 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=102993) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:27:40.288406 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [None req-067ffb6c-190f-4714-b827-deac348f5526 admin admin] 10.222.0.62 "GET /v2.0/subnets HTTP/1.1" status: 200 len: 1479 time: 0.0905569 Nov 23 19:27:41.012984 dv-cinder-819011-1-iscsi neutron-server[102995]: DEBUG neutron.db.agents_db [None req-84bdc9b2-57ea-4bdb-a245-07c78d37cea8 None None] Agent healthcheck: found 5 active agents {{(pid=102995) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 23 19:27:41.718471 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron_lib.callbacks.manager [None req-43ea80ab-04ae-4ed7-aead-05a99c9d5f63 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8783631323329', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7978582'] for agent, after_update {{(pid=102994) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:27:42.546015 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.wsgi [-] (102993) accepted ('10.222.0.62', 40116) {{(pid=102993) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 23 19:27:42.637539 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-0cdeded9-fe5c-4937-aeaf-dc8b7437c029 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=102993) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:27:42.638881 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [None req-0cdeded9-fe5c-4937-aeaf-dc8b7437c029 admin admin] 10.222.0.62 "GET /v2.0/subnets/d96c8e74-eccf-40d7-8588-0d6d07c85013 HTTP/1.1" status: 200 len: 868 time: 0.0918877 Nov 23 19:27:44.193081 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron_lib.callbacks.manager [None req-4f646dce-41ac-4688-9261-fa5302555162 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8783631323329', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7978582'] for agent, after_update {{(pid=102994) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:27:44.911857 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.wsgi [-] (102993) accepted ('10.222.0.62', 40124) {{(pid=102993) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 23 19:27:45.001648 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-ee0481b9-fd4f-4d6e-9bba-2a0176ee5226 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=102993) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:27:45.002984 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [None req-ee0481b9-fd4f-4d6e-9bba-2a0176ee5226 admin admin] 10.222.0.62 "GET /v2.0/subnets/e0b32f3d-83d6-439a-bbed-01df7cf01051 HTTP/1.1" status: 200 len: 816 time: 0.0901873 Nov 23 19:27:45.033334 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron_lib.callbacks.manager [None req-8346ef05-f685-4c3d-af3d-a159b683bec2 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8783631323329', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7978582'] for agent, after_update {{(pid=102994) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:27:46.518449 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron_lib.callbacks.manager [None req-785c1d26-11ba-42d8-b5a6-51a8b3daeef0 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8783631323329', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7978582'] for agent, after_update {{(pid=102994) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:27:47.300495 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron_lib.callbacks.manager [None req-eb87b2c3-3339-4249-8b85-e695b5b4e1f9 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8783631323329', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7978582'] for agent, after_update {{(pid=102994) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:28:11.033053 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.wsgi [-] (102993) accepted ('10.222.0.62', 40178) {{(pid=102993) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 23 19:28:11.079934 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.wsgi [None req-f8225ea2-1713-4a73-be4a-0abef9a41887 admin admin] http://10.222.0.62:9696/v2.0/extensions returned with HTTP 200 {{(pid=102993) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Nov 23 19:28:11.080926 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [None req-f8225ea2-1713-4a73-be4a-0abef9a41887 admin admin] 10.222.0.62 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 14082 time: 0.0468802 Nov 23 19:28:11.695606 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron_lib.callbacks.manager [None req-61ddba3b-9b6b-4f96-8e0a-f604479e64ae None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8783631323329', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7978582'] for agent, after_update {{(pid=102994) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:28:13.469811 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.wsgi [-] (102993) accepted ('10.222.0.62', 40186) {{(pid=102993) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 23 19:28:13.529730 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.pecan_wsgi.hooks.translation [None req-6e1f7fd5-feac-460d-abbe-20c63031afe5 admin admin] GET failed (client error): The resource could not be found. Nov 23 19:28:13.531002 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [None req-6e1f7fd5-feac-460d-abbe-20c63031afe5 admin admin] 10.222.0.62 "GET /v2.0/networks/public HTTP/1.1" status: 404 len: 314 time: 0.0603228 Nov 23 19:28:13.676056 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-c06712f0-53a7-445b-98ec-870acdc4eb0a admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102993) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:28:13.677570 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [None req-c06712f0-53a7-445b-98ec-870acdc4eb0a admin admin] 10.222.0.62 "GET /v2.0/networks?name=public HTTP/1.1" status: 200 len: 889 time: 0.1419911 Nov 23 19:28:14.157860 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron_lib.callbacks.manager [None req-25f863ef-acdb-43f7-acba-7e7fe373aa9b None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8783631323329', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7978582'] for agent, after_update {{(pid=102994) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:28:15.032798 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron_lib.callbacks.manager [None req-8346ef05-f685-4c3d-af3d-a159b683bec2 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8783631323329', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7978582'] for agent, after_update {{(pid=102994) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:28:16.020574 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.wsgi [-] (102993) accepted ('10.222.0.62', 40194) {{(pid=102993) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 23 19:28:16.068050 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.api.v2.base [None req-69415228-e335-4f2b-8280-ce85f95626ad admin admin] Request body: {'network': {'admin_state_up': True, 'shared': True, 'name': 'shared'}} {{(pid=102993) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 23 19:28:16.141431 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-69415228-e335-4f2b-8280-ce85f95626ad admin admin] Made reservation on behalf of bbbece3b7f8c49dc96e2d01b1a42f43c for: {'network': 1} {{(pid=102993) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 23 19:28:16.143791 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-69415228-e335-4f2b-8280-ce85f95626ad admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7921281'] for network, before_create {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:28:16.172017 dv-cinder-819011-1-iscsi neutron-server[102993]: WARNING neutron.services.revisions.revision_plugin [None req-69415228-e335-4f2b-8280-ce85f95626ad admin admin] Could not find related network for resource to bump revision. Nov 23 19:28:16.187804 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-69415228-e335-4f2b-8280-ce85f95626ad admin admin] vlan segment allocate from pool success with {'vlan_id': 802, 'physical_network': 'physnet1'} {{(pid=102993) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 23 19:28:16.198542 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-69415228-e335-4f2b-8280-ce85f95626ad admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7982218'] for segment, precommit_create {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:28:16.198907 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.db.segments_db [None req-69415228-e335-4f2b-8280-ce85f95626ad admin admin] Added segment 760573d6-1aff-43f3-9bab-dbb5402f9396 of type vlan for network 2096bff1-f35e-4603-897c-41fe38bec144 Nov 23 19:28:16.239605 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-69415228-e335-4f2b-8280-ce85f95626ad admin admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8783630993713'] for network, precommit_create {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:28:16.295624 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-69415228-e335-4f2b-8280-ce85f95626ad admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-554949', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560168'] for network, after_create {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:28:16.296547 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-69415228-e335-4f2b-8280-ce85f95626ad admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102993) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:28:16.297128 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-69415228-e335-4f2b-8280-ce85f95626ad admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-560186'] for network, before_response {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:28:16.354141 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-69415228-e335-4f2b-8280-ce85f95626ad admin admin] Pushing event updated for resources: {'Network': ['ID=2096bff1-f35e-4603-897c-41fe38bec144,revision_number=1']} {{(pid=102993) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 23 19:28:16.360653 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-69415228-e335-4f2b-8280-ce85f95626ad admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-819011-1-iscsi {{(pid=102993) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 23 19:28:16.361010 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-69415228-e335-4f2b-8280-ce85f95626ad admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-819011-1-iscsi {{(pid=102993) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 23 19:28:16.361365 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-69415228-e335-4f2b-8280-ce85f95626ad admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-819011-1-iscsi {{(pid=102993) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 23 19:28:16.361751 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-69415228-e335-4f2b-8280-ce85f95626ad admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-819011-1-iscsi {{(pid=102993) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 23 19:28:16.362091 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-69415228-e335-4f2b-8280-ce85f95626ad admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-819011-1-iscsi {{(pid=102993) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 23 19:28:16.362432 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-69415228-e335-4f2b-8280-ce85f95626ad admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-819011-1-iscsi {{(pid=102993) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 23 19:28:16.362767 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-69415228-e335-4f2b-8280-ce85f95626ad admin admin] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-819011-1-iscsi {{(pid=102993) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 23 19:28:16.363125 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-69415228-e335-4f2b-8280-ce85f95626ad admin admin] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-819011-1-iscsi {{(pid=102993) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 23 19:28:16.363562 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-69415228-e335-4f2b-8280-ce85f95626ad admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-819011-1-iscsi {{(pid=102993) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 23 19:28:16.363897 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-69415228-e335-4f2b-8280-ce85f95626ad admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-819011-1-iscsi {{(pid=102993) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 23 19:28:16.364227 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-69415228-e335-4f2b-8280-ce85f95626ad admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-819011-1-iscsi {{(pid=102993) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 23 19:28:16.364583 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-69415228-e335-4f2b-8280-ce85f95626ad admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-819011-1-iscsi {{(pid=102993) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 23 19:28:16.371558 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [None req-69415228-e335-4f2b-8280-ce85f95626ad admin admin] 10.222.0.62 "POST /v2.0/networks HTTP/1.1" status: 201 len: 847 time: 0.3499582 Nov 23 19:28:16.376648 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.plugins.ml2.rpc [None req-eb87b2c3-3339-4249-8b85-e695b5b4e1f9 None None] Network 2096bff1-f35e-4603-897c-41fe38bec144 details requested by agent ovs-agent-dv-cinder-819011-1-iscsi with host dv-cinder-819011-1-iscsi {{(pid=102994) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Nov 23 19:28:16.513031 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron_lib.callbacks.manager [None req-785c1d26-11ba-42d8-b5a6-51a8b3daeef0 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8783631323329', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7978582'] for agent, after_update {{(pid=102994) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:28:17.353716 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron_lib.callbacks.manager [None req-eb87b2c3-3339-4249-8b85-e695b5b4e1f9 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8783631323329', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7978582'] for agent, after_update {{(pid=102994) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:28:18.011754 dv-cinder-819011-1-iscsi neutron-server[102995]: DEBUG neutron.db.agents_db [None req-84bdc9b2-57ea-4bdb-a245-07c78d37cea8 None None] Agent healthcheck: found 5 active agents {{(pid=102995) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 23 19:28:18.707015 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.wsgi [-] (102993) accepted ('10.222.0.62', 40202) {{(pid=102993) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 23 19:28:18.766315 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.pecan_wsgi.hooks.translation [None req-72bb2ecc-3ccb-4c40-a71c-71b2360c0c3b admin admin] GET failed (client error): The resource could not be found. Nov 23 19:28:18.771985 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [None req-72bb2ecc-3ccb-4c40-a71c-71b2360c0c3b admin admin] 10.222.0.62 "GET /v2.0/networks/shared HTTP/1.1" status: 404 len: 314 time: 0.0596313 Nov 23 19:28:18.838841 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-3a8c3f94-17de-4add-b4aa-102140363f71 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102993) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:28:18.840300 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [None req-3a8c3f94-17de-4add-b4aa-102140363f71 admin admin] 10.222.0.62 "GET /v2.0/networks?name=shared HTTP/1.1" status: 200 len: 826 time: 0.0682185 Nov 23 19:28:18.850497 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.api.v2.base [None req-784bc00e-76cf-4e86-9b47-d6f263e10574 admin admin] Request body: {'subnet': {'name': 'shared-subnet', 'description': 'shared-subnet', 'network_id': '2096bff1-f35e-4603-897c-41fe38bec144', 'ip_version': 4, 'cidr': '192.168.233.0/24'}} {{(pid=102993) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 23 19:28:18.969622 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-784bc00e-76cf-4e86-9b47-d6f263e10574 admin admin] Made reservation on behalf of bbbece3b7f8c49dc96e2d01b1a42f43c for: {'subnet': 1} {{(pid=102993) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 23 19:28:18.971983 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-784bc00e-76cf-4e86-9b47-d6f263e10574 admin admin] Publish callbacks [] for subnet, before_create {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:28:19.193609 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-784bc00e-76cf-4e86-9b47-d6f263e10574 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-554858', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560168'] for subnet, after_create {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:28:19.250966 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-784bc00e-76cf-4e86-9b47-d6f263e10574 admin admin] Pushing event updated for resources: {'Subnet': ['ID=2a6b6168-a59d-4c5e-be49-7d9bee937678,revision_number=0']} {{(pid=102993) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 23 19:28:19.255183 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-784bc00e-76cf-4e86-9b47-d6f263e10574 admin admin] Checking segment: {'id': '760573d6-1aff-43f3-9bab-dbb5402f9396', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 802, 'network_id': '2096bff1-f35e-4603-897c-41fe38bec144'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102993) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 23 19:28:19.255605 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-784bc00e-76cf-4e86-9b47-d6f263e10574 admin admin] Network hostable DHCP agents. Network: 2096bff1-f35e-4603-897c-41fe38bec144, hostable agents: ['e51c95c7-6a36-4263-ba47-1839054f3e7a'], hosted agents: [] {{(pid=102993) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 23 19:28:19.324405 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-784bc00e-76cf-4e86-9b47-d6f263e10574 admin admin] Network 2096bff1-f35e-4603-897c-41fe38bec144 is scheduled to be hosted by DHCP agent e51c95c7-6a36-4263-ba47-1839054f3e7a with binding_index 1 {{(pid=102993) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 23 19:28:19.369822 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.scheduler.base_scheduler [None req-784bc00e-76cf-4e86-9b47-d6f263e10574 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-819011-1-iscsi, 2096bff1-f35e-4603-897c-41fe38bec144) {{(pid=102993) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 23 19:28:19.373838 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-784bc00e-76cf-4e86-9b47-d6f263e10574 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'network'] {{(pid=102993) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:28:19.374555 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-784bc00e-76cf-4e86-9b47-d6f263e10574 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-560186'] for subnet, before_response {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:28:19.378917 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-ac99fb0e-0109-4638-a194-2af5fde0faf4 None None] Network 2096bff1-f35e-4603-897c-41fe38bec144 requested from dv-cinder-819011-1-iscsi {{(pid=102994) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 23 19:28:19.441628 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [None req-784bc00e-76cf-4e86-9b47-d6f263e10574 admin admin] 10.222.0.62 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 845 time: 0.5944176 Nov 23 19:28:19.532430 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-f8285995-7c6c-4f5d-9876-3be9e4e8fd31 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp8353ff9b-e01d-5e31-ab2d-60a764783255-2096bff1-f35e-4603-897c-41fe38bec144', 'network_id': '2096bff1-f35e-4603-897c-41fe38bec144', 'tenant_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'fixed_ips': [{'subnet_id': '2a6b6168-a59d-4c5e-be49-7d9bee937678'}]}} from dv-cinder-819011-1-iscsi. {{(pid=102994) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:285}} Nov 23 19:28:19.533362 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron_lib.callbacks.manager [None req-f8285995-7c6c-4f5d-9876-3be9e4e8fd31 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7921281'] for port, before_create {{(pid=102994) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:28:19.681481 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.db.db_base_plugin_common [None req-f8285995-7c6c-4f5d-9876-3be9e4e8fd31 None None] Allocated IP 192.168.233.2 (2096bff1-f35e-4603-897c-41fe38bec144/2a6b6168-a59d-4c5e-be49-7d9bee937678/c883d979-e034-4bae-965a-63033419ff6f) {{(pid=102994) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 23 19:28:19.842692 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron_lib.callbacks.manager [None req-f8285995-7c6c-4f5d-9876-3be9e4e8fd31 None None] Publish callbacks [] for port, precommit_create {{(pid=102994) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:28:19.932213 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron_lib.callbacks.manager [None req-f8285995-7c6c-4f5d-9876-3be9e4e8fd31 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7918660', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-15067', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560168', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8783631008714'] for port, after_create {{(pid=102994) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:28:19.979622 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-f8285995-7c6c-4f5d-9876-3be9e4e8fd31 None None] Network 2096bff1-f35e-4603-897c-41fe38bec144 is already hosted by enough agents. {{(pid=102994) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 23 19:28:19.982532 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.scheduler.base_scheduler [None req-f8285995-7c6c-4f5d-9876-3be9e4e8fd31 None None] Resources bound (agent type, host, resource id): {{(pid=102994) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 23 19:28:19.985542 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.db.l3_dvrscheduler_db [None req-f8285995-7c6c-4f5d-9876-3be9e4e8fd31 None None] Received port after_create {{(pid=102994) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 23 19:28:19.995416 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f8285995-7c6c-4f5d-9876-3be9e4e8fd31 None None] Pushing event updated for resources: {'Port': ['ID=c883d979-e034-4bae-965a-63033419ff6f,revision_number=1']} {{(pid=102994) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 23 19:28:20.115891 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f8285995-7c6c-4f5d-9876-3be9e4e8fd31 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-819011-1-iscsi {{(pid=102994) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 23 19:28:20.116230 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f8285995-7c6c-4f5d-9876-3be9e4e8fd31 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-819011-1-iscsi {{(pid=102994) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 23 19:28:20.116516 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f8285995-7c6c-4f5d-9876-3be9e4e8fd31 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-819011-1-iscsi {{(pid=102994) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 23 19:28:20.116855 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f8285995-7c6c-4f5d-9876-3be9e4e8fd31 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-819011-1-iscsi {{(pid=102994) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 23 19:28:20.117188 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f8285995-7c6c-4f5d-9876-3be9e4e8fd31 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-819011-1-iscsi {{(pid=102994) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 23 19:28:20.117544 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f8285995-7c6c-4f5d-9876-3be9e4e8fd31 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-819011-1-iscsi {{(pid=102994) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 23 19:28:20.117885 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f8285995-7c6c-4f5d-9876-3be9e4e8fd31 None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-819011-1-iscsi {{(pid=102994) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 23 19:28:20.118746 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f8285995-7c6c-4f5d-9876-3be9e4e8fd31 None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-819011-1-iscsi {{(pid=102994) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 23 19:28:20.119093 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f8285995-7c6c-4f5d-9876-3be9e4e8fd31 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-819011-1-iscsi {{(pid=102994) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 23 19:28:20.119996 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f8285995-7c6c-4f5d-9876-3be9e4e8fd31 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-819011-1-iscsi {{(pid=102994) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 23 19:28:20.120350 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f8285995-7c6c-4f5d-9876-3be9e4e8fd31 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-819011-1-iscsi {{(pid=102994) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 23 19:28:20.120684 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f8285995-7c6c-4f5d-9876-3be9e4e8fd31 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-819011-1-iscsi {{(pid=102994) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 23 19:28:20.154140 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.plugins.ml2.managers [None req-f8285995-7c6c-4f5d-9876-3be9e4e8fd31 None None] Attempting to bind port c883d979-e034-4bae-965a-63033419ff6f on host dv-cinder-819011-1-iscsi for vnic_type normal with profile {{(pid=102994) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 23 19:28:20.154520 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.plugins.ml2.managers [None req-f8285995-7c6c-4f5d-9876-3be9e4e8fd31 None None] Attempting to bind port c883d979-e034-4bae-965a-63033419ff6f by drivers openvswitch,hyperv on host dv-cinder-819011-1-iscsi at level 0 using segments [{'id': '760573d6-1aff-43f3-9bab-dbb5402f9396', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 802, 'network_id': '2096bff1-f35e-4603-897c-41fe38bec144'}] {{(pid=102994) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 23 19:28:20.154886 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-f8285995-7c6c-4f5d-9876-3be9e4e8fd31 None None] Attempting to bind port c883d979-e034-4bae-965a-63033419ff6f on network 2096bff1-f35e-4603-897c-41fe38bec144 {{(pid=102994) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 23 19:28:20.159947 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-f8285995-7c6c-4f5d-9876-3be9e4e8fd31 None None] Checking agent: {'id': '668c8953-047c-499e-8c0d-db838fac1668', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-819011-1-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 23, 19, 25, 17), 'started_at': datetime.datetime(2021, 11, 23, 19, 25, 47), 'heartbeat_timestamp': datetime.datetime(2021, 11, 23, 19, 28, 17), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-819011-1-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=102994) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 23 19:28:20.160331 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-f8285995-7c6c-4f5d-9876-3be9e4e8fd31 None None] Checking segment: {'id': '760573d6-1aff-43f3-9bab-dbb5402f9396', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 802, 'network_id': '2096bff1-f35e-4603-897c-41fe38bec144'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102994) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 23 19:28:20.160734 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron_lib.callbacks.manager [None req-f8285995-7c6c-4f5d-9876-3be9e4e8fd31 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=102994) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:28:20.161128 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-f8285995-7c6c-4f5d-9876-3be9e4e8fd31 None None] Bound using segment: {'id': '760573d6-1aff-43f3-9bab-dbb5402f9396', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 802, 'network_id': '2096bff1-f35e-4603-897c-41fe38bec144'} {{(pid=102994) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 23 19:28:20.161617 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.plugins.ml2.managers [None req-f8285995-7c6c-4f5d-9876-3be9e4e8fd31 None None] Bound port: c883d979-e034-4bae-965a-63033419ff6f, host: dv-cinder-819011-1-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '760573d6-1aff-43f3-9bab-dbb5402f9396', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 802, 'network_id': '2096bff1-f35e-4603-897c-41fe38bec144'}}] {{(pid=102994) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 23 19:28:20.162020 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron_lib.callbacks.manager [None req-f8285995-7c6c-4f5d-9876-3be9e4e8fd31 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7921281'] for port, before_update {{(pid=102994) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:28:20.225343 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.plugins.ml2.db [None req-f8285995-7c6c-4f5d-9876-3be9e4e8fd31 None None] For port c883d979-e034-4bae-965a-63033419ff6f, host dv-cinder-819011-1-iscsi, cleared binding levels {{(pid=102994) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 23 19:28:20.228796 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.plugins.ml2.db [None req-f8285995-7c6c-4f5d-9876-3be9e4e8fd31 None None] For port c883d979-e034-4bae-965a-63033419ff6f, host dv-cinder-819011-1-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-819011-1-iscsi',level=0,port_id=c883d979-e034-4bae-965a-63033419ff6f,segment=NetworkSegment(760573d6-1aff-43f3-9bab-dbb5402f9396),segment_id=760573d6-1aff-43f3-9bab-dbb5402f9396)] {{(pid=102994) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 23 19:28:20.308793 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron_lib.callbacks.manager [None req-f8285995-7c6c-4f5d-9876-3be9e4e8fd31 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7918660', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-15067', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560168', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8783631423946', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8783631008732', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8783631008750'] for port, after_update {{(pid=102994) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:28:20.382654 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f8285995-7c6c-4f5d-9876-3be9e4e8fd31 None None] Pushing event updated for resources: {'Port': ['ID=c883d979-e034-4bae-965a-63033419ff6f,revision_number=2']} {{(pid=102994) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 23 19:28:21.140215 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-38f117f8-487a-4191-83ed-18e44f0035fa None None] Network 2096bff1-f35e-4603-897c-41fe38bec144 requested from dv-cinder-819011-1-iscsi {{(pid=102994) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 23 19:28:21.299872 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.plugins.ml2.rpc [None req-eb87b2c3-3339-4249-8b85-e695b5b4e1f9 None None] Device c883d979-e034-4bae-965a-63033419ff6f up at agent ovs-agent-dv-cinder-819011-1-iscsi {{(pid=102994) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 23 19:28:21.301705 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.db.provisioning_blocks [None req-98e9a321-d26a-4d78-b610-6416542bc056 None None] Provisioning complete for port c883d979-e034-4bae-965a-63033419ff6f triggered by entity DHCP. {{(pid=102994) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 23 19:28:21.302077 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron_lib.callbacks.manager [None req-98e9a321-d26a-4d78-b610-6416542bc056 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-8355713'] for port, provisioning_complete {{(pid=102994) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:28:21.432874 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron_lib.callbacks.manager [None req-98e9a321-d26a-4d78-b610-6416542bc056 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7921281'] for port, before_update {{(pid=102994) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:28:21.464026 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.db.provisioning_blocks [None req-eb87b2c3-3339-4249-8b85-e695b5b4e1f9 None None] Provisioning complete for port c883d979-e034-4bae-965a-63033419ff6f triggered by entity L2. {{(pid=102994) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 23 19:28:21.464398 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron_lib.callbacks.manager [None req-eb87b2c3-3339-4249-8b85-e695b5b4e1f9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-8355713'] for port, provisioning_complete {{(pid=102994) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:28:21.496616 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.plugins.ml2.db [None req-98e9a321-d26a-4d78-b610-6416542bc056 None None] For port c883d979-e034-4bae-965a-63033419ff6f, host dv-cinder-819011-1-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-819011-1-iscsi',level=0,port_id=c883d979-e034-4bae-965a-63033419ff6f,segment=NetworkSegment(760573d6-1aff-43f3-9bab-dbb5402f9396),segment_id=760573d6-1aff-43f3-9bab-dbb5402f9396)] {{(pid=102994) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 23 19:28:21.553157 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron_lib.callbacks.manager [None req-eb87b2c3-3339-4249-8b85-e695b5b4e1f9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7921281'] for port, before_update {{(pid=102994) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:28:21.599540 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron_lib.callbacks.manager [None req-98e9a321-d26a-4d78-b610-6416542bc056 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7918660', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-15067', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560168', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8783631423946', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8783631008732', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8783631008750'] for port, after_update {{(pid=102994) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:28:21.678480 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron_lib.db.api [None req-eb87b2c3-3339-4249-8b85-e695b5b4e1f9 None None] Retry wrapper got retriable exception: UPDATE statement on table 'standardattributes' expected to update 1 row(s); 0 were matched. {{(pid=102994) wrapped /usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py:183}} Nov 23 19:28:21.678863 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG oslo_db.api [None req-eb87b2c3-3339-4249-8b85-e695b5b4e1f9 None None] Performing DB retry for function neutron.plugins.ml2.plugin.Ml2Plugin.update_port_statuses {{(pid=102994) wrapper /usr/local/lib/python3.8/dist-packages/oslo_db/api.py:155}} Nov 23 19:28:21.683354 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-98e9a321-d26a-4d78-b610-6416542bc056 None None] Pushing event updated for resources: {'Port': ['ID=c883d979-e034-4bae-965a-63033419ff6f,revision_number=3']} {{(pid=102994) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 23 19:28:21.719878 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.db.provisioning_blocks [None req-1c96998c-d43d-4494-94ab-8618532163f6 None None] Provisioning complete for port c883d979-e034-4bae-965a-63033419ff6f triggered by entity DHCP. {{(pid=102994) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 23 19:28:21.721386 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron_lib.callbacks.manager [None req-1c96998c-d43d-4494-94ab-8618532163f6 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-8355713'] for port, provisioning_complete {{(pid=102994) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:28:23.260085 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.plugins.ml2.rpc [None req-eb87b2c3-3339-4249-8b85-e695b5b4e1f9 None None] Device c883d979-e034-4bae-965a-63033419ff6f up at agent ovs-agent-dv-cinder-819011-1-iscsi {{(pid=102994) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 23 19:28:23.307897 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.db.provisioning_blocks [None req-eb87b2c3-3339-4249-8b85-e695b5b4e1f9 None None] Provisioning complete for port c883d979-e034-4bae-965a-63033419ff6f triggered by entity L2. {{(pid=102994) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 23 19:28:23.308270 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron_lib.callbacks.manager [None req-eb87b2c3-3339-4249-8b85-e695b5b4e1f9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-8355713'] for port, provisioning_complete {{(pid=102994) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:28:41.730730 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron_lib.callbacks.manager [None req-37ec7a12-b79a-4c8b-b660-d521593d3375 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8783631323329', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7978582'] for agent, after_update {{(pid=102994) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:28:44.170553 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron_lib.callbacks.manager [None req-d16221d5-a3ec-43fb-b0fc-b6f75a553bd5 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8783631323329', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7978582'] for agent, after_update {{(pid=102994) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:28:45.050471 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron_lib.callbacks.manager [None req-8346ef05-f685-4c3d-af3d-a159b683bec2 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8783631323329', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7978582'] for agent, after_update {{(pid=102994) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:28:46.501936 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron_lib.callbacks.manager [None req-785c1d26-11ba-42d8-b5a6-51a8b3daeef0 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8783631323329', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7978582'] for agent, after_update {{(pid=102994) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:28:47.342182 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron_lib.callbacks.manager [None req-eb87b2c3-3339-4249-8b85-e695b5b4e1f9 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8783631323329', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7978582'] for agent, after_update {{(pid=102994) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:28:55.010513 dv-cinder-819011-1-iscsi neutron-server[102995]: DEBUG neutron.db.agents_db [None req-84bdc9b2-57ea-4bdb-a245-07c78d37cea8 None None] Agent healthcheck: found 5 active agents {{(pid=102995) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 23 19:29:11.696439 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron_lib.callbacks.manager [None req-61c1432e-a520-47f7-b27e-e87f9aaa2957 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8783631323329', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7978582'] for agent, after_update {{(pid=102994) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:29:14.221949 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron_lib.callbacks.manager [None req-3a2dd18e-db38-4c79-9767-0643897b12e3 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8783631323329', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7978582'] for agent, after_update {{(pid=102994) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:29:15.028268 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron_lib.callbacks.manager [None req-8346ef05-f685-4c3d-af3d-a159b683bec2 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8783631323329', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7978582'] for agent, after_update {{(pid=102994) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:29:16.508236 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron_lib.callbacks.manager [None req-785c1d26-11ba-42d8-b5a6-51a8b3daeef0 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8783631323329', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7978582'] for agent, after_update {{(pid=102994) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:29:17.308025 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron_lib.callbacks.manager [None req-eb87b2c3-3339-4249-8b85-e695b5b4e1f9 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8783631323329', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7978582'] for agent, after_update {{(pid=102994) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:29:32.009169 dv-cinder-819011-1-iscsi neutron-server[102995]: DEBUG neutron.db.agents_db [None req-84bdc9b2-57ea-4bdb-a245-07c78d37cea8 None None] Agent healthcheck: found 5 active agents {{(pid=102995) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 23 19:29:41.719942 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron_lib.callbacks.manager [None req-fb9d793d-c0d9-47e2-b7fc-2703184f6bdc None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8783631323329', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7978582'] for agent, after_update {{(pid=102994) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:29:44.177467 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron_lib.callbacks.manager [None req-8569f864-516f-4f87-8121-2f9f05c00efb None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8783631323329', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7978582'] for agent, after_update {{(pid=102994) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:29:45.034346 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron_lib.callbacks.manager [None req-8346ef05-f685-4c3d-af3d-a159b683bec2 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8783631323329', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7978582'] for agent, after_update {{(pid=102994) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:29:46.514238 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron_lib.callbacks.manager [None req-785c1d26-11ba-42d8-b5a6-51a8b3daeef0 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8783631323329', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7978582'] for agent, after_update {{(pid=102994) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:29:47.382894 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron_lib.callbacks.manager [None req-eb87b2c3-3339-4249-8b85-e695b5b4e1f9 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8783631323329', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7978582'] for agent, after_update {{(pid=102994) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:29:47.942396 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.wsgi [-] (102992) accepted ('10.222.0.62', 40248) {{(pid=102992) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 23 19:29:47.948353 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.wsgi [None req-81d00949-40a2-4cf1-b347-82064d9a30e7 tempest-verify_tempest_config-1921733833 tempest-verify_tempest_config-1921733833-project] http://10.222.0.62:9696/v2.0/extensions returned with HTTP 200 {{(pid=102992) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Nov 23 19:29:47.950034 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [None req-81d00949-40a2-4cf1-b347-82064d9a30e7 tempest-verify_tempest_config-1921733833 tempest-verify_tempest_config-1921733833-project] 10.222.0.62 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 14077 time: 0.0065954 Nov 23 19:29:48.404675 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.wsgi [-] (102992) accepted ('10.222.0.62', 40266) {{(pid=102992) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 23 19:29:48.506840 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [None req-0132101a-e429-4537-acd2-3d29618b221c admin admin] Publish callbacks [] for security_group, before_create {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:29:48.579048 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [None req-0132101a-e429-4537-acd2-3d29618b221c admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:29:48.639616 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [None req-0132101a-e429-4537-acd2-3d29618b221c admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-623933'] for security_group, after_create {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:29:48.693801 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [None req-0132101a-e429-4537-acd2-3d29618b221c admin admin] 10.222.0.62 "GET /v2.0/security-groups?tenant_id=e82efd17d79a4de7a069e03ccf260985&name=default HTTP/1.1" status: 200 len: 2992 time: 0.2877679 Nov 23 19:29:48.694798 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0132101a-e429-4537-acd2-3d29618b221c admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=fe10d0a5-ac5e-4603-a072-8f1cae522ae0,revision_number=1']} {{(pid=102992) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 23 19:29:48.696672 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.wsgi [-] (102993) accepted ('10.222.0.62', 40270) {{(pid=102993) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 23 19:29:48.702682 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0132101a-e429-4537-acd2-3d29618b221c admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-819011-1-iscsi {{(pid=102992) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 23 19:29:48.703046 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0132101a-e429-4537-acd2-3d29618b221c admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-819011-1-iscsi {{(pid=102992) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 23 19:29:48.703398 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0132101a-e429-4537-acd2-3d29618b221c admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-819011-1-iscsi {{(pid=102992) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 23 19:29:48.703746 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0132101a-e429-4537-acd2-3d29618b221c admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-819011-1-iscsi {{(pid=102992) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 23 19:29:48.704091 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0132101a-e429-4537-acd2-3d29618b221c admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-819011-1-iscsi {{(pid=102992) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 23 19:29:48.704439 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0132101a-e429-4537-acd2-3d29618b221c admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-819011-1-iscsi {{(pid=102992) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 23 19:29:48.704786 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0132101a-e429-4537-acd2-3d29618b221c admin admin] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-819011-1-iscsi {{(pid=102992) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 23 19:29:48.705144 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0132101a-e429-4537-acd2-3d29618b221c admin admin] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-819011-1-iscsi {{(pid=102992) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 23 19:29:48.705529 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0132101a-e429-4537-acd2-3d29618b221c admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-819011-1-iscsi {{(pid=102992) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 23 19:29:48.705872 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0132101a-e429-4537-acd2-3d29618b221c admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-819011-1-iscsi {{(pid=102992) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 23 19:29:48.706208 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0132101a-e429-4537-acd2-3d29618b221c admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-819011-1-iscsi {{(pid=102992) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 23 19:29:48.706541 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0132101a-e429-4537-acd2-3d29618b221c admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-819011-1-iscsi {{(pid=102992) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 23 19:29:48.753203 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-937c1e3e-102d-448f-866d-479f54ed5677 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:29:48.774198 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-937c1e3e-102d-448f-866d-479f54ed5677 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:29:48.903595 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-937c1e3e-102d-448f-866d-479f54ed5677 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-623933'] for security_group, after_delete {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:29:48.906240 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-937c1e3e-102d-448f-866d-479f54ed5677 admin admin] Publish callbacks [] for security_group, before_response {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:29:48.907413 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [None req-937c1e3e-102d-448f-866d-479f54ed5677 admin admin] 10.222.0.62 "DELETE /v2.0/security-groups/fe10d0a5-ac5e-4603-a072-8f1cae522ae0 HTTP/1.1" status: 204 len: 168 time: 0.2091873 Nov 23 19:29:48.915074 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-937c1e3e-102d-448f-866d-479f54ed5677 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=fe10d0a5-ac5e-4603-a072-8f1cae522ae0,revision_number=None']} {{(pid=102993) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 23 19:29:48.922154 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-937c1e3e-102d-448f-866d-479f54ed5677 admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-819011-1-iscsi {{(pid=102993) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 23 19:29:48.922519 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-937c1e3e-102d-448f-866d-479f54ed5677 admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-819011-1-iscsi {{(pid=102993) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 23 19:29:48.922864 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-937c1e3e-102d-448f-866d-479f54ed5677 admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-819011-1-iscsi {{(pid=102993) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 23 19:29:48.923201 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-937c1e3e-102d-448f-866d-479f54ed5677 admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-819011-1-iscsi {{(pid=102993) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 23 19:29:48.923526 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-937c1e3e-102d-448f-866d-479f54ed5677 admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-819011-1-iscsi {{(pid=102993) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 23 19:29:48.923874 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-937c1e3e-102d-448f-866d-479f54ed5677 admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-819011-1-iscsi {{(pid=102993) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 23 19:29:48.924207 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-937c1e3e-102d-448f-866d-479f54ed5677 admin admin] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-819011-1-iscsi {{(pid=102993) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 23 19:29:48.924548 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-937c1e3e-102d-448f-866d-479f54ed5677 admin admin] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-819011-1-iscsi {{(pid=102993) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 23 19:29:48.924897 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-937c1e3e-102d-448f-866d-479f54ed5677 admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-819011-1-iscsi {{(pid=102993) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 23 19:29:48.925220 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-937c1e3e-102d-448f-866d-479f54ed5677 admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-819011-1-iscsi {{(pid=102993) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 23 19:29:48.925571 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-937c1e3e-102d-448f-866d-479f54ed5677 admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-819011-1-iscsi {{(pid=102993) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 23 19:29:48.925891 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-937c1e3e-102d-448f-866d-479f54ed5677 admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-819011-1-iscsi {{(pid=102993) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 23 19:30:09.007632 dv-cinder-819011-1-iscsi neutron-server[102995]: DEBUG neutron.db.agents_db [None req-84bdc9b2-57ea-4bdb-a245-07c78d37cea8 None None] Agent healthcheck: found 5 active agents {{(pid=102995) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 23 19:30:11.691496 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron_lib.callbacks.manager [None req-5b4a7022-0a6a-4290-9bff-09e531e52fdc None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8783631323329', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7978582'] for agent, after_update {{(pid=102994) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:30:14.165785 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron_lib.callbacks.manager [None req-c01c0211-95e6-46a4-92e9-92f5b4f796fe None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8783631323329', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7978582'] for agent, after_update {{(pid=102994) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:30:15.028573 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron_lib.callbacks.manager [None req-8346ef05-f685-4c3d-af3d-a159b683bec2 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8783631323329', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7978582'] for agent, after_update {{(pid=102994) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:30:16.520095 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron_lib.callbacks.manager [None req-785c1d26-11ba-42d8-b5a6-51a8b3daeef0 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8783631323329', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7978582'] for agent, after_update {{(pid=102994) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:30:17.297323 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron_lib.callbacks.manager [None req-eb87b2c3-3339-4249-8b85-e695b5b4e1f9 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8783631323329', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7978582'] for agent, after_update {{(pid=102994) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:30:41.703679 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron_lib.callbacks.manager [None req-09967ceb-4ab5-474e-b2c8-9efc5f3b52c5 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8783631323329', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7978582'] for agent, after_update {{(pid=102994) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:30:44.188484 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron_lib.callbacks.manager [None req-7d96dfdf-cd45-4ea0-93cc-33ab2aa0c8bb None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8783631323329', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7978582'] for agent, after_update {{(pid=102994) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:30:45.040225 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron_lib.callbacks.manager [None req-8346ef05-f685-4c3d-af3d-a159b683bec2 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8783631323329', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7978582'] for agent, after_update {{(pid=102994) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:30:46.006567 dv-cinder-819011-1-iscsi neutron-server[102995]: DEBUG neutron.db.agents_db [None req-84bdc9b2-57ea-4bdb-a245-07c78d37cea8 None None] Agent healthcheck: found 5 active agents {{(pid=102995) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 23 19:30:46.526508 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron_lib.callbacks.manager [None req-785c1d26-11ba-42d8-b5a6-51a8b3daeef0 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8783631323329', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7978582'] for agent, after_update {{(pid=102994) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:30:47.292383 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron_lib.callbacks.manager [None req-eb87b2c3-3339-4249-8b85-e695b5b4e1f9 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8783631323329', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7978582'] for agent, after_update {{(pid=102994) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:31:11.715595 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron_lib.callbacks.manager [None req-aec6f2b5-d38d-4cb6-b2ea-789f9f1492d0 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8783631323329', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7978582'] for agent, after_update {{(pid=102994) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:31:14.183948 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron_lib.callbacks.manager [None req-8a7e434a-577d-4d95-aacc-65a370eef390 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8783631323329', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7978582'] for agent, after_update {{(pid=102994) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:31:15.035511 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron_lib.callbacks.manager [None req-8346ef05-f685-4c3d-af3d-a159b683bec2 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8783631323329', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7978582'] for agent, after_update {{(pid=102994) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:31:16.515435 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron_lib.callbacks.manager [None req-785c1d26-11ba-42d8-b5a6-51a8b3daeef0 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8783631323329', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7978582'] for agent, after_update {{(pid=102994) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:31:17.298528 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron_lib.callbacks.manager [None req-eb87b2c3-3339-4249-8b85-e695b5b4e1f9 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8783631323329', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7978582'] for agent, after_update {{(pid=102994) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:31:23.004757 dv-cinder-819011-1-iscsi neutron-server[102995]: DEBUG neutron.db.agents_db [None req-84bdc9b2-57ea-4bdb-a245-07c78d37cea8 None None] Agent healthcheck: found 5 active agents {{(pid=102995) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 23 19:31:29.012863 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron_lib.callbacks.manager [None req-4bf48ff4-ecfb-4168-8b63-249b8c6e9f04 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8783631323329', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.create_fip_agent_gw_ports-933164'] for agent, after_create {{(pid=102994) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:31:41.721908 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron_lib.callbacks.manager [None req-60e70c42-b8a2-4847-9ffe-943974f7fc55 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8783631323329', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7978582'] for agent, after_update {{(pid=102994) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:31:42.841967 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.wsgi [-] (102993) accepted ('10.222.0.62', 40348) {{(pid=102993) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 23 19:31:42.945257 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [None req-8a433ff5-4584-4632-abaa-fb72e2efbeb5 admin admin] 10.222.0.62 "GET /v2.0/agents HTTP/1.1" status: 200 len: 4553 time: 0.1022091 Nov 23 19:31:44.189973 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron_lib.callbacks.manager [None req-e7b11c8d-4de6-406b-b716-e8093e541164 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8783631323329', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7978582'] for agent, after_update {{(pid=102994) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:31:45.030712 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron_lib.callbacks.manager [None req-8346ef05-f685-4c3d-af3d-a159b683bec2 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8783631323329', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7978582'] for agent, after_update {{(pid=102994) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:31:45.259816 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.wsgi [-] (102993) accepted ('10.222.0.62', 40358) {{(pid=102993) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 23 19:31:45.315038 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [None req-14584598-dd7b-4bae-b466-12c2e80c9f76 admin admin] 10.222.0.62 "GET /v2.0/agents HTTP/1.1" status: 200 len: 4553 time: 0.0541482 Nov 23 19:31:46.538678 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron_lib.callbacks.manager [None req-785c1d26-11ba-42d8-b5a6-51a8b3daeef0 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8783631323329', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7978582'] for agent, after_update {{(pid=102994) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:31:47.338977 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron_lib.callbacks.manager [None req-eb87b2c3-3339-4249-8b85-e695b5b4e1f9 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8783631323329', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7978582'] for agent, after_update {{(pid=102994) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:31:58.933121 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron_lib.callbacks.manager [None req-4bf48ff4-ecfb-4168-8b63-249b8c6e9f04 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8783631323329', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7978582'] for agent, after_update {{(pid=102994) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:32:00.005084 dv-cinder-819011-1-iscsi neutron-server[102995]: DEBUG neutron.db.agents_db [None req-84bdc9b2-57ea-4bdb-a245-07c78d37cea8 None None] Agent healthcheck: found 6 active agents {{(pid=102995) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 23 19:32:11.704823 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron_lib.callbacks.manager [None req-cb417392-12ca-4118-b5bc-25890420ad17 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8783631323329', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7978582'] for agent, after_update {{(pid=102994) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:32:14.162425 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron_lib.callbacks.manager [None req-9b4c7d1b-21c9-4e5b-adfd-a622c15132aa None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8783631323329', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7978582'] for agent, after_update {{(pid=102994) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:32:15.042211 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron_lib.callbacks.manager [None req-8346ef05-f685-4c3d-af3d-a159b683bec2 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8783631323329', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7978582'] for agent, after_update {{(pid=102994) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:32:16.521973 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron_lib.callbacks.manager [None req-785c1d26-11ba-42d8-b5a6-51a8b3daeef0 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8783631323329', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7978582'] for agent, after_update {{(pid=102994) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:32:17.316911 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron_lib.callbacks.manager [None req-eb87b2c3-3339-4249-8b85-e695b5b4e1f9 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8783631323329', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7978582'] for agent, after_update {{(pid=102994) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:32:28.968240 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron_lib.callbacks.manager [None req-4bf48ff4-ecfb-4168-8b63-249b8c6e9f04 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8783631323329', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7978582'] for agent, after_update {{(pid=102994) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:32:37.004561 dv-cinder-819011-1-iscsi neutron-server[102995]: DEBUG neutron.db.agents_db [None req-84bdc9b2-57ea-4bdb-a245-07c78d37cea8 None None] Agent healthcheck: found 6 active agents {{(pid=102995) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 23 19:32:41.711898 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron_lib.callbacks.manager [None req-1a279c5a-a50d-45d6-acd0-c68dd6cc0dd3 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8783631323329', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7978582'] for agent, after_update {{(pid=102994) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:32:44.179731 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron_lib.callbacks.manager [None req-2d4252a2-71f8-4245-83e3-5fbf32d96623 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8783631323329', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7978582'] for agent, after_update {{(pid=102994) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:32:45.054082 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron_lib.callbacks.manager [None req-8346ef05-f685-4c3d-af3d-a159b683bec2 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8783631323329', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7978582'] for agent, after_update {{(pid=102994) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:32:46.591254 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron_lib.callbacks.manager [None req-785c1d26-11ba-42d8-b5a6-51a8b3daeef0 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8783631323329', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7978582'] for agent, after_update {{(pid=102994) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:32:47.305849 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron_lib.callbacks.manager [None req-eb87b2c3-3339-4249-8b85-e695b5b4e1f9 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8783631323329', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7978582'] for agent, after_update {{(pid=102994) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:32:58.991683 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron_lib.callbacks.manager [None req-4bf48ff4-ecfb-4168-8b63-249b8c6e9f04 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8783631323329', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7978582'] for agent, after_update {{(pid=102994) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:33:11.700515 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron_lib.callbacks.manager [None req-86670abb-1543-427c-8b8d-863a102f176c None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8783631323329', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7978582'] for agent, after_update {{(pid=102994) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:33:14.004720 dv-cinder-819011-1-iscsi neutron-server[102995]: DEBUG neutron.db.agents_db [None req-84bdc9b2-57ea-4bdb-a245-07c78d37cea8 None None] Agent healthcheck: found 6 active agents {{(pid=102995) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 23 19:33:14.187208 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron_lib.callbacks.manager [None req-f4afec2c-915c-42bf-b2a0-9a9424793c04 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8783631323329', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7978582'] for agent, after_update {{(pid=102994) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:33:15.103455 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron_lib.callbacks.manager [None req-8346ef05-f685-4c3d-af3d-a159b683bec2 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8783631323329', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7978582'] for agent, after_update {{(pid=102994) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:33:16.583016 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron_lib.callbacks.manager [None req-785c1d26-11ba-42d8-b5a6-51a8b3daeef0 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8783631323329', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7978582'] for agent, after_update {{(pid=102994) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:33:17.289791 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron_lib.callbacks.manager [None req-eb87b2c3-3339-4249-8b85-e695b5b4e1f9 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8783631323329', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7978582'] for agent, after_update {{(pid=102994) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:33:17.867037 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.wsgi [-] (102993) accepted ('10.222.0.62', 40532) {{(pid=102993) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 23 19:33:18.215596 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.api.v2.base [None req-7293e0a2-cee6-4284-82f7-971c0a69adf7 admin admin] Request body: {'network': {'name': 'tempest-DeleteServersTestJSON-2059745116-network', 'tenant_id': '69ab6d68b3f1442f9785568cd27eb367'}} {{(pid=102993) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 23 19:33:18.289508 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-7293e0a2-cee6-4284-82f7-971c0a69adf7 admin admin] Made reservation on behalf of 69ab6d68b3f1442f9785568cd27eb367 for: {'network': 1} {{(pid=102993) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 23 19:33:18.291793 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-7293e0a2-cee6-4284-82f7-971c0a69adf7 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7921281'] for network, before_create {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:33:18.300341 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-7293e0a2-cee6-4284-82f7-971c0a69adf7 admin admin] Publish callbacks [] for security_group, before_create {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:33:18.375942 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-7293e0a2-cee6-4284-82f7-971c0a69adf7 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:33:18.415341 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-7293e0a2-cee6-4284-82f7-971c0a69adf7 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-623933'] for security_group, after_create {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:33:18.447509 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-7293e0a2-cee6-4284-82f7-971c0a69adf7 admin admin] vlan segment allocate from pool success with {'vlan_id': 823, 'physical_network': 'physnet1'} {{(pid=102993) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 23 19:33:18.449787 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7293e0a2-cee6-4284-82f7-971c0a69adf7 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=5b5d5814-644d-45c2-ad35-f8920c3382b0,revision_number=1']} {{(pid=102993) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 23 19:33:18.460963 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7293e0a2-cee6-4284-82f7-971c0a69adf7 admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-819011-1-iscsi {{(pid=102993) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 23 19:33:18.461572 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7293e0a2-cee6-4284-82f7-971c0a69adf7 admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-819011-1-iscsi {{(pid=102993) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 23 19:33:18.462092 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7293e0a2-cee6-4284-82f7-971c0a69adf7 admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-819011-1-iscsi {{(pid=102993) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 23 19:33:18.462721 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7293e0a2-cee6-4284-82f7-971c0a69adf7 admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-819011-1-iscsi {{(pid=102993) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 23 19:33:18.463326 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7293e0a2-cee6-4284-82f7-971c0a69adf7 admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-819011-1-iscsi {{(pid=102993) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 23 19:33:18.463814 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7293e0a2-cee6-4284-82f7-971c0a69adf7 admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-819011-1-iscsi {{(pid=102993) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 23 19:33:18.464160 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7293e0a2-cee6-4284-82f7-971c0a69adf7 admin admin] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-819011-1-iscsi {{(pid=102993) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 23 19:33:18.464519 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7293e0a2-cee6-4284-82f7-971c0a69adf7 admin admin] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-819011-1-iscsi {{(pid=102993) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 23 19:33:18.464868 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7293e0a2-cee6-4284-82f7-971c0a69adf7 admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-819011-1-iscsi {{(pid=102993) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 23 19:33:18.465249 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7293e0a2-cee6-4284-82f7-971c0a69adf7 admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-819011-1-iscsi {{(pid=102993) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 23 19:33:18.465603 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7293e0a2-cee6-4284-82f7-971c0a69adf7 admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-819011-1-iscsi {{(pid=102993) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 23 19:33:18.465934 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7293e0a2-cee6-4284-82f7-971c0a69adf7 admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-819011-1-iscsi {{(pid=102993) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 23 19:33:18.467003 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7293e0a2-cee6-4284-82f7-971c0a69adf7 admin admin] Tracked resource versions report: Nov 23 19:33:18.467003 dv-cinder-819011-1-iscsi neutron-server[102993]: pushed versions: Nov 23 19:33:18.467003 dv-cinder-819011-1-iscsi neutron-server[102993]: { 'AddressGroup': {'1.2'}, Nov 23 19:33:18.467003 dv-cinder-819011-1-iscsi neutron-server[102993]: 'ConntrackHelper': {'1.0'}, Nov 23 19:33:18.467003 dv-cinder-819011-1-iscsi neutron-server[102993]: 'Log': {'1.0'}, Nov 23 19:33:18.467003 dv-cinder-819011-1-iscsi neutron-server[102993]: 'Network': {'1.1'}, Nov 23 19:33:18.467003 dv-cinder-819011-1-iscsi neutron-server[102993]: 'Port': {'1.7'}, Nov 23 19:33:18.467003 dv-cinder-819011-1-iscsi neutron-server[102993]: 'PortForwarding': {'1.2'}, Nov 23 19:33:18.467003 dv-cinder-819011-1-iscsi neutron-server[102993]: 'QosPolicy': {'1.10'}, Nov 23 19:33:18.467003 dv-cinder-819011-1-iscsi neutron-server[102993]: 'SecurityGroup': {'1.5'}, Nov 23 19:33:18.467003 dv-cinder-819011-1-iscsi neutron-server[102993]: 'SecurityGroupRule': {'1.2'}, Nov 23 19:33:18.467003 dv-cinder-819011-1-iscsi neutron-server[102993]: 'SubPort': {'1.0'}, Nov 23 19:33:18.467003 dv-cinder-819011-1-iscsi neutron-server[102993]: 'Subnet': {'1.1'}, Nov 23 19:33:18.467003 dv-cinder-819011-1-iscsi neutron-server[102993]: 'Trunk': {'1.1'}} Nov 23 19:33:18.467003 dv-cinder-819011-1-iscsi neutron-server[102993]: consumer versions: Nov 23 19:33:18.467003 dv-cinder-819011-1-iscsi neutron-server[102993]: { DHCP agent@dv-cinder-819011-1-iscsi: {}, Nov 23 19:33:18.467003 dv-cinder-819011-1-iscsi neutron-server[102993]: HyperV agent@hv-cinder-81901: {}, Nov 23 19:33:18.467003 dv-cinder-819011-1-iscsi neutron-server[102993]: L3 agent@dv-cinder-819011-1-iscsi: {}, Nov 23 19:33:18.467003 dv-cinder-819011-1-iscsi neutron-server[102993]: Metadata agent@dv-cinder-819011-1-iscsi: {}, Nov 23 19:33:18.467003 dv-cinder-819011-1-iscsi neutron-server[102993]: Metering agent@dv-cinder-819011-1-iscsi: {}, Nov 23 19:33:18.467003 dv-cinder-819011-1-iscsi neutron-server[102993]: Open vSwitch agent@dv-cinder-819011-1-iscsi: { 'AddressGroup': '1.2', Nov 23 19:33:18.467003 dv-cinder-819011-1-iscsi neutron-server[102993]: 'ConntrackHelper': '1.0', Nov 23 19:33:18.467003 dv-cinder-819011-1-iscsi neutron-server[102993]: 'Log': '1.0', Nov 23 19:33:18.467003 dv-cinder-819011-1-iscsi neutron-server[102993]: 'Network': '1.1', Nov 23 19:33:18.467003 dv-cinder-819011-1-iscsi neutron-server[102993]: 'Port': '1.7', Nov 23 19:33:18.467003 dv-cinder-819011-1-iscsi neutron-server[102993]: 'PortForwarding': '1.2', Nov 23 19:33:18.467003 dv-cinder-819011-1-iscsi neutron-server[102993]: 'QosPolicy': '1.10', Nov 23 19:33:18.467003 dv-cinder-819011-1-iscsi neutron-server[102993]: 'SecurityGroup': '1.5', Nov 23 19:33:18.467003 dv-cinder-819011-1-iscsi neutron-server[102993]: 'SecurityGroupRule': '1.2', Nov 23 19:33:18.467003 dv-cinder-819011-1-iscsi neutron-server[102993]: 'SubPort': '1.0', Nov 23 19:33:18.467003 dv-cinder-819011-1-iscsi neutron-server[102993]: 'Subnet': '1.1', Nov 23 19:33:18.467003 dv-cinder-819011-1-iscsi neutron-server[102993]: 'Trunk': '1.1'}} Nov 23 19:33:18.467003 dv-cinder-819011-1-iscsi neutron-server[102993]: {{(pid=102993) report /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:175}} Nov 23 19:33:18.480090 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-7293e0a2-cee6-4284-82f7-971c0a69adf7 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7982218'] for segment, precommit_create {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:33:18.480090 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.db.segments_db [None req-7293e0a2-cee6-4284-82f7-971c0a69adf7 admin admin] Added segment 6f1d4a41-ab87-4da1-b83c-5e20faf1683c of type vlan for network 2cf6d774-4b5e-4f5e-bb22-8de22e43722d Nov 23 19:33:18.538535 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-7293e0a2-cee6-4284-82f7-971c0a69adf7 admin admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8783630993713'] for network, precommit_create {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:33:18.609434 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-7293e0a2-cee6-4284-82f7-971c0a69adf7 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-554949', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560168'] for network, after_create {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:33:18.610394 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-7293e0a2-cee6-4284-82f7-971c0a69adf7 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102993) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:33:18.610970 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-7293e0a2-cee6-4284-82f7-971c0a69adf7 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-560186'] for network, before_response {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:33:18.675925 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7293e0a2-cee6-4284-82f7-971c0a69adf7 admin admin] Pushing event updated for resources: {'Network': ['ID=2cf6d774-4b5e-4f5e-bb22-8de22e43722d,revision_number=1']} {{(pid=102993) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 23 19:33:18.687919 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.plugins.ml2.rpc [None req-eb87b2c3-3339-4249-8b85-e695b5b4e1f9 None None] Network 2cf6d774-4b5e-4f5e-bb22-8de22e43722d details requested by agent ovs-agent-dv-cinder-819011-1-iscsi with host dv-cinder-819011-1-iscsi {{(pid=102994) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Nov 23 19:33:18.692307 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [None req-7293e0a2-cee6-4284-82f7-971c0a69adf7 admin admin] 10.222.0.62 "POST /v2.0/networks HTTP/1.1" status: 201 len: 885 time: 0.8208377 Nov 23 19:33:18.692424 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.wsgi [-] (102992) accepted ('10.222.0.62', 40576) {{(pid=102992) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 23 19:33:18.696772 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.api.v2.base [None req-41d4057c-a575-4fb9-b4e5-6416115894c0 admin admin] Request body: {'subnet': {'network_id': '2cf6d774-4b5e-4f5e-bb22-8de22e43722d', 'cidr': '172.20.0.0/28', 'name': 'tempest-DeleteServersTestJSON-2059745116-subnet', 'tenant_id': '69ab6d68b3f1442f9785568cd27eb367', 'enable_dhcp': False, 'ip_version': 4}} {{(pid=102992) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 23 19:33:18.741067 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.wsgi [-] (102992) accepted ('10.222.0.62', 40580) {{(pid=102992) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 23 19:33:18.797551 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-41d4057c-a575-4fb9-b4e5-6416115894c0 admin admin] Made reservation on behalf of 69ab6d68b3f1442f9785568cd27eb367 for: {'subnet': 1} {{(pid=102992) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 23 19:33:18.800519 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [None req-41d4057c-a575-4fb9-b4e5-6416115894c0 admin admin] Publish callbacks [] for subnet, before_create {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:33:19.023265 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [None req-41d4057c-a575-4fb9-b4e5-6416115894c0 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-554858', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560168'] for subnet, after_create {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:33:19.147016 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-41d4057c-a575-4fb9-b4e5-6416115894c0 admin admin] Pushing event updated for resources: {'Subnet': ['ID=c1e8e6ce-3e67-4ef5-bbc3-db04880e7fab,revision_number=0']} {{(pid=102992) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 23 19:33:19.159472 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.api.v2.base [None req-5a26373f-3aea-45bc-aa99-5244d5d3d785 admin admin] Request body: {'network': {'name': 'tempest-ServerRescueNegativeTestJSON-1810346202-network', 'tenant_id': 'c15ab51e579448cfb7a4b3e4f8049687'}} {{(pid=102992) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 23 19:33:19.163454 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-41d4057c-a575-4fb9-b4e5-6416115894c0 admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-819011-1-iscsi {{(pid=102992) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 23 19:33:19.164018 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-41d4057c-a575-4fb9-b4e5-6416115894c0 admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-819011-1-iscsi {{(pid=102992) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 23 19:33:19.164373 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-41d4057c-a575-4fb9-b4e5-6416115894c0 admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-819011-1-iscsi {{(pid=102992) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 23 19:33:19.164715 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-41d4057c-a575-4fb9-b4e5-6416115894c0 admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-819011-1-iscsi {{(pid=102992) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 23 19:33:19.165049 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-41d4057c-a575-4fb9-b4e5-6416115894c0 admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-819011-1-iscsi {{(pid=102992) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 23 19:33:19.165453 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-41d4057c-a575-4fb9-b4e5-6416115894c0 admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-819011-1-iscsi {{(pid=102992) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 23 19:33:19.165788 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-41d4057c-a575-4fb9-b4e5-6416115894c0 admin admin] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-819011-1-iscsi {{(pid=102992) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 23 19:33:19.166129 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-41d4057c-a575-4fb9-b4e5-6416115894c0 admin admin] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-819011-1-iscsi {{(pid=102992) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 23 19:33:19.166761 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-41d4057c-a575-4fb9-b4e5-6416115894c0 admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-819011-1-iscsi {{(pid=102992) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 23 19:33:19.167100 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-41d4057c-a575-4fb9-b4e5-6416115894c0 admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-819011-1-iscsi {{(pid=102992) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 23 19:33:19.167438 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-41d4057c-a575-4fb9-b4e5-6416115894c0 admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-819011-1-iscsi {{(pid=102992) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 23 19:33:19.167765 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-41d4057c-a575-4fb9-b4e5-6416115894c0 admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-819011-1-iscsi {{(pid=102992) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 23 19:33:19.168834 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-41d4057c-a575-4fb9-b4e5-6416115894c0 admin admin] Tracked resource versions report: Nov 23 19:33:19.168834 dv-cinder-819011-1-iscsi neutron-server[102992]: pushed versions: Nov 23 19:33:19.168834 dv-cinder-819011-1-iscsi neutron-server[102992]: { 'AddressGroup': {'1.2'}, Nov 23 19:33:19.168834 dv-cinder-819011-1-iscsi neutron-server[102992]: 'ConntrackHelper': {'1.0'}, Nov 23 19:33:19.168834 dv-cinder-819011-1-iscsi neutron-server[102992]: 'Log': {'1.0'}, Nov 23 19:33:19.168834 dv-cinder-819011-1-iscsi neutron-server[102992]: 'Network': {'1.1'}, Nov 23 19:33:19.168834 dv-cinder-819011-1-iscsi neutron-server[102992]: 'Port': {'1.7'}, Nov 23 19:33:19.168834 dv-cinder-819011-1-iscsi neutron-server[102992]: 'PortForwarding': {'1.2'}, Nov 23 19:33:19.168834 dv-cinder-819011-1-iscsi neutron-server[102992]: 'QosPolicy': {'1.10'}, Nov 23 19:33:19.168834 dv-cinder-819011-1-iscsi neutron-server[102992]: 'SecurityGroup': {'1.5'}, Nov 23 19:33:19.168834 dv-cinder-819011-1-iscsi neutron-server[102992]: 'SecurityGroupRule': {'1.2'}, Nov 23 19:33:19.168834 dv-cinder-819011-1-iscsi neutron-server[102992]: 'SubPort': {'1.0'}, Nov 23 19:33:19.168834 dv-cinder-819011-1-iscsi neutron-server[102992]: 'Subnet': {'1.1'}, Nov 23 19:33:19.168834 dv-cinder-819011-1-iscsi neutron-server[102992]: 'Trunk': {'1.1'}} Nov 23 19:33:19.168834 dv-cinder-819011-1-iscsi neutron-server[102992]: consumer versions: Nov 23 19:33:19.168834 dv-cinder-819011-1-iscsi neutron-server[102992]: { DHCP agent@dv-cinder-819011-1-iscsi: {}, Nov 23 19:33:19.168834 dv-cinder-819011-1-iscsi neutron-server[102992]: HyperV agent@hv-cinder-81901: {}, Nov 23 19:33:19.168834 dv-cinder-819011-1-iscsi neutron-server[102992]: L3 agent@dv-cinder-819011-1-iscsi: {}, Nov 23 19:33:19.168834 dv-cinder-819011-1-iscsi neutron-server[102992]: Metadata agent@dv-cinder-819011-1-iscsi: {}, Nov 23 19:33:19.168834 dv-cinder-819011-1-iscsi neutron-server[102992]: Metering agent@dv-cinder-819011-1-iscsi: {}, Nov 23 19:33:19.168834 dv-cinder-819011-1-iscsi neutron-server[102992]: Open vSwitch agent@dv-cinder-819011-1-iscsi: { 'AddressGroup': '1.2', Nov 23 19:33:19.168834 dv-cinder-819011-1-iscsi neutron-server[102992]: 'ConntrackHelper': '1.0', Nov 23 19:33:19.168834 dv-cinder-819011-1-iscsi neutron-server[102992]: 'Log': '1.0', Nov 23 19:33:19.168834 dv-cinder-819011-1-iscsi neutron-server[102992]: 'Network': '1.1', Nov 23 19:33:19.168834 dv-cinder-819011-1-iscsi neutron-server[102992]: 'Port': '1.7', Nov 23 19:33:19.168834 dv-cinder-819011-1-iscsi neutron-server[102992]: 'PortForwarding': '1.2', Nov 23 19:33:19.168834 dv-cinder-819011-1-iscsi neutron-server[102992]: 'QosPolicy': '1.10', Nov 23 19:33:19.168834 dv-cinder-819011-1-iscsi neutron-server[102992]: 'SecurityGroup': '1.5', Nov 23 19:33:19.168834 dv-cinder-819011-1-iscsi neutron-server[102992]: 'SecurityGroupRule': '1.2', Nov 23 19:33:19.168834 dv-cinder-819011-1-iscsi neutron-server[102992]: 'SubPort': '1.0', Nov 23 19:33:19.168834 dv-cinder-819011-1-iscsi neutron-server[102992]: 'Subnet': '1.1', Nov 23 19:33:19.168834 dv-cinder-819011-1-iscsi neutron-server[102992]: 'Trunk': '1.1'}} Nov 23 19:33:19.168834 dv-cinder-819011-1-iscsi neutron-server[102992]: {{(pid=102992) report /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:175}} Nov 23 19:33:19.179450 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-41d4057c-a575-4fb9-b4e5-6416115894c0 admin admin] Checking segment: {'id': '6f1d4a41-ab87-4da1-b83c-5e20faf1683c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 823, 'network_id': '2cf6d774-4b5e-4f5e-bb22-8de22e43722d'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102992) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 23 19:33:19.179754 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-41d4057c-a575-4fb9-b4e5-6416115894c0 admin admin] Network hostable DHCP agents. Network: 2cf6d774-4b5e-4f5e-bb22-8de22e43722d, hostable agents: ['e51c95c7-6a36-4263-ba47-1839054f3e7a'], hosted agents: [] {{(pid=102992) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 23 19:33:19.243674 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.wsgi [-] (102992) accepted ('10.222.0.62', 40602) {{(pid=102992) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 23 19:33:19.277832 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-41d4057c-a575-4fb9-b4e5-6416115894c0 admin admin] Network 2cf6d774-4b5e-4f5e-bb22-8de22e43722d is scheduled to be hosted by DHCP agent e51c95c7-6a36-4263-ba47-1839054f3e7a with binding_index 1 {{(pid=102992) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 23 19:33:19.289115 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-5a26373f-3aea-45bc-aa99-5244d5d3d785 admin admin] Made reservation on behalf of c15ab51e579448cfb7a4b3e4f8049687 for: {'network': 1} {{(pid=102992) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 23 19:33:19.291414 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [None req-5a26373f-3aea-45bc-aa99-5244d5d3d785 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7921281'] for network, before_create {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:33:19.300667 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [None req-5a26373f-3aea-45bc-aa99-5244d5d3d785 admin admin] Publish callbacks [] for security_group, before_create {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:33:19.373605 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [None req-5a26373f-3aea-45bc-aa99-5244d5d3d785 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:33:19.403650 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.scheduler.base_scheduler [None req-41d4057c-a575-4fb9-b4e5-6416115894c0 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-819011-1-iscsi, 2cf6d774-4b5e-4f5e-bb22-8de22e43722d) {{(pid=102992) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 23 19:33:19.408185 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-41d4057c-a575-4fb9-b4e5-6416115894c0 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'network'] {{(pid=102992) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:33:19.409326 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [None req-41d4057c-a575-4fb9-b4e5-6416115894c0 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-560186'] for subnet, before_response {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:33:19.415717 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-45ae5f10-9e4d-4fac-89f8-42eb94d358e5 None None] Network 2cf6d774-4b5e-4f5e-bb22-8de22e43722d requested from dv-cinder-819011-1-iscsi {{(pid=102994) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 23 19:33:19.473209 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [None req-5a26373f-3aea-45bc-aa99-5244d5d3d785 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-623933'] for security_group, after_create {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:33:19.497393 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-5a26373f-3aea-45bc-aa99-5244d5d3d785 admin admin] vlan segment allocate from pool success with {'vlan_id': 821, 'physical_network': 'physnet1'} {{(pid=102992) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 23 19:33:19.515072 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5a26373f-3aea-45bc-aa99-5244d5d3d785 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=62a09434-acf0-424f-9001-2c3a78119364,revision_number=1']} {{(pid=102992) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 23 19:33:19.520036 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [None req-5a26373f-3aea-45bc-aa99-5244d5d3d785 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7982218'] for segment, precommit_create {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:33:19.524277 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.db.segments_db [None req-5a26373f-3aea-45bc-aa99-5244d5d3d785 admin admin] Added segment b8302c34-e78d-4c43-9d45-a2604c95a2d2 of type vlan for network 07eeb44e-4cdb-4c58-a83d-1dd8ab1ccb8a Nov 23 19:33:19.527478 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [None req-41d4057c-a575-4fb9-b4e5-6416115894c0 admin admin] 10.222.0.62 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 849 time: 0.8363976 Nov 23 19:33:19.565757 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-b1c220c0-e155-4436-96ef-de7e043d9d4e None None] Network 2cf6d774-4b5e-4f5e-bb22-8de22e43722d requested from dv-cinder-819011-1-iscsi {{(pid=102994) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 23 19:33:19.580257 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [None req-5a26373f-3aea-45bc-aa99-5244d5d3d785 admin admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8783630993713'] for network, precommit_create {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:33:19.672753 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [None req-5a26373f-3aea-45bc-aa99-5244d5d3d785 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-554949', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560168'] for network, after_create {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:33:19.674170 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-5a26373f-3aea-45bc-aa99-5244d5d3d785 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102992) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:33:19.674997 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [None req-5a26373f-3aea-45bc-aa99-5244d5d3d785 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-560186'] for network, before_response {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:33:19.781687 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5a26373f-3aea-45bc-aa99-5244d5d3d785 admin admin] Pushing event updated for resources: {'Network': ['ID=07eeb44e-4cdb-4c58-a83d-1dd8ab1ccb8a,revision_number=1']} {{(pid=102992) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 23 19:33:19.798323 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.plugins.ml2.rpc [None req-eb87b2c3-3339-4249-8b85-e695b5b4e1f9 None None] Network 07eeb44e-4cdb-4c58-a83d-1dd8ab1ccb8a details requested by agent ovs-agent-dv-cinder-819011-1-iscsi with host dv-cinder-819011-1-iscsi {{(pid=102994) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Nov 23 19:33:19.829809 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.api.v2.base [None req-c1d5dbc9-49dc-4bc1-b41f-c072e30316cb admin admin] Request body: {'network': {'name': 'tempest-AttachVolumeShelveTestJSON-1609224522-network', 'tenant_id': '2d925fb59ba34355aa85758374d76928'}} {{(pid=102992) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 23 19:33:19.881041 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.wsgi [-] (102993) accepted ('10.222.0.62', 40618) {{(pid=102993) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 23 19:33:19.882256 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [None req-5a26373f-3aea-45bc-aa99-5244d5d3d785 admin admin] 10.222.0.62 "POST /v2.0/networks HTTP/1.1" status: 201 len: 892 time: 1.1399333 Nov 23 19:33:19.885886 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.api.v2.base [None req-174b34f4-c23f-4401-83c0-5ab51e01809d admin admin] Request body: {'subnet': {'network_id': '07eeb44e-4cdb-4c58-a83d-1dd8ab1ccb8a', 'cidr': '172.20.0.0/28', 'name': 'tempest-ServerRescueNegativeTestJSON-1810346202-subnet', 'tenant_id': 'c15ab51e579448cfb7a4b3e4f8049687', 'enable_dhcp': False, 'ip_version': 4}} {{(pid=102993) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 23 19:33:19.976590 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-c1d5dbc9-49dc-4bc1-b41f-c072e30316cb admin admin] Made reservation on behalf of 2d925fb59ba34355aa85758374d76928 for: {'network': 1} {{(pid=102992) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 23 19:33:19.979108 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [None req-c1d5dbc9-49dc-4bc1-b41f-c072e30316cb admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7921281'] for network, before_create {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:33:19.996136 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [None req-c1d5dbc9-49dc-4bc1-b41f-c072e30316cb admin admin] Publish callbacks [] for security_group, before_create {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:33:20.073002 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-174b34f4-c23f-4401-83c0-5ab51e01809d admin admin] Made reservation on behalf of c15ab51e579448cfb7a4b3e4f8049687 for: {'subnet': 1} {{(pid=102993) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 23 19:33:20.076223 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-174b34f4-c23f-4401-83c0-5ab51e01809d admin admin] Publish callbacks [] for subnet, before_create {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:33:20.082883 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [None req-c1d5dbc9-49dc-4bc1-b41f-c072e30316cb admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:33:20.153063 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [None req-c1d5dbc9-49dc-4bc1-b41f-c072e30316cb admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-623933'] for security_group, after_create {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:33:20.176734 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-c1d5dbc9-49dc-4bc1-b41f-c072e30316cb admin admin] vlan segment allocate from pool success with {'vlan_id': 825, 'physical_network': 'physnet1'} {{(pid=102992) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 23 19:33:20.194472 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c1d5dbc9-49dc-4bc1-b41f-c072e30316cb admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=d8ef3615-d8e9-4f33-b439-9c44891c7a34,revision_number=1']} {{(pid=102992) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 23 19:33:20.212931 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [None req-c1d5dbc9-49dc-4bc1-b41f-c072e30316cb admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7982218'] for segment, precommit_create {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:33:20.212931 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.db.segments_db [None req-c1d5dbc9-49dc-4bc1-b41f-c072e30316cb admin admin] Added segment b4453f21-ac7f-498c-8316-73b738820700 of type vlan for network fc901312-2937-4784-8a6d-c046666e8bf8 Nov 23 19:33:20.277248 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [None req-c1d5dbc9-49dc-4bc1-b41f-c072e30316cb admin admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8783630993713'] for network, precommit_create {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:33:20.398464 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [None req-c1d5dbc9-49dc-4bc1-b41f-c072e30316cb admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-554949', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560168'] for network, after_create {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:33:20.398464 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-c1d5dbc9-49dc-4bc1-b41f-c072e30316cb admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102992) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:33:20.398464 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [None req-c1d5dbc9-49dc-4bc1-b41f-c072e30316cb admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-560186'] for network, before_response {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:33:20.464850 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c1d5dbc9-49dc-4bc1-b41f-c072e30316cb admin admin] Pushing event updated for resources: {'Network': ['ID=fc901312-2937-4784-8a6d-c046666e8bf8,revision_number=1']} {{(pid=102992) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 23 19:33:20.476811 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.plugins.ml2.rpc [None req-eb87b2c3-3339-4249-8b85-e695b5b4e1f9 None None] Network fc901312-2937-4784-8a6d-c046666e8bf8 details requested by agent ovs-agent-dv-cinder-819011-1-iscsi with host dv-cinder-819011-1-iscsi {{(pid=102994) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Nov 23 19:33:20.501639 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-174b34f4-c23f-4401-83c0-5ab51e01809d admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-554858', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560168'] for subnet, after_create {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:33:20.510724 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [None req-c1d5dbc9-49dc-4bc1-b41f-c072e30316cb admin admin] 10.222.0.62 "POST /v2.0/networks HTTP/1.1" status: 201 len: 890 time: 1.2657001 Nov 23 19:33:20.522628 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.wsgi [-] (102992) accepted ('10.222.0.62', 40660) {{(pid=102992) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 23 19:33:20.522628 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.api.v2.base [None req-066062f4-07b1-451f-8142-d645a2e29a47 admin admin] Request body: {'subnet': {'network_id': 'fc901312-2937-4784-8a6d-c046666e8bf8', 'cidr': '172.20.0.0/28', 'name': 'tempest-AttachVolumeShelveTestJSON-1609224522-subnet', 'tenant_id': '2d925fb59ba34355aa85758374d76928', 'enable_dhcp': True, 'ip_version': 4}} {{(pid=102992) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 23 19:33:20.582726 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-174b34f4-c23f-4401-83c0-5ab51e01809d admin admin] Pushing event updated for resources: {'Subnet': ['ID=e4fda56f-85ff-422d-adad-ec00db6378af,revision_number=0']} {{(pid=102993) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 23 19:33:20.586428 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-174b34f4-c23f-4401-83c0-5ab51e01809d admin admin] Checking segment: {'id': 'b8302c34-e78d-4c43-9d45-a2604c95a2d2', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 821, 'network_id': '07eeb44e-4cdb-4c58-a83d-1dd8ab1ccb8a'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102993) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 23 19:33:20.586765 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-174b34f4-c23f-4401-83c0-5ab51e01809d admin admin] Network hostable DHCP agents. Network: 07eeb44e-4cdb-4c58-a83d-1dd8ab1ccb8a, hostable agents: ['e51c95c7-6a36-4263-ba47-1839054f3e7a'], hosted agents: [] {{(pid=102993) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 23 19:33:20.649559 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-066062f4-07b1-451f-8142-d645a2e29a47 admin admin] Made reservation on behalf of 2d925fb59ba34355aa85758374d76928 for: {'subnet': 1} {{(pid=102992) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 23 19:33:20.654277 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [None req-066062f4-07b1-451f-8142-d645a2e29a47 admin admin] Publish callbacks [] for subnet, before_create {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:33:20.683146 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-174b34f4-c23f-4401-83c0-5ab51e01809d admin admin] Network 07eeb44e-4cdb-4c58-a83d-1dd8ab1ccb8a is scheduled to be hosted by DHCP agent e51c95c7-6a36-4263-ba47-1839054f3e7a with binding_index 1 {{(pid=102993) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 23 19:33:20.758568 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.scheduler.base_scheduler [None req-174b34f4-c23f-4401-83c0-5ab51e01809d admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-819011-1-iscsi, 07eeb44e-4cdb-4c58-a83d-1dd8ab1ccb8a) {{(pid=102993) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 23 19:33:20.762870 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-174b34f4-c23f-4401-83c0-5ab51e01809d admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'network'] {{(pid=102993) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:33:20.763632 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-174b34f4-c23f-4401-83c0-5ab51e01809d admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-560186'] for subnet, before_response {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:33:20.770258 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-a5803397-44a2-4fbf-9378-51ab4a445b53 None None] Network 07eeb44e-4cdb-4c58-a83d-1dd8ab1ccb8a requested from dv-cinder-819011-1-iscsi {{(pid=102994) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 23 19:33:20.837238 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [None req-174b34f4-c23f-4401-83c0-5ab51e01809d admin admin] 10.222.0.62 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 856 time: 0.9548564 Nov 23 19:33:20.839873 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.wsgi [-] (102993) accepted ('10.222.0.62', 40666) {{(pid=102993) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 23 19:33:20.844287 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.api.v2.base [None req-cf84120c-a976-41b2-a100-942328f9f01f admin admin] Request body: {'router': {'name': 'tempest-ServerRescueNegativeTestJSON-1810346202-router', 'tenant_id': 'c15ab51e579448cfb7a4b3e4f8049687', 'external_gateway_info': {'network_id': 'a93e254e-aac9-4233-9e4d-4290fd0458e4'}}} {{(pid=102993) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 23 19:33:20.912816 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [None req-066062f4-07b1-451f-8142-d645a2e29a47 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-554858', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560168'] for subnet, after_create {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:33:20.929046 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-da52a5ba-5f1e-47c9-9417-7a10a378114c None None] Network 07eeb44e-4cdb-4c58-a83d-1dd8ab1ccb8a requested from dv-cinder-819011-1-iscsi {{(pid=102994) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 23 19:33:20.953066 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-cf84120c-a976-41b2-a100-942328f9f01f admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-933550', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-13503'] for router, before_create {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:33:20.954886 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-cf84120c-a976-41b2-a100-942328f9f01f admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-933038', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-927700', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-622769', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-13448'] for router, precommit_create {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:33:20.967632 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-066062f4-07b1-451f-8142-d645a2e29a47 admin admin] Pushing event updated for resources: {'Subnet': ['ID=2caca985-6ed6-4ef7-ba49-7b7410bea160,revision_number=0']} {{(pid=102992) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 23 19:33:20.993003 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-066062f4-07b1-451f-8142-d645a2e29a47 admin admin] Checking segment: {'id': 'b4453f21-ac7f-498c-8316-73b738820700', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 825, 'network_id': 'fc901312-2937-4784-8a6d-c046666e8bf8'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102992) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 23 19:33:20.993384 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-066062f4-07b1-451f-8142-d645a2e29a47 admin admin] Network hostable DHCP agents. Network: fc901312-2937-4784-8a6d-c046666e8bf8, hostable agents: ['e51c95c7-6a36-4263-ba47-1839054f3e7a'], hosted agents: [] {{(pid=102992) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 23 19:33:21.085326 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-cf84120c-a976-41b2-a100-942328f9f01f admin admin] Publish callbacks [] for router_controller, precommit_add_association {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:33:21.089671 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-066062f4-07b1-451f-8142-d645a2e29a47 admin admin] Network fc901312-2937-4784-8a6d-c046666e8bf8 is scheduled to be hosted by DHCP agent e51c95c7-6a36-4263-ba47-1839054f3e7a with binding_index 1 {{(pid=102992) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 23 19:33:21.169493 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.scheduler.base_scheduler [None req-066062f4-07b1-451f-8142-d645a2e29a47 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-819011-1-iscsi, fc901312-2937-4784-8a6d-c046666e8bf8) {{(pid=102992) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 23 19:33:21.174318 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-066062f4-07b1-451f-8142-d645a2e29a47 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'network'] {{(pid=102992) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:33:21.175512 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [None req-066062f4-07b1-451f-8142-d645a2e29a47 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-560186'] for subnet, before_response {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:33:21.180597 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-192d6197-13c3-4901-90c7-c21669136db9 None None] Network fc901312-2937-4784-8a6d-c046666e8bf8 requested from dv-cinder-819011-1-iscsi {{(pid=102994) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 23 19:33:21.252618 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [None req-066062f4-07b1-451f-8142-d645a2e29a47 admin admin] 10.222.0.62 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 853 time: 0.7339067 Nov 23 19:33:21.255093 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.wsgi [-] (102992) accepted ('10.222.0.62', 40676) {{(pid=102992) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 23 19:33:21.272930 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.api.v2.base [None req-1feef603-724f-48c7-8cb2-fcbf0fe1382f admin admin] Request body: {'router': {'name': 'tempest-AttachVolumeShelveTestJSON-1609224522-router', 'tenant_id': '2d925fb59ba34355aa85758374d76928', 'external_gateway_info': {'network_id': 'a93e254e-aac9-4233-9e4d-4290fd0458e4'}}} {{(pid=102992) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 23 19:33:21.356304 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-cf84120c-a976-41b2-a100-942328f9f01f admin admin] Publish callbacks [] for router_gateway, precommit_update {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:33:21.386044 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-d2fc141f-e830-4022-b34d-f838670285d3 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp8353ff9b-e01d-5e31-ab2d-60a764783255-fc901312-2937-4784-8a6d-c046666e8bf8', 'network_id': 'fc901312-2937-4784-8a6d-c046666e8bf8', 'tenant_id': '2d925fb59ba34355aa85758374d76928', 'fixed_ips': [{'subnet_id': '2caca985-6ed6-4ef7-ba49-7b7410bea160'}]}} from dv-cinder-819011-1-iscsi. {{(pid=102994) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:285}} Nov 23 19:33:21.387034 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron_lib.callbacks.manager [None req-d2fc141f-e830-4022-b34d-f838670285d3 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7921281'] for port, before_create {{(pid=102994) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:33:21.480519 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [None req-1feef603-724f-48c7-8cb2-fcbf0fe1382f admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-933550', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-13503'] for router, before_create {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:33:21.483383 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [None req-1feef603-724f-48c7-8cb2-fcbf0fe1382f admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-933038', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-927700', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-622769', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-13448'] for router, precommit_create {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:33:21.577785 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.db.db_base_plugin_common [None req-d2fc141f-e830-4022-b34d-f838670285d3 None None] Allocated IP 172.20.0.2 (fc901312-2937-4784-8a6d-c046666e8bf8/2caca985-6ed6-4ef7-ba49-7b7410bea160/32f2a89f-0f71-4db4-a1fd-d54f31e610e0) {{(pid=102994) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 23 19:33:21.621658 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [None req-1feef603-724f-48c7-8cb2-fcbf0fe1382f admin admin] Publish callbacks [] for router_controller, precommit_add_association {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:33:21.790725 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-cf84120c-a976-41b2-a100-942328f9f01f admin admin] Publish callbacks [] for router_gateway, before_create {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:33:21.840410 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-cf84120c-a976-41b2-a100-942328f9f01f admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7921281'] for port, before_create {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:33:21.862451 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron_lib.callbacks.manager [None req-d2fc141f-e830-4022-b34d-f838670285d3 None None] Publish callbacks [] for port, precommit_create {{(pid=102994) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:33:21.913391 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron_lib.callbacks.manager [None req-d2fc141f-e830-4022-b34d-f838670285d3 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7918660', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-15067', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560168', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8783631008714'] for port, after_create {{(pid=102994) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:33:21.977453 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [None req-1feef603-724f-48c7-8cb2-fcbf0fe1382f admin admin] Publish callbacks [] for router_gateway, precommit_update {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:33:22.004900 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.db.db_base_plugin_common [None req-cf84120c-a976-41b2-a100-942328f9f01f admin admin] Allocated IP 172.27.1.194 (a93e254e-aac9-4233-9e4d-4290fd0458e4/e0b32f3d-83d6-439a-bbed-01df7cf01051/ccf9cfdb-e164-48bc-b433-5906352d8e1a) {{(pid=102993) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 23 19:33:22.035345 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-d2fc141f-e830-4022-b34d-f838670285d3 None None] Network fc901312-2937-4784-8a6d-c046666e8bf8 is already hosted by enough agents. {{(pid=102994) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 23 19:33:22.036951 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.scheduler.base_scheduler [None req-d2fc141f-e830-4022-b34d-f838670285d3 None None] Resources bound (agent type, host, resource id): {{(pid=102994) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 23 19:33:22.042159 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.db.l3_dvrscheduler_db [None req-d2fc141f-e830-4022-b34d-f838670285d3 None None] Received port after_create {{(pid=102994) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 23 19:33:22.044655 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d2fc141f-e830-4022-b34d-f838670285d3 None None] Pushing event updated for resources: {'Port': ['ID=32f2a89f-0f71-4db4-a1fd-d54f31e610e0,revision_number=1']} {{(pid=102994) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 23 19:33:22.072859 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d2fc141f-e830-4022-b34d-f838670285d3 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-819011-1-iscsi {{(pid=102994) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 23 19:33:22.074055 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d2fc141f-e830-4022-b34d-f838670285d3 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-819011-1-iscsi {{(pid=102994) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 23 19:33:22.074494 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d2fc141f-e830-4022-b34d-f838670285d3 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-819011-1-iscsi {{(pid=102994) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 23 19:33:22.074852 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d2fc141f-e830-4022-b34d-f838670285d3 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-819011-1-iscsi {{(pid=102994) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 23 19:33:22.078004 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d2fc141f-e830-4022-b34d-f838670285d3 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-819011-1-iscsi {{(pid=102994) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 23 19:33:22.078004 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d2fc141f-e830-4022-b34d-f838670285d3 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-819011-1-iscsi {{(pid=102994) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 23 19:33:22.083581 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d2fc141f-e830-4022-b34d-f838670285d3 None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-819011-1-iscsi {{(pid=102994) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 23 19:33:22.084575 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d2fc141f-e830-4022-b34d-f838670285d3 None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-819011-1-iscsi {{(pid=102994) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 23 19:33:22.085387 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d2fc141f-e830-4022-b34d-f838670285d3 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-819011-1-iscsi {{(pid=102994) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 23 19:33:22.085957 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d2fc141f-e830-4022-b34d-f838670285d3 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-819011-1-iscsi {{(pid=102994) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 23 19:33:22.086527 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d2fc141f-e830-4022-b34d-f838670285d3 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-819011-1-iscsi {{(pid=102994) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 23 19:33:22.087072 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d2fc141f-e830-4022-b34d-f838670285d3 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-819011-1-iscsi {{(pid=102994) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 23 19:33:22.088871 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d2fc141f-e830-4022-b34d-f838670285d3 None None] Tracked resource versions report: Nov 23 19:33:22.088871 dv-cinder-819011-1-iscsi neutron-server[102994]: pushed versions: Nov 23 19:33:22.088871 dv-cinder-819011-1-iscsi neutron-server[102994]: { 'AddressGroup': {'1.2'}, Nov 23 19:33:22.088871 dv-cinder-819011-1-iscsi neutron-server[102994]: 'ConntrackHelper': {'1.0'}, Nov 23 19:33:22.088871 dv-cinder-819011-1-iscsi neutron-server[102994]: 'Log': {'1.0'}, Nov 23 19:33:22.088871 dv-cinder-819011-1-iscsi neutron-server[102994]: 'Network': {'1.1'}, Nov 23 19:33:22.088871 dv-cinder-819011-1-iscsi neutron-server[102994]: 'Port': {'1.7'}, Nov 23 19:33:22.088871 dv-cinder-819011-1-iscsi neutron-server[102994]: 'PortForwarding': {'1.2'}, Nov 23 19:33:22.088871 dv-cinder-819011-1-iscsi neutron-server[102994]: 'QosPolicy': {'1.10'}, Nov 23 19:33:22.088871 dv-cinder-819011-1-iscsi neutron-server[102994]: 'SecurityGroup': {'1.5'}, Nov 23 19:33:22.088871 dv-cinder-819011-1-iscsi neutron-server[102994]: 'SecurityGroupRule': {'1.2'}, Nov 23 19:33:22.088871 dv-cinder-819011-1-iscsi neutron-server[102994]: 'SubPort': {'1.0'}, Nov 23 19:33:22.088871 dv-cinder-819011-1-iscsi neutron-server[102994]: 'Subnet': {'1.1'}, Nov 23 19:33:22.088871 dv-cinder-819011-1-iscsi neutron-server[102994]: 'Trunk': {'1.1'}} Nov 23 19:33:22.088871 dv-cinder-819011-1-iscsi neutron-server[102994]: consumer versions: Nov 23 19:33:22.088871 dv-cinder-819011-1-iscsi neutron-server[102994]: { DHCP agent@dv-cinder-819011-1-iscsi: {}, Nov 23 19:33:22.088871 dv-cinder-819011-1-iscsi neutron-server[102994]: HyperV agent@hv-cinder-81901: {}, Nov 23 19:33:22.088871 dv-cinder-819011-1-iscsi neutron-server[102994]: L3 agent@dv-cinder-819011-1-iscsi: {}, Nov 23 19:33:22.088871 dv-cinder-819011-1-iscsi neutron-server[102994]: Metadata agent@dv-cinder-819011-1-iscsi: {}, Nov 23 19:33:22.088871 dv-cinder-819011-1-iscsi neutron-server[102994]: Metering agent@dv-cinder-819011-1-iscsi: {}, Nov 23 19:33:22.088871 dv-cinder-819011-1-iscsi neutron-server[102994]: Open vSwitch agent@dv-cinder-819011-1-iscsi: { 'AddressGroup': '1.2', Nov 23 19:33:22.088871 dv-cinder-819011-1-iscsi neutron-server[102994]: 'ConntrackHelper': '1.0', Nov 23 19:33:22.088871 dv-cinder-819011-1-iscsi neutron-server[102994]: 'Log': '1.0', Nov 23 19:33:22.088871 dv-cinder-819011-1-iscsi neutron-server[102994]: 'Network': '1.1', Nov 23 19:33:22.088871 dv-cinder-819011-1-iscsi neutron-server[102994]: 'Port': '1.7', Nov 23 19:33:22.088871 dv-cinder-819011-1-iscsi neutron-server[102994]: 'PortForwarding': '1.2', Nov 23 19:33:22.088871 dv-cinder-819011-1-iscsi neutron-server[102994]: 'QosPolicy': '1.10', Nov 23 19:33:22.088871 dv-cinder-819011-1-iscsi neutron-server[102994]: 'SecurityGroup': '1.5', Nov 23 19:33:22.088871 dv-cinder-819011-1-iscsi neutron-server[102994]: 'SecurityGroupRule': '1.2', Nov 23 19:33:22.088871 dv-cinder-819011-1-iscsi neutron-server[102994]: 'SubPort': '1.0', Nov 23 19:33:22.088871 dv-cinder-819011-1-iscsi neutron-server[102994]: 'Subnet': '1.1', Nov 23 19:33:22.088871 dv-cinder-819011-1-iscsi neutron-server[102994]: 'Trunk': '1.1'}} Nov 23 19:33:22.088871 dv-cinder-819011-1-iscsi neutron-server[102994]: {{(pid=102994) report /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:175}} Nov 23 19:33:22.132553 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-cf84120c-a976-41b2-a100-942328f9f01f admin admin] Publish callbacks [] for port, precommit_create {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:33:22.180785 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.plugins.ml2.managers [None req-d2fc141f-e830-4022-b34d-f838670285d3 None None] Attempting to bind port 32f2a89f-0f71-4db4-a1fd-d54f31e610e0 on host dv-cinder-819011-1-iscsi for vnic_type normal with profile {{(pid=102994) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 23 19:33:22.184256 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.plugins.ml2.managers [None req-d2fc141f-e830-4022-b34d-f838670285d3 None None] Attempting to bind port 32f2a89f-0f71-4db4-a1fd-d54f31e610e0 by drivers openvswitch,hyperv on host dv-cinder-819011-1-iscsi at level 0 using segments [{'id': 'b4453f21-ac7f-498c-8316-73b738820700', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 825, 'network_id': 'fc901312-2937-4784-8a6d-c046666e8bf8'}] {{(pid=102994) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 23 19:33:22.184256 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-d2fc141f-e830-4022-b34d-f838670285d3 None None] Attempting to bind port 32f2a89f-0f71-4db4-a1fd-d54f31e610e0 on network fc901312-2937-4784-8a6d-c046666e8bf8 {{(pid=102994) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 23 19:33:22.191943 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-d2fc141f-e830-4022-b34d-f838670285d3 None None] Checking agent: {'id': '668c8953-047c-499e-8c0d-db838fac1668', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-819011-1-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 23, 19, 25, 17), 'started_at': datetime.datetime(2021, 11, 23, 19, 25, 47), 'heartbeat_timestamp': datetime.datetime(2021, 11, 23, 19, 33, 17), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-819011-1-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=102994) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 23 19:33:22.192626 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-d2fc141f-e830-4022-b34d-f838670285d3 None None] Checking segment: {'id': 'b4453f21-ac7f-498c-8316-73b738820700', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 825, 'network_id': 'fc901312-2937-4784-8a6d-c046666e8bf8'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102994) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 23 19:33:22.193498 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron_lib.callbacks.manager [None req-d2fc141f-e830-4022-b34d-f838670285d3 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=102994) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:33:22.193641 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-d2fc141f-e830-4022-b34d-f838670285d3 None None] Bound using segment: {'id': 'b4453f21-ac7f-498c-8316-73b738820700', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 825, 'network_id': 'fc901312-2937-4784-8a6d-c046666e8bf8'} {{(pid=102994) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 23 19:33:22.194534 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.plugins.ml2.managers [None req-d2fc141f-e830-4022-b34d-f838670285d3 None None] Bound port: 32f2a89f-0f71-4db4-a1fd-d54f31e610e0, host: dv-cinder-819011-1-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'b4453f21-ac7f-498c-8316-73b738820700', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 825, 'network_id': 'fc901312-2937-4784-8a6d-c046666e8bf8'}}] {{(pid=102994) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 23 19:33:22.195052 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron_lib.callbacks.manager [None req-d2fc141f-e830-4022-b34d-f838670285d3 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7921281'] for port, before_update {{(pid=102994) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:33:22.277940 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.plugins.ml2.db [None req-d2fc141f-e830-4022-b34d-f838670285d3 None None] For port 32f2a89f-0f71-4db4-a1fd-d54f31e610e0, host dv-cinder-819011-1-iscsi, cleared binding levels {{(pid=102994) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 23 19:33:22.279978 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.plugins.ml2.db [None req-d2fc141f-e830-4022-b34d-f838670285d3 None None] For port 32f2a89f-0f71-4db4-a1fd-d54f31e610e0, host dv-cinder-819011-1-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-819011-1-iscsi',level=0,port_id=32f2a89f-0f71-4db4-a1fd-d54f31e610e0,segment=NetworkSegment(b4453f21-ac7f-498c-8316-73b738820700),segment_id=b4453f21-ac7f-498c-8316-73b738820700)] {{(pid=102994) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 23 19:33:22.298467 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-cf84120c-a976-41b2-a100-942328f9f01f admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7918660', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-15067', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560168', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8783631008714'] for port, after_create {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:33:22.322995 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.wsgi [-] (102993) accepted ('10.222.0.62', 40736) {{(pid=102993) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 23 19:33:22.328299 dv-cinder-819011-1-iscsi neutron-server[102993]: WARNING keystonemiddleware.auth_token [-] A valid token was submitted as a service token, but it was not a valid service token. This is incorrect but backwards compatible behaviour. This will be removed in future releases. Nov 23 19:33:22.352860 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-cf84120c-a976-41b2-a100-942328f9f01f admin admin] Network a93e254e-aac9-4233-9e4d-4290fd0458e4 is already hosted by enough agents. {{(pid=102993) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 23 19:33:22.384621 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.scheduler.base_scheduler [None req-cf84120c-a976-41b2-a100-942328f9f01f admin admin] Resources bound (agent type, host, resource id): {{(pid=102993) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 23 19:33:22.390095 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cf84120c-a976-41b2-a100-942328f9f01f admin admin] Pushing event updated for resources: {'Port': ['ID=ccf9cfdb-e164-48bc-b433-5906352d8e1a,revision_number=1']} {{(pid=102993) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 23 19:33:22.392261 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.db.l3_dvrscheduler_db [None req-cf84120c-a976-41b2-a100-942328f9f01f admin admin] Received port after_create {{(pid=102993) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 23 19:33:22.416406 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron_lib.callbacks.manager [None req-d2fc141f-e830-4022-b34d-f838670285d3 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7918660', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-15067', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560168', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8783631423946', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8783631008732', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8783631008750'] for port, after_update {{(pid=102994) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:33:22.429504 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [None req-1feef603-724f-48c7-8cb2-fcbf0fe1382f admin admin] Publish callbacks [] for router_gateway, before_create {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:33:22.467715 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [None req-1feef603-724f-48c7-8cb2-fcbf0fe1382f admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7921281'] for port, before_create {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:33:22.539992 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d2fc141f-e830-4022-b34d-f838670285d3 None None] Pushing event updated for resources: {'Port': ['ID=32f2a89f-0f71-4db4-a1fd-d54f31e610e0,revision_number=2']} {{(pid=102994) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 23 19:33:22.706994 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0a57b9d2-6400-42ea-bdd7-d1bf707b8bb8 req-82b7c954-55e9-4e5d-8001-6772229a5c29 tempest-DeleteServersTestJSON-453817978 tempest-DeleteServersTestJSON-453817978-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=102993) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:33:22.708569 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-0a57b9d2-6400-42ea-bdd7-d1bf707b8bb8 req-82b7c954-55e9-4e5d-8001-6772229a5c29 tempest-DeleteServersTestJSON-453817978 tempest-DeleteServersTestJSON-453817978-project] 10.222.0.62 "GET /v2.0/networks?id=2cf6d774-4b5e-4f5e-bb22-8de22e43722d HTTP/1.1" status: 200 len: 812 time: 0.3828552 Nov 23 19:33:22.727513 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-0a57b9d2-6400-42ea-bdd7-d1bf707b8bb8 req-3b3005e3-8a14-4ad6-b10a-1e85024fb7ed tempest-DeleteServersTestJSON-453817978 tempest-DeleteServersTestJSON-453817978-project] 10.222.0.62 "GET /v2.0/quotas/69ab6d68b3f1442f9785568cd27eb367 HTTP/1.1" status: 200 len: 375 time: 0.0120769 Nov 23 19:33:22.748484 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.db.db_base_plugin_common [None req-1feef603-724f-48c7-8cb2-fcbf0fe1382f admin admin] Allocated IP 172.27.1.99 (a93e254e-aac9-4233-9e4d-4290fd0458e4/e0b32f3d-83d6-439a-bbed-01df7cf01051/a6140c41-82e2-4d62-8e5f-f3fc119a374e) {{(pid=102992) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 23 19:33:22.942072 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-0a57b9d2-6400-42ea-bdd7-d1bf707b8bb8 req-a6ea2265-bf7a-4b45-9215-e31193592212 tempest-DeleteServersTestJSON-453817978 tempest-DeleteServersTestJSON-453817978-project] 10.222.0.62 "GET /v2.0/ports?tenant_id=69ab6d68b3f1442f9785568cd27eb367&fields=id HTTP/1.1" status: 200 len: 210 time: 0.0969322 Nov 23 19:33:22.950551 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [None req-1feef603-724f-48c7-8cb2-fcbf0fe1382f admin admin] Publish callbacks [] for port, precommit_create {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:33:22.950996 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-cf84120c-a976-41b2-a100-942328f9f01f admin admin] Publish callbacks [] for router_gateway, after_create {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:33:23.101910 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [None req-1feef603-724f-48c7-8cb2-fcbf0fe1382f admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7918660', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-15067', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560168', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8783631008714'] for port, after_create {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:33:23.239028 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.wsgi [req-0a57b9d2-6400-42ea-bdd7-d1bf707b8bb8 req-def60b50-c1c6-4a66-a5f2-9416efd4ef06 service neutron] http://10.222.0.62:9696/v2.0/extensions returned with HTTP 200 {{(pid=102993) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Nov 23 19:33:23.240075 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-0a57b9d2-6400-42ea-bdd7-d1bf707b8bb8 req-def60b50-c1c6-4a66-a5f2-9416efd4ef06 service neutron] 10.222.0.62 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 14082 time: 0.0848358 Nov 23 19:33:23.260068 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-1feef603-724f-48c7-8cb2-fcbf0fe1382f admin admin] Network a93e254e-aac9-4233-9e4d-4290fd0458e4 is already hosted by enough agents. {{(pid=102992) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 23 19:33:23.269555 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.scheduler.base_scheduler [None req-1feef603-724f-48c7-8cb2-fcbf0fe1382f admin admin] Resources bound (agent type, host, resource id): {{(pid=102992) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 23 19:33:23.277055 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.db.l3_dvrscheduler_db [None req-1feef603-724f-48c7-8cb2-fcbf0fe1382f admin admin] Received port after_create {{(pid=102992) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 23 19:33:23.356884 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1feef603-724f-48c7-8cb2-fcbf0fe1382f admin admin] Pushing event updated for resources: {'Port': ['ID=a6140c41-82e2-4d62-8e5f-f3fc119a374e,revision_number=1']} {{(pid=102992) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 23 19:33:23.369942 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.wsgi [-] (102993) accepted ('10.222.0.62', 40780) {{(pid=102993) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 23 19:33:23.384333 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-cf84120c-a976-41b2-a100-942328f9f01f admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-932875', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-926501'] for router, after_create {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:33:23.487501 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-0a57b9d2-6400-42ea-bdd7-d1bf707b8bb8 req-c6c4fa9f-62a4-42a5-b193-63250cb0dcf6 service neutron] 10.222.0.62 "GET /v2.0/networks/2cf6d774-4b5e-4f5e-bb22-8de22e43722d?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2381608 Nov 23 19:33:23.584890 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.plugins.ml2.rpc [None req-eb87b2c3-3339-4249-8b85-e695b5b4e1f9 None None] Device 32f2a89f-0f71-4db4-a1fd-d54f31e610e0 up at agent ovs-agent-dv-cinder-819011-1-iscsi {{(pid=102994) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 23 19:33:23.664395 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-c12e4bd9-a832-4aa3-b21c-f245365888b6 admin admin] Publish callbacks [] for security_group, before_create {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:33:23.680603 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.db.provisioning_blocks [None req-eb87b2c3-3339-4249-8b85-e695b5b4e1f9 None None] Provisioning complete for port 32f2a89f-0f71-4db4-a1fd-d54f31e610e0 triggered by entity L2. {{(pid=102994) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 23 19:33:23.681595 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron_lib.callbacks.manager [None req-eb87b2c3-3339-4249-8b85-e695b5b4e1f9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-8355713'] for port, provisioning_complete {{(pid=102994) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:33:23.735916 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-0a57b9d2-6400-42ea-bdd7-d1bf707b8bb8 req-4d7da676-2a21-4288-8505-a64a6047b8ff service neutron] 10.222.0.62 "GET /v2.0/networks/2cf6d774-4b5e-4f5e-bb22-8de22e43722d?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2117994 Nov 23 19:33:23.816711 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-c12e4bd9-a832-4aa3-b21c-f245365888b6 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:33:23.872872 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-cf84120c-a976-41b2-a100-942328f9f01f admin admin] Router dcdcae73-a8c6-43f9-b388-80519245de0c is scheduled to L3 agent 1b20f2c4-70b6-43c3-b9bd-0062cc9e57ac with binding_index 1 {{(pid=102993) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Nov 23 19:33:23.973537 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-c12e4bd9-a832-4aa3-b21c-f245365888b6 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-623933'] for security_group, after_create {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:33:23.990898 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-c5501063-ea6b-4040-9585-cd390ce46829 None None] Network fc901312-2937-4784-8a6d-c046666e8bf8 requested from dv-cinder-819011-1-iscsi {{(pid=102994) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 23 19:33:24.035176 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron_lib.callbacks.manager [None req-eb87b2c3-3339-4249-8b85-e695b5b4e1f9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7921281'] for port, before_update {{(pid=102994) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:33:24.079187 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [None req-1feef603-724f-48c7-8cb2-fcbf0fe1382f admin admin] Publish callbacks [] for router_gateway, after_create {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:33:24.101326 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [None req-c12e4bd9-a832-4aa3-b21c-f245365888b6 admin admin] 10.222.0.62 "GET /v2.0/security-groups?tenant_id=33923edb4748417790aab15a429ac0ff&name=default HTTP/1.1" status: 200 len: 2992 time: 0.7285354 Nov 23 19:33:24.107112 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.wsgi [-] (102993) accepted ('10.222.0.62', 40816) {{(pid=102993) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 23 19:33:24.119600 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c12e4bd9-a832-4aa3-b21c-f245365888b6 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=8f461df6-9b3d-44ab-9ee4-87eb53ce9524,revision_number=1']} {{(pid=102993) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 23 19:33:24.203950 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-cf84120c-a976-41b2-a100-942328f9f01f admin admin] Notify agent at l3_agent.dv-cinder-819011-1-iscsi the message routers_updated {{(pid=102993) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 23 19:33:24.215485 dv-cinder-819011-1-iscsi neutron-server[102995]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-1f69e9ad-9d9c-4e12-a8b2-c66d9a22ed70 None None] Sync routers for ids ['dcdcae73-a8c6-43f9-b388-80519245de0c'] in dv-cinder-819011-1-iscsi {{(pid=102995) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 23 19:33:24.226552 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.db.provisioning_blocks [None req-3a908265-a4e6-4b76-93f8-ed01d8178e1f None None] Provisioning complete for port 32f2a89f-0f71-4db4-a1fd-d54f31e610e0 triggered by entity DHCP. {{(pid=102994) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 23 19:33:24.228652 dv-cinder-819011-1-iscsi neutron-server[102995]: DEBUG neutron.db.l3_dvrscheduler_db [None req-1f69e9ad-9d9c-4e12-a8b2-c66d9a22ed70 None None] Routers {'dcdcae73-a8c6-43f9-b388-80519245de0c'} bound to L3 agent in host dv-cinder-819011-1-iscsi {{(pid=102995) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 23 19:33:24.229304 dv-cinder-819011-1-iscsi neutron-server[102995]: DEBUG neutron.db.l3_hamode_db [None req-1f69e9ad-9d9c-4e12-a8b2-c66d9a22ed70 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-819011-1-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2021-11-23T19:25:14Z,description=,heartbeat_timestamp=2021-11-23T19:33:14Z,host='dv-cinder-819011-1-iscsi',id=1b20f2c4-70b6-43c3-b9bd-0062cc9e57ac,load=0,resource_versions=,resources_synced=,started_at=2021-11-23T19:25:15Z,topic='l3_agent')) {'router_ids': ['dcdcae73-a8c6-43f9-b388-80519245de0c'], 'active': True} {{(pid=102995) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 23 19:33:24.229944 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron_lib.callbacks.manager [None req-3a908265-a4e6-4b76-93f8-ed01d8178e1f None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-8355713'] for port, provisioning_complete {{(pid=102994) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:33:24.242532 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-814926e1-984d-4b33-8c03-2b8ffdc05fee admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:33:24.248285 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.plugins.ml2.db [None req-eb87b2c3-3339-4249-8b85-e695b5b4e1f9 None None] For port 32f2a89f-0f71-4db4-a1fd-d54f31e610e0, host dv-cinder-819011-1-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-819011-1-iscsi',level=0,port_id=32f2a89f-0f71-4db4-a1fd-d54f31e610e0,segment=NetworkSegment(b4453f21-ac7f-498c-8316-73b738820700),segment_id=b4453f21-ac7f-498c-8316-73b738820700)] {{(pid=102994) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 23 19:33:24.276049 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-814926e1-984d-4b33-8c03-2b8ffdc05fee admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:33:24.324749 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-cf84120c-a976-41b2-a100-942328f9f01f admin admin] Publish callbacks [] for router, before_response {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:33:24.326118 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [None req-cf84120c-a976-41b2-a100-942328f9f01f admin admin] 10.222.0.62 "POST /v2.0/routers HTTP/1.1" status: 201 len: 931 time: 3.4852939 Nov 23 19:33:24.372451 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.wsgi [-] (102993) accepted ('10.222.0.62', 40830) {{(pid=102993) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 23 19:33:24.385787 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron_lib.callbacks.manager [None req-eb87b2c3-3339-4249-8b85-e695b5b4e1f9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7918660', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-15067', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560168', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8783631423946', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8783631008732', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8783631008750'] for port, after_update {{(pid=102994) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:33:24.400275 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-f8e54d20-6d5c-46d4-a93d-2fa52c779284 req-76c60072-4db9-4d80-9e09-4acd4821abc2 tempest-DeleteServersTestJSON-453817978 tempest-DeleteServersTestJSON-453817978-project] 10.222.0.62 "GET /v2.0/ports?device_id=5e3c1406-dc8c-414a-bcc5-55c7c963e1df HTTP/1.1" status: 200 len: 210 time: 0.0816135 Nov 23 19:33:24.476758 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron_lib.callbacks.manager [None req-3a908265-a4e6-4b76-93f8-ed01d8178e1f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7921281'] for port, before_update {{(pid=102994) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:33:24.513804 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-814926e1-984d-4b33-8c03-2b8ffdc05fee admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-623933'] for security_group, after_delete {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:33:24.516967 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-814926e1-984d-4b33-8c03-2b8ffdc05fee admin admin] Publish callbacks [] for security_group, before_response {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:33:24.519072 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [None req-814926e1-984d-4b33-8c03-2b8ffdc05fee admin admin] 10.222.0.62 "DELETE /v2.0/security-groups/8f461df6-9b3d-44ab-9ee4-87eb53ce9524 HTTP/1.1" status: 204 len: 168 time: 0.4092760 Nov 23 19:33:24.554832 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-eb87b2c3-3339-4249-8b85-e695b5b4e1f9 None None] Pushing event updated for resources: {'Port': ['ID=32f2a89f-0f71-4db4-a1fd-d54f31e610e0,revision_number=3']} {{(pid=102994) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 23 19:33:24.592007 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-814926e1-984d-4b33-8c03-2b8ffdc05fee admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=8f461df6-9b3d-44ab-9ee4-87eb53ce9524,revision_number=None']} {{(pid=102993) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 23 19:33:24.604116 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [None req-1feef603-724f-48c7-8cb2-fcbf0fe1382f admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-932875', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-926501'] for router, after_create {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:33:24.653635 dv-cinder-819011-1-iscsi neutron-server[102995]: DEBUG neutron.db.l3_dvr_db [None req-1f69e9ad-9d9c-4e12-a8b2-c66d9a22ed70 None None] Set router dcdcae73-a8c6-43f9-b388-80519245de0c gateway port host: dv-cinder-819011-1-iscsi {{(pid=102995) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 23 19:33:24.666980 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron_lib.db.api [None req-3a908265-a4e6-4b76-93f8-ed01d8178e1f None None] Retry wrapper got retriable exception: UPDATE statement on table 'standardattributes' expected to update 1 row(s); 0 were matched. {{(pid=102994) wrapped /usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py:183}} Nov 23 19:33:24.667623 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG oslo_db.api [None req-3a908265-a4e6-4b76-93f8-ed01d8178e1f None None] Performing DB retry for function neutron.plugins.ml2.plugin.Ml2Plugin.update_port_statuses {{(pid=102994) wrapper /usr/local/lib/python3.8/dist-packages/oslo_db/api.py:155}} Nov 23 19:33:24.956721 dv-cinder-819011-1-iscsi neutron-server[102995]: DEBUG neutron.db.l3_hamode_db [None req-1f69e9ad-9d9c-4e12-a8b2-c66d9a22ed70 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'dcdcae73-a8c6-43f9-b388-80519245de0c', 'name': 'tempest-ServerRescueNegativeTestJSON-1810346202-router', 'tenant_id': 'c15ab51e579448cfb7a4b3e4f8049687', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'a93e254e-aac9-4233-9e4d-4290fd0458e4', 'external_fixed_ips': [{'subnet_id': 'e0b32f3d-83d6-439a-bbed-01df7cf01051', 'ip_address': '172.27.1.194'}], 'enable_snat': True}, 'gw_port_id': 'ccf9cfdb-e164-48bc-b433-5906352d8e1a', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-23T19:33:20Z', 'updated_at': '2021-11-23T19:33:22Z', 'revision_number': 3, 'project_id': 'c15ab51e579448cfb7a4b3e4f8049687', 'gw_port': {'id': 'ccf9cfdb-e164-48bc-b433-5906352d8e1a', 'name': '', 'network_id': 'a93e254e-aac9-4233-9e4d-4290fd0458e4', 'tenant_id': '', 'mac_address': 'fa:16:3e:29:81:78', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'dcdcae73-a8c6-43f9-b388-80519245de0c', 'device_owner': 'network:router_gateway', 'standard_attr_id': 58, 'fixed_ips': [{'subnet_id': 'e0b32f3d-83d6-439a-bbed-01df7cf01051', 'ip_address': '172.27.1.194', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-23T19:33:21Z', 'updated_at': '2021-11-23T19:33:22Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': 'e0b32f3d-83d6-439a-bbed-01df7cf01051', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-819011-1-iscsi'}], 'dv-cinder-819011-1-iscsi', False) {} {{(pid=102995) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 23 19:33:24.988051 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-1feef603-724f-48c7-8cb2-fcbf0fe1382f admin admin] Router 01438284-e62a-4056-8ee2-4899a051e144 is scheduled to L3 agent 1b20f2c4-70b6-43c3-b9bd-0062cc9e57ac with binding_index 1 {{(pid=102992) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Nov 23 19:33:25.009171 dv-cinder-819011-1-iscsi neutron-server[102995]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-1f69e9ad-9d9c-4e12-a8b2-c66d9a22ed70 None None] Checking router: dcdcae73-a8c6-43f9-b388-80519245de0c for host: dv-cinder-819011-1-iscsi {{(pid=102995) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 23 19:33:25.009171 dv-cinder-819011-1-iscsi neutron-server[102995]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-1f69e9ad-9d9c-4e12-a8b2-c66d9a22ed70 None None] Updating router dcdcae73-a8c6-43f9-b388-80519245de0c port ccf9cfdb-e164-48bc-b433-5906352d8e1a binding host dv-cinder-819011-1-iscsi {{(pid=102995) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Nov 23 19:33:25.023947 dv-cinder-819011-1-iscsi neutron-server[102995]: DEBUG neutron_lib.callbacks.manager [None req-1f69e9ad-9d9c-4e12-a8b2-c66d9a22ed70 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7921281'] for port, before_update {{(pid=102995) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:33:25.239760 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-1feef603-724f-48c7-8cb2-fcbf0fe1382f admin admin] Notify agent at l3_agent.dv-cinder-819011-1-iscsi the message routers_updated {{(pid=102992) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 23 19:33:25.249950 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-0173cc2b-73c8-460f-a7c9-754012a34c5d None None] Sync routers for ids ['01438284-e62a-4056-8ee2-4899a051e144'] in dv-cinder-819011-1-iscsi {{(pid=102994) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 23 19:33:25.297346 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.db.l3_dvrscheduler_db [None req-0173cc2b-73c8-460f-a7c9-754012a34c5d None None] Routers {'01438284-e62a-4056-8ee2-4899a051e144'} bound to L3 agent in host dv-cinder-819011-1-iscsi {{(pid=102994) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 23 19:33:25.306228 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.db.l3_hamode_db [None req-0173cc2b-73c8-460f-a7c9-754012a34c5d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-819011-1-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2021-11-23T19:25:14Z,description=,heartbeat_timestamp=2021-11-23T19:33:14Z,host='dv-cinder-819011-1-iscsi',id=1b20f2c4-70b6-43c3-b9bd-0062cc9e57ac,load=0,resource_versions=,resources_synced=,started_at=2021-11-23T19:25:15Z,topic='l3_agent')) {'router_ids': ['01438284-e62a-4056-8ee2-4899a051e144'], 'active': True} {{(pid=102994) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 23 19:33:25.324331 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-90c11ca9-0dd5-41c0-a350-a6a440cf2627 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7921281'] for port, before_create {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:33:25.339714 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [None req-1feef603-724f-48c7-8cb2-fcbf0fe1382f admin admin] Publish callbacks [] for router, before_response {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:33:25.348332 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [None req-1feef603-724f-48c7-8cb2-fcbf0fe1382f admin admin] 10.222.0.62 "POST /v2.0/routers HTTP/1.1" status: 201 len: 928 time: 4.0848744 Nov 23 19:33:25.348876 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.wsgi [-] (102992) accepted ('10.222.0.62', 40886) {{(pid=102992) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 23 19:33:25.522718 dv-cinder-819011-1-iscsi neutron-server[102995]: DEBUG neutron_lib.callbacks.manager [None req-1f69e9ad-9d9c-4e12-a8b2-c66d9a22ed70 None None] Publish callbacks [] for port, precommit_update {{(pid=102995) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:33:25.572001 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.db.l3_dvr_db [None req-0173cc2b-73c8-460f-a7c9-754012a34c5d None None] Set router 01438284-e62a-4056-8ee2-4899a051e144 gateway port host: dv-cinder-819011-1-iscsi {{(pid=102994) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 23 19:33:25.609843 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-feee264e-3f18-4ece-9ff5-f5daf8d1ba0b req-1fd3db43-2289-4081-9cfa-3bc5a5a14130 tempest-DeleteServersTestJSON-453817978 tempest-DeleteServersTestJSON-453817978-project] 10.222.0.62 "GET /v2.0/ports?device_id=5e3c1406-dc8c-414a-bcc5-55c7c963e1df HTTP/1.1" status: 200 len: 210 time: 0.0488291 Nov 23 19:33:25.664216 dv-cinder-819011-1-iscsi neutron-server[102995]: DEBUG neutron_lib.callbacks.manager [None req-1f69e9ad-9d9c-4e12-a8b2-c66d9a22ed70 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7918660', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-15067', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560168', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8783631423946', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8783631008732', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8783631008750'] for port, after_update {{(pid=102995) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:33:25.721292 dv-cinder-819011-1-iscsi neutron-server[102995]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c7bfea5a-f065-47a8-979c-7fffb65515c5 None None] Pushing event updated for resources: {'Port': ['ID=ccf9cfdb-e164-48bc-b433-5906352d8e1a,revision_number=2']} {{(pid=102995) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 23 19:33:25.735115 dv-cinder-819011-1-iscsi neutron-server[102995]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c7bfea5a-f065-47a8-979c-7fffb65515c5 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-819011-1-iscsi {{(pid=102995) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 23 19:33:25.736448 dv-cinder-819011-1-iscsi neutron-server[102995]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c7bfea5a-f065-47a8-979c-7fffb65515c5 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-819011-1-iscsi {{(pid=102995) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 23 19:33:25.737004 dv-cinder-819011-1-iscsi neutron-server[102995]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c7bfea5a-f065-47a8-979c-7fffb65515c5 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-819011-1-iscsi {{(pid=102995) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 23 19:33:25.737992 dv-cinder-819011-1-iscsi neutron-server[102995]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c7bfea5a-f065-47a8-979c-7fffb65515c5 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-819011-1-iscsi {{(pid=102995) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 23 19:33:25.738510 dv-cinder-819011-1-iscsi neutron-server[102995]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c7bfea5a-f065-47a8-979c-7fffb65515c5 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-819011-1-iscsi {{(pid=102995) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 23 19:33:25.739009 dv-cinder-819011-1-iscsi neutron-server[102995]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c7bfea5a-f065-47a8-979c-7fffb65515c5 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-819011-1-iscsi {{(pid=102995) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 23 19:33:25.739506 dv-cinder-819011-1-iscsi neutron-server[102995]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c7bfea5a-f065-47a8-979c-7fffb65515c5 None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-819011-1-iscsi {{(pid=102995) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 23 19:33:25.740151 dv-cinder-819011-1-iscsi neutron-server[102995]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c7bfea5a-f065-47a8-979c-7fffb65515c5 None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-819011-1-iscsi {{(pid=102995) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 23 19:33:25.740701 dv-cinder-819011-1-iscsi neutron-server[102995]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c7bfea5a-f065-47a8-979c-7fffb65515c5 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-819011-1-iscsi {{(pid=102995) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 23 19:33:25.741175 dv-cinder-819011-1-iscsi neutron-server[102995]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c7bfea5a-f065-47a8-979c-7fffb65515c5 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-819011-1-iscsi {{(pid=102995) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 23 19:33:25.741830 dv-cinder-819011-1-iscsi neutron-server[102995]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c7bfea5a-f065-47a8-979c-7fffb65515c5 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-819011-1-iscsi {{(pid=102995) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 23 19:33:25.742347 dv-cinder-819011-1-iscsi neutron-server[102995]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c7bfea5a-f065-47a8-979c-7fffb65515c5 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-819011-1-iscsi {{(pid=102995) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 23 19:33:25.743894 dv-cinder-819011-1-iscsi neutron-server[102995]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c7bfea5a-f065-47a8-979c-7fffb65515c5 None None] Tracked resource versions report: Nov 23 19:33:25.743894 dv-cinder-819011-1-iscsi neutron-server[102995]: pushed versions: Nov 23 19:33:25.743894 dv-cinder-819011-1-iscsi neutron-server[102995]: { 'AddressGroup': {'1.2'}, Nov 23 19:33:25.743894 dv-cinder-819011-1-iscsi neutron-server[102995]: 'ConntrackHelper': {'1.0'}, Nov 23 19:33:25.743894 dv-cinder-819011-1-iscsi neutron-server[102995]: 'Log': {'1.0'}, Nov 23 19:33:25.743894 dv-cinder-819011-1-iscsi neutron-server[102995]: 'Network': {'1.1'}, Nov 23 19:33:25.743894 dv-cinder-819011-1-iscsi neutron-server[102995]: 'Port': {'1.7'}, Nov 23 19:33:25.743894 dv-cinder-819011-1-iscsi neutron-server[102995]: 'PortForwarding': {'1.2'}, Nov 23 19:33:25.743894 dv-cinder-819011-1-iscsi neutron-server[102995]: 'QosPolicy': {'1.10'}, Nov 23 19:33:25.743894 dv-cinder-819011-1-iscsi neutron-server[102995]: 'SecurityGroup': {'1.5'}, Nov 23 19:33:25.743894 dv-cinder-819011-1-iscsi neutron-server[102995]: 'SecurityGroupRule': {'1.2'}, Nov 23 19:33:25.743894 dv-cinder-819011-1-iscsi neutron-server[102995]: 'SubPort': {'1.0'}, Nov 23 19:33:25.743894 dv-cinder-819011-1-iscsi neutron-server[102995]: 'Subnet': {'1.1'}, Nov 23 19:33:25.743894 dv-cinder-819011-1-iscsi neutron-server[102995]: 'Trunk': {'1.1'}} Nov 23 19:33:25.743894 dv-cinder-819011-1-iscsi neutron-server[102995]: consumer versions: Nov 23 19:33:25.743894 dv-cinder-819011-1-iscsi neutron-server[102995]: { DHCP agent@dv-cinder-819011-1-iscsi: {}, Nov 23 19:33:25.743894 dv-cinder-819011-1-iscsi neutron-server[102995]: HyperV agent@hv-cinder-81901: {}, Nov 23 19:33:25.743894 dv-cinder-819011-1-iscsi neutron-server[102995]: L3 agent@dv-cinder-819011-1-iscsi: {}, Nov 23 19:33:25.743894 dv-cinder-819011-1-iscsi neutron-server[102995]: Metadata agent@dv-cinder-819011-1-iscsi: {}, Nov 23 19:33:25.743894 dv-cinder-819011-1-iscsi neutron-server[102995]: Metering agent@dv-cinder-819011-1-iscsi: {}, Nov 23 19:33:25.743894 dv-cinder-819011-1-iscsi neutron-server[102995]: Open vSwitch agent@dv-cinder-819011-1-iscsi: { 'AddressGroup': '1.2', Nov 23 19:33:25.743894 dv-cinder-819011-1-iscsi neutron-server[102995]: 'ConntrackHelper': '1.0', Nov 23 19:33:25.743894 dv-cinder-819011-1-iscsi neutron-server[102995]: 'Log': '1.0', Nov 23 19:33:25.743894 dv-cinder-819011-1-iscsi neutron-server[102995]: 'Network': '1.1', Nov 23 19:33:25.743894 dv-cinder-819011-1-iscsi neutron-server[102995]: 'Port': '1.7', Nov 23 19:33:25.743894 dv-cinder-819011-1-iscsi neutron-server[102995]: 'PortForwarding': '1.2', Nov 23 19:33:25.743894 dv-cinder-819011-1-iscsi neutron-server[102995]: 'QosPolicy': '1.10', Nov 23 19:33:25.743894 dv-cinder-819011-1-iscsi neutron-server[102995]: 'SecurityGroup': '1.5', Nov 23 19:33:25.743894 dv-cinder-819011-1-iscsi neutron-server[102995]: 'SecurityGroupRule': '1.2', Nov 23 19:33:25.743894 dv-cinder-819011-1-iscsi neutron-server[102995]: 'SubPort': '1.0', Nov 23 19:33:25.743894 dv-cinder-819011-1-iscsi neutron-server[102995]: 'Subnet': '1.1', Nov 23 19:33:25.743894 dv-cinder-819011-1-iscsi neutron-server[102995]: 'Trunk': '1.1'}} Nov 23 19:33:25.743894 dv-cinder-819011-1-iscsi neutron-server[102995]: {{(pid=102995) report /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:175}} Nov 23 19:33:25.763090 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.plugins.ml2.rpc [None req-eb87b2c3-3339-4249-8b85-e695b5b4e1f9 None None] Device 32f2a89f-0f71-4db4-a1fd-d54f31e610e0 up at agent ovs-agent-dv-cinder-819011-1-iscsi {{(pid=102994) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 23 19:33:25.776874 dv-cinder-819011-1-iscsi neutron-server[102995]: DEBUG neutron.plugins.ml2.managers [None req-1f69e9ad-9d9c-4e12-a8b2-c66d9a22ed70 None None] Attempting to bind port ccf9cfdb-e164-48bc-b433-5906352d8e1a on host dv-cinder-819011-1-iscsi for vnic_type normal with profile {{(pid=102995) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 23 19:33:25.777618 dv-cinder-819011-1-iscsi neutron-server[102995]: DEBUG neutron.plugins.ml2.managers [None req-1f69e9ad-9d9c-4e12-a8b2-c66d9a22ed70 None None] Attempting to bind port ccf9cfdb-e164-48bc-b433-5906352d8e1a by drivers openvswitch,hyperv on host dv-cinder-819011-1-iscsi at level 0 using segments [{'id': '3cb5e60b-103a-47d0-a28b-d68e3159d032', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'a93e254e-aac9-4233-9e4d-4290fd0458e4'}] {{(pid=102995) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 23 19:33:25.778167 dv-cinder-819011-1-iscsi neutron-server[102995]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-1f69e9ad-9d9c-4e12-a8b2-c66d9a22ed70 None None] Attempting to bind port ccf9cfdb-e164-48bc-b433-5906352d8e1a on network a93e254e-aac9-4233-9e4d-4290fd0458e4 {{(pid=102995) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 23 19:33:25.787359 dv-cinder-819011-1-iscsi neutron-server[102995]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-1f69e9ad-9d9c-4e12-a8b2-c66d9a22ed70 None None] Checking agent: {'id': '668c8953-047c-499e-8c0d-db838fac1668', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-819011-1-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 23, 19, 25, 17), 'started_at': datetime.datetime(2021, 11, 23, 19, 25, 47), 'heartbeat_timestamp': datetime.datetime(2021, 11, 23, 19, 33, 17), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-819011-1-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=102995) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 23 19:33:25.788063 dv-cinder-819011-1-iscsi neutron-server[102995]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-1f69e9ad-9d9c-4e12-a8b2-c66d9a22ed70 None None] Checking segment: {'id': '3cb5e60b-103a-47d0-a28b-d68e3159d032', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'a93e254e-aac9-4233-9e4d-4290fd0458e4'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102995) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 23 19:33:25.788796 dv-cinder-819011-1-iscsi neutron-server[102995]: DEBUG neutron_lib.callbacks.manager [None req-1f69e9ad-9d9c-4e12-a8b2-c66d9a22ed70 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=102995) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:33:25.789341 dv-cinder-819011-1-iscsi neutron-server[102995]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-1f69e9ad-9d9c-4e12-a8b2-c66d9a22ed70 None None] Bound using segment: {'id': '3cb5e60b-103a-47d0-a28b-d68e3159d032', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'a93e254e-aac9-4233-9e4d-4290fd0458e4'} {{(pid=102995) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 23 19:33:25.790170 dv-cinder-819011-1-iscsi neutron-server[102995]: DEBUG neutron.plugins.ml2.managers [None req-1f69e9ad-9d9c-4e12-a8b2-c66d9a22ed70 None None] Bound port: ccf9cfdb-e164-48bc-b433-5906352d8e1a, host: dv-cinder-819011-1-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '3cb5e60b-103a-47d0-a28b-d68e3159d032', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'a93e254e-aac9-4233-9e4d-4290fd0458e4'}}] {{(pid=102995) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 23 19:33:25.790730 dv-cinder-819011-1-iscsi neutron-server[102995]: DEBUG neutron_lib.callbacks.manager [None req-1f69e9ad-9d9c-4e12-a8b2-c66d9a22ed70 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7921281'] for port, before_update {{(pid=102995) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:33:25.838556 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.db.db_base_plugin_common [None req-90c11ca9-0dd5-41c0-a350-a6a440cf2627 admin admin] Allocated IP 172.20.0.1 (07eeb44e-4cdb-4c58-a83d-1dd8ab1ccb8a/e4fda56f-85ff-422d-adad-ec00db6378af/67851a82-183f-4bba-b05f-793c8b4e7ec3) {{(pid=102993) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 23 19:33:25.862727 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.db.provisioning_blocks [None req-2cedc5e8-b114-4a50-9d04-975e5fa57b5b None None] Provisioning complete for port 32f2a89f-0f71-4db4-a1fd-d54f31e610e0 triggered by entity DHCP. {{(pid=102994) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 23 19:33:25.863411 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron_lib.callbacks.manager [None req-2cedc5e8-b114-4a50-9d04-975e5fa57b5b None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-8355713'] for port, provisioning_complete {{(pid=102994) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:33:25.880395 dv-cinder-819011-1-iscsi neutron-server[102995]: DEBUG neutron.plugins.ml2.db [None req-1f69e9ad-9d9c-4e12-a8b2-c66d9a22ed70 None None] For port ccf9cfdb-e164-48bc-b433-5906352d8e1a, host dv-cinder-819011-1-iscsi, cleared binding levels {{(pid=102995) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 23 19:33:25.884881 dv-cinder-819011-1-iscsi neutron-server[102995]: DEBUG neutron.plugins.ml2.db [None req-1f69e9ad-9d9c-4e12-a8b2-c66d9a22ed70 None None] For port ccf9cfdb-e164-48bc-b433-5906352d8e1a, host dv-cinder-819011-1-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-819011-1-iscsi',level=0,port_id=ccf9cfdb-e164-48bc-b433-5906352d8e1a,segment=NetworkSegment(3cb5e60b-103a-47d0-a28b-d68e3159d032),segment_id=3cb5e60b-103a-47d0-a28b-d68e3159d032)] {{(pid=102995) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 23 19:33:25.927176 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.db.provisioning_blocks [None req-eb87b2c3-3339-4249-8b85-e695b5b4e1f9 None None] Provisioning complete for port 32f2a89f-0f71-4db4-a1fd-d54f31e610e0 triggered by entity L2. {{(pid=102994) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 23 19:33:25.928464 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron_lib.callbacks.manager [None req-eb87b2c3-3339-4249-8b85-e695b5b4e1f9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-8355713'] for port, provisioning_complete {{(pid=102994) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:33:25.958796 dv-cinder-819011-1-iscsi neutron-server[102995]: DEBUG neutron_lib.callbacks.manager [None req-1f69e9ad-9d9c-4e12-a8b2-c66d9a22ed70 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7918660', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-15067', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560168', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8783631423946', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8783631008732', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8783631008750'] for port, after_update {{(pid=102995) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:33:26.078956 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.db.l3_hamode_db [None req-0173cc2b-73c8-460f-a7c9-754012a34c5d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '01438284-e62a-4056-8ee2-4899a051e144', 'name': 'tempest-AttachVolumeShelveTestJSON-1609224522-router', 'tenant_id': '2d925fb59ba34355aa85758374d76928', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'a93e254e-aac9-4233-9e4d-4290fd0458e4', 'external_fixed_ips': [{'subnet_id': 'e0b32f3d-83d6-439a-bbed-01df7cf01051', 'ip_address': '172.27.1.99'}], 'enable_snat': True}, 'gw_port_id': 'a6140c41-82e2-4d62-8e5f-f3fc119a374e', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-23T19:33:21Z', 'updated_at': '2021-11-23T19:33:23Z', 'revision_number': 3, 'project_id': '2d925fb59ba34355aa85758374d76928', 'gw_port': {'id': 'a6140c41-82e2-4d62-8e5f-f3fc119a374e', 'name': '', 'network_id': 'a93e254e-aac9-4233-9e4d-4290fd0458e4', 'tenant_id': '', 'mac_address': 'fa:16:3e:32:52:e2', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '01438284-e62a-4056-8ee2-4899a051e144', 'device_owner': 'network:router_gateway', 'standard_attr_id': 59, 'fixed_ips': [{'subnet_id': 'e0b32f3d-83d6-439a-bbed-01df7cf01051', 'ip_address': '172.27.1.99', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-23T19:33:22Z', 'updated_at': '2021-11-23T19:33:22Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': 'e0b32f3d-83d6-439a-bbed-01df7cf01051', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-819011-1-iscsi'}], 'dv-cinder-819011-1-iscsi', False) {} {{(pid=102994) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 23 19:33:26.094233 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-90c11ca9-0dd5-41c0-a350-a6a440cf2627 admin admin] Publish callbacks [] for port, precommit_create {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:33:26.121965 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.wsgi [-] (102992) accepted ('10.222.0.62', 40918) {{(pid=102992) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 23 19:33:26.129172 dv-cinder-819011-1-iscsi neutron-server[102995]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c7bfea5a-f065-47a8-979c-7fffb65515c5 None None] Pushing event updated for resources: {'Port': ['ID=ccf9cfdb-e164-48bc-b433-5906352d8e1a,revision_number=3']} {{(pid=102995) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 23 19:33:26.134865 dv-cinder-819011-1-iscsi neutron-server[102995]: DEBUG neutron.db.l3_dvrscheduler_db [None req-1f69e9ad-9d9c-4e12-a8b2-c66d9a22ed70 None None] Routers {'dcdcae73-a8c6-43f9-b388-80519245de0c'} bound to L3 agent in host dv-cinder-819011-1-iscsi {{(pid=102995) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 23 19:33:26.145567 dv-cinder-819011-1-iscsi neutron-server[102995]: DEBUG neutron.db.l3_hamode_db [None req-1f69e9ad-9d9c-4e12-a8b2-c66d9a22ed70 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-819011-1-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2021-11-23T19:25:14Z,description=,heartbeat_timestamp=2021-11-23T19:33:14Z,host='dv-cinder-819011-1-iscsi',id=1b20f2c4-70b6-43c3-b9bd-0062cc9e57ac,load=0,resource_versions=,resources_synced=,started_at=2021-11-23T19:25:15Z,topic='l3_agent')) {'router_ids': ['dcdcae73-a8c6-43f9-b388-80519245de0c'], 'active': True} {{(pid=102995) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 23 19:33:26.151187 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-0173cc2b-73c8-460f-a7c9-754012a34c5d None None] Checking router: 01438284-e62a-4056-8ee2-4899a051e144 for host: dv-cinder-819011-1-iscsi {{(pid=102994) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 23 19:33:26.151807 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-0173cc2b-73c8-460f-a7c9-754012a34c5d None None] Updating router 01438284-e62a-4056-8ee2-4899a051e144 port a6140c41-82e2-4d62-8e5f-f3fc119a374e binding host dv-cinder-819011-1-iscsi {{(pid=102994) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Nov 23 19:33:26.186692 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron_lib.callbacks.manager [None req-0173cc2b-73c8-460f-a7c9-754012a34c5d None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7921281'] for port, before_update {{(pid=102994) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:33:26.296218 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-90c11ca9-0dd5-41c0-a350-a6a440cf2627 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7918660', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-15067', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560168', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8783631008714'] for port, after_create {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:33:26.304399 dv-cinder-819011-1-iscsi neutron-server[102995]: DEBUG neutron.db.l3_dvr_db [None req-1f69e9ad-9d9c-4e12-a8b2-c66d9a22ed70 None None] Set router dcdcae73-a8c6-43f9-b388-80519245de0c gateway port host: dv-cinder-819011-1-iscsi {{(pid=102995) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 23 19:33:26.400162 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-90c11ca9-0dd5-41c0-a350-a6a440cf2627 admin admin] Network 07eeb44e-4cdb-4c58-a83d-1dd8ab1ccb8a is already hosted by enough agents. {{(pid=102993) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 23 19:33:26.423491 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.scheduler.base_scheduler [None req-90c11ca9-0dd5-41c0-a350-a6a440cf2627 admin admin] Resources bound (agent type, host, resource id): {{(pid=102993) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 23 19:33:26.428699 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.db.l3_dvrscheduler_db [None req-90c11ca9-0dd5-41c0-a350-a6a440cf2627 admin admin] Received port after_create {{(pid=102993) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 23 19:33:26.428699 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-90c11ca9-0dd5-41c0-a350-a6a440cf2627 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-926676'] for router_interface, before_create {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:33:26.440647 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [None req-5def81fb-c502-4e35-b582-3671b03e4d41 admin admin] Publish callbacks [] for security_group, before_create {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:33:26.674071 dv-cinder-819011-1-iscsi neutron-server[102995]: DEBUG neutron.db.l3_hamode_db [None req-1f69e9ad-9d9c-4e12-a8b2-c66d9a22ed70 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'dcdcae73-a8c6-43f9-b388-80519245de0c', 'name': 'tempest-ServerRescueNegativeTestJSON-1810346202-router', 'tenant_id': 'c15ab51e579448cfb7a4b3e4f8049687', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'a93e254e-aac9-4233-9e4d-4290fd0458e4', 'external_fixed_ips': [{'subnet_id': 'e0b32f3d-83d6-439a-bbed-01df7cf01051', 'ip_address': '172.27.1.194'}], 'enable_snat': True}, 'gw_port_id': 'ccf9cfdb-e164-48bc-b433-5906352d8e1a', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-23T19:33:20Z', 'updated_at': '2021-11-23T19:33:22Z', 'revision_number': 3, 'project_id': 'c15ab51e579448cfb7a4b3e4f8049687', 'gw_port': {'id': 'ccf9cfdb-e164-48bc-b433-5906352d8e1a', 'name': '', 'network_id': 'a93e254e-aac9-4233-9e4d-4290fd0458e4', 'tenant_id': '', 'mac_address': 'fa:16:3e:29:81:78', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'dcdcae73-a8c6-43f9-b388-80519245de0c', 'device_owner': 'network:router_gateway', 'standard_attr_id': 58, 'fixed_ips': [{'subnet_id': 'e0b32f3d-83d6-439a-bbed-01df7cf01051', 'ip_address': '172.27.1.194', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-819011-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-23T19:33:21Z', 'updated_at': '2021-11-23T19:33:25Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'e0b32f3d-83d6-439a-bbed-01df7cf01051', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-819011-1-iscsi'}], 'dv-cinder-819011-1-iscsi', False) {} {{(pid=102995) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 23 19:33:26.713376 dv-cinder-819011-1-iscsi neutron-server[102995]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-1f69e9ad-9d9c-4e12-a8b2-c66d9a22ed70 None None] The sync data for ids ['dcdcae73-a8c6-43f9-b388-80519245de0c'] in dv-cinder-819011-1-iscsi is: [{'id': 'dcdcae73-a8c6-43f9-b388-80519245de0c', 'name': 'tempest-ServerRescueNegativeTestJSON-1810346202-router', 'tenant_id': 'c15ab51e579448cfb7a4b3e4f8049687', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'a93e254e-aac9-4233-9e4d-4290fd0458e4', 'external_fixed_ips': [{'subnet_id': 'e0b32f3d-83d6-439a-bbed-01df7cf01051', 'ip_address': '172.27.1.194'}], 'enable_snat': True}, 'gw_port_id': 'ccf9cfdb-e164-48bc-b433-5906352d8e1a', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-23T19:33:20Z', 'updated_at': '2021-11-23T19:33:22Z', 'revision_number': 3, 'project_id': 'c15ab51e579448cfb7a4b3e4f8049687', 'gw_port': {'id': 'ccf9cfdb-e164-48bc-b433-5906352d8e1a', 'name': '', 'network_id': 'a93e254e-aac9-4233-9e4d-4290fd0458e4', 'tenant_id': '', 'mac_address': 'fa:16:3e:29:81:78', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'dcdcae73-a8c6-43f9-b388-80519245de0c', 'device_owner': 'network:router_gateway', 'standard_attr_id': 58, 'fixed_ips': [{'subnet_id': 'e0b32f3d-83d6-439a-bbed-01df7cf01051', 'ip_address': '172.27.1.194', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-819011-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-23T19:33:21Z', 'updated_at': '2021-11-23T19:33:25Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'e0b32f3d-83d6-439a-bbed-01df7cf01051', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-819011-1-iscsi'}] {{(pid=102995) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 23 19:33:26.750939 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron_lib.callbacks.manager [None req-0173cc2b-73c8-460f-a7c9-754012a34c5d None None] Publish callbacks [] for port, precommit_update {{(pid=102994) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:33:26.775080 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [None req-646bca3c-4f0d-44a1-b793-33e725f16209 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7921281'] for port, before_create {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:33:26.855938 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-90c11ca9-0dd5-41c0-a350-a6a440cf2627 admin admin] Pushing event updated for resources: {'Port': ['ID=67851a82-183f-4bba-b05f-793c8b4e7ec3,revision_number=1']} {{(pid=102993) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 23 19:33:26.885773 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron_lib.callbacks.manager [None req-0173cc2b-73c8-460f-a7c9-754012a34c5d None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7918660', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-15067', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560168', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8783631423946', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8783631008732', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8783631008750'] for port, after_update {{(pid=102994) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:33:26.896568 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-c2b1cced-07a1-4058-bd9b-89daa75845f6 req-344a84ab-b278-4b9f-849c-a65235bce175 tempest-DeleteServersTestJSON-453817978 tempest-DeleteServersTestJSON-453817978-project] 10.222.0.62 "GET /v2.0/ports?device_id=5e3c1406-dc8c-414a-bcc5-55c7c963e1df HTTP/1.1" status: 200 len: 210 time: 0.0414209 Nov 23 19:33:26.947364 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [None req-5def81fb-c502-4e35-b582-3671b03e4d41 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:33:26.987118 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-90c11ca9-0dd5-41c0-a350-a6a440cf2627 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7921281'] for port, before_update {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:33:26.997910 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.plugins.ml2.managers [None req-0173cc2b-73c8-460f-a7c9-754012a34c5d None None] Attempting to bind port a6140c41-82e2-4d62-8e5f-f3fc119a374e on host dv-cinder-819011-1-iscsi for vnic_type normal with profile {{(pid=102994) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 23 19:33:26.998525 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.plugins.ml2.managers [None req-0173cc2b-73c8-460f-a7c9-754012a34c5d None None] Attempting to bind port a6140c41-82e2-4d62-8e5f-f3fc119a374e by drivers openvswitch,hyperv on host dv-cinder-819011-1-iscsi at level 0 using segments [{'id': '3cb5e60b-103a-47d0-a28b-d68e3159d032', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'a93e254e-aac9-4233-9e4d-4290fd0458e4'}] {{(pid=102994) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 23 19:33:26.999105 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-0173cc2b-73c8-460f-a7c9-754012a34c5d None None] Attempting to bind port a6140c41-82e2-4d62-8e5f-f3fc119a374e on network a93e254e-aac9-4233-9e4d-4290fd0458e4 {{(pid=102994) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 23 19:33:27.001463 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c35d8c46-606f-43d3-8ae3-2ba7cdf3a009 None None] Pushing event updated for resources: {'Port': ['ID=a6140c41-82e2-4d62-8e5f-f3fc119a374e,revision_number=2']} {{(pid=102994) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 23 19:33:27.008929 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-0173cc2b-73c8-460f-a7c9-754012a34c5d None None] Checking agent: {'id': '668c8953-047c-499e-8c0d-db838fac1668', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-819011-1-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 23, 19, 25, 17), 'started_at': datetime.datetime(2021, 11, 23, 19, 25, 47), 'heartbeat_timestamp': datetime.datetime(2021, 11, 23, 19, 33, 17), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-819011-1-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=102994) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 23 19:33:27.009645 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-0173cc2b-73c8-460f-a7c9-754012a34c5d None None] Checking segment: {'id': '3cb5e60b-103a-47d0-a28b-d68e3159d032', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'a93e254e-aac9-4233-9e4d-4290fd0458e4'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102994) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 23 19:33:27.010248 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron_lib.callbacks.manager [None req-0173cc2b-73c8-460f-a7c9-754012a34c5d None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=102994) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:33:27.010973 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-0173cc2b-73c8-460f-a7c9-754012a34c5d None None] Bound using segment: {'id': '3cb5e60b-103a-47d0-a28b-d68e3159d032', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'a93e254e-aac9-4233-9e4d-4290fd0458e4'} {{(pid=102994) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 23 19:33:27.011942 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.plugins.ml2.managers [None req-0173cc2b-73c8-460f-a7c9-754012a34c5d None None] Bound port: a6140c41-82e2-4d62-8e5f-f3fc119a374e, host: dv-cinder-819011-1-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '3cb5e60b-103a-47d0-a28b-d68e3159d032', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'a93e254e-aac9-4233-9e4d-4290fd0458e4'}}] {{(pid=102994) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 23 19:33:27.012565 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron_lib.callbacks.manager [None req-0173cc2b-73c8-460f-a7c9-754012a34c5d None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7921281'] for port, before_update {{(pid=102994) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:33:27.090698 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [None req-5def81fb-c502-4e35-b582-3671b03e4d41 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-623933'] for security_group, after_create {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:33:27.128692 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.plugins.ml2.db [None req-0173cc2b-73c8-460f-a7c9-754012a34c5d None None] For port a6140c41-82e2-4d62-8e5f-f3fc119a374e, host dv-cinder-819011-1-iscsi, cleared binding levels {{(pid=102994) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 23 19:33:27.132836 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.plugins.ml2.db [None req-0173cc2b-73c8-460f-a7c9-754012a34c5d None None] For port a6140c41-82e2-4d62-8e5f-f3fc119a374e, host dv-cinder-819011-1-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-819011-1-iscsi',level=0,port_id=a6140c41-82e2-4d62-8e5f-f3fc119a374e,segment=NetworkSegment(3cb5e60b-103a-47d0-a28b-d68e3159d032),segment_id=3cb5e60b-103a-47d0-a28b-d68e3159d032)] {{(pid=102994) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 23 19:33:27.197979 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [None req-5def81fb-c502-4e35-b582-3671b03e4d41 admin admin] 10.222.0.62 "GET /v2.0/security-groups?tenant_id=141fa94a9f464d909a64362e4a068a3b&name=default HTTP/1.1" status: 200 len: 2992 time: 1.0715175 Nov 23 19:33:27.199156 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5def81fb-c502-4e35-b582-3671b03e4d41 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=c180fb22-a067-4545-aa3d-7624aef2eacf,revision_number=1']} {{(pid=102992) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 23 19:33:27.220596 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.wsgi [-] (102993) accepted ('10.222.0.62', 40944) {{(pid=102993) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 23 19:33:27.240545 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron_lib.callbacks.manager [None req-0173cc2b-73c8-460f-a7c9-754012a34c5d None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7918660', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-15067', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560168', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8783631423946', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8783631008732', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8783631008750'] for port, after_update {{(pid=102994) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:33:27.263099 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.db.db_base_plugin_common [None req-646bca3c-4f0d-44a1-b793-33e725f16209 admin admin] Allocated IP 172.20.0.1 (fc901312-2937-4784-8a6d-c046666e8bf8/2caca985-6ed6-4ef7-ba49-7b7410bea160/c96e4c46-b1fa-4e6c-9fe8-9c516c4ee278) {{(pid=102992) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 23 19:33:27.323535 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.db.l3_dvrscheduler_db [None req-0173cc2b-73c8-460f-a7c9-754012a34c5d None None] Routers {'01438284-e62a-4056-8ee2-4899a051e144'} bound to L3 agent in host dv-cinder-819011-1-iscsi {{(pid=102994) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 23 19:33:27.324316 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.db.l3_hamode_db [None req-0173cc2b-73c8-460f-a7c9-754012a34c5d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-819011-1-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2021-11-23T19:25:14Z,description=,heartbeat_timestamp=2021-11-23T19:33:14Z,host='dv-cinder-819011-1-iscsi',id=1b20f2c4-70b6-43c3-b9bd-0062cc9e57ac,load=0,resource_versions=,resources_synced=,started_at=2021-11-23T19:25:15Z,topic='l3_agent')) {'router_ids': ['01438284-e62a-4056-8ee2-4899a051e144'], 'active': True} {{(pid=102994) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 23 19:33:27.422670 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-81c3b1cd-f3fd-441a-934e-94526c6829ff admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:33:27.453469 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-81c3b1cd-f3fd-441a-934e-94526c6829ff admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:33:27.497040 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [None req-646bca3c-4f0d-44a1-b793-33e725f16209 admin admin] Publish callbacks [] for port, precommit_create {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:33:27.519486 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-90c11ca9-0dd5-41c0-a350-a6a440cf2627 admin admin] Publish callbacks [] for port, precommit_update {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:33:27.531212 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c35d8c46-606f-43d3-8ae3-2ba7cdf3a009 None None] Pushing event updated for resources: {'Port': ['ID=a6140c41-82e2-4d62-8e5f-f3fc119a374e,revision_number=3']} {{(pid=102994) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 23 19:33:27.550680 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.plugins.ml2.rpc [None req-eb87b2c3-3339-4249-8b85-e695b5b4e1f9 None None] Device ccf9cfdb-e164-48bc-b433-5906352d8e1a up at agent ovs-agent-dv-cinder-819011-1-iscsi {{(pid=102994) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 23 19:33:27.603872 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-90c11ca9-0dd5-41c0-a350-a6a440cf2627 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7918660', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-15067', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560168', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8783631423946', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8783631008732', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8783631008750'] for port, after_update {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:33:27.818475 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-90c11ca9-0dd5-41c0-a350-a6a440cf2627 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-553426', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-932964'] for router_interface, after_create {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:33:27.824451 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [None req-646bca3c-4f0d-44a1-b793-33e725f16209 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7918660', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-15067', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560168', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8783631008714'] for port, after_create {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:33:27.825520 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-81c3b1cd-f3fd-441a-934e-94526c6829ff admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-623933'] for security_group, after_delete {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:33:27.825520 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-81c3b1cd-f3fd-441a-934e-94526c6829ff admin admin] Publish callbacks [] for security_group, before_response {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:33:27.825520 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [None req-81c3b1cd-f3fd-441a-934e-94526c6829ff admin admin] 10.222.0.62 "DELETE /v2.0/security-groups/c180fb22-a067-4545-aa3d-7624aef2eacf HTTP/1.1" status: 204 len: 168 time: 0.4465396 Nov 23 19:33:27.826145 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-646bca3c-4f0d-44a1-b793-33e725f16209 admin admin] Pushing event updated for resources: {'Port': ['ID=c96e4c46-b1fa-4e6c-9fe8-9c516c4ee278,revision_number=1']} {{(pid=102992) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 23 19:33:27.827350 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.db.l3_dvr_db [None req-0173cc2b-73c8-460f-a7c9-754012a34c5d None None] Set router 01438284-e62a-4056-8ee2-4899a051e144 gateway port host: dv-cinder-819011-1-iscsi {{(pid=102994) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 23 19:33:27.827634 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-81c3b1cd-f3fd-441a-934e-94526c6829ff admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=c180fb22-a067-4545-aa3d-7624aef2eacf,revision_number=None']} {{(pid=102993) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 23 19:33:27.827902 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-646bca3c-4f0d-44a1-b793-33e725f16209 admin admin] Network fc901312-2937-4784-8a6d-c046666e8bf8 is already hosted by enough agents. {{(pid=102992) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 23 19:33:27.827902 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.scheduler.base_scheduler [None req-646bca3c-4f0d-44a1-b793-33e725f16209 admin admin] Resources bound (agent type, host, resource id): {{(pid=102992) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 23 19:33:27.827902 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.db.l3_dvrscheduler_db [None req-646bca3c-4f0d-44a1-b793-33e725f16209 admin admin] Received port after_create {{(pid=102992) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 23 19:33:27.827902 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [None req-646bca3c-4f0d-44a1-b793-33e725f16209 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-926676'] for router_interface, before_create {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:33:27.871236 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-90c11ca9-0dd5-41c0-a350-a6a440cf2627 admin admin] Pushing event updated for resources: {'Port': ['ID=67851a82-183f-4bba-b05f-793c8b4e7ec3,revision_number=2']} {{(pid=102993) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 23 19:33:27.923326 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.db.provisioning_blocks [None req-eb87b2c3-3339-4249-8b85-e695b5b4e1f9 None None] Provisioning complete for port ccf9cfdb-e164-48bc-b433-5906352d8e1a triggered by entity L2. {{(pid=102994) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 23 19:33:27.924278 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron_lib.callbacks.manager [None req-eb87b2c3-3339-4249-8b85-e695b5b4e1f9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-8355713'] for port, provisioning_complete {{(pid=102994) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:33:27.950542 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-90c11ca9-0dd5-41c0-a350-a6a440cf2627 admin admin] Network 07eeb44e-4cdb-4c58-a83d-1dd8ab1ccb8a is already hosted by enough agents. {{(pid=102993) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 23 19:33:27.953635 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.scheduler.base_scheduler [None req-90c11ca9-0dd5-41c0-a350-a6a440cf2627 admin admin] Resources bound (agent type, host, resource id): {{(pid=102993) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 23 19:33:28.169237 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-90c11ca9-0dd5-41c0-a350-a6a440cf2627 admin admin] Router dcdcae73-a8c6-43f9-b388-80519245de0c has already been hosted by L3 agent 1b20f2c4-70b6-43c3-b9bd-0062cc9e57ac {{(pid=102993) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 23 19:33:28.217603 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.db.l3_hamode_db [None req-0173cc2b-73c8-460f-a7c9-754012a34c5d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '01438284-e62a-4056-8ee2-4899a051e144', 'name': 'tempest-AttachVolumeShelveTestJSON-1609224522-router', 'tenant_id': '2d925fb59ba34355aa85758374d76928', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'a93e254e-aac9-4233-9e4d-4290fd0458e4', 'external_fixed_ips': [{'subnet_id': 'e0b32f3d-83d6-439a-bbed-01df7cf01051', 'ip_address': '172.27.1.99'}], 'enable_snat': True}, 'gw_port_id': 'a6140c41-82e2-4d62-8e5f-f3fc119a374e', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-23T19:33:21Z', 'updated_at': '2021-11-23T19:33:23Z', 'revision_number': 3, 'project_id': '2d925fb59ba34355aa85758374d76928', 'gw_port': {'id': 'a6140c41-82e2-4d62-8e5f-f3fc119a374e', 'name': '', 'network_id': 'a93e254e-aac9-4233-9e4d-4290fd0458e4', 'tenant_id': '', 'mac_address': 'fa:16:3e:32:52:e2', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '01438284-e62a-4056-8ee2-4899a051e144', 'device_owner': 'network:router_gateway', 'standard_attr_id': 59, 'fixed_ips': [{'subnet_id': 'e0b32f3d-83d6-439a-bbed-01df7cf01051', 'ip_address': '172.27.1.99', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-819011-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-23T19:33:22Z', 'updated_at': '2021-11-23T19:33:27Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'e0b32f3d-83d6-439a-bbed-01df7cf01051', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-819011-1-iscsi'}], 'dv-cinder-819011-1-iscsi', False) {} {{(pid=102994) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 23 19:33:28.249876 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-0173cc2b-73c8-460f-a7c9-754012a34c5d None None] The sync data for ids ['01438284-e62a-4056-8ee2-4899a051e144'] in dv-cinder-819011-1-iscsi is: [{'id': '01438284-e62a-4056-8ee2-4899a051e144', 'name': 'tempest-AttachVolumeShelveTestJSON-1609224522-router', 'tenant_id': '2d925fb59ba34355aa85758374d76928', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'a93e254e-aac9-4233-9e4d-4290fd0458e4', 'external_fixed_ips': [{'subnet_id': 'e0b32f3d-83d6-439a-bbed-01df7cf01051', 'ip_address': '172.27.1.99'}], 'enable_snat': True}, 'gw_port_id': 'a6140c41-82e2-4d62-8e5f-f3fc119a374e', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-23T19:33:21Z', 'updated_at': '2021-11-23T19:33:23Z', 'revision_number': 3, 'project_id': '2d925fb59ba34355aa85758374d76928', 'gw_port': {'id': 'a6140c41-82e2-4d62-8e5f-f3fc119a374e', 'name': '', 'network_id': 'a93e254e-aac9-4233-9e4d-4290fd0458e4', 'tenant_id': '', 'mac_address': 'fa:16:3e:32:52:e2', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '01438284-e62a-4056-8ee2-4899a051e144', 'device_owner': 'network:router_gateway', 'standard_attr_id': 59, 'fixed_ips': [{'subnet_id': 'e0b32f3d-83d6-439a-bbed-01df7cf01051', 'ip_address': '172.27.1.99', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-819011-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-23T19:33:22Z', 'updated_at': '2021-11-23T19:33:27Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'e0b32f3d-83d6-439a-bbed-01df7cf01051', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-819011-1-iscsi'}] {{(pid=102994) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 23 19:33:28.271050 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.db.provisioning_blocks [None req-77a5c508-f097-4b3b-bcd2-f6de8dbc57fb None None] Provisioning complete for port c96e4c46-b1fa-4e6c-9fe8-9c516c4ee278 triggered by entity DHCP. {{(pid=102994) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 23 19:33:28.271314 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron_lib.callbacks.manager [None req-77a5c508-f097-4b3b-bcd2-f6de8dbc57fb None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-8355713'] for port, provisioning_complete {{(pid=102994) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:33:28.274059 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-695e7fa3-de8a-43a3-9eab-dafc6da30a45 req-9ecb1201-c578-4e08-9efd-e1cc55fdf950 tempest-DeleteServersTestJSON-453817978 tempest-DeleteServersTestJSON-453817978-project] 10.222.0.62 "GET /v2.0/ports?device_id=5e3c1406-dc8c-414a-bcc5-55c7c963e1df HTTP/1.1" status: 200 len: 210 time: 0.0441215 Nov 23 19:33:28.307326 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.plugins.ml2.plugin [None req-77a5c508-f097-4b3b-bcd2-f6de8dbc57fb None None] Port c96e4c46-b1fa-4e6c-9fe8-9c516c4ee278 cannot update to ACTIVE because it is not bound. {{(pid=102994) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 23 19:33:28.308772 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron_lib.callbacks.manager [None req-eb87b2c3-3339-4249-8b85-e695b5b4e1f9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7921281'] for port, before_update {{(pid=102994) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:33:28.342044 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.plugins.ml2.db [None req-eb87b2c3-3339-4249-8b85-e695b5b4e1f9 None None] For port ccf9cfdb-e164-48bc-b433-5906352d8e1a, host dv-cinder-819011-1-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-819011-1-iscsi',level=0,port_id=ccf9cfdb-e164-48bc-b433-5906352d8e1a,segment=NetworkSegment(3cb5e60b-103a-47d0-a28b-d68e3159d032),segment_id=3cb5e60b-103a-47d0-a28b-d68e3159d032)] {{(pid=102994) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 23 19:33:28.368920 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-90c11ca9-0dd5-41c0-a350-a6a440cf2627 admin admin] Notify agent at l3_agent.dv-cinder-819011-1-iscsi the message routers_updated {{(pid=102993) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 23 19:33:28.378765 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [None req-90c11ca9-0dd5-41c0-a350-a6a440cf2627 admin admin] 10.222.0.62 "PUT /v2.0/routers/dcdcae73-a8c6-43f9-b388-80519245de0c/add_router_interface HTTP/1.1" status: 200 len: 503 time: 4.0070887 Nov 23 19:33:28.404190 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron_lib.callbacks.manager [None req-eb87b2c3-3339-4249-8b85-e695b5b4e1f9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7918660', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-15067', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560168', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8783631423946', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8783631008732', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8783631008750'] for port, after_update {{(pid=102994) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:33:28.456084 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [None req-646bca3c-4f0d-44a1-b793-33e725f16209 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7921281'] for port, before_update {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:33:28.494872 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-eb87b2c3-3339-4249-8b85-e695b5b4e1f9 None None] Pushing event updated for resources: {'Port': ['ID=ccf9cfdb-e164-48bc-b433-5906352d8e1a,revision_number=4']} {{(pid=102994) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 23 19:33:28.708654 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [None req-646bca3c-4f0d-44a1-b793-33e725f16209 admin admin] Publish callbacks [] for port, precommit_update {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:33:28.793278 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [None req-646bca3c-4f0d-44a1-b793-33e725f16209 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7918660', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-15067', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560168', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8783631423946', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8783631008732', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8783631008750'] for port, after_update {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:33:28.794455 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [None req-646bca3c-4f0d-44a1-b793-33e725f16209 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-553426', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-932964'] for router_interface, after_create {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:33:28.963223 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-646bca3c-4f0d-44a1-b793-33e725f16209 admin admin] Pushing event updated for resources: {'Port': ['ID=c96e4c46-b1fa-4e6c-9fe8-9c516c4ee278,revision_number=2']} {{(pid=102992) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 23 19:33:28.975198 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-646bca3c-4f0d-44a1-b793-33e725f16209 admin admin] Network fc901312-2937-4784-8a6d-c046666e8bf8 is already hosted by enough agents. {{(pid=102992) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 23 19:33:28.978086 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.scheduler.base_scheduler [None req-646bca3c-4f0d-44a1-b793-33e725f16209 admin admin] Resources bound (agent type, host, resource id): {{(pid=102992) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 23 19:33:29.004196 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron_lib.callbacks.manager [None req-4bf48ff4-ecfb-4168-8b63-249b8c6e9f04 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8783631323329', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7978582'] for agent, after_update {{(pid=102994) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:33:29.178962 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-646bca3c-4f0d-44a1-b793-33e725f16209 admin admin] Router 01438284-e62a-4056-8ee2-4899a051e144 has already been hosted by L3 agent 1b20f2c4-70b6-43c3-b9bd-0062cc9e57ac {{(pid=102992) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 23 19:33:29.200720 dv-cinder-819011-1-iscsi neutron-server[102995]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-c8401697-c129-45cb-b23c-43b4293c6f37 None None] Sync routers for ids ['dcdcae73-a8c6-43f9-b388-80519245de0c'] in dv-cinder-819011-1-iscsi {{(pid=102995) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 23 19:33:29.218653 dv-cinder-819011-1-iscsi neutron-server[102995]: DEBUG neutron.db.l3_dvrscheduler_db [None req-c8401697-c129-45cb-b23c-43b4293c6f37 None None] Routers {'dcdcae73-a8c6-43f9-b388-80519245de0c'} bound to L3 agent in host dv-cinder-819011-1-iscsi {{(pid=102995) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 23 19:33:29.220400 dv-cinder-819011-1-iscsi neutron-server[102995]: DEBUG neutron.db.l3_hamode_db [None req-c8401697-c129-45cb-b23c-43b4293c6f37 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-819011-1-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2021-11-23T19:25:14Z,description=,heartbeat_timestamp=2021-11-23T19:33:14Z,host='dv-cinder-819011-1-iscsi',id=1b20f2c4-70b6-43c3-b9bd-0062cc9e57ac,load=0,resource_versions=,resources_synced=,started_at=2021-11-23T19:25:15Z,topic='l3_agent')) {'router_ids': ['dcdcae73-a8c6-43f9-b388-80519245de0c'], 'active': True} {{(pid=102995) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 23 19:33:29.343955 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.wsgi [-] (102993) accepted ('10.222.0.62', 41006) {{(pid=102993) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 23 19:33:29.390545 dv-cinder-819011-1-iscsi neutron-server[102995]: DEBUG neutron.db.l3_dvr_db [None req-c8401697-c129-45cb-b23c-43b4293c6f37 None None] Set router dcdcae73-a8c6-43f9-b388-80519245de0c gateway port host: dv-cinder-819011-1-iscsi {{(pid=102995) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 23 19:33:29.396377 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.db.provisioning_blocks [None req-686de753-2a11-4f77-9f60-2a42cc3adc7f None None] Provisioning complete for port c96e4c46-b1fa-4e6c-9fe8-9c516c4ee278 triggered by entity DHCP. {{(pid=102994) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 23 19:33:29.399501 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron_lib.callbacks.manager [None req-686de753-2a11-4f77-9f60-2a42cc3adc7f None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-8355713'] for port, provisioning_complete {{(pid=102994) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:33:29.432187 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-646bca3c-4f0d-44a1-b793-33e725f16209 admin admin] Notify agent at l3_agent.dv-cinder-819011-1-iscsi the message routers_updated {{(pid=102992) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 23 19:33:29.445116 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [None req-646bca3c-4f0d-44a1-b793-33e725f16209 admin admin] 10.222.0.62 "PUT /v2.0/routers/01438284-e62a-4056-8ee2-4899a051e144/add_router_interface HTTP/1.1" status: 200 len: 503 time: 4.0946176 Nov 23 19:33:29.550731 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.plugins.ml2.plugin [None req-686de753-2a11-4f77-9f60-2a42cc3adc7f None None] Port c96e4c46-b1fa-4e6c-9fe8-9c516c4ee278 cannot update to ACTIVE because it is not bound. {{(pid=102994) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 23 19:33:29.703547 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-f1439c13-53f3-4607-8134-dcd43f5384fb admin admin] Publish callbacks [] for security_group, before_create {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:33:29.716891 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.wsgi [-] (102992) accepted ('10.222.0.62', 41032) {{(pid=102992) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 23 19:33:29.719591 dv-cinder-819011-1-iscsi neutron-server[102992]: WARNING keystonemiddleware.auth_token [-] A valid token was submitted as a service token, but it was not a valid service token. This is incorrect but backwards compatible behaviour. This will be removed in future releases. Nov 23 19:33:29.729573 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.plugins.ml2.rpc [None req-eb87b2c3-3339-4249-8b85-e695b5b4e1f9 None None] Device ccf9cfdb-e164-48bc-b433-5906352d8e1a up at agent ovs-agent-dv-cinder-819011-1-iscsi {{(pid=102994) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 23 19:33:29.818650 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.db.provisioning_blocks [None req-eb87b2c3-3339-4249-8b85-e695b5b4e1f9 None None] Provisioning complete for port ccf9cfdb-e164-48bc-b433-5906352d8e1a triggered by entity L2. {{(pid=102994) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 23 19:33:29.819028 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron_lib.callbacks.manager [None req-eb87b2c3-3339-4249-8b85-e695b5b4e1f9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-8355713'] for port, provisioning_complete {{(pid=102994) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:33:29.884995 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-bd16f29d-ba87-45f5-ad61-c80c6782ad3d req-73398e27-57d8-4242-a518-2b19d5b4d529 tempest-DeleteServersTestJSON-453817978 tempest-DeleteServersTestJSON-453817978-project] 10.222.0.62 "GET /v2.0/ports?device_id=5e3c1406-dc8c-414a-bcc5-55c7c963e1df HTTP/1.1" status: 200 len: 210 time: 0.1668670 Nov 23 19:33:29.897726 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-17781b45-59ea-449c-b5b6-5d1c26c7c224 req-d20a0d88-af6d-47a4-9146-bbc529b5a781 tempest-ServerRescueNegativeTestJSON-1447477341 tempest-ServerRescueNegativeTestJSON-1447477341-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=102993) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:33:29.899425 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-17781b45-59ea-449c-b5b6-5d1c26c7c224 req-d20a0d88-af6d-47a4-9146-bbc529b5a781 tempest-ServerRescueNegativeTestJSON-1447477341 tempest-ServerRescueNegativeTestJSON-1447477341-project] 10.222.0.62 "GET /v2.0/networks?id=07eeb44e-4cdb-4c58-a83d-1dd8ab1ccb8a HTTP/1.1" status: 200 len: 819 time: 0.4321327 Nov 23 19:33:29.952366 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.plugins.ml2.rpc [None req-eb87b2c3-3339-4249-8b85-e695b5b4e1f9 None None] Device a6140c41-82e2-4d62-8e5f-f3fc119a374e up at agent ovs-agent-dv-cinder-819011-1-iscsi {{(pid=102994) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 23 19:33:29.954389 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-17781b45-59ea-449c-b5b6-5d1c26c7c224 req-867239e6-f9d7-4479-8933-fac0227d3f78 tempest-ServerRescueNegativeTestJSON-1447477341 tempest-ServerRescueNegativeTestJSON-1447477341-project] 10.222.0.62 "GET /v2.0/quotas/c15ab51e579448cfb7a4b3e4f8049687 HTTP/1.1" status: 200 len: 375 time: 0.0486388 Nov 23 19:33:29.984585 dv-cinder-819011-1-iscsi neutron-server[102995]: DEBUG neutron.db.l3_hamode_db [None req-c8401697-c129-45cb-b23c-43b4293c6f37 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'dcdcae73-a8c6-43f9-b388-80519245de0c', 'name': 'tempest-ServerRescueNegativeTestJSON-1810346202-router', 'tenant_id': 'c15ab51e579448cfb7a4b3e4f8049687', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'a93e254e-aac9-4233-9e4d-4290fd0458e4', 'external_fixed_ips': [{'subnet_id': 'e0b32f3d-83d6-439a-bbed-01df7cf01051', 'ip_address': '172.27.1.194'}], 'enable_snat': True}, 'gw_port_id': 'ccf9cfdb-e164-48bc-b433-5906352d8e1a', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-23T19:33:20Z', 'updated_at': '2021-11-23T19:33:26Z', 'revision_number': 4, 'project_id': 'c15ab51e579448cfb7a4b3e4f8049687', 'gw_port': {'id': 'ccf9cfdb-e164-48bc-b433-5906352d8e1a', 'name': '', 'network_id': 'a93e254e-aac9-4233-9e4d-4290fd0458e4', 'tenant_id': '', 'mac_address': 'fa:16:3e:29:81:78', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'dcdcae73-a8c6-43f9-b388-80519245de0c', 'device_owner': 'network:router_gateway', 'standard_attr_id': 58, 'fixed_ips': [{'subnet_id': 'e0b32f3d-83d6-439a-bbed-01df7cf01051', 'ip_address': '172.27.1.194', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-819011-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-23T19:33:21Z', 'updated_at': '2021-11-23T19:33:28Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'e0b32f3d-83d6-439a-bbed-01df7cf01051', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-819011-1-iscsi', '_interfaces': [{'id': '67851a82-183f-4bba-b05f-793c8b4e7ec3', 'name': '', 'network_id': '07eeb44e-4cdb-4c58-a83d-1dd8ab1ccb8a', 'tenant_id': 'c15ab51e579448cfb7a4b3e4f8049687', 'mac_address': 'fa:16:3e:a3:2e:cc', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'dcdcae73-a8c6-43f9-b388-80519245de0c', 'device_owner': 'network:router_interface', 'standard_attr_id': 65, 'fixed_ips': [{'subnet_id': 'e4fda56f-85ff-422d-adad-ec00db6378af', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-23T19:33:25Z', 'updated_at': '2021-11-23T19:33:27Z', 'revision_number': 2, 'project_id': 'c15ab51e579448cfb7a4b3e4f8049687', 'subnets': [{'id': 'e4fda56f-85ff-422d-adad-ec00db6378af', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-819011-1-iscsi', False) {} {{(pid=102995) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 23 19:33:30.027533 dv-cinder-819011-1-iscsi neutron-server[102995]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-c8401697-c129-45cb-b23c-43b4293c6f37 None None] Checking router: dcdcae73-a8c6-43f9-b388-80519245de0c for host: dv-cinder-819011-1-iscsi {{(pid=102995) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 23 19:33:30.028197 dv-cinder-819011-1-iscsi neutron-server[102995]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-c8401697-c129-45cb-b23c-43b4293c6f37 None None] Updating router dcdcae73-a8c6-43f9-b388-80519245de0c port 67851a82-183f-4bba-b05f-793c8b4e7ec3 binding host dv-cinder-819011-1-iscsi {{(pid=102995) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Nov 23 19:33:30.040323 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.db.provisioning_blocks [None req-eb87b2c3-3339-4249-8b85-e695b5b4e1f9 None None] Provisioning complete for port a6140c41-82e2-4d62-8e5f-f3fc119a374e triggered by entity L2. {{(pid=102994) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 23 19:33:30.041943 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron_lib.callbacks.manager [None req-eb87b2c3-3339-4249-8b85-e695b5b4e1f9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-8355713'] for port, provisioning_complete {{(pid=102994) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:33:30.076645 dv-cinder-819011-1-iscsi neutron-server[102995]: DEBUG neutron_lib.callbacks.manager [None req-c8401697-c129-45cb-b23c-43b4293c6f37 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7921281'] for port, before_update {{(pid=102995) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:33:30.085216 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-f1439c13-53f3-4607-8134-dcd43f5384fb admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:33:30.166377 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-17781b45-59ea-449c-b5b6-5d1c26c7c224 req-0a781efa-ae1a-457f-9993-2a0e746246ce tempest-ServerRescueNegativeTestJSON-1447477341 tempest-ServerRescueNegativeTestJSON-1447477341-project] 10.222.0.62 "GET /v2.0/ports?tenant_id=c15ab51e579448cfb7a4b3e4f8049687&fields=id HTTP/1.1" status: 200 len: 255 time: 0.2034762 Nov 23 19:33:30.183697 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron_lib.callbacks.manager [None req-eb87b2c3-3339-4249-8b85-e695b5b4e1f9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7921281'] for port, before_update {{(pid=102994) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:33:30.217340 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.plugins.ml2.db [None req-eb87b2c3-3339-4249-8b85-e695b5b4e1f9 None None] For port a6140c41-82e2-4d62-8e5f-f3fc119a374e, host dv-cinder-819011-1-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-819011-1-iscsi',level=0,port_id=a6140c41-82e2-4d62-8e5f-f3fc119a374e,segment=NetworkSegment(3cb5e60b-103a-47d0-a28b-d68e3159d032),segment_id=3cb5e60b-103a-47d0-a28b-d68e3159d032)] {{(pid=102994) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 23 19:33:30.295718 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron_lib.callbacks.manager [None req-eb87b2c3-3339-4249-8b85-e695b5b4e1f9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7918660', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-15067', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560168', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8783631423946', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8783631008732', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8783631008750'] for port, after_update {{(pid=102994) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:33:30.302136 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-17781b45-59ea-449c-b5b6-5d1c26c7c224 req-34f56e47-86f9-43e1-8040-c99c81acdae2 service neutron] 10.222.0.62 "GET /v2.0/networks/07eeb44e-4cdb-4c58-a83d-1dd8ab1ccb8a?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1279237 Nov 23 19:33:30.303162 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-f1439c13-53f3-4607-8134-dcd43f5384fb admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-623933'] for security_group, after_create {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:33:30.350597 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.wsgi [-] (102992) accepted ('10.222.0.41', 51761) {{(pid=102992) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 23 19:33:30.368903 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [None req-f1439c13-53f3-4607-8134-dcd43f5384fb admin admin] 10.222.0.62 "GET /v2.0/security-groups?tenant_id=e336b3b6f4df41f59c8bf29d15c75be0&name=default HTTP/1.1" status: 200 len: 2992 time: 1.0235198 Nov 23 19:33:30.374652 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.wsgi [-] (102992) accepted ('10.222.0.62', 41056) {{(pid=102992) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 23 19:33:30.404755 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f1439c13-53f3-4607-8134-dcd43f5384fb admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=2d67934c-bcef-43fd-9dee-10d02ae7839b,revision_number=1']} {{(pid=102993) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 23 19:33:30.449911 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-eb87b2c3-3339-4249-8b85-e695b5b4e1f9 None None] Pushing event updated for resources: {'Port': ['ID=a6140c41-82e2-4d62-8e5f-f3fc119a374e,revision_number=4']} {{(pid=102994) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 23 19:33:30.561145 dv-cinder-819011-1-iscsi neutron-server[102995]: DEBUG neutron_lib.callbacks.manager [None req-c8401697-c129-45cb-b23c-43b4293c6f37 None None] Publish callbacks [] for port, precommit_update {{(pid=102995) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:33:30.617477 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-17781b45-59ea-449c-b5b6-5d1c26c7c224 req-98b31a71-e70d-4393-8141-972b06304864 service neutron] 10.222.0.62 "GET /v2.0/networks/07eeb44e-4cdb-4c58-a83d-1dd8ab1ccb8a?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2564962 Nov 23 19:33:30.684357 dv-cinder-819011-1-iscsi neutron-server[102995]: DEBUG neutron_lib.callbacks.manager [None req-c8401697-c129-45cb-b23c-43b4293c6f37 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7918660', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-15067', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560168', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8783631423946', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8783631008732', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8783631008750'] for port, after_update {{(pid=102995) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:33:30.745443 dv-cinder-819011-1-iscsi neutron-server[102995]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cf3bdf5d-5959-463f-a328-99460e77eddd None None] Pushing event updated for resources: {'Port': ['ID=67851a82-183f-4bba-b05f-793c8b4e7ec3,revision_number=3']} {{(pid=102995) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 23 19:33:30.832203 dv-cinder-819011-1-iscsi neutron-server[102995]: DEBUG neutron.plugins.ml2.managers [None req-c8401697-c129-45cb-b23c-43b4293c6f37 None None] Attempting to bind port 67851a82-183f-4bba-b05f-793c8b4e7ec3 on host dv-cinder-819011-1-iscsi for vnic_type normal with profile {{(pid=102995) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 23 19:33:30.832534 dv-cinder-819011-1-iscsi neutron-server[102995]: DEBUG neutron.plugins.ml2.managers [None req-c8401697-c129-45cb-b23c-43b4293c6f37 None None] Attempting to bind port 67851a82-183f-4bba-b05f-793c8b4e7ec3 by drivers openvswitch,hyperv on host dv-cinder-819011-1-iscsi at level 0 using segments [{'id': 'b8302c34-e78d-4c43-9d45-a2604c95a2d2', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 821, 'network_id': '07eeb44e-4cdb-4c58-a83d-1dd8ab1ccb8a'}] {{(pid=102995) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 23 19:33:30.832908 dv-cinder-819011-1-iscsi neutron-server[102995]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-c8401697-c129-45cb-b23c-43b4293c6f37 None None] Attempting to bind port 67851a82-183f-4bba-b05f-793c8b4e7ec3 on network 07eeb44e-4cdb-4c58-a83d-1dd8ab1ccb8a {{(pid=102995) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 23 19:33:30.839968 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [None req-e66d86aa-9ac8-4346-92f5-d4b1b7da864f admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:33:30.842533 dv-cinder-819011-1-iscsi neutron-server[102995]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-c8401697-c129-45cb-b23c-43b4293c6f37 None None] Checking agent: {'id': '668c8953-047c-499e-8c0d-db838fac1668', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-819011-1-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 23, 19, 25, 17), 'started_at': datetime.datetime(2021, 11, 23, 19, 25, 47), 'heartbeat_timestamp': datetime.datetime(2021, 11, 23, 19, 33, 17), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-819011-1-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=102995) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 23 19:33:30.847150 dv-cinder-819011-1-iscsi neutron-server[102995]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-c8401697-c129-45cb-b23c-43b4293c6f37 None None] Checking segment: {'id': 'b8302c34-e78d-4c43-9d45-a2604c95a2d2', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 821, 'network_id': '07eeb44e-4cdb-4c58-a83d-1dd8ab1ccb8a'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102995) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 23 19:33:30.847150 dv-cinder-819011-1-iscsi neutron-server[102995]: DEBUG neutron_lib.callbacks.manager [None req-c8401697-c129-45cb-b23c-43b4293c6f37 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=102995) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:33:30.847150 dv-cinder-819011-1-iscsi neutron-server[102995]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-c8401697-c129-45cb-b23c-43b4293c6f37 None None] Bound using segment: {'id': 'b8302c34-e78d-4c43-9d45-a2604c95a2d2', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 821, 'network_id': '07eeb44e-4cdb-4c58-a83d-1dd8ab1ccb8a'} {{(pid=102995) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 23 19:33:30.847150 dv-cinder-819011-1-iscsi neutron-server[102995]: DEBUG neutron.plugins.ml2.managers [None req-c8401697-c129-45cb-b23c-43b4293c6f37 None None] Bound port: 67851a82-183f-4bba-b05f-793c8b4e7ec3, host: dv-cinder-819011-1-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'b8302c34-e78d-4c43-9d45-a2604c95a2d2', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 821, 'network_id': '07eeb44e-4cdb-4c58-a83d-1dd8ab1ccb8a'}}] {{(pid=102995) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 23 19:33:30.847150 dv-cinder-819011-1-iscsi neutron-server[102995]: DEBUG neutron_lib.callbacks.manager [None req-c8401697-c129-45cb-b23c-43b4293c6f37 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7921281'] for port, before_update {{(pid=102995) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:33:30.864664 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0a57b9d2-6400-42ea-bdd7-d1bf707b8bb8 req-93cc4cb5-e267-4b86-9ffa-cccfe20a6076 tempest-DeleteServersTestJSON-453817978 tempest-DeleteServersTestJSON-453817978-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=102992) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:33:30.866336 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-0a57b9d2-6400-42ea-bdd7-d1bf707b8bb8 req-93cc4cb5-e267-4b86-9ffa-cccfe20a6076 tempest-DeleteServersTestJSON-453817978 tempest-DeleteServersTestJSON-453817978-project] 10.222.0.41 "GET /v2.0/networks?id=2cf6d774-4b5e-4f5e-bb22-8de22e43722d HTTP/1.1" status: 200 len: 812 time: 0.5139966 Nov 23 19:33:30.897249 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [None req-e66d86aa-9ac8-4346-92f5-d4b1b7da864f admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:33:30.914690 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.wsgi [-] (102992) accepted ('10.222.0.62', 41076) {{(pid=102992) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 23 19:33:30.928338 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.api.v2.base [None req-2aed4f18-2d1e-49e9-923a-6363af653cda tempest-AttachVolumeShelveTestJSON-1172915835 tempest-AttachVolumeShelveTestJSON-1172915835-project] Request body: {'security_group': {'name': 'tempest-securitygroup--51382851', 'description': 'tempest-description--290665894'}} {{(pid=102992) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 23 19:33:30.943823 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.api.v2.base [req-0a57b9d2-6400-42ea-bdd7-d1bf707b8bb8 req-240035de-5c3e-4f7c-b062-1d2d11e23539 tempest-DeleteServersTestJSON-453817978 tempest-DeleteServersTestJSON-453817978-project] Request body: {'port': {'device_id': '5e3c1406-dc8c-414a-bcc5-55c7c963e1df', 'network_id': '2cf6d774-4b5e-4f5e-bb22-8de22e43722d', 'admin_state_up': True, 'tenant_id': '69ab6d68b3f1442f9785568cd27eb367'}} {{(pid=102992) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 23 19:33:31.007321 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-b65efca2-8d88-4d1b-b381-f2a4b8da48da req-49026ff4-eb34-4e01-9098-61a6c70a1e78 tempest-ServerRescueNegativeTestJSON-1447477341 tempest-ServerRescueNegativeTestJSON-1447477341-project] 10.222.0.62 "GET /v2.0/ports?device_id=671f1d44-7752-4a9d-835d-4d76164c900f HTTP/1.1" status: 200 len: 210 time: 0.0757637 Nov 23 19:33:31.092014 dv-cinder-819011-1-iscsi neutron-server[102995]: DEBUG neutron.plugins.ml2.db [None req-c8401697-c129-45cb-b23c-43b4293c6f37 None None] For port 67851a82-183f-4bba-b05f-793c8b4e7ec3, host dv-cinder-819011-1-iscsi, cleared binding levels {{(pid=102995) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 23 19:33:31.094439 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-3d363d88-a46d-4797-81ec-f17ea8a0a69f None None] Sync routers for ids ['01438284-e62a-4056-8ee2-4899a051e144'] in dv-cinder-819011-1-iscsi {{(pid=102994) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 23 19:33:31.113466 dv-cinder-819011-1-iscsi neutron-server[102995]: DEBUG neutron.plugins.ml2.db [None req-c8401697-c129-45cb-b23c-43b4293c6f37 None None] For port 67851a82-183f-4bba-b05f-793c8b4e7ec3, host dv-cinder-819011-1-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-819011-1-iscsi',level=0,port_id=67851a82-183f-4bba-b05f-793c8b4e7ec3,segment=NetworkSegment(b8302c34-e78d-4c43-9d45-a2604c95a2d2),segment_id=b8302c34-e78d-4c43-9d45-a2604c95a2d2)] {{(pid=102995) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 23 19:33:31.118221 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.db.l3_dvrscheduler_db [None req-3d363d88-a46d-4797-81ec-f17ea8a0a69f None None] Routers {'01438284-e62a-4056-8ee2-4899a051e144'} bound to L3 agent in host dv-cinder-819011-1-iscsi {{(pid=102994) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 23 19:33:31.122671 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.db.l3_hamode_db [None req-3d363d88-a46d-4797-81ec-f17ea8a0a69f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-819011-1-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2021-11-23T19:25:14Z,description=,heartbeat_timestamp=2021-11-23T19:33:14Z,host='dv-cinder-819011-1-iscsi',id=1b20f2c4-70b6-43c3-b9bd-0062cc9e57ac,load=0,resource_versions=,resources_synced=,started_at=2021-11-23T19:25:15Z,topic='l3_agent')) {'router_ids': ['01438284-e62a-4056-8ee2-4899a051e144'], 'active': True} {{(pid=102994) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 23 19:33:31.134282 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.wsgi [-] (102993) accepted ('10.222.0.62', 41094) {{(pid=102993) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 23 19:33:31.199666 dv-cinder-819011-1-iscsi neutron-server[102995]: DEBUG neutron_lib.callbacks.manager [None req-c8401697-c129-45cb-b23c-43b4293c6f37 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7918660', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-15067', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560168', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8783631423946', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8783631008732', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8783631008750'] for port, after_update {{(pid=102995) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:33:31.240563 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [None req-2aed4f18-2d1e-49e9-923a-6363af653cda tempest-AttachVolumeShelveTestJSON-1172915835 tempest-AttachVolumeShelveTestJSON-1172915835-project] Publish callbacks [] for security_group, before_create {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:33:31.255101 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-f0031c99-5347-4008-ba5b-d41ba8551ddc req-a7441f3b-6495-456f-a4cf-985ef8f04b36 tempest-DeleteServersTestJSON-453817978 tempest-DeleteServersTestJSON-453817978-project] 10.222.0.62 "GET /v2.0/ports?device_id=5e3c1406-dc8c-414a-bcc5-55c7c963e1df HTTP/1.1" status: 200 len: 210 time: 0.0855570 Nov 23 19:33:31.378253 dv-cinder-819011-1-iscsi neutron-server[102995]: DEBUG neutron.db.l3_dvrscheduler_db [None req-c8401697-c129-45cb-b23c-43b4293c6f37 None None] Routers {'dcdcae73-a8c6-43f9-b388-80519245de0c'} bound to L3 agent in host dv-cinder-819011-1-iscsi {{(pid=102995) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 23 19:33:31.388693 dv-cinder-819011-1-iscsi neutron-server[102995]: DEBUG neutron.db.l3_hamode_db [None req-c8401697-c129-45cb-b23c-43b4293c6f37 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-819011-1-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2021-11-23T19:25:14Z,description=,heartbeat_timestamp=2021-11-23T19:33:14Z,host='dv-cinder-819011-1-iscsi',id=1b20f2c4-70b6-43c3-b9bd-0062cc9e57ac,load=0,resource_versions=,resources_synced=,started_at=2021-11-23T19:25:15Z,topic='l3_agent')) {'router_ids': ['dcdcae73-a8c6-43f9-b388-80519245de0c'], 'active': True} {{(pid=102995) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 23 19:33:31.422065 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [None req-e66d86aa-9ac8-4346-92f5-d4b1b7da864f admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-623933'] for security_group, after_delete {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:33:31.425312 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [None req-e66d86aa-9ac8-4346-92f5-d4b1b7da864f admin admin] Publish callbacks [] for security_group, before_response {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:33:31.426560 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [None req-e66d86aa-9ac8-4346-92f5-d4b1b7da864f admin admin] 10.222.0.62 "DELETE /v2.0/security-groups/2d67934c-bcef-43fd-9dee-10d02ae7839b HTTP/1.1" status: 204 len: 168 time: 1.0227611 Nov 23 19:33:31.475453 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e66d86aa-9ac8-4346-92f5-d4b1b7da864f admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=2d67934c-bcef-43fd-9dee-10d02ae7839b,revision_number=None']} {{(pid=102992) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 23 19:33:31.560655 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.plugins.ml2.rpc [None req-eb87b2c3-3339-4249-8b85-e695b5b4e1f9 None None] Device a6140c41-82e2-4d62-8e5f-f3fc119a374e up at agent ovs-agent-dv-cinder-819011-1-iscsi {{(pid=102994) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 23 19:33:31.568472 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [None req-2aed4f18-2d1e-49e9-923a-6363af653cda tempest-AttachVolumeShelveTestJSON-1172915835 tempest-AttachVolumeShelveTestJSON-1172915835-project] Publish callbacks [] for security_group, precommit_create {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:33:31.644735 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [None req-2aed4f18-2d1e-49e9-923a-6363af653cda tempest-AttachVolumeShelveTestJSON-1172915835 tempest-AttachVolumeShelveTestJSON-1172915835-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-623933'] for security_group, after_create {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:33:31.655546 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.db.l3_dvr_db [None req-3d363d88-a46d-4797-81ec-f17ea8a0a69f None None] Set router 01438284-e62a-4056-8ee2-4899a051e144 gateway port host: dv-cinder-819011-1-iscsi {{(pid=102994) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 23 19:33:31.704402 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-47069518-df9a-4746-84a8-fb477093fa62 req-20ee03c1-612d-49c9-819b-4ab05ebccabf tempest-ServerRescueNegativeTestJSON-1447477341 tempest-ServerRescueNegativeTestJSON-1447477341-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=102993) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:33:31.716751 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-47069518-df9a-4746-84a8-fb477093fa62 req-20ee03c1-612d-49c9-819b-4ab05ebccabf tempest-ServerRescueNegativeTestJSON-1447477341 tempest-ServerRescueNegativeTestJSON-1447477341-project] 10.222.0.62 "GET /v2.0/networks?id=07eeb44e-4cdb-4c58-a83d-1dd8ab1ccb8a HTTP/1.1" status: 200 len: 819 time: 0.2247066 Nov 23 19:33:31.740274 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-47069518-df9a-4746-84a8-fb477093fa62 req-702dc359-bd6a-4d87-b341-c605ce8f6754 tempest-ServerRescueNegativeTestJSON-1447477341 tempest-ServerRescueNegativeTestJSON-1447477341-project] 10.222.0.62 "GET /v2.0/quotas/c15ab51e579448cfb7a4b3e4f8049687 HTTP/1.1" status: 200 len: 375 time: 0.0224466 Nov 23 19:33:31.761679 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-3d83efd1-b706-42d2-96ca-b4cd34391265 admin admin] Publish callbacks [] for security_group, before_create {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:33:31.761842 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2aed4f18-2d1e-49e9-923a-6363af653cda tempest-AttachVolumeShelveTestJSON-1172915835 tempest-AttachVolumeShelveTestJSON-1172915835-project] Pushing event updated for resources: {'SecurityGroup': ['ID=f1ca24d9-0a31-470d-a1d5-fa7059df0141,revision_number=1']} {{(pid=102992) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 23 19:33:31.769922 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-0a57b9d2-6400-42ea-bdd7-d1bf707b8bb8 req-240035de-5c3e-4f7c-b062-1d2d11e23539 tempest-DeleteServersTestJSON-453817978 tempest-DeleteServersTestJSON-453817978-project] Made reservation on behalf of 69ab6d68b3f1442f9785568cd27eb367 for: {'port': 1} {{(pid=102992) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 23 19:33:31.793839 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [req-0a57b9d2-6400-42ea-bdd7-d1bf707b8bb8 req-240035de-5c3e-4f7c-b062-1d2d11e23539 tempest-DeleteServersTestJSON-453817978 tempest-DeleteServersTestJSON-453817978-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7921281'] for port, before_create {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:33:31.820354 dv-cinder-819011-1-iscsi neutron-server[102995]: DEBUG neutron.db.l3_dvr_db [None req-c8401697-c129-45cb-b23c-43b4293c6f37 None None] Set router dcdcae73-a8c6-43f9-b388-80519245de0c gateway port host: dv-cinder-819011-1-iscsi {{(pid=102995) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 23 19:33:31.831527 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.db.provisioning_blocks [None req-eb87b2c3-3339-4249-8b85-e695b5b4e1f9 None None] Provisioning complete for port a6140c41-82e2-4d62-8e5f-f3fc119a374e triggered by entity L2. {{(pid=102994) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 23 19:33:31.831894 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron_lib.callbacks.manager [None req-eb87b2c3-3339-4249-8b85-e695b5b4e1f9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-8355713'] for port, provisioning_complete {{(pid=102994) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:33:31.868627 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-47069518-df9a-4746-84a8-fb477093fa62 req-302032f4-781f-478b-a633-d35d1d43111c tempest-ServerRescueNegativeTestJSON-1447477341 tempest-ServerRescueNegativeTestJSON-1447477341-project] 10.222.0.62 "GET /v2.0/ports?tenant_id=c15ab51e579448cfb7a4b3e4f8049687&fields=id HTTP/1.1" status: 200 len: 255 time: 0.1272218 Nov 23 19:33:31.872601 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [None req-2aed4f18-2d1e-49e9-923a-6363af653cda tempest-AttachVolumeShelveTestJSON-1172915835 tempest-AttachVolumeShelveTestJSON-1172915835-project] Publish callbacks [] for security_group, before_response {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:33:31.882747 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [None req-2aed4f18-2d1e-49e9-923a-6363af653cda tempest-AttachVolumeShelveTestJSON-1172915835 tempest-AttachVolumeShelveTestJSON-1172915835-project] 10.222.0.62 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1792 time: 0.9666858 Nov 23 19:33:31.887724 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.wsgi [-] (102992) accepted ('10.222.0.62', 41148) {{(pid=102992) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 23 19:33:31.902861 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.api.v2.base [None req-a5d7a4c9-ac34-44f3-9901-c16cebdbe8f7 tempest-AttachVolumeShelveTestJSON-1172915835 tempest-AttachVolumeShelveTestJSON-1172915835-project] Request body: {'security_group_rule': {'security_group_id': 'f1ca24d9-0a31-470d-a1d5-fa7059df0141', 'protocol': 'tcp', 'ethertype': 'IPv4', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'ingress'}} {{(pid=102992) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 23 19:33:32.009251 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.db.l3_hamode_db [None req-3d363d88-a46d-4797-81ec-f17ea8a0a69f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '01438284-e62a-4056-8ee2-4899a051e144', 'name': 'tempest-AttachVolumeShelveTestJSON-1609224522-router', 'tenant_id': '2d925fb59ba34355aa85758374d76928', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'a93e254e-aac9-4233-9e4d-4290fd0458e4', 'external_fixed_ips': [{'subnet_id': 'e0b32f3d-83d6-439a-bbed-01df7cf01051', 'ip_address': '172.27.1.99'}], 'enable_snat': True}, 'gw_port_id': 'a6140c41-82e2-4d62-8e5f-f3fc119a374e', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-23T19:33:21Z', 'updated_at': '2021-11-23T19:33:28Z', 'revision_number': 4, 'project_id': '2d925fb59ba34355aa85758374d76928', 'gw_port': {'id': 'a6140c41-82e2-4d62-8e5f-f3fc119a374e', 'name': '', 'network_id': 'a93e254e-aac9-4233-9e4d-4290fd0458e4', 'tenant_id': '', 'mac_address': 'fa:16:3e:32:52:e2', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '01438284-e62a-4056-8ee2-4899a051e144', 'device_owner': 'network:router_gateway', 'standard_attr_id': 59, 'fixed_ips': [{'subnet_id': 'e0b32f3d-83d6-439a-bbed-01df7cf01051', 'ip_address': '172.27.1.99', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-819011-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-23T19:33:22Z', 'updated_at': '2021-11-23T19:33:30Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'e0b32f3d-83d6-439a-bbed-01df7cf01051', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-819011-1-iscsi', '_interfaces': [{'id': 'c96e4c46-b1fa-4e6c-9fe8-9c516c4ee278', 'name': '', 'network_id': 'fc901312-2937-4784-8a6d-c046666e8bf8', 'tenant_id': '2d925fb59ba34355aa85758374d76928', 'mac_address': 'fa:16:3e:b7:43:ca', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '01438284-e62a-4056-8ee2-4899a051e144', 'device_owner': 'network:router_interface', 'standard_attr_id': 71, 'fixed_ips': [{'subnet_id': '2caca985-6ed6-4ef7-ba49-7b7410bea160', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-23T19:33:26Z', 'updated_at': '2021-11-23T19:33:28Z', 'revision_number': 2, 'project_id': '2d925fb59ba34355aa85758374d76928', 'subnets': [{'id': '2caca985-6ed6-4ef7-ba49-7b7410bea160', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-819011-1-iscsi', False) {} {{(pid=102994) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 23 19:33:32.045261 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-3d363d88-a46d-4797-81ec-f17ea8a0a69f None None] Checking router: 01438284-e62a-4056-8ee2-4899a051e144 for host: dv-cinder-819011-1-iscsi {{(pid=102994) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 23 19:33:32.045824 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-3d363d88-a46d-4797-81ec-f17ea8a0a69f None None] Updating router 01438284-e62a-4056-8ee2-4899a051e144 port c96e4c46-b1fa-4e6c-9fe8-9c516c4ee278 binding host dv-cinder-819011-1-iscsi {{(pid=102994) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Nov 23 19:33:32.078672 dv-cinder-819011-1-iscsi neutron-server[102995]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cf3bdf5d-5959-463f-a328-99460e77eddd None None] Pushing event updated for resources: {'Port': ['ID=67851a82-183f-4bba-b05f-793c8b4e7ec3,revision_number=4']} {{(pid=102995) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 23 19:33:32.086019 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron_lib.callbacks.manager [None req-3d363d88-a46d-4797-81ec-f17ea8a0a69f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7921281'] for port, before_update {{(pid=102994) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:33:32.157886 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-47069518-df9a-4746-84a8-fb477093fa62 req-aa6534cb-4e30-4301-82b2-74f966ef80b7 service neutron] 10.222.0.62 "GET /v2.0/networks/07eeb44e-4cdb-4c58-a83d-1dd8ab1ccb8a?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2883525 Nov 23 19:33:32.369875 dv-cinder-819011-1-iscsi neutron-server[102995]: DEBUG neutron.db.l3_hamode_db [None req-c8401697-c129-45cb-b23c-43b4293c6f37 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'dcdcae73-a8c6-43f9-b388-80519245de0c', 'name': 'tempest-ServerRescueNegativeTestJSON-1810346202-router', 'tenant_id': 'c15ab51e579448cfb7a4b3e4f8049687', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'a93e254e-aac9-4233-9e4d-4290fd0458e4', 'external_fixed_ips': [{'subnet_id': 'e0b32f3d-83d6-439a-bbed-01df7cf01051', 'ip_address': '172.27.1.194'}], 'enable_snat': True}, 'gw_port_id': 'ccf9cfdb-e164-48bc-b433-5906352d8e1a', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-23T19:33:20Z', 'updated_at': '2021-11-23T19:33:26Z', 'revision_number': 4, 'project_id': 'c15ab51e579448cfb7a4b3e4f8049687', 'gw_port': {'id': 'ccf9cfdb-e164-48bc-b433-5906352d8e1a', 'name': '', 'network_id': 'a93e254e-aac9-4233-9e4d-4290fd0458e4', 'tenant_id': '', 'mac_address': 'fa:16:3e:29:81:78', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'dcdcae73-a8c6-43f9-b388-80519245de0c', 'device_owner': 'network:router_gateway', 'standard_attr_id': 58, 'fixed_ips': [{'subnet_id': 'e0b32f3d-83d6-439a-bbed-01df7cf01051', 'ip_address': '172.27.1.194', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-819011-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-23T19:33:21Z', 'updated_at': '2021-11-23T19:33:28Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'e0b32f3d-83d6-439a-bbed-01df7cf01051', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-819011-1-iscsi', '_interfaces': [{'id': '67851a82-183f-4bba-b05f-793c8b4e7ec3', 'name': '', 'network_id': '07eeb44e-4cdb-4c58-a83d-1dd8ab1ccb8a', 'tenant_id': 'c15ab51e579448cfb7a4b3e4f8049687', 'mac_address': 'fa:16:3e:a3:2e:cc', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'dcdcae73-a8c6-43f9-b388-80519245de0c', 'device_owner': 'network:router_interface', 'standard_attr_id': 65, 'fixed_ips': [{'subnet_id': 'e4fda56f-85ff-422d-adad-ec00db6378af', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-819011-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-23T19:33:25Z', 'updated_at': '2021-11-23T19:33:31Z', 'revision_number': 4, 'project_id': 'c15ab51e579448cfb7a4b3e4f8049687', 'subnets': [{'id': 'e4fda56f-85ff-422d-adad-ec00db6378af', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-819011-1-iscsi', False) {} {{(pid=102995) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 23 19:33:32.375095 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [None req-a5d7a4c9-ac34-44f3-9901-c16cebdbe8f7 tempest-AttachVolumeShelveTestJSON-1172915835 tempest-AttachVolumeShelveTestJSON-1172915835-project] Publish callbacks [] for security_group_rule, before_create {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:33:32.452534 dv-cinder-819011-1-iscsi neutron-server[102995]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-c8401697-c129-45cb-b23c-43b4293c6f37 None None] The sync data for ids ['dcdcae73-a8c6-43f9-b388-80519245de0c'] in dv-cinder-819011-1-iscsi is: [{'id': 'dcdcae73-a8c6-43f9-b388-80519245de0c', 'name': 'tempest-ServerRescueNegativeTestJSON-1810346202-router', 'tenant_id': 'c15ab51e579448cfb7a4b3e4f8049687', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'a93e254e-aac9-4233-9e4d-4290fd0458e4', 'external_fixed_ips': [{'subnet_id': 'e0b32f3d-83d6-439a-bbed-01df7cf01051', 'ip_address': '172.27.1.194'}], 'enable_snat': True}, 'gw_port_id': 'ccf9cfdb-e164-48bc-b433-5906352d8e1a', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-23T19:33:20Z', 'updated_at': '2021-11-23T19:33:26Z', 'revision_number': 4, 'project_id': 'c15ab51e579448cfb7a4b3e4f8049687', 'gw_port': {'id': 'ccf9cfdb-e164-48bc-b433-5906352d8e1a', 'name': '', 'network_id': 'a93e254e-aac9-4233-9e4d-4290fd0458e4', 'tenant_id': '', 'mac_address': 'fa:16:3e:29:81:78', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'dcdcae73-a8c6-43f9-b388-80519245de0c', 'device_owner': 'network:router_gateway', 'standard_attr_id': 58, 'fixed_ips': [{'subnet_id': 'e0b32f3d-83d6-439a-bbed-01df7cf01051', 'ip_address': '172.27.1.194', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-819011-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-23T19:33:21Z', 'updated_at': '2021-11-23T19:33:28Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'e0b32f3d-83d6-439a-bbed-01df7cf01051', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-819011-1-iscsi', '_interfaces': [{'id': '67851a82-183f-4bba-b05f-793c8b4e7ec3', 'name': '', 'network_id': '07eeb44e-4cdb-4c58-a83d-1dd8ab1ccb8a', 'tenant_id': 'c15ab51e579448cfb7a4b3e4f8049687', 'mac_address': 'fa:16:3e:a3:2e:cc', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'dcdcae73-a8c6-43f9-b388-80519245de0c', 'device_owner': 'network:router_interface', 'standard_attr_id': 65, 'fixed_ips': [{'subnet_id': 'e4fda56f-85ff-422d-adad-ec00db6378af', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-819011-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-23T19:33:25Z', 'updated_at': '2021-11-23T19:33:31Z', 'revision_number': 4, 'project_id': 'c15ab51e579448cfb7a4b3e4f8049687', 'subnets': [{'id': 'e4fda56f-85ff-422d-adad-ec00db6378af', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=102995) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 23 19:33:32.542103 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-47069518-df9a-4746-84a8-fb477093fa62 req-8015ad25-61eb-4097-8c90-2ed74051f7ab service neutron] 10.222.0.62 "GET /v2.0/networks/07eeb44e-4cdb-4c58-a83d-1dd8ab1ccb8a?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.3832607 Nov 23 19:33:32.584326 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-dae1f482-7e3a-4d0f-ad3a-2f88d0c3e76a req-365f2f30-c367-42ab-af6c-157741e42ed1 tempest-DeleteServersTestJSON-453817978 tempest-DeleteServersTestJSON-453817978-project] 10.222.0.62 "GET /v2.0/ports?device_id=5e3c1406-dc8c-414a-bcc5-55c7c963e1df HTTP/1.1" status: 200 len: 210 time: 0.1249039 Nov 23 19:33:32.591560 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-3d83efd1-b706-42d2-96ca-b4cd34391265 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:33:32.650248 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.db.db_base_plugin_common [req-0a57b9d2-6400-42ea-bdd7-d1bf707b8bb8 req-240035de-5c3e-4f7c-b062-1d2d11e23539 tempest-DeleteServersTestJSON-453817978 tempest-DeleteServersTestJSON-453817978-project] Allocated IP 172.20.0.7 (2cf6d774-4b5e-4f5e-bb22-8de22e43722d/c1e8e6ce-3e67-4ef5-bbc3-db04880e7fab/8c70d83a-558d-4a92-a3e8-15396107e64d) {{(pid=102992) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 23 19:33:32.661293 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-3d83efd1-b706-42d2-96ca-b4cd34391265 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-623933'] for security_group, after_create {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:33:32.743985 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3d83efd1-b706-42d2-96ca-b4cd34391265 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=3c72e0c3-c761-4e91-8e4a-61ba78ebf0b0,revision_number=1']} {{(pid=102993) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 23 19:33:32.760128 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [None req-a5d7a4c9-ac34-44f3-9901-c16cebdbe8f7 tempest-AttachVolumeShelveTestJSON-1172915835 tempest-AttachVolumeShelveTestJSON-1172915835-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:33:32.769112 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron_lib.callbacks.manager [None req-3d363d88-a46d-4797-81ec-f17ea8a0a69f None None] Publish callbacks [] for port, precommit_update {{(pid=102994) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:33:32.806566 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.wsgi [-] (102993) accepted ('10.222.0.62', 41198) {{(pid=102993) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 23 19:33:32.840686 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [None req-a5d7a4c9-ac34-44f3-9901-c16cebdbe8f7 tempest-AttachVolumeShelveTestJSON-1172915835 tempest-AttachVolumeShelveTestJSON-1172915835-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-601991'] for security_group_rule, after_create {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:33:32.856134 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [None req-3d83efd1-b706-42d2-96ca-b4cd34391265 admin admin] 10.222.0.62 "GET /v2.0/security-groups?tenant_id=3f785c5b833646fe8bd3d132c0f01a4c&name=default HTTP/1.1" status: 200 len: 2992 time: 1.7183895 Nov 23 19:33:32.856364 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-a0404762-1837-496a-86a4-30591a00e746 admin admin] Publish callbacks [] for security_group, before_create {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:33:32.857738 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron_lib.callbacks.manager [None req-3d363d88-a46d-4797-81ec-f17ea8a0a69f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7918660', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-15067', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560168', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8783631423946', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8783631008732', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8783631008750'] for port, after_update {{(pid=102994) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:33:32.860769 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.wsgi [-] (102993) accepted ('10.222.0.62', 41200) {{(pid=102993) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 23 19:33:32.935032 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d05988ac-f9f8-46db-8217-ff1ea416e94b None None] Pushing event updated for resources: {'Port': ['ID=c96e4c46-b1fa-4e6c-9fe8-9c516c4ee278,revision_number=3']} {{(pid=102994) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 23 19:33:32.988591 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a5d7a4c9-ac34-44f3-9901-c16cebdbe8f7 tempest-AttachVolumeShelveTestJSON-1172915835 tempest-AttachVolumeShelveTestJSON-1172915835-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=28deadc4-d527-4768-8e9c-76a6b978e630,revision_number=0']} {{(pid=102992) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 23 19:33:33.042858 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-9ffd68fa-3ffb-4248-be91-179bcf692a1d admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:33:33.075748 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.plugins.ml2.managers [None req-3d363d88-a46d-4797-81ec-f17ea8a0a69f None None] Attempting to bind port c96e4c46-b1fa-4e6c-9fe8-9c516c4ee278 on host dv-cinder-819011-1-iscsi for vnic_type normal with profile {{(pid=102994) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 23 19:33:33.076322 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.plugins.ml2.managers [None req-3d363d88-a46d-4797-81ec-f17ea8a0a69f None None] Attempting to bind port c96e4c46-b1fa-4e6c-9fe8-9c516c4ee278 by drivers openvswitch,hyperv on host dv-cinder-819011-1-iscsi at level 0 using segments [{'id': 'b4453f21-ac7f-498c-8316-73b738820700', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 825, 'network_id': 'fc901312-2937-4784-8a6d-c046666e8bf8'}] {{(pid=102994) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 23 19:33:33.077221 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-3d363d88-a46d-4797-81ec-f17ea8a0a69f None None] Attempting to bind port c96e4c46-b1fa-4e6c-9fe8-9c516c4ee278 on network fc901312-2937-4784-8a6d-c046666e8bf8 {{(pid=102994) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 23 19:33:33.089147 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-3d363d88-a46d-4797-81ec-f17ea8a0a69f None None] Checking agent: {'id': '668c8953-047c-499e-8c0d-db838fac1668', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-819011-1-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 23, 19, 25, 17), 'started_at': datetime.datetime(2021, 11, 23, 19, 25, 47), 'heartbeat_timestamp': datetime.datetime(2021, 11, 23, 19, 33, 17), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-819011-1-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=102994) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 23 19:33:33.089825 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-3d363d88-a46d-4797-81ec-f17ea8a0a69f None None] Checking segment: {'id': 'b4453f21-ac7f-498c-8316-73b738820700', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 825, 'network_id': 'fc901312-2937-4784-8a6d-c046666e8bf8'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102994) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 23 19:33:33.091372 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron_lib.callbacks.manager [None req-3d363d88-a46d-4797-81ec-f17ea8a0a69f None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=102994) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:33:33.092023 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-3d363d88-a46d-4797-81ec-f17ea8a0a69f None None] Bound using segment: {'id': 'b4453f21-ac7f-498c-8316-73b738820700', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 825, 'network_id': 'fc901312-2937-4784-8a6d-c046666e8bf8'} {{(pid=102994) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 23 19:33:33.093272 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.plugins.ml2.managers [None req-3d363d88-a46d-4797-81ec-f17ea8a0a69f None None] Bound port: c96e4c46-b1fa-4e6c-9fe8-9c516c4ee278, host: dv-cinder-819011-1-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'b4453f21-ac7f-498c-8316-73b738820700', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 825, 'network_id': 'fc901312-2937-4784-8a6d-c046666e8bf8'}}] {{(pid=102994) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 23 19:33:33.094716 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron_lib.callbacks.manager [None req-3d363d88-a46d-4797-81ec-f17ea8a0a69f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7921281'] for port, before_update {{(pid=102994) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:33:33.195715 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-a0404762-1837-496a-86a4-30591a00e746 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:33:33.208998 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [req-0a57b9d2-6400-42ea-bdd7-d1bf707b8bb8 req-240035de-5c3e-4f7c-b062-1d2d11e23539 tempest-DeleteServersTestJSON-453817978 tempest-DeleteServersTestJSON-453817978-project] Publish callbacks [] for port, precommit_create {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:33:33.213400 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [None req-a5d7a4c9-ac34-44f3-9901-c16cebdbe8f7 tempest-AttachVolumeShelveTestJSON-1172915835 tempest-AttachVolumeShelveTestJSON-1172915835-project] Publish callbacks [] for security_group_rule, before_response {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:33:33.216553 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [None req-a5d7a4c9-ac34-44f3-9901-c16cebdbe8f7 tempest-AttachVolumeShelveTestJSON-1172915835 tempest-AttachVolumeShelveTestJSON-1172915835-project] 10.222.0.62 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 764 time: 1.3262372 Nov 23 19:33:33.222680 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.wsgi [-] (102992) accepted ('10.222.0.62', 41210) {{(pid=102992) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 23 19:33:33.229898 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.api.v2.base [None req-a40ea992-4db7-4377-9060-53dc712bb424 tempest-AttachVolumeShelveTestJSON-1172915835 tempest-AttachVolumeShelveTestJSON-1172915835-project] Request body: {'security_group_rule': {'security_group_id': 'f1ca24d9-0a31-470d-a1d5-fa7059df0141', 'protocol': 'icmp', 'ethertype': 'IPv4', 'direction': 'ingress'}} {{(pid=102992) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 23 19:33:33.270495 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.plugins.ml2.db [None req-3d363d88-a46d-4797-81ec-f17ea8a0a69f None None] For port c96e4c46-b1fa-4e6c-9fe8-9c516c4ee278, host dv-cinder-819011-1-iscsi, cleared binding levels {{(pid=102994) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 23 19:33:33.279168 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.plugins.ml2.db [None req-3d363d88-a46d-4797-81ec-f17ea8a0a69f None None] For port c96e4c46-b1fa-4e6c-9fe8-9c516c4ee278, host dv-cinder-819011-1-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-819011-1-iscsi',level=0,port_id=c96e4c46-b1fa-4e6c-9fe8-9c516c4ee278,segment=NetworkSegment(b4453f21-ac7f-498c-8316-73b738820700),segment_id=b4453f21-ac7f-498c-8316-73b738820700)] {{(pid=102994) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 23 19:33:33.404880 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron_lib.callbacks.manager [None req-3d363d88-a46d-4797-81ec-f17ea8a0a69f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7918660', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-15067', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560168', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8783631423946', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8783631008732', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8783631008750'] for port, after_update {{(pid=102994) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:33:33.488325 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [req-0a57b9d2-6400-42ea-bdd7-d1bf707b8bb8 req-240035de-5c3e-4f7c-b062-1d2d11e23539 tempest-DeleteServersTestJSON-453817978 tempest-DeleteServersTestJSON-453817978-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7918660', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-15067', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560168', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8783631008714'] for port, after_create {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:33:33.556728 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [None req-a40ea992-4db7-4377-9060-53dc712bb424 tempest-AttachVolumeShelveTestJSON-1172915835 tempest-AttachVolumeShelveTestJSON-1172915835-project] Publish callbacks [] for security_group_rule, before_create {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:33:33.652186 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-9ffd68fa-3ffb-4248-be91-179bcf692a1d admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:33:33.838952 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-0a57b9d2-6400-42ea-bdd7-d1bf707b8bb8 req-240035de-5c3e-4f7c-b062-1d2d11e23539 tempest-DeleteServersTestJSON-453817978 tempest-DeleteServersTestJSON-453817978-project] Network 2cf6d774-4b5e-4f5e-bb22-8de22e43722d is already hosted by enough agents. {{(pid=102992) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 23 19:33:33.841164 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-39bbfd9b-0f63-474f-a5c5-cdeba73bb7ec req-09a04cbd-ad79-480e-b1ec-d33415177f68 tempest-ServerRescueNegativeTestJSON-1447477341 tempest-ServerRescueNegativeTestJSON-1447477341-project] 10.222.0.62 "GET /v2.0/ports?device_id=90cb32bd-c375-400a-b79a-97fc61e2a3a3 HTTP/1.1" status: 200 len: 210 time: 0.6412106 Nov 23 19:33:33.849012 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-a0404762-1837-496a-86a4-30591a00e746 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-623933'] for security_group, after_create {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:33:33.864017 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-240035de-5c3e-4f7c-b062-1d2d11e23539 tempest-DeleteServersTestJSON-453817978 tempest-DeleteServersTestJSON-453817978-project] Pushing event updated for resources: {'Port': ['ID=8c70d83a-558d-4a92-a3e8-15396107e64d,revision_number=1']} {{(pid=102992) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 23 19:33:33.882536 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.plugins.ml2.rpc [None req-eb87b2c3-3339-4249-8b85-e695b5b4e1f9 None None] Device 67851a82-183f-4bba-b05f-793c8b4e7ec3 up at agent ovs-agent-dv-cinder-819011-1-iscsi {{(pid=102994) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 23 19:33:33.888149 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.scheduler.base_scheduler [req-0a57b9d2-6400-42ea-bdd7-d1bf707b8bb8 req-240035de-5c3e-4f7c-b062-1d2d11e23539 tempest-DeleteServersTestJSON-453817978 tempest-DeleteServersTestJSON-453817978-project] Resources bound (agent type, host, resource id): {{(pid=102992) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 23 19:33:33.893288 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.db.l3_dvrscheduler_db [req-0a57b9d2-6400-42ea-bdd7-d1bf707b8bb8 req-240035de-5c3e-4f7c-b062-1d2d11e23539 tempest-DeleteServersTestJSON-453817978 tempest-DeleteServersTestJSON-453817978-project] Received port after_create {{(pid=102992) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 23 19:33:33.905914 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0a57b9d2-6400-42ea-bdd7-d1bf707b8bb8 req-240035de-5c3e-4f7c-b062-1d2d11e23539 tempest-DeleteServersTestJSON-453817978 tempest-DeleteServersTestJSON-453817978-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=102992) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:33:33.918737 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [req-0a57b9d2-6400-42ea-bdd7-d1bf707b8bb8 req-240035de-5c3e-4f7c-b062-1d2d11e23539 tempest-DeleteServersTestJSON-453817978 tempest-DeleteServersTestJSON-453817978-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-514902', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-560186'] for port, before_response {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:33:33.936002 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-9ffd68fa-3ffb-4248-be91-179bcf692a1d admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-623933'] for security_group, after_delete {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:33:33.938593 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-9ffd68fa-3ffb-4248-be91-179bcf692a1d admin admin] Publish callbacks [] for security_group, before_response {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:33:33.939729 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [None req-9ffd68fa-3ffb-4248-be91-179bcf692a1d admin admin] 10.222.0.62 "DELETE /v2.0/security-groups/3c72e0c3-c761-4e91-8e4a-61ba78ebf0b0 HTTP/1.1" status: 204 len: 168 time: 1.0763829 Nov 23 19:33:34.012110 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d05988ac-f9f8-46db-8217-ff1ea416e94b None None] Pushing event updated for resources: {'Port': ['ID=c96e4c46-b1fa-4e6c-9fe8-9c516c4ee278,revision_number=4']} {{(pid=102994) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 23 19:33:34.060294 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [None req-a0404762-1837-496a-86a4-30591a00e746 admin admin] 10.222.0.62 "GET /v2.0/security-groups?tenant_id=19ebf3e474f549dbb7ef60b75089e9d7&name=default HTTP/1.1" status: 200 len: 2992 time: 1.2437789 Nov 23 19:33:34.061727 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.wsgi [-] (102993) accepted ('10.222.0.62', 41238) {{(pid=102993) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 23 19:33:34.065334 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a0404762-1837-496a-86a4-30591a00e746 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=3fc3b3db-d57b-4920-994b-e2da68ae8ae4,revision_number=1']} {{(pid=102993) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 23 19:33:34.131978 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.wsgi [-] (102993) accepted ('10.222.0.62', 41244) {{(pid=102993) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 23 19:33:34.150122 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-0a57b9d2-6400-42ea-bdd7-d1bf707b8bb8 req-240035de-5c3e-4f7c-b062-1d2d11e23539 tempest-DeleteServersTestJSON-453817978 tempest-DeleteServersTestJSON-453817978-project] 10.222.0.41 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 3.2127614 Nov 23 19:33:34.152682 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [None req-a40ea992-4db7-4377-9060-53dc712bb424 tempest-AttachVolumeShelveTestJSON-1172915835 tempest-AttachVolumeShelveTestJSON-1172915835-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:33:34.164734 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9ffd68fa-3ffb-4248-be91-179bcf692a1d admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=3c72e0c3-c761-4e91-8e4a-61ba78ebf0b0,revision_number=None']} {{(pid=102993) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 23 19:33:34.172398 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.db.provisioning_blocks [None req-56becd84-7d8b-4df3-87a0-5682f5764960 None None] Provisioning complete for port c96e4c46-b1fa-4e6c-9fe8-9c516c4ee278 triggered by entity DHCP. {{(pid=102994) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 23 19:33:34.172772 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron_lib.callbacks.manager [None req-56becd84-7d8b-4df3-87a0-5682f5764960 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-8355713'] for port, provisioning_complete {{(pid=102994) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:33:34.215438 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f1bd3473-6211-4ffc-8482-dcf643f03caf req-3ac9217d-7154-4e27-80df-bda36bbd4d01 tempest-DeleteServersTestJSON-453817978 tempest-DeleteServersTestJSON-453817978-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102992) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:33:34.220126 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-f1bd3473-6211-4ffc-8482-dcf643f03caf req-3ac9217d-7154-4e27-80df-bda36bbd4d01 tempest-DeleteServersTestJSON-453817978 tempest-DeleteServersTestJSON-453817978-project] 10.222.0.62 "GET /v2.0/ports?device_id=5e3c1406-dc8c-414a-bcc5-55c7c963e1df HTTP/1.1" status: 200 len: 931 time: 0.3656430 Nov 23 19:33:34.240304 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.wsgi [req-0a57b9d2-6400-42ea-bdd7-d1bf707b8bb8 req-dfa92f50-2fd9-4a97-9d45-a7b99e2bca41 tempest-DeleteServersTestJSON-453817978 tempest-DeleteServersTestJSON-453817978-project] http://10.222.0.62:9696/v2.0/extensions returned with HTTP 200 {{(pid=102992) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Nov 23 19:33:34.241388 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-0a57b9d2-6400-42ea-bdd7-d1bf707b8bb8 req-dfa92f50-2fd9-4a97-9d45-a7b99e2bca41 tempest-DeleteServersTestJSON-453817978 tempest-DeleteServersTestJSON-453817978-project] 10.222.0.41 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 14082 time: 0.0203433 Nov 23 19:33:34.267568 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [None req-a40ea992-4db7-4377-9060-53dc712bb424 tempest-AttachVolumeShelveTestJSON-1172915835 tempest-AttachVolumeShelveTestJSON-1172915835-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-601991'] for security_group_rule, after_create {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:33:34.378175 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-c4860cbf-e584-493b-be1c-9eaf25f77e13 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:33:34.390083 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a40ea992-4db7-4377-9060-53dc712bb424 tempest-AttachVolumeShelveTestJSON-1172915835 tempest-AttachVolumeShelveTestJSON-1172915835-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=6eb65428-189b-467d-91ee-f57b5383370f,revision_number=0']} {{(pid=102992) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 23 19:33:34.465174 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-f1bd3473-6211-4ffc-8482-dcf643f03caf req-701be33c-a6cc-4aab-be48-9e7f70bfceb3 tempest-DeleteServersTestJSON-453817978 tempest-DeleteServersTestJSON-453817978-project] 10.222.0.62 "GET /v2.0/security-groups?id=5b5d5814-644d-45c2-ad35-f8920c3382b0&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2227185 Nov 23 19:33:34.466820 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-c4860cbf-e584-493b-be1c-9eaf25f77e13 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:33:34.484245 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [None req-a40ea992-4db7-4377-9060-53dc712bb424 tempest-AttachVolumeShelveTestJSON-1172915835 tempest-AttachVolumeShelveTestJSON-1172915835-project] Publish callbacks [] for security_group_rule, before_response {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:33:34.491961 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.db.l3_dvrscheduler_db [None req-3d363d88-a46d-4797-81ec-f17ea8a0a69f None None] Routers {'01438284-e62a-4056-8ee2-4899a051e144'} bound to L3 agent in host dv-cinder-819011-1-iscsi {{(pid=102994) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 23 19:33:34.492655 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.db.l3_hamode_db [None req-3d363d88-a46d-4797-81ec-f17ea8a0a69f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-819011-1-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2021-11-23T19:25:14Z,description=,heartbeat_timestamp=2021-11-23T19:33:14Z,host='dv-cinder-819011-1-iscsi',id=1b20f2c4-70b6-43c3-b9bd-0062cc9e57ac,load=0,resource_versions=,resources_synced=,started_at=2021-11-23T19:25:15Z,topic='l3_agent')) {'router_ids': ['01438284-e62a-4056-8ee2-4899a051e144'], 'active': True} {{(pid=102994) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 23 19:33:34.493516 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.wsgi [-] (102993) accepted ('10.222.0.62', 41260) {{(pid=102993) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 23 19:33:34.517121 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.api.v2.base [None req-62964d1b-f4c9-4db3-a20f-b1638156d3a7 tempest-AttachVolumeShelveTestJSON-1172915835 tempest-AttachVolumeShelveTestJSON-1172915835-project] Request body: {'floatingip': {'floating_network_id': 'a93e254e-aac9-4233-9e4d-4290fd0458e4'}} {{(pid=102993) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 23 19:33:34.524633 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [None req-a40ea992-4db7-4377-9060-53dc712bb424 tempest-AttachVolumeShelveTestJSON-1172915835 tempest-AttachVolumeShelveTestJSON-1172915835-project] 10.222.0.62 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 769 time: 1.2993603 Nov 23 19:33:34.633123 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-62964d1b-f4c9-4db3-a20f-b1638156d3a7 tempest-AttachVolumeShelveTestJSON-1172915835 tempest-AttachVolumeShelveTestJSON-1172915835-project] Publish callbacks [] for floatingip, before_create {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:33:34.750852 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-c4860cbf-e584-493b-be1c-9eaf25f77e13 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-623933'] for security_group, after_delete {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:33:34.760171 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-c4860cbf-e584-493b-be1c-9eaf25f77e13 admin admin] Publish callbacks [] for security_group, before_response {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:33:34.762179 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [None req-c4860cbf-e584-493b-be1c-9eaf25f77e13 admin admin] 10.222.0.62 "DELETE /v2.0/security-groups/3fc3b3db-d57b-4920-994b-e2da68ae8ae4 HTTP/1.1" status: 204 len: 168 time: 0.6980689 Nov 23 19:33:34.800708 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c4860cbf-e584-493b-be1c-9eaf25f77e13 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=3fc3b3db-d57b-4920-994b-e2da68ae8ae4,revision_number=None']} {{(pid=102993) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 23 19:33:35.037464 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.db.provisioning_blocks [None req-eb87b2c3-3339-4249-8b85-e695b5b4e1f9 None None] Provisioning complete for port 67851a82-183f-4bba-b05f-793c8b4e7ec3 triggered by entity L2. {{(pid=102994) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 23 19:33:35.038076 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron_lib.callbacks.manager [None req-eb87b2c3-3339-4249-8b85-e695b5b4e1f9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-8355713'] for port, provisioning_complete {{(pid=102994) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:33:35.053276 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-80844573-b7e7-4817-9910-53a597eff113 req-1d4d656e-cf52-4f44-8171-efaf8cf3e5d5 tempest-ServerRescueNegativeTestJSON-1447477341 tempest-ServerRescueNegativeTestJSON-1447477341-project] 10.222.0.62 "GET /v2.0/ports?device_id=90cb32bd-c375-400a-b79a-97fc61e2a3a3 HTTP/1.1" status: 200 len: 210 time: 0.0727670 Nov 23 19:33:35.055213 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-7ea66916-be9e-4ebf-8614-68a4dfefd0e9 admin admin] Publish callbacks [] for security_group, before_create {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:33:35.121633 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron_lib.callbacks.manager [None req-56becd84-7d8b-4df3-87a0-5682f5764960 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7921281'] for port, before_update {{(pid=102994) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:33:35.129932 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.db.l3_dvr_db [None req-3d363d88-a46d-4797-81ec-f17ea8a0a69f None None] Set router 01438284-e62a-4056-8ee2-4899a051e144 gateway port host: dv-cinder-819011-1-iscsi {{(pid=102994) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 23 19:33:35.250971 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-62964d1b-f4c9-4db3-a20f-b1638156d3a7 tempest-AttachVolumeShelveTestJSON-1172915835 tempest-AttachVolumeShelveTestJSON-1172915835-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7921281'] for port, before_create {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:33:35.294769 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.plugins.ml2.db [None req-56becd84-7d8b-4df3-87a0-5682f5764960 None None] For port c96e4c46-b1fa-4e6c-9fe8-9c516c4ee278, host dv-cinder-819011-1-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-819011-1-iscsi',level=0,port_id=c96e4c46-b1fa-4e6c-9fe8-9c516c4ee278,segment=NetworkSegment(b4453f21-ac7f-498c-8316-73b738820700),segment_id=b4453f21-ac7f-498c-8316-73b738820700)] {{(pid=102994) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 23 19:33:35.311324 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron_lib.callbacks.manager [None req-eb87b2c3-3339-4249-8b85-e695b5b4e1f9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7921281'] for port, before_update {{(pid=102994) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:33:35.335489 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-7ea66916-be9e-4ebf-8614-68a4dfefd0e9 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:33:35.408485 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.db.db_base_plugin_common [None req-62964d1b-f4c9-4db3-a20f-b1638156d3a7 tempest-AttachVolumeShelveTestJSON-1172915835 tempest-AttachVolumeShelveTestJSON-1172915835-project] Allocated IP 172.27.1.211 (a93e254e-aac9-4233-9e4d-4290fd0458e4/e0b32f3d-83d6-439a-bbed-01df7cf01051/63d8ec9c-d152-4c6f-9ac7-7d9ca3bd5f11) {{(pid=102993) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 23 19:33:35.427951 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.plugins.ml2.db [None req-eb87b2c3-3339-4249-8b85-e695b5b4e1f9 None None] For port 67851a82-183f-4bba-b05f-793c8b4e7ec3, host dv-cinder-819011-1-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-819011-1-iscsi',level=0,port_id=67851a82-183f-4bba-b05f-793c8b4e7ec3,segment=NetworkSegment(b8302c34-e78d-4c43-9d45-a2604c95a2d2),segment_id=b8302c34-e78d-4c43-9d45-a2604c95a2d2)] {{(pid=102994) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 23 19:33:35.512083 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.db.l3_hamode_db [None req-3d363d88-a46d-4797-81ec-f17ea8a0a69f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '01438284-e62a-4056-8ee2-4899a051e144', 'name': 'tempest-AttachVolumeShelveTestJSON-1609224522-router', 'tenant_id': '2d925fb59ba34355aa85758374d76928', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'a93e254e-aac9-4233-9e4d-4290fd0458e4', 'external_fixed_ips': [{'subnet_id': 'e0b32f3d-83d6-439a-bbed-01df7cf01051', 'ip_address': '172.27.1.99'}], 'enable_snat': True}, 'gw_port_id': 'a6140c41-82e2-4d62-8e5f-f3fc119a374e', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-23T19:33:21Z', 'updated_at': '2021-11-23T19:33:28Z', 'revision_number': 4, 'project_id': '2d925fb59ba34355aa85758374d76928', 'gw_port': {'id': 'a6140c41-82e2-4d62-8e5f-f3fc119a374e', 'name': '', 'network_id': 'a93e254e-aac9-4233-9e4d-4290fd0458e4', 'tenant_id': '', 'mac_address': 'fa:16:3e:32:52:e2', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '01438284-e62a-4056-8ee2-4899a051e144', 'device_owner': 'network:router_gateway', 'standard_attr_id': 59, 'fixed_ips': [{'subnet_id': 'e0b32f3d-83d6-439a-bbed-01df7cf01051', 'ip_address': '172.27.1.99', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-819011-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-23T19:33:22Z', 'updated_at': '2021-11-23T19:33:30Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'e0b32f3d-83d6-439a-bbed-01df7cf01051', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-819011-1-iscsi', '_interfaces': [{'id': 'c96e4c46-b1fa-4e6c-9fe8-9c516c4ee278', 'name': '', 'network_id': 'fc901312-2937-4784-8a6d-c046666e8bf8', 'tenant_id': '2d925fb59ba34355aa85758374d76928', 'mac_address': 'fa:16:3e:b7:43:ca', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '01438284-e62a-4056-8ee2-4899a051e144', 'device_owner': 'network:router_interface', 'standard_attr_id': 71, 'fixed_ips': [{'subnet_id': '2caca985-6ed6-4ef7-ba49-7b7410bea160', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-819011-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-23T19:33:26Z', 'updated_at': '2021-11-23T19:33:33Z', 'revision_number': 4, 'project_id': '2d925fb59ba34355aa85758374d76928', 'subnets': [{'id': '2caca985-6ed6-4ef7-ba49-7b7410bea160', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-819011-1-iscsi', False) {} {{(pid=102994) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 23 19:33:35.553890 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-3d363d88-a46d-4797-81ec-f17ea8a0a69f None None] The sync data for ids ['01438284-e62a-4056-8ee2-4899a051e144'] in dv-cinder-819011-1-iscsi is: [{'id': '01438284-e62a-4056-8ee2-4899a051e144', 'name': 'tempest-AttachVolumeShelveTestJSON-1609224522-router', 'tenant_id': '2d925fb59ba34355aa85758374d76928', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'a93e254e-aac9-4233-9e4d-4290fd0458e4', 'external_fixed_ips': [{'subnet_id': 'e0b32f3d-83d6-439a-bbed-01df7cf01051', 'ip_address': '172.27.1.99'}], 'enable_snat': True}, 'gw_port_id': 'a6140c41-82e2-4d62-8e5f-f3fc119a374e', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-23T19:33:21Z', 'updated_at': '2021-11-23T19:33:28Z', 'revision_number': 4, 'project_id': '2d925fb59ba34355aa85758374d76928', 'gw_port': {'id': 'a6140c41-82e2-4d62-8e5f-f3fc119a374e', 'name': '', 'network_id': 'a93e254e-aac9-4233-9e4d-4290fd0458e4', 'tenant_id': '', 'mac_address': 'fa:16:3e:32:52:e2', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '01438284-e62a-4056-8ee2-4899a051e144', 'device_owner': 'network:router_gateway', 'standard_attr_id': 59, 'fixed_ips': [{'subnet_id': 'e0b32f3d-83d6-439a-bbed-01df7cf01051', 'ip_address': '172.27.1.99', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-819011-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-23T19:33:22Z', 'updated_at': '2021-11-23T19:33:30Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'e0b32f3d-83d6-439a-bbed-01df7cf01051', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-819011-1-iscsi', '_interfaces': [{'id': 'c96e4c46-b1fa-4e6c-9fe8-9c516c4ee278', 'name': '', 'network_id': 'fc901312-2937-4784-8a6d-c046666e8bf8', 'tenant_id': '2d925fb59ba34355aa85758374d76928', 'mac_address': 'fa:16:3e:b7:43:ca', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '01438284-e62a-4056-8ee2-4899a051e144', 'device_owner': 'network:router_interface', 'standard_attr_id': 71, 'fixed_ips': [{'subnet_id': '2caca985-6ed6-4ef7-ba49-7b7410bea160', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-819011-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-23T19:33:26Z', 'updated_at': '2021-11-23T19:33:33Z', 'revision_number': 4, 'project_id': '2d925fb59ba34355aa85758374d76928', 'subnets': [{'id': '2caca985-6ed6-4ef7-ba49-7b7410bea160', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=102994) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 23 19:33:35.571406 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-62964d1b-f4c9-4db3-a20f-b1638156d3a7 tempest-AttachVolumeShelveTestJSON-1172915835 tempest-AttachVolumeShelveTestJSON-1172915835-project] Publish callbacks [] for port, precommit_create {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:33:35.583171 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron_lib.callbacks.manager [None req-56becd84-7d8b-4df3-87a0-5682f5764960 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7918660', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-15067', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560168', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8783631423946', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8783631008732', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8783631008750'] for port, after_update {{(pid=102994) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:33:35.718804 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-56becd84-7d8b-4df3-87a0-5682f5764960 None None] Pushing event updated for resources: {'Port': ['ID=c96e4c46-b1fa-4e6c-9fe8-9c516c4ee278,revision_number=5']} {{(pid=102994) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 23 19:33:35.737010 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.db.provisioning_blocks [None req-b4e22945-4e29-4162-a14c-d88ea54830a2 None None] Provisioning complete for port c96e4c46-b1fa-4e6c-9fe8-9c516c4ee278 triggered by entity DHCP. {{(pid=102994) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 23 19:33:35.738428 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron_lib.callbacks.manager [None req-b4e22945-4e29-4162-a14c-d88ea54830a2 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-8355713'] for port, provisioning_complete {{(pid=102994) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:33:35.742722 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron_lib.callbacks.manager [None req-eb87b2c3-3339-4249-8b85-e695b5b4e1f9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7918660', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-15067', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560168', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8783631423946', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8783631008732', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8783631008750'] for port, after_update {{(pid=102994) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:33:35.747056 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-7ea66916-be9e-4ebf-8614-68a4dfefd0e9 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-623933'] for security_group, after_create {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:33:35.774815 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6a35804c-abc9-4b6a-8947-49a6bbd4c30f req-9b7341c0-4164-4724-a759-798c99cbbc83 tempest-DeleteServersTestJSON-453817978 tempest-DeleteServersTestJSON-453817978-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102993) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:33:35.778860 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-6a35804c-abc9-4b6a-8947-49a6bbd4c30f req-9b7341c0-4164-4724-a759-798c99cbbc83 tempest-DeleteServersTestJSON-453817978 tempest-DeleteServersTestJSON-453817978-project] 10.222.0.62 "GET /v2.0/ports?device_id=5e3c1406-dc8c-414a-bcc5-55c7c963e1df HTTP/1.1" status: 200 len: 931 time: 0.1329355 Nov 23 19:33:35.848267 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.wsgi [-] (102992) accepted ('10.222.0.62', 41276) {{(pid=102992) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 23 19:33:35.867284 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7ea66916-be9e-4ebf-8614-68a4dfefd0e9 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=9022832d-8dc2-4796-abb0-7898a024a7c4,revision_number=1']} {{(pid=102993) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 23 19:33:35.886640 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-62964d1b-f4c9-4db3-a20f-b1638156d3a7 tempest-AttachVolumeShelveTestJSON-1172915835 tempest-AttachVolumeShelveTestJSON-1172915835-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7918660', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-15067', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560168', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8783631008714'] for port, after_create {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:33:35.901113 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [None req-ef7b361b-73ee-4d54-97db-5c076da679b9 admin admin] Publish callbacks [] for security_group, before_create {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:33:35.915576 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-62964d1b-f4c9-4db3-a20f-b1638156d3a7 tempest-AttachVolumeShelveTestJSON-1172915835 tempest-AttachVolumeShelveTestJSON-1172915835-project] Network a93e254e-aac9-4233-9e4d-4290fd0458e4 is already hosted by enough agents. {{(pid=102993) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 23 19:33:35.922707 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.scheduler.base_scheduler [None req-62964d1b-f4c9-4db3-a20f-b1638156d3a7 tempest-AttachVolumeShelveTestJSON-1172915835 tempest-AttachVolumeShelveTestJSON-1172915835-project] Resources bound (agent type, host, resource id): {{(pid=102993) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 23 19:33:35.976024 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.db.l3_dvrscheduler_db [None req-62964d1b-f4c9-4db3-a20f-b1638156d3a7 tempest-AttachVolumeShelveTestJSON-1172915835 tempest-AttachVolumeShelveTestJSON-1172915835-project] Received port after_create {{(pid=102993) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 23 19:33:35.995415 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-eb87b2c3-3339-4249-8b85-e695b5b4e1f9 None None] Pushing event updated for resources: {'Port': ['ID=67851a82-183f-4bba-b05f-793c8b4e7ec3,revision_number=5']} {{(pid=102994) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 23 19:33:36.005588 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.plugins.ml2.rpc [None req-eb87b2c3-3339-4249-8b85-e695b5b4e1f9 None None] Device c96e4c46-b1fa-4e6c-9fe8-9c516c4ee278 up at agent ovs-agent-dv-cinder-819011-1-iscsi {{(pid=102994) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 23 19:33:36.129797 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-62964d1b-f4c9-4db3-a20f-b1638156d3a7 tempest-AttachVolumeShelveTestJSON-1172915835 tempest-AttachVolumeShelveTestJSON-1172915835-project] Pushing event updated for resources: {'Port': ['ID=63d8ec9c-d152-4c6f-9ac7-7d9ca3bd5f11,revision_number=1']} {{(pid=102993) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 23 19:33:36.181204 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-6a35804c-abc9-4b6a-8947-49a6bbd4c30f req-c05dbb5d-be22-4bf3-834d-fc30174d8636 tempest-DeleteServersTestJSON-453817978 tempest-DeleteServersTestJSON-453817978-project] 10.222.0.62 "GET /v2.0/security-groups?id=5b5d5814-644d-45c2-ad35-f8920c3382b0&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.3908112 Nov 23 19:33:36.196323 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [None req-7ea66916-be9e-4ebf-8614-68a4dfefd0e9 admin admin] 10.222.0.62 "GET /v2.0/security-groups?tenant_id=8096ed4f52544d74a46426641e12ce89&name=default HTTP/1.1" status: 200 len: 2992 time: 2.0632350 Nov 23 19:33:36.222339 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.wsgi [-] (102993) accepted ('10.222.0.62', 41282) {{(pid=102993) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 23 19:33:36.269546 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-c2863a7c-e282-4888-9f71-6020cf9b80b7 req-b7aea050-75f8-40ca-b6b2-8b38d4111c4a tempest-ServerRescueNegativeTestJSON-1447477341 tempest-ServerRescueNegativeTestJSON-1447477341-project] 10.222.0.62 "GET /v2.0/ports?device_id=90cb32bd-c375-400a-b79a-97fc61e2a3a3 HTTP/1.1" status: 200 len: 210 time: 0.0991414 Nov 23 19:33:36.290148 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.db.provisioning_blocks [None req-eb87b2c3-3339-4249-8b85-e695b5b4e1f9 None None] Provisioning complete for port c96e4c46-b1fa-4e6c-9fe8-9c516c4ee278 triggered by entity L2. {{(pid=102994) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 23 19:33:36.290719 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron_lib.callbacks.manager [None req-eb87b2c3-3339-4249-8b85-e695b5b4e1f9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-8355713'] for port, provisioning_complete {{(pid=102994) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:33:36.317301 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.api.v2.base [req-0a57b9d2-6400-42ea-bdd7-d1bf707b8bb8 req-a6a6519e-6a5a-4b63-b162-5706c7d72202 service neutron] Request body: {'port': {'device_id': '5e3c1406-dc8c-414a-bcc5-55c7c963e1df', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-81901'}} {{(pid=102992) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 23 19:33:36.370626 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.wsgi [-] (102992) accepted ('10.222.0.62', 41286) {{(pid=102992) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 23 19:33:36.377008 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [None req-ef7b361b-73ee-4d54-97db-5c076da679b9 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:33:36.402024 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.wsgi [-] (102992) accepted ('10.222.0.41', 51776) {{(pid=102992) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 23 19:33:36.471702 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-62964d1b-f4c9-4db3-a20f-b1638156d3a7 tempest-AttachVolumeShelveTestJSON-1172915835 tempest-AttachVolumeShelveTestJSON-1172915835-project] Publish callbacks [] for floatingip, precommit_create {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:33:36.471989 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [req-0a57b9d2-6400-42ea-bdd7-d1bf707b8bb8 req-a6a6519e-6a5a-4b63-b162-5706c7d72202 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7921281'] for port, before_update {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:33:36.486861 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-ecb87176-2cf2-4340-a7ea-08dca3aa5d0b admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:33:36.516282 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-ecb87176-2cf2-4340-a7ea-08dca3aa5d0b admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:33:36.641454 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [None req-ef7b361b-73ee-4d54-97db-5c076da679b9 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-623933'] for security_group, after_create {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:33:36.641713 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-62964d1b-f4c9-4db3-a20f-b1638156d3a7 tempest-AttachVolumeShelveTestJSON-1172915835 tempest-AttachVolumeShelveTestJSON-1172915835-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7921281'] for port, before_update {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:33:36.644379 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-ecb87176-2cf2-4340-a7ea-08dca3aa5d0b admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-623933'] for security_group, after_delete {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:33:36.645267 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [None req-0747519c-e2a9-4794-b106-84d94fabe477 admin admin] Publish callbacks [] for security_group, before_create {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:33:36.647790 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-ecb87176-2cf2-4340-a7ea-08dca3aa5d0b admin admin] Publish callbacks [] for security_group, before_response {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:33:36.651757 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [None req-ecb87176-2cf2-4340-a7ea-08dca3aa5d0b admin admin] 10.222.0.62 "DELETE /v2.0/security-groups/9022832d-8dc2-4796-abb0-7898a024a7c4 HTTP/1.1" status: 204 len: 168 time: 0.4223189 Nov 23 19:33:36.723317 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ef7b361b-73ee-4d54-97db-5c076da679b9 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=04c18522-a431-4cb2-9001-8b6f633b1893,revision_number=1']} {{(pid=102992) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 23 19:33:36.734103 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ecb87176-2cf2-4340-a7ea-08dca3aa5d0b admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=9022832d-8dc2-4796-abb0-7898a024a7c4,revision_number=None']} {{(pid=102993) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 23 19:33:37.013689 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [None req-ef7b361b-73ee-4d54-97db-5c076da679b9 admin admin] 10.222.0.62 "GET /v2.0/security-groups?tenant_id=b85fbc4d72d54c95847f8e04dc7cb64d&name=default HTTP/1.1" status: 200 len: 2996 time: 1.1615334 Nov 23 19:33:37.031621 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.wsgi [-] (102993) accepted ('10.222.0.62', 41302) {{(pid=102993) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 23 19:33:37.063163 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-62964d1b-f4c9-4db3-a20f-b1638156d3a7 tempest-AttachVolumeShelveTestJSON-1172915835 tempest-AttachVolumeShelveTestJSON-1172915835-project] Publish callbacks [] for port, precommit_update {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:33:37.104330 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-17781b45-59ea-449c-b5b6-5d1c26c7c224 req-cc9e666c-f0c4-40cc-b6a2-172e49951d2d tempest-ServerRescueNegativeTestJSON-1447477341 tempest-ServerRescueNegativeTestJSON-1447477341-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=102992) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:33:37.109426 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-17781b45-59ea-449c-b5b6-5d1c26c7c224 req-cc9e666c-f0c4-40cc-b6a2-172e49951d2d tempest-ServerRescueNegativeTestJSON-1447477341 tempest-ServerRescueNegativeTestJSON-1447477341-project] 10.222.0.41 "GET /v2.0/networks?id=07eeb44e-4cdb-4c58-a83d-1dd8ab1ccb8a HTTP/1.1" status: 200 len: 819 time: 0.6544714 Nov 23 19:33:37.191068 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-62964d1b-f4c9-4db3-a20f-b1638156d3a7 tempest-AttachVolumeShelveTestJSON-1172915835 tempest-AttachVolumeShelveTestJSON-1172915835-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7918660', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-15067', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560168', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8783631423946', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8783631008732', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8783631008750'] for port, after_update {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:33:37.233371 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-a29161a3-9d2a-4558-afc7-f4f0ccc69ff8 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:33:37.242636 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-62964d1b-f4c9-4db3-a20f-b1638156d3a7 tempest-AttachVolumeShelveTestJSON-1172915835 tempest-AttachVolumeShelveTestJSON-1172915835-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-926531'] for floatingip, after_create {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:33:37.287366 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.api.v2.base [req-17781b45-59ea-449c-b5b6-5d1c26c7c224 req-b15ab789-a21c-44c9-9c73-f438a9111c97 tempest-ServerRescueNegativeTestJSON-1447477341 tempest-ServerRescueNegativeTestJSON-1447477341-project] Request body: {'port': {'device_id': '671f1d44-7752-4a9d-835d-4d76164c900f', 'network_id': '07eeb44e-4cdb-4c58-a83d-1dd8ab1ccb8a', 'admin_state_up': True, 'tenant_id': 'c15ab51e579448cfb7a4b3e4f8049687'}} {{(pid=102992) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 23 19:33:37.400159 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-a29161a3-9d2a-4558-afc7-f4f0ccc69ff8 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:33:37.406166 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-62964d1b-f4c9-4db3-a20f-b1638156d3a7 tempest-AttachVolumeShelveTestJSON-1172915835 tempest-AttachVolumeShelveTestJSON-1172915835-project] Pushing event updated for resources: {'Port': ['ID=63d8ec9c-d152-4c6f-9ac7-7d9ca3bd5f11,revision_number=2']} {{(pid=102993) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 23 19:33:37.585576 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4c4f04c2-f148-4f84-a35c-6f8c25983f5d req-fdc12611-c7c6-479c-b8ee-744105342ae3 tempest-DeleteServersTestJSON-453817978 tempest-DeleteServersTestJSON-453817978-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102993) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:33:37.604902 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-4c4f04c2-f148-4f84-a35c-6f8c25983f5d req-fdc12611-c7c6-479c-b8ee-744105342ae3 tempest-DeleteServersTestJSON-453817978 tempest-DeleteServersTestJSON-453817978-project] 10.222.0.62 "GET /v2.0/ports?device_id=5e3c1406-dc8c-414a-bcc5-55c7c963e1df HTTP/1.1" status: 200 len: 931 time: 0.1961677 Nov 23 19:33:37.681729 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-a29161a3-9d2a-4558-afc7-f4f0ccc69ff8 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-623933'] for security_group, after_delete {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:33:37.696797 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-a29161a3-9d2a-4558-afc7-f4f0ccc69ff8 admin admin] Publish callbacks [] for security_group, before_response {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:33:37.702083 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [None req-a29161a3-9d2a-4558-afc7-f4f0ccc69ff8 admin admin] 10.222.0.62 "DELETE /v2.0/security-groups/04c18522-a431-4cb2-9001-8b6f633b1893 HTTP/1.1" status: 204 len: 168 time: 0.6573501 Nov 23 19:33:37.708247 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-62964d1b-f4c9-4db3-a20f-b1638156d3a7 tempest-AttachVolumeShelveTestJSON-1172915835 tempest-AttachVolumeShelveTestJSON-1172915835-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-514902'] for floatingip, before_response {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:33:37.711655 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [None req-62964d1b-f4c9-4db3-a20f-b1638156d3a7 tempest-AttachVolumeShelveTestJSON-1172915835 tempest-AttachVolumeShelveTestJSON-1172915835-project] 10.222.0.62 "POST /v2.0/floatingips HTTP/1.1" status: 201 len: 693 time: 3.2164340 Nov 23 19:33:37.738834 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a29161a3-9d2a-4558-afc7-f4f0ccc69ff8 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=04c18522-a431-4cb2-9001-8b6f633b1893,revision_number=None']} {{(pid=102993) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 23 19:33:37.774256 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-4c4f04c2-f148-4f84-a35c-6f8c25983f5d req-15ecb784-ca36-4bd8-aa49-d987cd576c97 tempest-DeleteServersTestJSON-453817978 tempest-DeleteServersTestJSON-453817978-project] 10.222.0.62 "GET /v2.0/security-groups?id=5b5d5814-644d-45c2-ad35-f8920c3382b0&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1596544 Nov 23 19:33:37.798372 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [None req-0747519c-e2a9-4794-b106-84d94fabe477 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:33:37.841052 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.wsgi [-] (102993) accepted ('10.222.0.41', 51779) {{(pid=102993) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 23 19:33:37.878219 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [None req-0747519c-e2a9-4794-b106-84d94fabe477 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-623933'] for security_group, after_create {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:33:37.934052 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.plugins.ml2.rpc [None req-eb87b2c3-3339-4249-8b85-e695b5b4e1f9 None None] Device 67851a82-183f-4bba-b05f-793c8b4e7ec3 up at agent ovs-agent-dv-cinder-819011-1-iscsi {{(pid=102994) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 23 19:33:37.993762 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-d0419cc1-ba3c-4e9d-acea-d64be4bb5e59 req-1d83f43b-e21f-4cd5-ab65-bbcaf33bf3c9 tempest-ServerRescueNegativeTestJSON-1447477341 tempest-ServerRescueNegativeTestJSON-1447477341-project] 10.222.0.62 "GET /v2.0/ports?device_id=90cb32bd-c375-400a-b79a-97fc61e2a3a3 HTTP/1.1" status: 200 len: 210 time: 0.1391065 Nov 23 19:33:37.995972 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.notifiers.nova [req-0a57b9d2-6400-42ea-bdd7-d1bf707b8bb8 req-a6a6519e-6a5a-4b63-b162-5706c7d72202 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 8c70d83a-558d-4a92-a3e8-15396107e64d {{(pid=102992) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 23 19:33:37.998602 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-47069518-df9a-4746-84a8-fb477093fa62 req-d3ef6383-481d-4770-b9c3-85ca2e3cee7f tempest-ServerRescueNegativeTestJSON-1447477341 tempest-ServerRescueNegativeTestJSON-1447477341-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=102993) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:33:38.000230 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-47069518-df9a-4746-84a8-fb477093fa62 req-d3ef6383-481d-4770-b9c3-85ca2e3cee7f tempest-ServerRescueNegativeTestJSON-1447477341 tempest-ServerRescueNegativeTestJSON-1447477341-project] 10.222.0.41 "GET /v2.0/networks?id=07eeb44e-4cdb-4c58-a83d-1dd8ab1ccb8a HTTP/1.1" status: 200 len: 819 time: 0.1484659 Nov 23 19:33:38.026508 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [req-0a57b9d2-6400-42ea-bdd7-d1bf707b8bb8 req-a6a6519e-6a5a-4b63-b162-5706c7d72202 service neutron] Publish callbacks [] for port, precommit_update {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:33:38.038124 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0747519c-e2a9-4794-b106-84d94fabe477 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=a5561ba4-2b7d-4f03-bf5c-79bc836e5a1f,revision_number=1']} {{(pid=102992) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 23 19:33:38.055570 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [None req-0747519c-e2a9-4794-b106-84d94fabe477 admin admin] 10.222.0.62 "GET /v2.0/security-groups?tenant_id=90c36f903ecc4c8f9f00800e54daf910&name=default HTTP/1.1" status: 200 len: 2996 time: 1.6810429 Nov 23 19:33:38.057843 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.wsgi [-] (102993) accepted ('10.222.0.62', 41338) {{(pid=102993) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 23 19:33:38.075938 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.db.provisioning_blocks [req-0a57b9d2-6400-42ea-bdd7-d1bf707b8bb8 req-a6a6519e-6a5a-4b63-b162-5706c7d72202 service neutron] Transition to ACTIVE for port object 8c70d83a-558d-4a92-a3e8-15396107e64d will not be triggered until provisioned by entity L2. {{(pid=102992) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 23 19:33:38.080462 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.db.provisioning_blocks [None req-eb87b2c3-3339-4249-8b85-e695b5b4e1f9 None None] Provisioning complete for port 67851a82-183f-4bba-b05f-793c8b4e7ec3 triggered by entity L2. {{(pid=102994) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 23 19:33:38.082832 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron_lib.callbacks.manager [None req-eb87b2c3-3339-4249-8b85-e695b5b4e1f9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-8355713'] for port, provisioning_complete {{(pid=102994) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:33:38.090652 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.api.v2.base [req-47069518-df9a-4746-84a8-fb477093fa62 req-0faeb902-6de5-4c60-8ccc-eb0ffc6b92b3 tempest-ServerRescueNegativeTestJSON-1447477341 tempest-ServerRescueNegativeTestJSON-1447477341-project] Request body: {'port': {'device_id': '90cb32bd-c375-400a-b79a-97fc61e2a3a3', 'network_id': '07eeb44e-4cdb-4c58-a83d-1dd8ab1ccb8a', 'admin_state_up': True, 'tenant_id': 'c15ab51e579448cfb7a4b3e4f8049687'}} {{(pid=102993) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 23 19:33:38.110270 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.wsgi [-] (102992) accepted ('10.222.0.62', 41340) {{(pid=102992) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 23 19:33:38.148472 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [None req-9777290d-c23a-4b7e-9068-10f5ce1598fc admin admin] Publish callbacks [] for security_group, before_create {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:33:38.364614 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [None req-9777290d-c23a-4b7e-9068-10f5ce1598fc admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:33:38.364614 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [req-0a57b9d2-6400-42ea-bdd7-d1bf707b8bb8 req-a6a6519e-6a5a-4b63-b162-5706c7d72202 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7918660', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-15067', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560168', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8783631423946', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8783631008732', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8783631008750'] for port, after_update {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:33:38.369975 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-3a270546-ef95-4f69-967d-cc7ee0b118ab admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:33:38.439704 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-3a270546-ef95-4f69-967d-cc7ee0b118ab admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:33:38.448234 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a6a6519e-6a5a-4b63-b162-5706c7d72202 service neutron] Pushing event updated for resources: {'Port': ['ID=8c70d83a-558d-4a92-a3e8-15396107e64d,revision_number=2']} {{(pid=102992) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 23 19:33:38.540490 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-5176909e-415f-4c22-b863-70d02645fe82 req-362c4137-4901-4c13-8508-c48dba200349 tempest-AttachVolumeShelveTestJSON-1172915835 tempest-AttachVolumeShelveTestJSON-1172915835-project] 10.222.0.62 "GET /v2.0/security-groups?name=tempest-securitygroup--51382851&fields=id&tenant_id=2d925fb59ba34355aa85758374d76928 HTTP/1.1" status: 200 len: 267 time: 0.1039407 Nov 23 19:33:38.597141 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-17781b45-59ea-449c-b5b6-5d1c26c7c224 req-b15ab789-a21c-44c9-9c73-f438a9111c97 tempest-ServerRescueNegativeTestJSON-1447477341 tempest-ServerRescueNegativeTestJSON-1447477341-project] Made reservation on behalf of c15ab51e579448cfb7a4b3e4f8049687 for: {'port': 1} {{(pid=102992) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 23 19:33:38.601128 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [req-17781b45-59ea-449c-b5b6-5d1c26c7c224 req-b15ab789-a21c-44c9-9c73-f438a9111c97 tempest-ServerRescueNegativeTestJSON-1447477341 tempest-ServerRescueNegativeTestJSON-1447477341-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7921281'] for port, before_create {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:33:38.619421 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [None req-9777290d-c23a-4b7e-9068-10f5ce1598fc admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-623933'] for security_group, after_create {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:33:38.684773 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.plugins.ml2.managers [req-0a57b9d2-6400-42ea-bdd7-d1bf707b8bb8 req-a6a6519e-6a5a-4b63-b162-5706c7d72202 service neutron] Attempting to bind port 8c70d83a-558d-4a92-a3e8-15396107e64d on host hv-cinder-81901 for vnic_type normal with profile {{(pid=102992) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 23 19:33:38.685199 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.plugins.ml2.managers [req-0a57b9d2-6400-42ea-bdd7-d1bf707b8bb8 req-a6a6519e-6a5a-4b63-b162-5706c7d72202 service neutron] Attempting to bind port 8c70d83a-558d-4a92-a3e8-15396107e64d by drivers openvswitch,hyperv on host hv-cinder-81901 at level 0 using segments [{'id': '6f1d4a41-ab87-4da1-b83c-5e20faf1683c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 823, 'network_id': '2cf6d774-4b5e-4f5e-bb22-8de22e43722d'}] {{(pid=102992) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 23 19:33:38.685489 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-0a57b9d2-6400-42ea-bdd7-d1bf707b8bb8 req-a6a6519e-6a5a-4b63-b162-5706c7d72202 service neutron] Attempting to bind port 8c70d83a-558d-4a92-a3e8-15396107e64d on network 2cf6d774-4b5e-4f5e-bb22-8de22e43722d {{(pid=102992) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 23 19:33:38.728240 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5176909e-415f-4c22-b863-70d02645fe82 req-f30fcb28-64b8-49af-a433-67a8923ac02c tempest-AttachVolumeShelveTestJSON-1172915835 tempest-AttachVolumeShelveTestJSON-1172915835-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=102993) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:33:38.729320 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [None req-9777290d-c23a-4b7e-9068-10f5ce1598fc admin admin] 10.222.0.62 "GET /v2.0/security-groups?tenant_id=6698a977324e41e3902e26da76616ac0&name=default HTTP/1.1" status: 200 len: 2996 time: 0.6166241 Nov 23 19:33:38.734450 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.wsgi [-] (102992) accepted ('10.222.0.62', 41360) {{(pid=102992) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 23 19:33:38.736204 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-5176909e-415f-4c22-b863-70d02645fe82 req-f30fcb28-64b8-49af-a433-67a8923ac02c tempest-AttachVolumeShelveTestJSON-1172915835 tempest-AttachVolumeShelveTestJSON-1172915835-project] 10.222.0.62 "GET /v2.0/networks?id=fc901312-2937-4784-8a6d-c046666e8bf8 HTTP/1.1" status: 200 len: 817 time: 0.1946027 Nov 23 19:33:38.736600 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-0a57b9d2-6400-42ea-bdd7-d1bf707b8bb8 req-a6a6519e-6a5a-4b63-b162-5706c7d72202 service neutron] Port 8c70d83a-558d-4a92-a3e8-15396107e64d on network 2cf6d774-4b5e-4f5e-bb22-8de22e43722d not bound, no agent of type Open vSwitch agent registered on host hv-cinder-81901 {{(pid=102992) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Nov 23 19:33:38.737155 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-0a57b9d2-6400-42ea-bdd7-d1bf707b8bb8 req-a6a6519e-6a5a-4b63-b162-5706c7d72202 service neutron] Attempting to bind port 8c70d83a-558d-4a92-a3e8-15396107e64d on network 2cf6d774-4b5e-4f5e-bb22-8de22e43722d {{(pid=102992) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 23 19:33:38.750167 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9777290d-c23a-4b7e-9068-10f5ce1598fc admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=39b29d65-9dca-49a1-84c5-ce7298484861,revision_number=1']} {{(pid=102992) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 23 19:33:38.763237 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-0a57b9d2-6400-42ea-bdd7-d1bf707b8bb8 req-a6a6519e-6a5a-4b63-b162-5706c7d72202 service neutron] Checking agent: {'id': '14e5d049-431d-466a-8d1c-264e5129d376', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-81901', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 23, 19, 31, 29), 'started_at': datetime.datetime(2021, 11, 23, 19, 31, 29), 'heartbeat_timestamp': datetime.datetime(2021, 11, 23, 19, 33, 29), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=102992) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 23 19:33:38.763574 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-0a57b9d2-6400-42ea-bdd7-d1bf707b8bb8 req-a6a6519e-6a5a-4b63-b162-5706c7d72202 service neutron] Checking segment: {'id': '6f1d4a41-ab87-4da1-b83c-5e20faf1683c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 823, 'network_id': '2cf6d774-4b5e-4f5e-bb22-8de22e43722d'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102992) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 23 19:33:38.764141 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-0a57b9d2-6400-42ea-bdd7-d1bf707b8bb8 req-a6a6519e-6a5a-4b63-b162-5706c7d72202 service neutron] Bound using segment: {'id': '6f1d4a41-ab87-4da1-b83c-5e20faf1683c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 823, 'network_id': '2cf6d774-4b5e-4f5e-bb22-8de22e43722d'} {{(pid=102992) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 23 19:33:38.764756 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.plugins.ml2.managers [req-0a57b9d2-6400-42ea-bdd7-d1bf707b8bb8 req-a6a6519e-6a5a-4b63-b162-5706c7d72202 service neutron] Bound port: 8c70d83a-558d-4a92-a3e8-15396107e64d, host: hv-cinder-81901, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '6f1d4a41-ab87-4da1-b83c-5e20faf1683c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 823, 'network_id': '2cf6d774-4b5e-4f5e-bb22-8de22e43722d'}}] {{(pid=102992) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 23 19:33:38.765009 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [req-0a57b9d2-6400-42ea-bdd7-d1bf707b8bb8 req-a6a6519e-6a5a-4b63-b162-5706c7d72202 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7921281'] for port, before_update {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:33:38.794819 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-5176909e-415f-4c22-b863-70d02645fe82 req-a77a01a5-7b5b-4daa-ac51-5053c4e54c32 tempest-AttachVolumeShelveTestJSON-1172915835 tempest-AttachVolumeShelveTestJSON-1172915835-project] 10.222.0.62 "GET /v2.0/quotas/2d925fb59ba34355aa85758374d76928 HTTP/1.1" status: 200 len: 375 time: 0.0415478 Nov 23 19:33:38.928041 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-5176909e-415f-4c22-b863-70d02645fe82 req-04cd3c1c-6db3-494b-8e05-08a943f73e36 tempest-AttachVolumeShelveTestJSON-1172915835 tempest-AttachVolumeShelveTestJSON-1172915835-project] 10.222.0.62 "GET /v2.0/ports?tenant_id=2d925fb59ba34355aa85758374d76928&fields=id HTTP/1.1" status: 200 len: 302 time: 0.1104827 Nov 23 19:33:38.929205 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-47069518-df9a-4746-84a8-fb477093fa62 req-0faeb902-6de5-4c60-8ccc-eb0ffc6b92b3 tempest-ServerRescueNegativeTestJSON-1447477341 tempest-ServerRescueNegativeTestJSON-1447477341-project] Made reservation on behalf of c15ab51e579448cfb7a4b3e4f8049687 for: {'port': 1} {{(pid=102993) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 23 19:33:38.941165 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [None req-2a324b5c-c1c4-4e33-bc6e-eb9c544f8ee3 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:33:38.952499 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [req-47069518-df9a-4746-84a8-fb477093fa62 req-0faeb902-6de5-4c60-8ccc-eb0ffc6b92b3 tempest-ServerRescueNegativeTestJSON-1447477341 tempest-ServerRescueNegativeTestJSON-1447477341-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7921281'] for port, before_create {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:33:39.051440 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [None req-2a324b5c-c1c4-4e33-bc6e-eb9c544f8ee3 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:33:39.072076 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.plugins.ml2.db [req-0a57b9d2-6400-42ea-bdd7-d1bf707b8bb8 req-a6a6519e-6a5a-4b63-b162-5706c7d72202 service neutron] For port 8c70d83a-558d-4a92-a3e8-15396107e64d, host hv-cinder-81901, cleared binding levels {{(pid=102992) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 23 19:33:39.136585 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.plugins.ml2.db [req-0a57b9d2-6400-42ea-bdd7-d1bf707b8bb8 req-a6a6519e-6a5a-4b63-b162-5706c7d72202 service neutron] For port 8c70d83a-558d-4a92-a3e8-15396107e64d, host hv-cinder-81901, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81901',level=0,port_id=8c70d83a-558d-4a92-a3e8-15396107e64d,segment=NetworkSegment(6f1d4a41-ab87-4da1-b83c-5e20faf1683c),segment_id=6f1d4a41-ab87-4da1-b83c-5e20faf1683c)] {{(pid=102992) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 23 19:33:39.148292 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4bf29632-5de2-48d9-9c32-8c20630a6d26 req-05f2702e-a4d8-4900-adc9-36ef74759fc5 tempest-DeleteServersTestJSON-453817978 tempest-DeleteServersTestJSON-453817978-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102992) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:33:39.155737 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-4bf29632-5de2-48d9-9c32-8c20630a6d26 req-05f2702e-a4d8-4900-adc9-36ef74759fc5 tempest-DeleteServersTestJSON-453817978 tempest-DeleteServersTestJSON-453817978-project] 10.222.0.62 "GET /v2.0/ports?device_id=5e3c1406-dc8c-414a-bcc5-55c7c963e1df HTTP/1.1" status: 200 len: 943 time: 0.2423239 Nov 23 19:33:39.305231 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-3a270546-ef95-4f69-967d-cc7ee0b118ab admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-623933'] for security_group, after_delete {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:33:39.305231 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-3a270546-ef95-4f69-967d-cc7ee0b118ab admin admin] Publish callbacks [] for security_group, before_response {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:33:39.305231 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [None req-3a270546-ef95-4f69-967d-cc7ee0b118ab admin admin] 10.222.0.62 "DELETE /v2.0/security-groups/a5561ba4-2b7d-4f03-bf5c-79bc836e5a1f HTTP/1.1" status: 204 len: 168 time: 1.1599011 Nov 23 19:33:39.305231 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3a270546-ef95-4f69-967d-cc7ee0b118ab admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=a5561ba4-2b7d-4f03-bf5c-79bc836e5a1f,revision_number=None']} {{(pid=102993) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 23 19:33:39.369484 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [req-0a57b9d2-6400-42ea-bdd7-d1bf707b8bb8 req-a6a6519e-6a5a-4b63-b162-5706c7d72202 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7918660', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-15067', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560168', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8783631423946', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8783631008732', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8783631008750'] for port, after_update {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:33:39.378657 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.db.db_base_plugin_common [req-17781b45-59ea-449c-b5b6-5d1c26c7c224 req-b15ab789-a21c-44c9-9c73-f438a9111c97 tempest-ServerRescueNegativeTestJSON-1447477341 tempest-ServerRescueNegativeTestJSON-1447477341-project] Allocated IP 172.20.0.3 (07eeb44e-4cdb-4c58-a83d-1dd8ab1ccb8a/e4fda56f-85ff-422d-adad-ec00db6378af/50e9d93b-ad23-4b6b-bdd0-ae5afe6f80ea) {{(pid=102992) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 23 19:33:39.423401 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-4bf29632-5de2-48d9-9c32-8c20630a6d26 req-233dbca9-4a24-43eb-a67e-da534f9e545d tempest-DeleteServersTestJSON-453817978 tempest-DeleteServersTestJSON-453817978-project] 10.222.0.62 "GET /v2.0/security-groups?id=5b5d5814-644d-45c2-ad35-f8920c3382b0&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2651961 Nov 23 19:33:39.453767 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [None req-2a324b5c-c1c4-4e33-bc6e-eb9c544f8ee3 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-623933'] for security_group, after_delete {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:33:39.457778 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [None req-2a324b5c-c1c4-4e33-bc6e-eb9c544f8ee3 admin admin] Publish callbacks [] for security_group, before_response {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:33:39.471346 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [None req-2a324b5c-c1c4-4e33-bc6e-eb9c544f8ee3 admin admin] 10.222.0.62 "DELETE /v2.0/security-groups/39b29d65-9dca-49a1-84c5-ce7298484861 HTTP/1.1" status: 204 len: 168 time: 0.7236297 Nov 23 19:33:39.474307 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0a57b9d2-6400-42ea-bdd7-d1bf707b8bb8 req-a6a6519e-6a5a-4b63-b162-5706c7d72202 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102992) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:33:39.474941 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [req-0a57b9d2-6400-42ea-bdd7-d1bf707b8bb8 req-a6a6519e-6a5a-4b63-b162-5706c7d72202 service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-514902', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-560186'] for port, before_response {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:33:39.477292 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-0a57b9d2-6400-42ea-bdd7-d1bf707b8bb8 req-a6a6519e-6a5a-4b63-b162-5706c7d72202 service neutron] 10.222.0.41 "PUT /v2.0/ports/8c70d83a-558d-4a92-a3e8-15396107e64d HTTP/1.1" status: 200 len: 1093 time: 4.5903139 Nov 23 19:33:39.483670 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '5e3c1406-dc8c-414a-bcc5-55c7c963e1df', 'tag': '8c70d83a-558d-4a92-a3e8-15396107e64d'}] {{(pid=102992) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 23 19:33:39.564513 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-5176909e-415f-4c22-b863-70d02645fe82 req-15fbc22b-f48f-4589-a9c5-43f20b278c14 service neutron] 10.222.0.62 "GET /v2.0/networks/fc901312-2937-4784-8a6d-c046666e8bf8?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.6037903 Nov 23 19:33:39.585907 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2a324b5c-c1c4-4e33-bc6e-eb9c544f8ee3 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=39b29d65-9dca-49a1-84c5-ce7298484861,revision_number=None']} {{(pid=102992) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 23 19:33:39.591922 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a6a6519e-6a5a-4b63-b162-5706c7d72202 service neutron] Pushing event updated for resources: {'Port': ['ID=8c70d83a-558d-4a92-a3e8-15396107e64d,revision_number=3']} {{(pid=102992) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 23 19:33:39.653523 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-75e0cf5d-f209-42a6-a10e-dbd7548c3ea8 req-77b1a782-9d0f-4574-8e14-f842f7b80b33 tempest-ServerRescueNegativeTestJSON-1447477341 tempest-ServerRescueNegativeTestJSON-1447477341-project] 10.222.0.62 "GET /v2.0/ports?device_id=90cb32bd-c375-400a-b79a-97fc61e2a3a3 HTTP/1.1" status: 200 len: 210 time: 0.0462303 Nov 23 19:33:39.740973 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-5176909e-415f-4c22-b863-70d02645fe82 req-ab94aba7-6eb9-46e6-9918-5bcc6423e3c2 service neutron] 10.222.0.62 "GET /v2.0/networks/fc901312-2937-4784-8a6d-c046666e8bf8?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1634958 Nov 23 19:33:39.877299 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [req-17781b45-59ea-449c-b5b6-5d1c26c7c224 req-b15ab789-a21c-44c9-9c73-f438a9111c97 tempest-ServerRescueNegativeTestJSON-1447477341 tempest-ServerRescueNegativeTestJSON-1447477341-project] Publish callbacks [] for port, precommit_create {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:33:40.134288 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0a57b9d2-6400-42ea-bdd7-d1bf707b8bb8 req-2fd3d7d4-b8f8-4e35-892e-09092d7a7bb5 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102992) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:33:40.134288 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-0a57b9d2-6400-42ea-bdd7-d1bf707b8bb8 req-2fd3d7d4-b8f8-4e35-892e-09092d7a7bb5 service neutron] 10.222.0.41 "GET /v2.0/ports?tenant_id=69ab6d68b3f1442f9785568cd27eb367&device_id=5e3c1406-dc8c-414a-bcc5-55c7c963e1df HTTP/1.1" status: 200 len: 1096 time: 0.0717053 Nov 23 19:33:40.155813 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.62/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}f86c332b591ae691ababa4b64e0601cbf242a448242f95367ce03daabfb7e1ce" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-83c535ba-69b0-456b-9520-91b210487abc" -d '{"events": [{"name": "network-changed", "server_uuid": "5e3c1406-dc8c-414a-bcc5-55c7c963e1df", "tag": "8c70d83a-558d-4a92-a3e8-15396107e64d"}]}' {{(pid=102992) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 23 19:33:40.182789 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [req-17781b45-59ea-449c-b5b6-5d1c26c7c224 req-b15ab789-a21c-44c9-9c73-f438a9111c97 tempest-ServerRescueNegativeTestJSON-1447477341 tempest-ServerRescueNegativeTestJSON-1447477341-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7918660', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-15067', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560168', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8783631008714'] for port, after_create {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:33:40.289550 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-17781b45-59ea-449c-b5b6-5d1c26c7c224 req-b15ab789-a21c-44c9-9c73-f438a9111c97 tempest-ServerRescueNegativeTestJSON-1447477341 tempest-ServerRescueNegativeTestJSON-1447477341-project] Network 07eeb44e-4cdb-4c58-a83d-1dd8ab1ccb8a is already hosted by enough agents. {{(pid=102992) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 23 19:33:40.303212 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.scheduler.base_scheduler [req-17781b45-59ea-449c-b5b6-5d1c26c7c224 req-b15ab789-a21c-44c9-9c73-f438a9111c97 tempest-ServerRescueNegativeTestJSON-1447477341 tempest-ServerRescueNegativeTestJSON-1447477341-project] Resources bound (agent type, host, resource id): {{(pid=102992) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 23 19:33:40.320454 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.db.l3_dvrscheduler_db [req-17781b45-59ea-449c-b5b6-5d1c26c7c224 req-b15ab789-a21c-44c9-9c73-f438a9111c97 tempest-ServerRescueNegativeTestJSON-1447477341 tempest-ServerRescueNegativeTestJSON-1447477341-project] Received port after_create {{(pid=102992) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 23 19:33:40.337427 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-17781b45-59ea-449c-b5b6-5d1c26c7c224 req-b15ab789-a21c-44c9-9c73-f438a9111c97 tempest-ServerRescueNegativeTestJSON-1447477341 tempest-ServerRescueNegativeTestJSON-1447477341-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=102992) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:33:40.340179 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [req-17781b45-59ea-449c-b5b6-5d1c26c7c224 req-b15ab789-a21c-44c9-9c73-f438a9111c97 tempest-ServerRescueNegativeTestJSON-1447477341 tempest-ServerRescueNegativeTestJSON-1447477341-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-514902', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-560186'] for port, before_response {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:33:40.355659 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b15ab789-a21c-44c9-9c73-f438a9111c97 tempest-ServerRescueNegativeTestJSON-1447477341 tempest-ServerRescueNegativeTestJSON-1447477341-project] Pushing event updated for resources: {'Port': ['ID=50e9d93b-ad23-4b6b-bdd0-ae5afe6f80ea,revision_number=1']} {{(pid=102992) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 23 19:33:40.400309 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-a26e061e-a496-403d-a591-144c47ea2db8 req-746fc286-acd1-410b-be10-f64946380694 tempest-AttachVolumeShelveTestJSON-1172915835 tempest-AttachVolumeShelveTestJSON-1172915835-project] 10.222.0.62 "GET /v2.0/ports?device_id=85ea3d72-6c17-4ea2-82b7-90cce01633bd HTTP/1.1" status: 200 len: 210 time: 0.0747321 Nov 23 19:33:40.438867 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.db.db_base_plugin_common [req-47069518-df9a-4746-84a8-fb477093fa62 req-0faeb902-6de5-4c60-8ccc-eb0ffc6b92b3 tempest-ServerRescueNegativeTestJSON-1447477341 tempest-ServerRescueNegativeTestJSON-1447477341-project] Allocated IP 172.20.0.2 (07eeb44e-4cdb-4c58-a83d-1dd8ab1ccb8a/e4fda56f-85ff-422d-adad-ec00db6378af/0a64c11d-0cb3-4c1e-aa45-5bcdf2771c8c) {{(pid=102993) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 23 19:33:40.536004 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-0a57b9d2-6400-42ea-bdd7-d1bf707b8bb8 req-093ce0a2-396a-4208-849b-46862a754e7b service neutron] 10.222.0.41 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.7&port_id=8c70d83a-558d-4a92-a3e8-15396107e64d HTTP/1.1" status: 200 len: 217 time: 0.2208264 Nov 23 19:33:40.632783 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0a57b9d2-6400-42ea-bdd7-d1bf707b8bb8 req-6660a4d7-0cfd-406e-bcba-8f3247fcd1c2 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=102992) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:33:40.634320 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-0a57b9d2-6400-42ea-bdd7-d1bf707b8bb8 req-6660a4d7-0cfd-406e-bcba-8f3247fcd1c2 service neutron] 10.222.0.41 "GET /v2.0/subnets?id=c1e8e6ce-3e67-4ef5-bbc3-db04880e7fab HTTP/1.1" status: 200 len: 852 time: 0.0798831 Nov 23 19:33:40.744957 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2d7f1caf-dcac-4040-9286-9c217801e569 req-6d079b2b-3fbe-4bd3-a8f7-2a849c2a60af tempest-DeleteServersTestJSON-453817978 tempest-DeleteServersTestJSON-453817978-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102993) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:33:40.744957 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-2d7f1caf-dcac-4040-9286-9c217801e569 req-6d079b2b-3fbe-4bd3-a8f7-2a849c2a60af tempest-DeleteServersTestJSON-453817978 tempest-DeleteServersTestJSON-453817978-project] 10.222.0.62 "GET /v2.0/ports?device_id=5e3c1406-dc8c-414a-bcc5-55c7c963e1df HTTP/1.1" status: 200 len: 943 time: 0.1265943 Nov 23 19:33:40.782322 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-2d7f1caf-dcac-4040-9286-9c217801e569 req-e6bfd29e-df19-4e0d-92d4-7b1a072f3f7b tempest-DeleteServersTestJSON-453817978 tempest-DeleteServersTestJSON-453817978-project] 10.222.0.62 "GET /v2.0/security-groups?id=5b5d5814-644d-45c2-ad35-f8920c3382b0&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0906217 Nov 23 19:33:40.796783 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [req-47069518-df9a-4746-84a8-fb477093fa62 req-0faeb902-6de5-4c60-8ccc-eb0ffc6b92b3 tempest-ServerRescueNegativeTestJSON-1447477341 tempest-ServerRescueNegativeTestJSON-1447477341-project] Publish callbacks [] for port, precommit_create {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:33:40.927987 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-17781b45-59ea-449c-b5b6-5d1c26c7c224 req-b15ab789-a21c-44c9-9c73-f438a9111c97 tempest-ServerRescueNegativeTestJSON-1447477341 tempest-ServerRescueNegativeTestJSON-1447477341-project] 10.222.0.41 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 3.6756589 Nov 23 19:33:41.058939 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-97da4123-67d4-4b30-9b3e-4c1519da048e req-119cc095-3d13-485b-b45d-9226c3f41d93 tempest-ServerRescueNegativeTestJSON-1447477341 tempest-ServerRescueNegativeTestJSON-1447477341-project] 10.222.0.62 "GET /v2.0/ports?device_id=90cb32bd-c375-400a-b79a-97fc61e2a3a3 HTTP/1.1" status: 200 len: 210 time: 0.0800655 Nov 23 19:33:41.061579 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [req-47069518-df9a-4746-84a8-fb477093fa62 req-0faeb902-6de5-4c60-8ccc-eb0ffc6b92b3 tempest-ServerRescueNegativeTestJSON-1447477341 tempest-ServerRescueNegativeTestJSON-1447477341-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7918660', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-15067', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560168', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8783631008714'] for port, after_create {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:33:41.070665 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Tue, 23 Nov 2021 19:33:40 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-62b92af7-5c47-468b-abda-ab9526b3449b x-openstack-request-id: req-62b92af7-5c47-468b-abda-ab9526b3449b {{(pid=102992) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 23 19:33:41.071252 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "5e3c1406-dc8c-414a-bcc5-55c7c963e1df", "tag": "8c70d83a-558d-4a92-a3e8-15396107e64d", "status": "completed", "code": 200}]} {{(pid=102992) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 23 19:33:41.072073 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.62/compute/v2.1/os-server-external-events used request id req-62b92af7-5c47-468b-abda-ab9526b3449b {{(pid=102992) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 23 19:33:41.073345 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '5e3c1406-dc8c-414a-bcc5-55c7c963e1df', 'tag': '8c70d83a-558d-4a92-a3e8-15396107e64d', 'status': 'completed', 'code': 200} Nov 23 19:33:41.203107 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-47069518-df9a-4746-84a8-fb477093fa62 req-0faeb902-6de5-4c60-8ccc-eb0ffc6b92b3 tempest-ServerRescueNegativeTestJSON-1447477341 tempest-ServerRescueNegativeTestJSON-1447477341-project] Network 07eeb44e-4cdb-4c58-a83d-1dd8ab1ccb8a is already hosted by enough agents. {{(pid=102993) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 23 19:33:41.217700 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.scheduler.base_scheduler [req-47069518-df9a-4746-84a8-fb477093fa62 req-0faeb902-6de5-4c60-8ccc-eb0ffc6b92b3 tempest-ServerRescueNegativeTestJSON-1447477341 tempest-ServerRescueNegativeTestJSON-1447477341-project] Resources bound (agent type, host, resource id): {{(pid=102993) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 23 19:33:41.226700 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.db.l3_dvrscheduler_db [req-47069518-df9a-4746-84a8-fb477093fa62 req-0faeb902-6de5-4c60-8ccc-eb0ffc6b92b3 tempest-ServerRescueNegativeTestJSON-1447477341 tempest-ServerRescueNegativeTestJSON-1447477341-project] Received port after_create {{(pid=102993) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 23 19:33:41.235573 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-47069518-df9a-4746-84a8-fb477093fa62 req-0faeb902-6de5-4c60-8ccc-eb0ffc6b92b3 tempest-ServerRescueNegativeTestJSON-1447477341 tempest-ServerRescueNegativeTestJSON-1447477341-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=102993) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:33:41.236224 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [req-47069518-df9a-4746-84a8-fb477093fa62 req-0faeb902-6de5-4c60-8ccc-eb0ffc6b92b3 tempest-ServerRescueNegativeTestJSON-1447477341 tempest-ServerRescueNegativeTestJSON-1447477341-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-514902', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-560186'] for port, before_response {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:33:41.248784 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0faeb902-6de5-4c60-8ccc-eb0ffc6b92b3 tempest-ServerRescueNegativeTestJSON-1447477341 tempest-ServerRescueNegativeTestJSON-1447477341-project] Pushing event updated for resources: {'Port': ['ID=0a64c11d-0cb3-4c1e-aa45-5bcdf2771c8c,revision_number=1']} {{(pid=102993) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 23 19:33:41.341271 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-47069518-df9a-4746-84a8-fb477093fa62 req-0faeb902-6de5-4c60-8ccc-eb0ffc6b92b3 tempest-ServerRescueNegativeTestJSON-1447477341 tempest-ServerRescueNegativeTestJSON-1447477341-project] 10.222.0.41 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 3.2804620 Nov 23 19:33:41.381385 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.api.v2.base [req-47069518-df9a-4746-84a8-fb477093fa62 req-d00ec7dc-0b38-4b82-ba3e-60905d363871 service neutron] Request body: {'port': {'device_id': '90cb32bd-c375-400a-b79a-97fc61e2a3a3', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-81901'}} {{(pid=102993) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 23 19:33:41.498598 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-0a57b9d2-6400-42ea-bdd7-d1bf707b8bb8 req-4248f6e5-8cae-4870-8e08-edbe35ed774f service neutron] 10.222.0.41 "GET /v2.0/ports?network_id=2cf6d774-4b5e-4f5e-bb22-8de22e43722d&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.1712430 Nov 23 19:33:41.505147 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.api.v2.base [req-17781b45-59ea-449c-b5b6-5d1c26c7c224 req-3e55bbed-e881-4d3a-9832-17a04788e209 service neutron] Request body: {'port': {'device_id': '671f1d44-7752-4a9d-835d-4d76164c900f', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-81901'}} {{(pid=102992) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 23 19:33:41.537693 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [req-47069518-df9a-4746-84a8-fb477093fa62 req-d00ec7dc-0b38-4b82-ba3e-60905d363871 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7921281'] for port, before_update {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:33:41.628401 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-5ccd2dad-9737-4d59-be47-54e70b5edc94 req-fb86504b-91a8-4408-bb98-939ed92cca8d tempest-AttachVolumeShelveTestJSON-1172915835 tempest-AttachVolumeShelveTestJSON-1172915835-project] 10.222.0.62 "GET /v2.0/ports?device_id=85ea3d72-6c17-4ea2-82b7-90cce01633bd HTTP/1.1" status: 200 len: 210 time: 0.0924227 Nov 23 19:33:41.739211 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [req-17781b45-59ea-449c-b5b6-5d1c26c7c224 req-3e55bbed-e881-4d3a-9832-17a04788e209 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7921281'] for port, before_update {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:33:41.833970 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-0a57b9d2-6400-42ea-bdd7-d1bf707b8bb8 req-0d67d1bb-1eeb-4e06-a9b8-df9117be2523 service neutron] 10.222.0.41 "GET /v2.0/networks/2cf6d774-4b5e-4f5e-bb22-8de22e43722d?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2843146 Nov 23 19:33:41.984845 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron_lib.callbacks.manager [None req-fbb48bda-3fa3-4563-b185-8283c44c3359 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8783631323329', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7978582'] for agent, after_update {{(pid=102994) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:33:42.235423 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-47f88023-1c88-49ed-ae74-42944e14692a req-74e829e1-a8e3-405f-856e-17be478767b0 tempest-ServerRescueNegativeTestJSON-1447477341 tempest-ServerRescueNegativeTestJSON-1447477341-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102993) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:33:42.236887 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-47f88023-1c88-49ed-ae74-42944e14692a req-74e829e1-a8e3-405f-856e-17be478767b0 tempest-ServerRescueNegativeTestJSON-1447477341 tempest-ServerRescueNegativeTestJSON-1447477341-project] 10.222.0.62 "GET /v2.0/ports?device_id=90cb32bd-c375-400a-b79a-97fc61e2a3a3 HTTP/1.1" status: 200 len: 931 time: 0.0798154 Nov 23 19:33:42.244665 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-320f6c3a-5996-49f2-a6b4-1eea7d2fbc54 req-9e9bf4a2-cc87-47fc-8637-523855f2119b tempest-DeleteServersTestJSON-453817978 tempest-DeleteServersTestJSON-453817978-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102992) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:33:42.246452 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-320f6c3a-5996-49f2-a6b4-1eea7d2fbc54 req-9e9bf4a2-cc87-47fc-8637-523855f2119b tempest-DeleteServersTestJSON-453817978 tempest-DeleteServersTestJSON-453817978-project] 10.222.0.62 "GET /v2.0/ports?device_id=5e3c1406-dc8c-414a-bcc5-55c7c963e1df HTTP/1.1" status: 200 len: 943 time: 0.2863460 Nov 23 19:33:42.270601 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-0a57b9d2-6400-42ea-bdd7-d1bf707b8bb8 req-96c3dc81-b277-4d95-8d02-0f6e0a097df0 service neutron] 10.222.0.41 "GET /v2.0/networks/2cf6d774-4b5e-4f5e-bb22-8de22e43722d?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.3462534 Nov 23 19:33:42.322021 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-320f6c3a-5996-49f2-a6b4-1eea7d2fbc54 req-fdc0abad-7fcc-4f7c-9ae7-01e63e9c6774 tempest-DeleteServersTestJSON-453817978 tempest-DeleteServersTestJSON-453817978-project] 10.222.0.62 "GET /v2.0/security-groups?id=5b5d5814-644d-45c2-ad35-f8920c3382b0&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0617218 Nov 23 19:33:42.344220 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.notifiers.nova [req-47069518-df9a-4746-84a8-fb477093fa62 req-d00ec7dc-0b38-4b82-ba3e-60905d363871 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 0a64c11d-0cb3-4c1e-aa45-5bcdf2771c8c {{(pid=102993) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 23 19:33:42.358638 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [req-47069518-df9a-4746-84a8-fb477093fa62 req-d00ec7dc-0b38-4b82-ba3e-60905d363871 service neutron] Publish callbacks [] for port, precommit_update {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:33:42.402411 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.db.provisioning_blocks [req-47069518-df9a-4746-84a8-fb477093fa62 req-d00ec7dc-0b38-4b82-ba3e-60905d363871 service neutron] Transition to ACTIVE for port object 0a64c11d-0cb3-4c1e-aa45-5bcdf2771c8c will not be triggered until provisioned by entity L2. {{(pid=102993) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 23 19:33:42.421713 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-47f88023-1c88-49ed-ae74-42944e14692a req-86ea2e00-10d8-4fc8-8b89-64026b7bd43a tempest-ServerRescueNegativeTestJSON-1447477341 tempest-ServerRescueNegativeTestJSON-1447477341-project] 10.222.0.62 "GET /v2.0/security-groups?id=62a09434-acf0-424f-9001-2c3a78119364&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1068556 Nov 23 19:33:42.615574 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [req-47069518-df9a-4746-84a8-fb477093fa62 req-d00ec7dc-0b38-4b82-ba3e-60905d363871 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7918660', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-15067', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560168', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8783631423946', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8783631008732', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8783631008750'] for port, after_update {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:33:42.811769 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d00ec7dc-0b38-4b82-ba3e-60905d363871 service neutron] Pushing event updated for resources: {'Port': ['ID=0a64c11d-0cb3-4c1e-aa45-5bcdf2771c8c,revision_number=2']} {{(pid=102993) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 23 19:33:42.817189 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.plugins.ml2.managers [req-47069518-df9a-4746-84a8-fb477093fa62 req-d00ec7dc-0b38-4b82-ba3e-60905d363871 service neutron] Attempting to bind port 0a64c11d-0cb3-4c1e-aa45-5bcdf2771c8c on host hv-cinder-81901 for vnic_type normal with profile {{(pid=102993) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 23 19:33:42.825729 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.plugins.ml2.managers [req-47069518-df9a-4746-84a8-fb477093fa62 req-d00ec7dc-0b38-4b82-ba3e-60905d363871 service neutron] Attempting to bind port 0a64c11d-0cb3-4c1e-aa45-5bcdf2771c8c by drivers openvswitch,hyperv on host hv-cinder-81901 at level 0 using segments [{'id': 'b8302c34-e78d-4c43-9d45-a2604c95a2d2', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 821, 'network_id': '07eeb44e-4cdb-4c58-a83d-1dd8ab1ccb8a'}] {{(pid=102993) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 23 19:33:42.825729 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-47069518-df9a-4746-84a8-fb477093fa62 req-d00ec7dc-0b38-4b82-ba3e-60905d363871 service neutron] Attempting to bind port 0a64c11d-0cb3-4c1e-aa45-5bcdf2771c8c on network 07eeb44e-4cdb-4c58-a83d-1dd8ab1ccb8a {{(pid=102993) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 23 19:33:42.825729 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-47069518-df9a-4746-84a8-fb477093fa62 req-d00ec7dc-0b38-4b82-ba3e-60905d363871 service neutron] Port 0a64c11d-0cb3-4c1e-aa45-5bcdf2771c8c on network 07eeb44e-4cdb-4c58-a83d-1dd8ab1ccb8a not bound, no agent of type Open vSwitch agent registered on host hv-cinder-81901 {{(pid=102993) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Nov 23 19:33:42.825729 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-47069518-df9a-4746-84a8-fb477093fa62 req-d00ec7dc-0b38-4b82-ba3e-60905d363871 service neutron] Attempting to bind port 0a64c11d-0cb3-4c1e-aa45-5bcdf2771c8c on network 07eeb44e-4cdb-4c58-a83d-1dd8ab1ccb8a {{(pid=102993) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 23 19:33:42.830352 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-47069518-df9a-4746-84a8-fb477093fa62 req-d00ec7dc-0b38-4b82-ba3e-60905d363871 service neutron] Checking agent: {'id': '14e5d049-431d-466a-8d1c-264e5129d376', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-81901', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 23, 19, 31, 29), 'started_at': datetime.datetime(2021, 11, 23, 19, 31, 29), 'heartbeat_timestamp': datetime.datetime(2021, 11, 23, 19, 33, 29), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=102993) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 23 19:33:42.830914 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-47069518-df9a-4746-84a8-fb477093fa62 req-d00ec7dc-0b38-4b82-ba3e-60905d363871 service neutron] Checking segment: {'id': 'b8302c34-e78d-4c43-9d45-a2604c95a2d2', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 821, 'network_id': '07eeb44e-4cdb-4c58-a83d-1dd8ab1ccb8a'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102993) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 23 19:33:42.832145 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-47069518-df9a-4746-84a8-fb477093fa62 req-d00ec7dc-0b38-4b82-ba3e-60905d363871 service neutron] Bound using segment: {'id': 'b8302c34-e78d-4c43-9d45-a2604c95a2d2', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 821, 'network_id': '07eeb44e-4cdb-4c58-a83d-1dd8ab1ccb8a'} {{(pid=102993) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 23 19:33:42.832655 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.plugins.ml2.managers [req-47069518-df9a-4746-84a8-fb477093fa62 req-d00ec7dc-0b38-4b82-ba3e-60905d363871 service neutron] Bound port: 0a64c11d-0cb3-4c1e-aa45-5bcdf2771c8c, host: hv-cinder-81901, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': 'b8302c34-e78d-4c43-9d45-a2604c95a2d2', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 821, 'network_id': '07eeb44e-4cdb-4c58-a83d-1dd8ab1ccb8a'}}] {{(pid=102993) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 23 19:33:42.833624 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [req-47069518-df9a-4746-84a8-fb477093fa62 req-d00ec7dc-0b38-4b82-ba3e-60905d363871 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7921281'] for port, before_update {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:33:42.924556 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.plugins.ml2.db [req-47069518-df9a-4746-84a8-fb477093fa62 req-d00ec7dc-0b38-4b82-ba3e-60905d363871 service neutron] For port 0a64c11d-0cb3-4c1e-aa45-5bcdf2771c8c, host hv-cinder-81901, cleared binding levels {{(pid=102993) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 23 19:33:42.929655 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.plugins.ml2.db [req-47069518-df9a-4746-84a8-fb477093fa62 req-d00ec7dc-0b38-4b82-ba3e-60905d363871 service neutron] For port 0a64c11d-0cb3-4c1e-aa45-5bcdf2771c8c, host hv-cinder-81901, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81901',level=0,port_id=0a64c11d-0cb3-4c1e-aa45-5bcdf2771c8c,segment=NetworkSegment(b8302c34-e78d-4c43-9d45-a2604c95a2d2),segment_id=b8302c34-e78d-4c43-9d45-a2604c95a2d2)] {{(pid=102993) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 23 19:33:42.933393 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-e3672210-e1d9-46db-ba69-2e0763607125 req-dc85bb39-3740-46ca-a463-1e4d158750eb tempest-AttachVolumeShelveTestJSON-1172915835 tempest-AttachVolumeShelveTestJSON-1172915835-project] 10.222.0.62 "GET /v2.0/ports?device_id=85ea3d72-6c17-4ea2-82b7-90cce01633bd HTTP/1.1" status: 200 len: 210 time: 0.0511775 Nov 23 19:33:42.958690 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.wsgi [-] (102992) accepted ('10.222.0.62', 41486) {{(pid=102992) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 23 19:33:43.008836 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [req-47069518-df9a-4746-84a8-fb477093fa62 req-d00ec7dc-0b38-4b82-ba3e-60905d363871 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7918660', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-15067', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560168', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8783631423946', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8783631008732', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8783631008750'] for port, after_update {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:33:43.022151 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.notifiers.nova [req-17781b45-59ea-449c-b5b6-5d1c26c7c224 req-3e55bbed-e881-4d3a-9832-17a04788e209 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 50e9d93b-ad23-4b6b-bdd0-ae5afe6f80ea {{(pid=102992) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 23 19:33:43.040464 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [req-17781b45-59ea-449c-b5b6-5d1c26c7c224 req-3e55bbed-e881-4d3a-9832-17a04788e209 service neutron] Publish callbacks [] for port, precommit_update {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:33:43.070647 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.db.provisioning_blocks [req-17781b45-59ea-449c-b5b6-5d1c26c7c224 req-3e55bbed-e881-4d3a-9832-17a04788e209 service neutron] Transition to ACTIVE for port object 50e9d93b-ad23-4b6b-bdd0-ae5afe6f80ea will not be triggered until provisioned by entity L2. {{(pid=102992) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 23 19:33:43.090098 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-47069518-df9a-4746-84a8-fb477093fa62 req-d00ec7dc-0b38-4b82-ba3e-60905d363871 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102993) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:33:43.090905 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [req-47069518-df9a-4746-84a8-fb477093fa62 req-d00ec7dc-0b38-4b82-ba3e-60905d363871 service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-514902', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-560186'] for port, before_response {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:33:43.092360 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-47069518-df9a-4746-84a8-fb477093fa62 req-d00ec7dc-0b38-4b82-ba3e-60905d363871 service neutron] 10.222.0.41 "PUT /v2.0/ports/0a64c11d-0cb3-4c1e-aa45-5bcdf2771c8c HTTP/1.1" status: 200 len: 1093 time: 1.7177300 Nov 23 19:33:43.095147 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '90cb32bd-c375-400a-b79a-97fc61e2a3a3', 'tag': '0a64c11d-0cb3-4c1e-aa45-5bcdf2771c8c'}] {{(pid=102993) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 23 19:33:43.193105 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d00ec7dc-0b38-4b82-ba3e-60905d363871 service neutron] Pushing event updated for resources: {'Port': ['ID=0a64c11d-0cb3-4c1e-aa45-5bcdf2771c8c,revision_number=3']} {{(pid=102993) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 23 19:33:43.236900 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [None req-e337656b-91a6-4cd2-8208-ca876c4ca53d admin admin] Publish callbacks [] for security_group, before_create {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:33:43.294591 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [req-17781b45-59ea-449c-b5b6-5d1c26c7c224 req-3e55bbed-e881-4d3a-9832-17a04788e209 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7918660', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-15067', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560168', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8783631423946', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8783631008732', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8783631008750'] for port, after_update {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:33:43.424677 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3e55bbed-e881-4d3a-9832-17a04788e209 service neutron] Pushing event updated for resources: {'Port': ['ID=50e9d93b-ad23-4b6b-bdd0-ae5afe6f80ea,revision_number=2']} {{(pid=102992) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 23 19:33:43.510513 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [None req-e337656b-91a6-4cd2-8208-ca876c4ca53d admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:33:43.511630 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.plugins.ml2.managers [req-17781b45-59ea-449c-b5b6-5d1c26c7c224 req-3e55bbed-e881-4d3a-9832-17a04788e209 service neutron] Attempting to bind port 50e9d93b-ad23-4b6b-bdd0-ae5afe6f80ea on host hv-cinder-81901 for vnic_type normal with profile {{(pid=102992) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 23 19:33:43.512028 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.plugins.ml2.managers [req-17781b45-59ea-449c-b5b6-5d1c26c7c224 req-3e55bbed-e881-4d3a-9832-17a04788e209 service neutron] Attempting to bind port 50e9d93b-ad23-4b6b-bdd0-ae5afe6f80ea by drivers openvswitch,hyperv on host hv-cinder-81901 at level 0 using segments [{'id': 'b8302c34-e78d-4c43-9d45-a2604c95a2d2', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 821, 'network_id': '07eeb44e-4cdb-4c58-a83d-1dd8ab1ccb8a'}] {{(pid=102992) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 23 19:33:43.512379 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-17781b45-59ea-449c-b5b6-5d1c26c7c224 req-3e55bbed-e881-4d3a-9832-17a04788e209 service neutron] Attempting to bind port 50e9d93b-ad23-4b6b-bdd0-ae5afe6f80ea on network 07eeb44e-4cdb-4c58-a83d-1dd8ab1ccb8a {{(pid=102992) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 23 19:33:43.517221 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-17781b45-59ea-449c-b5b6-5d1c26c7c224 req-3e55bbed-e881-4d3a-9832-17a04788e209 service neutron] Port 50e9d93b-ad23-4b6b-bdd0-ae5afe6f80ea on network 07eeb44e-4cdb-4c58-a83d-1dd8ab1ccb8a not bound, no agent of type Open vSwitch agent registered on host hv-cinder-81901 {{(pid=102992) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Nov 23 19:33:43.521672 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-17781b45-59ea-449c-b5b6-5d1c26c7c224 req-3e55bbed-e881-4d3a-9832-17a04788e209 service neutron] Attempting to bind port 50e9d93b-ad23-4b6b-bdd0-ae5afe6f80ea on network 07eeb44e-4cdb-4c58-a83d-1dd8ab1ccb8a {{(pid=102992) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 23 19:33:43.524412 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-17781b45-59ea-449c-b5b6-5d1c26c7c224 req-3e55bbed-e881-4d3a-9832-17a04788e209 service neutron] Checking agent: {'id': '14e5d049-431d-466a-8d1c-264e5129d376', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-81901', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 23, 19, 31, 29), 'started_at': datetime.datetime(2021, 11, 23, 19, 31, 29), 'heartbeat_timestamp': datetime.datetime(2021, 11, 23, 19, 33, 29), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=102992) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 23 19:33:43.524778 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-17781b45-59ea-449c-b5b6-5d1c26c7c224 req-3e55bbed-e881-4d3a-9832-17a04788e209 service neutron] Checking segment: {'id': 'b8302c34-e78d-4c43-9d45-a2604c95a2d2', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 821, 'network_id': '07eeb44e-4cdb-4c58-a83d-1dd8ab1ccb8a'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102992) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 23 19:33:43.525155 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-17781b45-59ea-449c-b5b6-5d1c26c7c224 req-3e55bbed-e881-4d3a-9832-17a04788e209 service neutron] Bound using segment: {'id': 'b8302c34-e78d-4c43-9d45-a2604c95a2d2', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 821, 'network_id': '07eeb44e-4cdb-4c58-a83d-1dd8ab1ccb8a'} {{(pid=102992) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 23 19:33:43.525624 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.plugins.ml2.managers [req-17781b45-59ea-449c-b5b6-5d1c26c7c224 req-3e55bbed-e881-4d3a-9832-17a04788e209 service neutron] Bound port: 50e9d93b-ad23-4b6b-bdd0-ae5afe6f80ea, host: hv-cinder-81901, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': 'b8302c34-e78d-4c43-9d45-a2604c95a2d2', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 821, 'network_id': '07eeb44e-4cdb-4c58-a83d-1dd8ab1ccb8a'}}] {{(pid=102992) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 23 19:33:43.526379 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [req-17781b45-59ea-449c-b5b6-5d1c26c7c224 req-3e55bbed-e881-4d3a-9832-17a04788e209 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7921281'] for port, before_update {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:33:43.549323 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e26bd0bb-ff3c-48b6-8f21-3b247f08229e req-04a68993-d1f4-4547-b2f2-56593d10d3e4 tempest-DeleteServersTestJSON-453817978 tempest-DeleteServersTestJSON-453817978-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102993) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:33:43.555405 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-e26bd0bb-ff3c-48b6-8f21-3b247f08229e req-04a68993-d1f4-4547-b2f2-56593d10d3e4 tempest-DeleteServersTestJSON-453817978 tempest-DeleteServersTestJSON-453817978-project] 10.222.0.62 "GET /v2.0/ports?device_id=5e3c1406-dc8c-414a-bcc5-55c7c963e1df HTTP/1.1" status: 200 len: 943 time: 0.1161413 Nov 23 19:33:43.656564 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [None req-e337656b-91a6-4cd2-8208-ca876c4ca53d admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-623933'] for security_group, after_create {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:33:43.656705 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-e26bd0bb-ff3c-48b6-8f21-3b247f08229e req-804bf1a3-cbb1-4717-bafe-1116470d9bc3 tempest-DeleteServersTestJSON-453817978 tempest-DeleteServersTestJSON-453817978-project] 10.222.0.62 "GET /v2.0/security-groups?id=5b5d5814-644d-45c2-ad35-f8920c3382b0&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0909612 Nov 23 19:33:43.714854 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [None req-e337656b-91a6-4cd2-8208-ca876c4ca53d admin admin] 10.222.0.62 "GET /v2.0/security-groups?tenant_id=4b0a9c91e7894d16b675e67539d818d6&name=default HTTP/1.1" status: 200 len: 2996 time: 0.7503343 Nov 23 19:33:43.716196 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.plugins.ml2.db [req-17781b45-59ea-449c-b5b6-5d1c26c7c224 req-3e55bbed-e881-4d3a-9832-17a04788e209 service neutron] For port 50e9d93b-ad23-4b6b-bdd0-ae5afe6f80ea, host hv-cinder-81901, cleared binding levels {{(pid=102992) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 23 19:33:43.718633 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.wsgi [-] (102992) accepted ('10.222.0.62', 41514) {{(pid=102992) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 23 19:33:43.758940 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.plugins.ml2.db [req-17781b45-59ea-449c-b5b6-5d1c26c7c224 req-3e55bbed-e881-4d3a-9832-17a04788e209 service neutron] For port 50e9d93b-ad23-4b6b-bdd0-ae5afe6f80ea, host hv-cinder-81901, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81901',level=0,port_id=50e9d93b-ad23-4b6b-bdd0-ae5afe6f80ea,segment=NetworkSegment(b8302c34-e78d-4c43-9d45-a2604c95a2d2),segment_id=b8302c34-e78d-4c43-9d45-a2604c95a2d2)] {{(pid=102992) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 23 19:33:43.760138 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e337656b-91a6-4cd2-8208-ca876c4ca53d admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=c3bc6a12-437d-4907-8675-d65b64cbb98f,revision_number=1']} {{(pid=102992) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 23 19:33:43.782637 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b66b988a-af82-4ebf-95bf-8a257f1f5f93 req-f4fcb165-1d44-4a8e-b4af-bdd74e3eec28 tempest-ServerRescueNegativeTestJSON-1447477341 tempest-ServerRescueNegativeTestJSON-1447477341-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102992) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:33:43.792891 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-b66b988a-af82-4ebf-95bf-8a257f1f5f93 req-f4fcb165-1d44-4a8e-b4af-bdd74e3eec28 tempest-ServerRescueNegativeTestJSON-1447477341 tempest-ServerRescueNegativeTestJSON-1447477341-project] 10.222.0.62 "GET /v2.0/ports?device_id=90cb32bd-c375-400a-b79a-97fc61e2a3a3 HTTP/1.1" status: 200 len: 943 time: 0.2211568 Nov 23 19:33:43.866884 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [None req-21bdfdbd-1a06-486e-a284-8a43612199fe admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:33:43.883479 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-b66b988a-af82-4ebf-95bf-8a257f1f5f93 req-81eafa41-3ba3-439f-a924-e4cf16d2d751 tempest-ServerRescueNegativeTestJSON-1447477341 tempest-ServerRescueNegativeTestJSON-1447477341-project] 10.222.0.62 "GET /v2.0/security-groups?id=62a09434-acf0-424f-9001-2c3a78119364&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0895514 Nov 23 19:33:43.922936 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [None req-21bdfdbd-1a06-486e-a284-8a43612199fe admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:33:43.997396 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.62/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}9b10b92acbee16fb695be1efeed0b68f7c36a5b215ec004a8d9d707fa3d35b2c" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-2cca1e02-f93f-417d-94f7-7797ed4cd036" -d '{"events": [{"name": "network-changed", "server_uuid": "90cb32bd-c375-400a-b79a-97fc61e2a3a3", "tag": "0a64c11d-0cb3-4c1e-aa45-5bcdf2771c8c"}]}' {{(pid=102993) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 23 19:33:44.062367 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [req-17781b45-59ea-449c-b5b6-5d1c26c7c224 req-3e55bbed-e881-4d3a-9832-17a04788e209 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7918660', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-15067', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560168', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8783631423946', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8783631008732', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8783631008750'] for port, after_update {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:33:44.124443 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-fe60d81c-46f3-47cc-b92f-0d99de153146 req-a59cefa6-bd69-4285-ac26-92a778c3fecd tempest-AttachVolumeShelveTestJSON-1172915835 tempest-AttachVolumeShelveTestJSON-1172915835-project] 10.222.0.62 "GET /v2.0/ports?device_id=85ea3d72-6c17-4ea2-82b7-90cce01633bd HTTP/1.1" status: 200 len: 210 time: 0.0676632 Nov 23 19:33:44.136234 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [None req-21bdfdbd-1a06-486e-a284-8a43612199fe admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-623933'] for security_group, after_delete {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:33:44.139774 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [None req-21bdfdbd-1a06-486e-a284-8a43612199fe admin admin] Publish callbacks [] for security_group, before_response {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:33:44.141093 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [None req-21bdfdbd-1a06-486e-a284-8a43612199fe admin admin] 10.222.0.62 "DELETE /v2.0/security-groups/c3bc6a12-437d-4907-8675-d65b64cbb98f HTTP/1.1" status: 204 len: 168 time: 0.4211183 Nov 23 19:33:44.160003 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-21bdfdbd-1a06-486e-a284-8a43612199fe admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=c3bc6a12-437d-4907-8675-d65b64cbb98f,revision_number=None']} {{(pid=102992) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 23 19:33:44.183008 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-17781b45-59ea-449c-b5b6-5d1c26c7c224 req-3e55bbed-e881-4d3a-9832-17a04788e209 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102992) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:33:44.183648 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [req-17781b45-59ea-449c-b5b6-5d1c26c7c224 req-3e55bbed-e881-4d3a-9832-17a04788e209 service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-514902', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-560186'] for port, before_response {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:33:44.185045 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-17781b45-59ea-449c-b5b6-5d1c26c7c224 req-3e55bbed-e881-4d3a-9832-17a04788e209 service neutron] 10.222.0.41 "PUT /v2.0/ports/50e9d93b-ad23-4b6b-bdd0-ae5afe6f80ea HTTP/1.1" status: 200 len: 1093 time: 2.6917195 Nov 23 19:33:44.186839 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron_lib.callbacks.manager [None req-3d65078d-7d07-499c-8a8c-c4aded83f02c None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8783631323329', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7978582'] for agent, after_update {{(pid=102994) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:33:44.188031 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '671f1d44-7752-4a9d-835d-4d76164c900f', 'tag': '50e9d93b-ad23-4b6b-bdd0-ae5afe6f80ea'}] {{(pid=102992) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 23 19:33:44.193390 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.62/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}f86c332b591ae691ababa4b64e0601cbf242a448242f95367ce03daabfb7e1ce" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-ec1f7589-c23b-4fdb-b2ba-e9af3d771aae" -d '{"events": [{"name": "network-changed", "server_uuid": "671f1d44-7752-4a9d-835d-4d76164c900f", "tag": "50e9d93b-ad23-4b6b-bdd0-ae5afe6f80ea"}]}' {{(pid=102992) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 23 19:33:44.203763 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3e55bbed-e881-4d3a-9832-17a04788e209 service neutron] Pushing event updated for resources: {'Port': ['ID=50e9d93b-ad23-4b6b-bdd0-ae5afe6f80ea,revision_number=3']} {{(pid=102992) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 23 19:33:44.327113 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Tue, 23 Nov 2021 19:33:44 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-ca36b321-5cf3-4444-b5a7-7d0750f084c2 x-openstack-request-id: req-ca36b321-5cf3-4444-b5a7-7d0750f084c2 {{(pid=102992) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 23 19:33:44.327477 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "671f1d44-7752-4a9d-835d-4d76164c900f", "tag": "50e9d93b-ad23-4b6b-bdd0-ae5afe6f80ea", "status": "completed", "code": 200}]} {{(pid=102992) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 23 19:33:44.327803 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.62/compute/v2.1/os-server-external-events used request id req-ca36b321-5cf3-4444-b5a7-7d0750f084c2 {{(pid=102992) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 23 19:33:44.328474 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '671f1d44-7752-4a9d-835d-4d76164c900f', 'tag': '50e9d93b-ad23-4b6b-bdd0-ae5afe6f80ea', 'status': 'completed', 'code': 200} Nov 23 19:33:44.363230 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Tue, 23 Nov 2021 19:33:44 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-a179d06f-e1ec-4f38-b58c-2da61d783a08 x-openstack-request-id: req-a179d06f-e1ec-4f38-b58c-2da61d783a08 {{(pid=102993) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 23 19:33:44.363516 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "90cb32bd-c375-400a-b79a-97fc61e2a3a3", "tag": "0a64c11d-0cb3-4c1e-aa45-5bcdf2771c8c", "status": "completed", "code": 200}]} {{(pid=102993) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 23 19:33:44.363953 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.62/compute/v2.1/os-server-external-events used request id req-a179d06f-e1ec-4f38-b58c-2da61d783a08 {{(pid=102993) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 23 19:33:44.364417 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '90cb32bd-c375-400a-b79a-97fc61e2a3a3', 'tag': '0a64c11d-0cb3-4c1e-aa45-5bcdf2771c8c', 'status': 'completed', 'code': 200} Nov 23 19:33:45.004796 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-da1c93c0-12f1-4087-bc0d-94d680f4fd36 req-9a1177f3-b222-4046-a914-30cfb71c57e9 tempest-DeleteServersTestJSON-453817978 tempest-DeleteServersTestJSON-453817978-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102993) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:33:45.009671 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-da1c93c0-12f1-4087-bc0d-94d680f4fd36 req-9a1177f3-b222-4046-a914-30cfb71c57e9 tempest-DeleteServersTestJSON-453817978 tempest-DeleteServersTestJSON-453817978-project] 10.222.0.62 "GET /v2.0/ports?device_id=5e3c1406-dc8c-414a-bcc5-55c7c963e1df HTTP/1.1" status: 200 len: 943 time: 0.2354612 Nov 23 19:33:45.026714 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-15a79294-7b68-48c3-a982-9325eb175259 req-28e8657e-f559-4b89-85b8-58083386bf4b tempest-ServerRescueNegativeTestJSON-1447477341 tempest-ServerRescueNegativeTestJSON-1447477341-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102992) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:33:45.028934 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-15a79294-7b68-48c3-a982-9325eb175259 req-28e8657e-f559-4b89-85b8-58083386bf4b tempest-ServerRescueNegativeTestJSON-1447477341 tempest-ServerRescueNegativeTestJSON-1447477341-project] 10.222.0.62 "GET /v2.0/ports?device_id=90cb32bd-c375-400a-b79a-97fc61e2a3a3 HTTP/1.1" status: 200 len: 943 time: 0.0626340 Nov 23 19:33:45.104867 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-15a79294-7b68-48c3-a982-9325eb175259 req-86edbd82-d0c5-4d7c-a89a-c6c17eeb2496 tempest-ServerRescueNegativeTestJSON-1447477341 tempest-ServerRescueNegativeTestJSON-1447477341-project] 10.222.0.62 "GET /v2.0/security-groups?id=62a09434-acf0-424f-9001-2c3a78119364&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0568771 Nov 23 19:33:45.105941 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-da1c93c0-12f1-4087-bc0d-94d680f4fd36 req-9a423d01-bb53-437b-8833-79c1e4f0769e tempest-DeleteServersTestJSON-453817978 tempest-DeleteServersTestJSON-453817978-project] 10.222.0.62 "GET /v2.0/security-groups?id=5b5d5814-644d-45c2-ad35-f8920c3382b0&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0904579 Nov 23 19:33:45.221292 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron_lib.callbacks.manager [None req-8346ef05-f685-4c3d-af3d-a159b683bec2 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8783631323329', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7978582'] for agent, after_update {{(pid=102994) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:33:45.250911 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-2fc0110e-7a3c-409e-b0a9-854b152c2e42 req-53caf950-3d6f-43cc-881b-1037182eb7c6 tempest-AttachVolumeShelveTestJSON-1172915835 tempest-AttachVolumeShelveTestJSON-1172915835-project] 10.222.0.62 "GET /v2.0/ports?device_id=85ea3d72-6c17-4ea2-82b7-90cce01633bd HTTP/1.1" status: 200 len: 210 time: 0.0261788 Nov 23 19:33:45.860851 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.wsgi [-] (102993) accepted ('10.222.0.62', 41568) {{(pid=102993) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 23 19:33:45.874072 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-405a39ff-297a-47cc-ac73-211ac37ddebc admin admin] Publish callbacks [] for security_group, before_create {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:33:46.012619 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-405a39ff-297a-47cc-ac73-211ac37ddebc admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:33:46.096079 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-405a39ff-297a-47cc-ac73-211ac37ddebc admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-623933'] for security_group, after_create {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:33:46.146901 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [None req-405a39ff-297a-47cc-ac73-211ac37ddebc admin admin] 10.222.0.62 "GET /v2.0/security-groups?tenant_id=07548b25b4604684bb008b31cc4aea18&name=default HTTP/1.1" status: 200 len: 2996 time: 0.2885251 Nov 23 19:33:46.148130 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-405a39ff-297a-47cc-ac73-211ac37ddebc admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=36ac60d1-ae7a-458e-82d4-7dc763cc21b0,revision_number=1']} {{(pid=102993) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 23 19:33:46.156867 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.wsgi [-] (102992) accepted ('10.222.0.62', 41586) {{(pid=102992) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 23 19:33:46.242063 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [None req-d7010eac-bd3e-48a1-bedf-80ee41e66ff6 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:33:46.290672 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [None req-d7010eac-bd3e-48a1-bedf-80ee41e66ff6 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:33:46.301089 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-42ad3e01-cfac-4d82-afe4-dbb896395ca0 req-68463856-6bf4-4c58-b192-d51e093192a2 tempest-ServerRescueNegativeTestJSON-1447477341 tempest-ServerRescueNegativeTestJSON-1447477341-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102993) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:33:46.302862 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-42ad3e01-cfac-4d82-afe4-dbb896395ca0 req-68463856-6bf4-4c58-b192-d51e093192a2 tempest-ServerRescueNegativeTestJSON-1447477341 tempest-ServerRescueNegativeTestJSON-1447477341-project] 10.222.0.62 "GET /v2.0/ports?device_id=90cb32bd-c375-400a-b79a-97fc61e2a3a3 HTTP/1.1" status: 200 len: 943 time: 0.0752475 Nov 23 19:33:46.319369 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2fa655d7-4afc-4189-87ee-ddea2c909d0d req-2573a3a4-fc14-4864-b4d5-07101e854917 tempest-DeleteServersTestJSON-453817978 tempest-DeleteServersTestJSON-453817978-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102992) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:33:46.321166 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-2fa655d7-4afc-4189-87ee-ddea2c909d0d req-2573a3a4-fc14-4864-b4d5-07101e854917 tempest-DeleteServersTestJSON-453817978 tempest-DeleteServersTestJSON-453817978-project] 10.222.0.62 "GET /v2.0/ports?device_id=5e3c1406-dc8c-414a-bcc5-55c7c963e1df HTTP/1.1" status: 200 len: 943 time: 0.0923169 Nov 23 19:33:46.370635 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-42ad3e01-cfac-4d82-afe4-dbb896395ca0 req-62725561-0ba0-4e5c-9311-57489c81fcf6 tempest-ServerRescueNegativeTestJSON-1447477341 tempest-ServerRescueNegativeTestJSON-1447477341-project] 10.222.0.62 "GET /v2.0/security-groups?id=62a09434-acf0-424f-9001-2c3a78119364&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0616715 Nov 23 19:33:46.400559 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-2fa655d7-4afc-4189-87ee-ddea2c909d0d req-0db14245-9966-4e8b-979a-f780cc8a6127 tempest-DeleteServersTestJSON-453817978 tempest-DeleteServersTestJSON-453817978-project] 10.222.0.62 "GET /v2.0/security-groups?id=5b5d5814-644d-45c2-ad35-f8920c3382b0&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0675492 Nov 23 19:33:46.472247 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [None req-d7010eac-bd3e-48a1-bedf-80ee41e66ff6 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-623933'] for security_group, after_delete {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:33:46.472247 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [None req-d7010eac-bd3e-48a1-bedf-80ee41e66ff6 admin admin] Publish callbacks [] for security_group, before_response {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:33:46.472247 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [None req-d7010eac-bd3e-48a1-bedf-80ee41e66ff6 admin admin] 10.222.0.62 "DELETE /v2.0/security-groups/36ac60d1-ae7a-458e-82d4-7dc763cc21b0 HTTP/1.1" status: 204 len: 168 time: 0.3187554 Nov 23 19:33:46.482266 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d7010eac-bd3e-48a1-bedf-80ee41e66ff6 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=36ac60d1-ae7a-458e-82d4-7dc763cc21b0,revision_number=None']} {{(pid=102992) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 23 19:33:46.505179 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-8400c9d1-8efd-4ed5-93ef-4fc0a422abea req-3ee882ed-5a7a-4a96-8489-e41757e6c78b tempest-AttachVolumeShelveTestJSON-1172915835 tempest-AttachVolumeShelveTestJSON-1172915835-project] 10.222.0.62 "GET /v2.0/ports?device_id=85ea3d72-6c17-4ea2-82b7-90cce01633bd HTTP/1.1" status: 200 len: 210 time: 0.0395412 Nov 23 19:33:46.627649 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron_lib.callbacks.manager [None req-785c1d26-11ba-42d8-b5a6-51a8b3daeef0 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8783631323329', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7978582'] for agent, after_update {{(pid=102994) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:33:46.843128 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ec1f7589-c23b-4fdb-b2ba-e9af3d771aae req-22d50131-efb6-4eff-9e08-08829c7b6c27 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102992) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:33:46.845657 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-ec1f7589-c23b-4fdb-b2ba-e9af3d771aae req-22d50131-efb6-4eff-9e08-08829c7b6c27 service neutron] 10.222.0.41 "GET /v2.0/ports?tenant_id=c15ab51e579448cfb7a4b3e4f8049687&device_id=671f1d44-7752-4a9d-835d-4d76164c900f HTTP/1.1" status: 200 len: 1096 time: 0.0642188 Nov 23 19:33:46.897702 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2cca1e02-f93f-417d-94f7-7797ed4cd036 req-fe88fb13-134e-411b-a80d-beb2befdd09a service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102993) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:33:46.899443 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-2cca1e02-f93f-417d-94f7-7797ed4cd036 req-fe88fb13-134e-411b-a80d-beb2befdd09a service neutron] 10.222.0.41 "GET /v2.0/ports?tenant_id=c15ab51e579448cfb7a4b3e4f8049687&device_id=90cb32bd-c375-400a-b79a-97fc61e2a3a3 HTTP/1.1" status: 200 len: 1096 time: 0.0875173 Nov 23 19:33:47.096954 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-83c535ba-69b0-456b-9520-91b210487abc req-d1052c6d-9707-45f2-a625-157e9cbc0868 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102992) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:33:47.099013 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-83c535ba-69b0-456b-9520-91b210487abc req-d1052c6d-9707-45f2-a625-157e9cbc0868 service neutron] 10.222.0.41 "GET /v2.0/ports?tenant_id=69ab6d68b3f1442f9785568cd27eb367&device_id=5e3c1406-dc8c-414a-bcc5-55c7c963e1df HTTP/1.1" status: 200 len: 1096 time: 0.1083276 Nov 23 19:33:47.100378 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ec1f7589-c23b-4fdb-b2ba-e9af3d771aae req-d183195a-4fb5-4d8a-8a7c-932fda1c2274 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102992) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:33:47.101729 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-ec1f7589-c23b-4fdb-b2ba-e9af3d771aae req-d183195a-4fb5-4d8a-8a7c-932fda1c2274 service neutron] 10.222.0.41 "GET /v2.0/networks?tenant_id=c15ab51e579448cfb7a4b3e4f8049687&shared=False HTTP/1.1" status: 200 len: 920 time: 0.2456005 Nov 23 19:33:47.146039 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2cca1e02-f93f-417d-94f7-7797ed4cd036 req-b9e2e1d6-b543-4040-a282-3b017135c36c service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102993) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:33:47.151290 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-2cca1e02-f93f-417d-94f7-7797ed4cd036 req-b9e2e1d6-b543-4040-a282-3b017135c36c service neutron] 10.222.0.41 "GET /v2.0/networks?tenant_id=c15ab51e579448cfb7a4b3e4f8049687&shared=False HTTP/1.1" status: 200 len: 920 time: 0.2335055 Nov 23 19:33:47.302105 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron_lib.callbacks.manager [None req-eb87b2c3-3339-4249-8b85-e695b5b4e1f9 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8783631323329', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7978582'] for agent, after_update {{(pid=102994) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:33:47.406558 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-83c535ba-69b0-456b-9520-91b210487abc req-d3e2c125-3af1-4783-ad09-4a8b82e7dc83 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102992) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:33:47.408019 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-83c535ba-69b0-456b-9520-91b210487abc req-d3e2c125-3af1-4783-ad09-4a8b82e7dc83 service neutron] 10.222.0.41 "GET /v2.0/networks?id=2cf6d774-4b5e-4f5e-bb22-8de22e43722d HTTP/1.1" status: 200 len: 913 time: 0.2938426 Nov 23 19:33:47.413123 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ec1f7589-c23b-4fdb-b2ba-e9af3d771aae req-d87b159b-28f1-4dcf-af24-47d829001507 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102992) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:33:47.414521 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-ec1f7589-c23b-4fdb-b2ba-e9af3d771aae req-d87b159b-28f1-4dcf-af24-47d829001507 service neutron] 10.222.0.41 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 870 time: 0.2613072 Nov 23 19:33:47.493379 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a41d8232-e348-4138-a707-64ddbc83b781 req-351f05ea-2552-4a1c-b796-d000a251e318 tempest-ServerRescueNegativeTestJSON-1447477341 tempest-ServerRescueNegativeTestJSON-1447477341-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102992) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:33:47.495155 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-a41d8232-e348-4138-a707-64ddbc83b781 req-351f05ea-2552-4a1c-b796-d000a251e318 tempest-ServerRescueNegativeTestJSON-1447477341 tempest-ServerRescueNegativeTestJSON-1447477341-project] 10.222.0.62 "GET /v2.0/ports?device_id=90cb32bd-c375-400a-b79a-97fc61e2a3a3 HTTP/1.1" status: 200 len: 943 time: 0.0529001 Nov 23 19:33:47.540421 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cc5b2b81-a05d-4dc3-8631-55cfd7e00b7b req-837b8620-68c7-4a79-86fb-2fc7a5653297 tempest-DeleteServersTestJSON-453817978 tempest-DeleteServersTestJSON-453817978-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102993) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:33:47.542314 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-cc5b2b81-a05d-4dc3-8631-55cfd7e00b7b req-837b8620-68c7-4a79-86fb-2fc7a5653297 tempest-DeleteServersTestJSON-453817978 tempest-DeleteServersTestJSON-453817978-project] 10.222.0.62 "GET /v2.0/ports?device_id=5e3c1406-dc8c-414a-bcc5-55c7c963e1df HTTP/1.1" status: 200 len: 943 time: 0.0571394 Nov 23 19:33:47.550362 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-a41d8232-e348-4138-a707-64ddbc83b781 req-ce3e9f4a-878f-4b28-88a3-b8e12aa92227 tempest-ServerRescueNegativeTestJSON-1447477341 tempest-ServerRescueNegativeTestJSON-1447477341-project] 10.222.0.62 "GET /v2.0/security-groups?id=62a09434-acf0-424f-9001-2c3a78119364&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0479004 Nov 23 19:33:47.557892 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.wsgi [-] (102992) accepted ('10.222.0.62', 41640) {{(pid=102992) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 23 19:33:47.579959 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [None req-cdc4827e-706a-4edd-8de2-2274369c6d4b admin admin] Publish callbacks [] for security_group, before_create {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:33:47.653543 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-cc5b2b81-a05d-4dc3-8631-55cfd7e00b7b req-eaa714e7-d196-46ab-a1aa-d9585b40d34c tempest-DeleteServersTestJSON-453817978 tempest-DeleteServersTestJSON-453817978-project] 10.222.0.62 "GET /v2.0/security-groups?id=5b5d5814-644d-45c2-ad35-f8920c3382b0&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1048927 Nov 23 19:33:47.685234 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.wsgi [-] (102993) accepted ('10.222.0.62', 41648) {{(pid=102993) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 23 19:33:47.723445 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-cd1b22de-9aae-44e1-891b-3df20c8f0fe9 req-cc19557f-6750-4a42-9a4c-fc42d282a4fa tempest-AttachVolumeShelveTestJSON-1172915835 tempest-AttachVolumeShelveTestJSON-1172915835-project] 10.222.0.62 "GET /v2.0/ports?device_id=85ea3d72-6c17-4ea2-82b7-90cce01633bd HTTP/1.1" status: 200 len: 210 time: 0.0441465 Nov 23 19:33:47.747797 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [None req-cdc4827e-706a-4edd-8de2-2274369c6d4b admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:33:47.821147 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [None req-cdc4827e-706a-4edd-8de2-2274369c6d4b admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-623933'] for security_group, after_create {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:33:47.865937 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [None req-cdc4827e-706a-4edd-8de2-2274369c6d4b admin admin] 10.222.0.62 "GET /v2.0/security-groups?tenant_id=c1409c65f74f477498196c51abaf49d0&name=default HTTP/1.1" status: 200 len: 2996 time: 0.3071301 Nov 23 19:33:47.867004 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cdc4827e-706a-4edd-8de2-2274369c6d4b admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=e7edaf2a-080d-4ab7-80fd-6c05f9e130c7,revision_number=1']} {{(pid=102992) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 23 19:33:47.868641 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.wsgi [-] (102993) accepted ('10.222.0.62', 41652) {{(pid=102993) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 23 19:33:47.875782 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-e3452ad0-4884-449a-a481-d83beae6ea78 admin admin] Publish callbacks [] for security_group, before_create {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:33:47.954350 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-f6204765-85bb-4cc7-a074-02438ed9951b admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:33:47.986812 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-f6204765-85bb-4cc7-a074-02438ed9951b admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:33:48.025140 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-e3452ad0-4884-449a-a481-d83beae6ea78 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:33:48.083868 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-e3452ad0-4884-449a-a481-d83beae6ea78 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-623933'] for security_group, after_create {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:33:48.104660 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-f6204765-85bb-4cc7-a074-02438ed9951b admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-623933'] for security_group, after_delete {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:33:48.107294 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-f6204765-85bb-4cc7-a074-02438ed9951b admin admin] Publish callbacks [] for security_group, before_response {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:33:48.108579 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [None req-f6204765-85bb-4cc7-a074-02438ed9951b admin admin] 10.222.0.62 "DELETE /v2.0/security-groups/e7edaf2a-080d-4ab7-80fd-6c05f9e130c7 HTTP/1.1" status: 204 len: 168 time: 0.2383068 Nov 23 19:33:48.132772 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e3452ad0-4884-449a-a481-d83beae6ea78 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=c821ef54-9c30-43d2-8cdd-aaa9ffb22df9,revision_number=1']} {{(pid=102993) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 23 19:33:48.139257 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [None req-e3452ad0-4884-449a-a481-d83beae6ea78 admin admin] 10.222.0.62 "GET /v2.0/security-groups?tenant_id=f5865a946ab24f399d59484590b84a91&name=default HTTP/1.1" status: 200 len: 2996 time: 0.4528940 Nov 23 19:33:48.143239 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.wsgi [-] (102992) accepted ('10.222.0.62', 41658) {{(pid=102992) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 23 19:33:48.155752 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f6204765-85bb-4cc7-a074-02438ed9951b admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=e7edaf2a-080d-4ab7-80fd-6c05f9e130c7,revision_number=None']} {{(pid=102993) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 23 19:33:48.212928 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [None req-24d31fbe-cb00-4ed5-846f-7f2a1a5a70f1 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:33:48.235037 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [None req-24d31fbe-cb00-4ed5-846f-7f2a1a5a70f1 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:33:48.364513 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [None req-24d31fbe-cb00-4ed5-846f-7f2a1a5a70f1 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-623933'] for security_group, after_delete {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:33:48.367413 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [None req-24d31fbe-cb00-4ed5-846f-7f2a1a5a70f1 admin admin] Publish callbacks [] for security_group, before_response {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:33:48.370353 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [None req-24d31fbe-cb00-4ed5-846f-7f2a1a5a70f1 admin admin] 10.222.0.62 "DELETE /v2.0/security-groups/c821ef54-9c30-43d2-8cdd-aaa9ffb22df9 HTTP/1.1" status: 204 len: 168 time: 0.2234697 Nov 23 19:33:48.377056 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-24d31fbe-cb00-4ed5-846f-7f2a1a5a70f1 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=c821ef54-9c30-43d2-8cdd-aaa9ffb22df9,revision_number=None']} {{(pid=102992) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 23 19:33:48.668838 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-adce4b6f-205f-476d-8fef-edf80e486665 req-15084682-87b9-4236-bdb2-0b6c57690309 tempest-ServerRescueNegativeTestJSON-1447477341 tempest-ServerRescueNegativeTestJSON-1447477341-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102993) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:33:48.670344 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-adce4b6f-205f-476d-8fef-edf80e486665 req-15084682-87b9-4236-bdb2-0b6c57690309 tempest-ServerRescueNegativeTestJSON-1447477341 tempest-ServerRescueNegativeTestJSON-1447477341-project] 10.222.0.62 "GET /v2.0/ports?device_id=90cb32bd-c375-400a-b79a-97fc61e2a3a3 HTTP/1.1" status: 200 len: 943 time: 0.0519223 Nov 23 19:33:48.734176 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-adce4b6f-205f-476d-8fef-edf80e486665 req-47552de9-d244-4fba-bc17-6d71861e33e7 tempest-ServerRescueNegativeTestJSON-1447477341 tempest-ServerRescueNegativeTestJSON-1447477341-project] 10.222.0.62 "GET /v2.0/security-groups?id=62a09434-acf0-424f-9001-2c3a78119364&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0566671 Nov 23 19:33:48.826615 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4f39e96b-a5e6-49f5-9dd1-c28824e00662 req-f0077373-1a47-440f-868a-c746f74d00a8 tempest-DeleteServersTestJSON-453817978 tempest-DeleteServersTestJSON-453817978-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102992) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:33:48.828434 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-4f39e96b-a5e6-49f5-9dd1-c28824e00662 req-f0077373-1a47-440f-868a-c746f74d00a8 tempest-DeleteServersTestJSON-453817978 tempest-DeleteServersTestJSON-453817978-project] 10.222.0.62 "GET /v2.0/ports?device_id=5e3c1406-dc8c-414a-bcc5-55c7c963e1df HTTP/1.1" status: 200 len: 943 time: 0.0772259 Nov 23 19:33:48.848582 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-8f21177a-a5c2-4004-ac3a-47b97c99eb55 req-f1ede727-0e9d-4658-8cc5-a357068f62d6 tempest-AttachVolumeShelveTestJSON-1172915835 tempest-AttachVolumeShelveTestJSON-1172915835-project] 10.222.0.62 "GET /v2.0/ports?device_id=85ea3d72-6c17-4ea2-82b7-90cce01633bd HTTP/1.1" status: 200 len: 210 time: 0.0314875 Nov 23 19:33:48.887908 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-4f39e96b-a5e6-49f5-9dd1-c28824e00662 req-38554ec6-d80c-478c-a25e-52db867d8415 tempest-DeleteServersTestJSON-453817978 tempest-DeleteServersTestJSON-453817978-project] 10.222.0.62 "GET /v2.0/security-groups?id=5b5d5814-644d-45c2-ad35-f8920c3382b0&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0486546 Nov 23 19:33:48.950558 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.wsgi [-] (102992) accepted ('10.222.0.62', 41688) {{(pid=102992) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 23 19:33:48.967885 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [None req-82127a99-0e35-4a4d-bf88-cfc130bd8e87 admin admin] Publish callbacks [] for security_group, before_create {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:33:49.210172 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [None req-82127a99-0e35-4a4d-bf88-cfc130bd8e87 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:33:49.249653 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [None req-82127a99-0e35-4a4d-bf88-cfc130bd8e87 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-623933'] for security_group, after_create {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:33:49.287938 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [None req-82127a99-0e35-4a4d-bf88-cfc130bd8e87 admin admin] 10.222.0.62 "GET /v2.0/security-groups?tenant_id=fcafd51b834f475f8ed7b6642968fe67&name=default HTTP/1.1" status: 200 len: 2996 time: 0.3362114 Nov 23 19:33:49.289895 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-82127a99-0e35-4a4d-bf88-cfc130bd8e87 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=fea91ccf-15a0-4d61-b297-e38f7d5f6cfd,revision_number=1']} {{(pid=102992) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 23 19:33:49.290978 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.wsgi [-] (102993) accepted ('10.222.0.62', 41702) {{(pid=102993) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 23 19:33:49.342017 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-e6f0552d-3e20-4ca5-9493-e740ae4aa172 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:33:49.364190 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-e6f0552d-3e20-4ca5-9493-e740ae4aa172 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:33:49.524174 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-e6f0552d-3e20-4ca5-9493-e740ae4aa172 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-623933'] for security_group, after_delete {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:33:49.526837 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-e6f0552d-3e20-4ca5-9493-e740ae4aa172 admin admin] Publish callbacks [] for security_group, before_response {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:33:49.528031 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [None req-e6f0552d-3e20-4ca5-9493-e740ae4aa172 admin admin] 10.222.0.62 "DELETE /v2.0/security-groups/fea91ccf-15a0-4d61-b297-e38f7d5f6cfd HTTP/1.1" status: 204 len: 168 time: 0.2350490 Nov 23 19:33:49.536338 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e6f0552d-3e20-4ca5-9493-e740ae4aa172 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=fea91ccf-15a0-4d61-b297-e38f7d5f6cfd,revision_number=None']} {{(pid=102993) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 23 19:33:49.894497 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-21e7379c-58ec-477f-888c-a43d70dfffba req-e1fe0604-ab61-49d7-b300-d89fedef8041 tempest-ServerRescueNegativeTestJSON-1447477341 tempest-ServerRescueNegativeTestJSON-1447477341-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102993) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:33:49.896160 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-21e7379c-58ec-477f-888c-a43d70dfffba req-e1fe0604-ab61-49d7-b300-d89fedef8041 tempest-ServerRescueNegativeTestJSON-1447477341 tempest-ServerRescueNegativeTestJSON-1447477341-project] 10.222.0.62 "GET /v2.0/ports?device_id=90cb32bd-c375-400a-b79a-97fc61e2a3a3 HTTP/1.1" status: 200 len: 943 time: 0.0532994 Nov 23 19:33:49.946522 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-21e7379c-58ec-477f-888c-a43d70dfffba req-7febd218-99e5-42b8-93c0-aa23cb72ccca tempest-ServerRescueNegativeTestJSON-1447477341 tempest-ServerRescueNegativeTestJSON-1447477341-project] 10.222.0.62 "GET /v2.0/security-groups?id=62a09434-acf0-424f-9001-2c3a78119364&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0443757 Nov 23 19:33:49.979665 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-df74d413-63ca-4758-9f4f-22ea420dcfc9 req-b83b008d-52e8-448b-9309-939b28fd1370 tempest-AttachVolumeShelveTestJSON-1172915835 tempest-AttachVolumeShelveTestJSON-1172915835-project] 10.222.0.62 "GET /v2.0/ports?device_id=85ea3d72-6c17-4ea2-82b7-90cce01633bd HTTP/1.1" status: 200 len: 210 time: 0.0473950 Nov 23 19:33:50.023025 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-83c535ba-69b0-456b-9520-91b210487abc req-aa17c3e5-fde7-45e7-8018-9b3181e918b3 service neutron] 10.222.0.41 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.7&port_id=8c70d83a-558d-4a92-a3e8-15396107e64d HTTP/1.1" status: 200 len: 217 time: 0.0548518 Nov 23 19:33:50.147773 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-83c535ba-69b0-456b-9520-91b210487abc req-e080ebf5-0b65-4439-9831-6e9e7b0a0d46 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=102992) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:33:50.149231 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-83c535ba-69b0-456b-9520-91b210487abc req-e080ebf5-0b65-4439-9831-6e9e7b0a0d46 service neutron] 10.222.0.41 "GET /v2.0/subnets?id=c1e8e6ce-3e67-4ef5-bbc3-db04880e7fab HTTP/1.1" status: 200 len: 852 time: 0.1176951 Nov 23 19:33:50.158340 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-17781b45-59ea-449c-b5b6-5d1c26c7c224 req-e15dfcce-93ac-47da-b60e-246c71cc2d64 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102992) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:33:50.160648 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-17781b45-59ea-449c-b5b6-5d1c26c7c224 req-e15dfcce-93ac-47da-b60e-246c71cc2d64 service neutron] 10.222.0.41 "GET /v2.0/ports?tenant_id=c15ab51e579448cfb7a4b3e4f8049687&device_id=671f1d44-7752-4a9d-835d-4d76164c900f HTTP/1.1" status: 200 len: 1096 time: 0.1184816 Nov 23 19:33:50.165125 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2cca1e02-f93f-417d-94f7-7797ed4cd036 req-d22633de-8db7-4e49-bef7-e2e66b432cfe service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102993) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:33:50.166610 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-2cca1e02-f93f-417d-94f7-7797ed4cd036 req-d22633de-8db7-4e49-bef7-e2e66b432cfe service neutron] 10.222.0.41 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 870 time: 0.2182395 Nov 23 19:33:50.179301 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-517252d6-0347-438b-a667-a84a74e86883 req-dbe8c2ef-9306-44f3-bd73-76797b200f0e tempest-DeleteServersTestJSON-453817978 tempest-DeleteServersTestJSON-453817978-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102993) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:33:50.186675 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-517252d6-0347-438b-a667-a84a74e86883 req-dbe8c2ef-9306-44f3-bd73-76797b200f0e tempest-DeleteServersTestJSON-453817978 tempest-DeleteServersTestJSON-453817978-project] 10.222.0.62 "GET /v2.0/ports?device_id=5e3c1406-dc8c-414a-bcc5-55c7c963e1df HTTP/1.1" status: 200 len: 943 time: 0.0991085 Nov 23 19:33:50.203612 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-83c535ba-69b0-456b-9520-91b210487abc req-9af33f9a-18a1-4ff6-bfd2-fc92df85ee18 service neutron] 10.222.0.41 "GET /v2.0/ports?network_id=2cf6d774-4b5e-4f5e-bb22-8de22e43722d&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0414579 Nov 23 19:33:50.246145 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-17781b45-59ea-449c-b5b6-5d1c26c7c224 req-783eb690-2e1d-4788-98e8-f5638d20e474 service neutron] 10.222.0.41 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.3&port_id=50e9d93b-ad23-4b6b-bdd0-ae5afe6f80ea HTTP/1.1" status: 200 len: 217 time: 0.0515070 Nov 23 19:33:50.277837 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-517252d6-0347-438b-a667-a84a74e86883 req-e7d5d35a-f0c4-47f6-9c82-efddb0ad7b43 tempest-DeleteServersTestJSON-453817978 tempest-DeleteServersTestJSON-453817978-project] 10.222.0.62 "GET /v2.0/security-groups?id=5b5d5814-644d-45c2-ad35-f8920c3382b0&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0899208 Nov 23 19:33:50.286871 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-47069518-df9a-4746-84a8-fb477093fa62 req-4ef223cd-2a6d-4c8f-b177-880ccd87dd2a service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102993) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:33:50.288324 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-47069518-df9a-4746-84a8-fb477093fa62 req-4ef223cd-2a6d-4c8f-b177-880ccd87dd2a service neutron] 10.222.0.41 "GET /v2.0/ports?tenant_id=c15ab51e579448cfb7a4b3e4f8049687&device_id=90cb32bd-c375-400a-b79a-97fc61e2a3a3 HTTP/1.1" status: 200 len: 1096 time: 0.0632589 Nov 23 19:33:50.342741 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-17781b45-59ea-449c-b5b6-5d1c26c7c224 req-acc6f8c6-544e-4175-8f46-1fda0fa992cc service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=102992) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:33:50.344205 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-17781b45-59ea-449c-b5b6-5d1c26c7c224 req-acc6f8c6-544e-4175-8f46-1fda0fa992cc service neutron] 10.222.0.41 "GET /v2.0/subnets?id=e4fda56f-85ff-422d-adad-ec00db6378af HTTP/1.1" status: 200 len: 859 time: 0.0864727 Nov 23 19:33:50.363738 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-83c535ba-69b0-456b-9520-91b210487abc req-672a8209-54ba-4ea6-b9eb-d5349e65907d service neutron] 10.222.0.41 "GET /v2.0/networks/2cf6d774-4b5e-4f5e-bb22-8de22e43722d?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1255493 Nov 23 19:33:51.006396 dv-cinder-819011-1-iscsi neutron-server[102995]: DEBUG neutron.db.agents_db [None req-84bdc9b2-57ea-4bdb-a245-07c78d37cea8 None None] Agent healthcheck: found 6 active agents {{(pid=102995) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 23 19:33:51.083811 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-87920690-4b97-490d-beb2-ea42855f04ad req-f7b66586-22dc-47d4-900c-36b8a6c9a7dd tempest-ServerRescueNegativeTestJSON-1447477341 tempest-ServerRescueNegativeTestJSON-1447477341-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102992) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:33:51.085371 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-87920690-4b97-490d-beb2-ea42855f04ad req-f7b66586-22dc-47d4-900c-36b8a6c9a7dd tempest-ServerRescueNegativeTestJSON-1447477341 tempest-ServerRescueNegativeTestJSON-1447477341-project] 10.222.0.62 "GET /v2.0/ports?device_id=90cb32bd-c375-400a-b79a-97fc61e2a3a3 HTTP/1.1" status: 200 len: 943 time: 0.0563107 Nov 23 19:33:51.141881 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-87920690-4b97-490d-beb2-ea42855f04ad req-85a79ccf-3977-4fe3-a587-599b90c41221 tempest-ServerRescueNegativeTestJSON-1447477341 tempest-ServerRescueNegativeTestJSON-1447477341-project] 10.222.0.62 "GET /v2.0/security-groups?id=62a09434-acf0-424f-9001-2c3a78119364&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0494702 Nov 23 19:33:51.181471 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-09441434-84cc-4873-9179-d99bd8de98be req-ccfc7fd2-2e1a-4f64-b639-9ff27eb03184 tempest-AttachVolumeShelveTestJSON-1172915835 tempest-AttachVolumeShelveTestJSON-1172915835-project] 10.222.0.62 "GET /v2.0/ports?device_id=85ea3d72-6c17-4ea2-82b7-90cce01633bd HTTP/1.1" status: 200 len: 210 time: 0.0264301 Nov 23 19:33:51.396967 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1bf6e9ce-fde9-40b2-b1b5-dd985062c548 req-e91a0ecb-4413-49d2-9e68-e925eb0a528b tempest-DeleteServersTestJSON-453817978 tempest-DeleteServersTestJSON-453817978-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102992) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:33:51.398696 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-1bf6e9ce-fde9-40b2-b1b5-dd985062c548 req-e91a0ecb-4413-49d2-9e68-e925eb0a528b tempest-DeleteServersTestJSON-453817978 tempest-DeleteServersTestJSON-453817978-project] 10.222.0.62 "GET /v2.0/ports?device_id=5e3c1406-dc8c-414a-bcc5-55c7c963e1df HTTP/1.1" status: 200 len: 943 time: 0.0530765 Nov 23 19:33:51.453501 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-1bf6e9ce-fde9-40b2-b1b5-dd985062c548 req-144e228d-8c37-4742-a4e2-d8d8d79bcf2a tempest-DeleteServersTestJSON-453817978 tempest-DeleteServersTestJSON-453817978-project] 10.222.0.62 "GET /v2.0/security-groups?id=5b5d5814-644d-45c2-ad35-f8920c3382b0&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0471921 Nov 23 19:33:52.291377 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-84cafa60-4471-4dc5-bf96-21e2bd065d44 req-2c3660bd-2453-4aa9-a411-96190e901e8c tempest-ServerRescueNegativeTestJSON-1447477341 tempest-ServerRescueNegativeTestJSON-1447477341-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102993) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:33:52.292834 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-84cafa60-4471-4dc5-bf96-21e2bd065d44 req-2c3660bd-2453-4aa9-a411-96190e901e8c tempest-ServerRescueNegativeTestJSON-1447477341 tempest-ServerRescueNegativeTestJSON-1447477341-project] 10.222.0.62 "GET /v2.0/ports?device_id=90cb32bd-c375-400a-b79a-97fc61e2a3a3 HTTP/1.1" status: 200 len: 943 time: 0.0528352 Nov 23 19:33:52.317344 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-ba6ae0f2-35df-4c65-be53-d6c312b6ef18 req-e2143689-2921-43dc-bbff-4d32ec0f32a8 tempest-AttachVolumeShelveTestJSON-1172915835 tempest-AttachVolumeShelveTestJSON-1172915835-project] 10.222.0.62 "GET /v2.0/ports?device_id=85ea3d72-6c17-4ea2-82b7-90cce01633bd HTTP/1.1" status: 200 len: 210 time: 0.0260577 Nov 23 19:33:52.341702 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-84cafa60-4471-4dc5-bf96-21e2bd065d44 req-f43e8ff2-bef7-4d5e-b673-022b2363c42f tempest-ServerRescueNegativeTestJSON-1447477341 tempest-ServerRescueNegativeTestJSON-1447477341-project] 10.222.0.62 "GET /v2.0/security-groups?id=62a09434-acf0-424f-9001-2c3a78119364&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0429606 Nov 23 19:33:52.578275 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bd0a1f00-3ffd-4401-a29c-2e58dd68d956 req-5154841e-fb54-4b86-8fa8-59ba7ad46a29 tempest-DeleteServersTestJSON-453817978 tempest-DeleteServersTestJSON-453817978-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102992) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:33:52.579803 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-bd0a1f00-3ffd-4401-a29c-2e58dd68d956 req-5154841e-fb54-4b86-8fa8-59ba7ad46a29 tempest-DeleteServersTestJSON-453817978 tempest-DeleteServersTestJSON-453817978-project] 10.222.0.62 "GET /v2.0/ports?device_id=5e3c1406-dc8c-414a-bcc5-55c7c963e1df HTTP/1.1" status: 200 len: 943 time: 0.0532532 Nov 23 19:33:52.628841 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-bd0a1f00-3ffd-4401-a29c-2e58dd68d956 req-a6fca4a7-ef8e-4610-bf83-a32b385e3bdb tempest-DeleteServersTestJSON-453817978 tempest-DeleteServersTestJSON-453817978-project] 10.222.0.62 "GET /v2.0/security-groups?id=5b5d5814-644d-45c2-ad35-f8920c3382b0&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0426552 Nov 23 19:33:53.225006 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-17781b45-59ea-449c-b5b6-5d1c26c7c224 req-e356b2ce-e1ff-44e5-8ad4-f47316e7dd7d service neutron] 10.222.0.41 "GET /v2.0/ports?network_id=07eeb44e-4cdb-4c58-a83d-1dd8ab1ccb8a&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0409286 Nov 23 19:33:53.235336 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-47069518-df9a-4746-84a8-fb477093fa62 req-6ad4cd6c-5693-4aee-a332-33626ab54b2a service neutron] 10.222.0.41 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.2&port_id=0a64c11d-0cb3-4c1e-aa45-5bcdf2771c8c HTTP/1.1" status: 200 len: 217 time: 0.0632310 Nov 23 19:33:53.309156 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-47069518-df9a-4746-84a8-fb477093fa62 req-10f8d98c-228b-4bf3-bd3a-c9f721c3630f service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=102993) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:33:53.309156 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-47069518-df9a-4746-84a8-fb477093fa62 req-10f8d98c-228b-4bf3-bd3a-c9f721c3630f service neutron] 10.222.0.41 "GET /v2.0/subnets?id=e4fda56f-85ff-422d-adad-ec00db6378af HTTP/1.1" status: 200 len: 859 time: 0.0547333 Nov 23 19:33:53.363827 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-47069518-df9a-4746-84a8-fb477093fa62 req-f6c06313-7d69-4965-9349-995b8b6fa961 service neutron] 10.222.0.41 "GET /v2.0/ports?network_id=07eeb44e-4cdb-4c58-a83d-1dd8ab1ccb8a&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0508623 Nov 23 19:33:53.366987 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-83c535ba-69b0-456b-9520-91b210487abc req-2ba8339e-522f-4be1-bde1-402363c6eebe service neutron] 10.222.0.41 "GET /v2.0/networks/2cf6d774-4b5e-4f5e-bb22-8de22e43722d?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1904671 Nov 23 19:33:53.370428 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-17781b45-59ea-449c-b5b6-5d1c26c7c224 req-91c3d5c3-5d4e-4a32-80b7-f9395f19ba73 service neutron] 10.222.0.41 "GET /v2.0/networks/07eeb44e-4cdb-4c58-a83d-1dd8ab1ccb8a?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1097882 Nov 23 19:33:53.450119 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-ba0dd7ca-a506-4a65-a4dd-98d79c78736f req-ccfaa5e6-934f-41c4-82d2-310cd628dab2 tempest-AttachVolumeShelveTestJSON-1172915835 tempest-AttachVolumeShelveTestJSON-1172915835-project] 10.222.0.62 "GET /v2.0/ports?device_id=85ea3d72-6c17-4ea2-82b7-90cce01633bd HTTP/1.1" status: 200 len: 210 time: 0.0370026 Nov 23 19:33:53.512384 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-47069518-df9a-4746-84a8-fb477093fa62 req-816a5d95-d8ff-477c-9ee7-1f3274ada32d service neutron] 10.222.0.41 "GET /v2.0/networks/07eeb44e-4cdb-4c58-a83d-1dd8ab1ccb8a?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1272733 Nov 23 19:33:53.518569 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-17781b45-59ea-449c-b5b6-5d1c26c7c224 req-025eb96b-b9e9-410f-bc4d-8df54b5164ba service neutron] 10.222.0.41 "GET /v2.0/networks/07eeb44e-4cdb-4c58-a83d-1dd8ab1ccb8a?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1332569 Nov 23 19:33:53.529160 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-328ef828-d413-4212-b0b0-b5117debb1bb req-c990d292-3ac8-490b-bd73-ad55561e09f3 tempest-ServerRescueNegativeTestJSON-1447477341 tempest-ServerRescueNegativeTestJSON-1447477341-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102992) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:33:53.530667 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-328ef828-d413-4212-b0b0-b5117debb1bb req-c990d292-3ac8-490b-bd73-ad55561e09f3 tempest-ServerRescueNegativeTestJSON-1447477341 tempest-ServerRescueNegativeTestJSON-1447477341-project] 10.222.0.62 "GET /v2.0/ports?device_id=90cb32bd-c375-400a-b79a-97fc61e2a3a3 HTTP/1.1" status: 200 len: 943 time: 0.1107061 Nov 23 19:33:53.590508 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-328ef828-d413-4212-b0b0-b5117debb1bb req-5c6a2e92-b2ed-4520-bcbe-da798c8147ec tempest-ServerRescueNegativeTestJSON-1447477341 tempest-ServerRescueNegativeTestJSON-1447477341-project] 10.222.0.62 "GET /v2.0/security-groups?id=62a09434-acf0-424f-9001-2c3a78119364&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0523202 Nov 23 19:33:53.621296 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-47069518-df9a-4746-84a8-fb477093fa62 req-87af5d53-e465-4f64-996c-09e56866c97b service neutron] 10.222.0.41 "GET /v2.0/networks/07eeb44e-4cdb-4c58-a83d-1dd8ab1ccb8a?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0971906 Nov 23 19:33:53.709699 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5176909e-415f-4c22-b863-70d02645fe82 req-18d906ee-45b7-4c8e-983f-e1fd7f73db5b tempest-AttachVolumeShelveTestJSON-1172915835 tempest-AttachVolumeShelveTestJSON-1172915835-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=102992) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:33:53.709699 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-5176909e-415f-4c22-b863-70d02645fe82 req-18d906ee-45b7-4c8e-983f-e1fd7f73db5b tempest-AttachVolumeShelveTestJSON-1172915835 tempest-AttachVolumeShelveTestJSON-1172915835-project] 10.222.0.41 "GET /v2.0/networks?id=fc901312-2937-4784-8a6d-c046666e8bf8 HTTP/1.1" status: 200 len: 817 time: 0.1174326 Nov 23 19:33:53.752076 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5bf481d4-8fb1-436c-b31f-3a4f6a884e40 req-24cce1a0-f972-40a2-91f5-0e990eb39fe1 tempest-DeleteServersTestJSON-453817978 tempest-DeleteServersTestJSON-453817978-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102993) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:33:53.753638 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-5bf481d4-8fb1-436c-b31f-3a4f6a884e40 req-24cce1a0-f972-40a2-91f5-0e990eb39fe1 tempest-DeleteServersTestJSON-453817978 tempest-DeleteServersTestJSON-453817978-project] 10.222.0.62 "GET /v2.0/ports?device_id=5e3c1406-dc8c-414a-bcc5-55c7c963e1df HTTP/1.1" status: 200 len: 943 time: 0.0583372 Nov 23 19:33:53.796189 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-5176909e-415f-4c22-b863-70d02645fe82 req-039d8b3f-729a-4924-9fea-9f5ab0fe8ff5 tempest-AttachVolumeShelveTestJSON-1172915835 tempest-AttachVolumeShelveTestJSON-1172915835-project] 10.222.0.41 "GET /v2.0/security-groups?fields=id&fields=name&tenant_id=2d925fb59ba34355aa85758374d76928 HTTP/1.1" status: 200 len: 378 time: 0.0668187 Nov 23 19:33:53.810837 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.api.v2.base [req-5176909e-415f-4c22-b863-70d02645fe82 req-df95c412-af4a-487c-823e-fd2e3cd26b5b tempest-AttachVolumeShelveTestJSON-1172915835 tempest-AttachVolumeShelveTestJSON-1172915835-project] Request body: {'port': {'device_id': '85ea3d72-6c17-4ea2-82b7-90cce01633bd', 'network_id': 'fc901312-2937-4784-8a6d-c046666e8bf8', 'admin_state_up': True, 'tenant_id': '2d925fb59ba34355aa85758374d76928', 'security_groups': ['f1ca24d9-0a31-470d-a1d5-fa7059df0141']}} {{(pid=102992) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 23 19:33:53.814194 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-5bf481d4-8fb1-436c-b31f-3a4f6a884e40 req-454e222a-dfc3-4b31-9860-f9ae51590aef tempest-DeleteServersTestJSON-453817978 tempest-DeleteServersTestJSON-453817978-project] 10.222.0.62 "GET /v2.0/security-groups?id=5b5d5814-644d-45c2-ad35-f8920c3382b0&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0536604 Nov 23 19:33:53.981257 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-5176909e-415f-4c22-b863-70d02645fe82 req-df95c412-af4a-487c-823e-fd2e3cd26b5b tempest-AttachVolumeShelveTestJSON-1172915835 tempest-AttachVolumeShelveTestJSON-1172915835-project] Made reservation on behalf of 2d925fb59ba34355aa85758374d76928 for: {'port': 1} {{(pid=102992) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 23 19:33:53.984843 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [req-5176909e-415f-4c22-b863-70d02645fe82 req-df95c412-af4a-487c-823e-fd2e3cd26b5b tempest-AttachVolumeShelveTestJSON-1172915835 tempest-AttachVolumeShelveTestJSON-1172915835-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7921281'] for port, before_create {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:33:54.108576 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.db.db_base_plugin_common [req-5176909e-415f-4c22-b863-70d02645fe82 req-df95c412-af4a-487c-823e-fd2e3cd26b5b tempest-AttachVolumeShelveTestJSON-1172915835 tempest-AttachVolumeShelveTestJSON-1172915835-project] Allocated IP 172.20.0.7 (fc901312-2937-4784-8a6d-c046666e8bf8/2caca985-6ed6-4ef7-ba49-7b7410bea160/4b380ab6-f3ec-4e12-9a2a-b5a20828969d) {{(pid=102992) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 23 19:33:54.242872 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [req-5176909e-415f-4c22-b863-70d02645fe82 req-df95c412-af4a-487c-823e-fd2e3cd26b5b tempest-AttachVolumeShelveTestJSON-1172915835 tempest-AttachVolumeShelveTestJSON-1172915835-project] Publish callbacks [] for port, precommit_create {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:33:54.330831 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [req-5176909e-415f-4c22-b863-70d02645fe82 req-df95c412-af4a-487c-823e-fd2e3cd26b5b tempest-AttachVolumeShelveTestJSON-1172915835 tempest-AttachVolumeShelveTestJSON-1172915835-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7918660', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-15067', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560168', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8783631008714'] for port, after_create {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:33:54.380456 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-5176909e-415f-4c22-b863-70d02645fe82 req-df95c412-af4a-487c-823e-fd2e3cd26b5b tempest-AttachVolumeShelveTestJSON-1172915835 tempest-AttachVolumeShelveTestJSON-1172915835-project] Network fc901312-2937-4784-8a6d-c046666e8bf8 is already hosted by enough agents. {{(pid=102992) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 23 19:33:54.383601 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.scheduler.base_scheduler [req-5176909e-415f-4c22-b863-70d02645fe82 req-df95c412-af4a-487c-823e-fd2e3cd26b5b tempest-AttachVolumeShelveTestJSON-1172915835 tempest-AttachVolumeShelveTestJSON-1172915835-project] Resources bound (agent type, host, resource id): {{(pid=102992) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 23 19:33:54.390501 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.db.l3_dvrscheduler_db [req-5176909e-415f-4c22-b863-70d02645fe82 req-df95c412-af4a-487c-823e-fd2e3cd26b5b tempest-AttachVolumeShelveTestJSON-1172915835 tempest-AttachVolumeShelveTestJSON-1172915835-project] Received port after_create {{(pid=102992) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 23 19:33:54.396984 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5176909e-415f-4c22-b863-70d02645fe82 req-df95c412-af4a-487c-823e-fd2e3cd26b5b tempest-AttachVolumeShelveTestJSON-1172915835 tempest-AttachVolumeShelveTestJSON-1172915835-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=102992) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:33:54.397705 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [req-5176909e-415f-4c22-b863-70d02645fe82 req-df95c412-af4a-487c-823e-fd2e3cd26b5b tempest-AttachVolumeShelveTestJSON-1172915835 tempest-AttachVolumeShelveTestJSON-1172915835-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-514902', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-560186'] for port, before_response {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:33:54.412638 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-df95c412-af4a-487c-823e-fd2e3cd26b5b tempest-AttachVolumeShelveTestJSON-1172915835 tempest-AttachVolumeShelveTestJSON-1172915835-project] Pushing event updated for resources: {'Port': ['ID=4b380ab6-f3ec-4e12-9a2a-b5a20828969d,revision_number=1']} {{(pid=102992) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 23 19:33:54.478686 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-5176909e-415f-4c22-b863-70d02645fe82 req-df95c412-af4a-487c-823e-fd2e3cd26b5b tempest-AttachVolumeShelveTestJSON-1172915835 tempest-AttachVolumeShelveTestJSON-1172915835-project] 10.222.0.41 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 0.6712112 Nov 23 19:33:54.491427 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.api.v2.base [req-5176909e-415f-4c22-b863-70d02645fe82 req-315ee249-b4f7-4686-aef5-51dcf4a8d4da service neutron] Request body: {'port': {'device_id': '85ea3d72-6c17-4ea2-82b7-90cce01633bd', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-81901'}} {{(pid=102992) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 23 19:33:54.579518 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [req-5176909e-415f-4c22-b863-70d02645fe82 req-315ee249-b4f7-4686-aef5-51dcf4a8d4da service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7921281'] for port, before_update {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:33:54.587128 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.db.provisioning_blocks [None req-c9b3f8d6-946a-4da2-87d5-1cdaf931a722 None None] Provisioning complete for port 4b380ab6-f3ec-4e12-9a2a-b5a20828969d triggered by entity DHCP. {{(pid=102994) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 23 19:33:54.587608 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron_lib.callbacks.manager [None req-c9b3f8d6-946a-4da2-87d5-1cdaf931a722 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-8355713'] for port, provisioning_complete {{(pid=102994) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:33:54.628349 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.plugins.ml2.plugin [None req-c9b3f8d6-946a-4da2-87d5-1cdaf931a722 None None] Port 4b380ab6-f3ec-4e12-9a2a-b5a20828969d cannot update to ACTIVE because it is not bound. {{(pid=102994) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 23 19:33:54.630813 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2b65b87b-5187-4554-b2c4-f8b362c0a321 req-10bf3582-9753-4afb-861a-5733b5cceba8 tempest-AttachVolumeShelveTestJSON-1172915835 tempest-AttachVolumeShelveTestJSON-1172915835-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102992) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:33:54.637860 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-2b65b87b-5187-4554-b2c4-f8b362c0a321 req-10bf3582-9753-4afb-861a-5733b5cceba8 tempest-AttachVolumeShelveTestJSON-1172915835 tempest-AttachVolumeShelveTestJSON-1172915835-project] 10.222.0.62 "GET /v2.0/ports?device_id=85ea3d72-6c17-4ea2-82b7-90cce01633bd HTTP/1.1" status: 200 len: 931 time: 0.0925891 Nov 23 19:33:54.716780 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6dd69ce2-b57b-4341-8801-090bea937366 req-704505eb-d3e2-42f4-9dcd-562559e36b4e tempest-ServerRescueNegativeTestJSON-1447477341 tempest-ServerRescueNegativeTestJSON-1447477341-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102993) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:33:54.718254 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-6dd69ce2-b57b-4341-8801-090bea937366 req-704505eb-d3e2-42f4-9dcd-562559e36b4e tempest-ServerRescueNegativeTestJSON-1447477341 tempest-ServerRescueNegativeTestJSON-1447477341-project] 10.222.0.62 "GET /v2.0/ports?device_id=90cb32bd-c375-400a-b79a-97fc61e2a3a3 HTTP/1.1" status: 200 len: 943 time: 0.0520766 Nov 23 19:33:54.750635 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-2b65b87b-5187-4554-b2c4-f8b362c0a321 req-82837f16-467c-43b1-bf14-18ef37b2b984 tempest-AttachVolumeShelveTestJSON-1172915835 tempest-AttachVolumeShelveTestJSON-1172915835-project] 10.222.0.62 "GET /v2.0/security-groups?id=f1ca24d9-0a31-470d-a1d5-fa7059df0141&fields=id&fields=name HTTP/1.1" status: 200 len: 311 time: 0.1118932 Nov 23 19:33:54.782067 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-6dd69ce2-b57b-4341-8801-090bea937366 req-50f82581-3338-4838-868d-86bcb877f75b tempest-ServerRescueNegativeTestJSON-1447477341 tempest-ServerRescueNegativeTestJSON-1447477341-project] 10.222.0.62 "GET /v2.0/security-groups?id=62a09434-acf0-424f-9001-2c3a78119364&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0473263 Nov 23 19:33:54.953316 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.notifiers.nova [req-5176909e-415f-4c22-b863-70d02645fe82 req-315ee249-b4f7-4686-aef5-51dcf4a8d4da service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 4b380ab6-f3ec-4e12-9a2a-b5a20828969d {{(pid=102992) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 23 19:33:54.967897 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-01ec0a6b-f942-4172-b163-1a30915dccbb req-06dbed01-30d1-4439-9d07-64a7d6072278 tempest-DeleteServersTestJSON-453817978 tempest-DeleteServersTestJSON-453817978-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102992) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:33:54.969391 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-01ec0a6b-f942-4172-b163-1a30915dccbb req-06dbed01-30d1-4439-9d07-64a7d6072278 tempest-DeleteServersTestJSON-453817978 tempest-DeleteServersTestJSON-453817978-project] 10.222.0.62 "GET /v2.0/ports?device_id=5e3c1406-dc8c-414a-bcc5-55c7c963e1df HTTP/1.1" status: 200 len: 943 time: 0.0930767 Nov 23 19:33:54.971256 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [req-5176909e-415f-4c22-b863-70d02645fe82 req-315ee249-b4f7-4686-aef5-51dcf4a8d4da service neutron] Publish callbacks [] for port, precommit_update {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:33:54.990310 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.db.provisioning_blocks [req-5176909e-415f-4c22-b863-70d02645fe82 req-315ee249-b4f7-4686-aef5-51dcf4a8d4da service neutron] Transition to ACTIVE for port object 4b380ab6-f3ec-4e12-9a2a-b5a20828969d will not be triggered until provisioned by entity L2. {{(pid=102992) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 23 19:33:55.026030 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-01ec0a6b-f942-4172-b163-1a30915dccbb req-3f6fe793-d1c8-4bb7-9194-98ce2fe67d98 tempest-DeleteServersTestJSON-453817978 tempest-DeleteServersTestJSON-453817978-project] 10.222.0.62 "GET /v2.0/security-groups?id=5b5d5814-644d-45c2-ad35-f8920c3382b0&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0479226 Nov 23 19:33:55.078875 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [req-5176909e-415f-4c22-b863-70d02645fe82 req-315ee249-b4f7-4686-aef5-51dcf4a8d4da service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7918660', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-15067', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560168', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8783631423946', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8783631008732', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8783631008750'] for port, after_update {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:33:55.165852 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-315ee249-b4f7-4686-aef5-51dcf4a8d4da service neutron] Pushing event updated for resources: {'Port': ['ID=4b380ab6-f3ec-4e12-9a2a-b5a20828969d,revision_number=2']} {{(pid=102992) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 23 19:33:55.172248 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.plugins.ml2.managers [req-5176909e-415f-4c22-b863-70d02645fe82 req-315ee249-b4f7-4686-aef5-51dcf4a8d4da service neutron] Attempting to bind port 4b380ab6-f3ec-4e12-9a2a-b5a20828969d on host hv-cinder-81901 for vnic_type normal with profile {{(pid=102992) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 23 19:33:55.172631 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.plugins.ml2.managers [req-5176909e-415f-4c22-b863-70d02645fe82 req-315ee249-b4f7-4686-aef5-51dcf4a8d4da service neutron] Attempting to bind port 4b380ab6-f3ec-4e12-9a2a-b5a20828969d by drivers openvswitch,hyperv on host hv-cinder-81901 at level 0 using segments [{'id': 'b4453f21-ac7f-498c-8316-73b738820700', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 825, 'network_id': 'fc901312-2937-4784-8a6d-c046666e8bf8'}] {{(pid=102992) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 23 19:33:55.172970 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-5176909e-415f-4c22-b863-70d02645fe82 req-315ee249-b4f7-4686-aef5-51dcf4a8d4da service neutron] Attempting to bind port 4b380ab6-f3ec-4e12-9a2a-b5a20828969d on network fc901312-2937-4784-8a6d-c046666e8bf8 {{(pid=102992) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 23 19:33:55.179611 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-5176909e-415f-4c22-b863-70d02645fe82 req-315ee249-b4f7-4686-aef5-51dcf4a8d4da service neutron] Port 4b380ab6-f3ec-4e12-9a2a-b5a20828969d on network fc901312-2937-4784-8a6d-c046666e8bf8 not bound, no agent of type Open vSwitch agent registered on host hv-cinder-81901 {{(pid=102992) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Nov 23 19:33:55.179963 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-5176909e-415f-4c22-b863-70d02645fe82 req-315ee249-b4f7-4686-aef5-51dcf4a8d4da service neutron] Attempting to bind port 4b380ab6-f3ec-4e12-9a2a-b5a20828969d on network fc901312-2937-4784-8a6d-c046666e8bf8 {{(pid=102992) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 23 19:33:55.193310 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-5176909e-415f-4c22-b863-70d02645fe82 req-315ee249-b4f7-4686-aef5-51dcf4a8d4da service neutron] Checking agent: {'id': '14e5d049-431d-466a-8d1c-264e5129d376', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-81901', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 23, 19, 31, 29), 'started_at': datetime.datetime(2021, 11, 23, 19, 31, 29), 'heartbeat_timestamp': datetime.datetime(2021, 11, 23, 19, 33, 29), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=102992) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 23 19:33:55.193310 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-5176909e-415f-4c22-b863-70d02645fe82 req-315ee249-b4f7-4686-aef5-51dcf4a8d4da service neutron] Checking segment: {'id': 'b4453f21-ac7f-498c-8316-73b738820700', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 825, 'network_id': 'fc901312-2937-4784-8a6d-c046666e8bf8'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102992) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 23 19:33:55.193310 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-5176909e-415f-4c22-b863-70d02645fe82 req-315ee249-b4f7-4686-aef5-51dcf4a8d4da service neutron] Bound using segment: {'id': 'b4453f21-ac7f-498c-8316-73b738820700', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 825, 'network_id': 'fc901312-2937-4784-8a6d-c046666e8bf8'} {{(pid=102992) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 23 19:33:55.193310 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.plugins.ml2.managers [req-5176909e-415f-4c22-b863-70d02645fe82 req-315ee249-b4f7-4686-aef5-51dcf4a8d4da service neutron] Bound port: 4b380ab6-f3ec-4e12-9a2a-b5a20828969d, host: hv-cinder-81901, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': 'b4453f21-ac7f-498c-8316-73b738820700', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 825, 'network_id': 'fc901312-2937-4784-8a6d-c046666e8bf8'}}] {{(pid=102992) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 23 19:33:55.193310 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [req-5176909e-415f-4c22-b863-70d02645fe82 req-315ee249-b4f7-4686-aef5-51dcf4a8d4da service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7921281'] for port, before_update {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:33:55.281686 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.plugins.ml2.db [req-5176909e-415f-4c22-b863-70d02645fe82 req-315ee249-b4f7-4686-aef5-51dcf4a8d4da service neutron] For port 4b380ab6-f3ec-4e12-9a2a-b5a20828969d, host hv-cinder-81901, cleared binding levels {{(pid=102992) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 23 19:33:55.286730 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.plugins.ml2.db [req-5176909e-415f-4c22-b863-70d02645fe82 req-315ee249-b4f7-4686-aef5-51dcf4a8d4da service neutron] For port 4b380ab6-f3ec-4e12-9a2a-b5a20828969d, host hv-cinder-81901, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81901',level=0,port_id=4b380ab6-f3ec-4e12-9a2a-b5a20828969d,segment=NetworkSegment(b4453f21-ac7f-498c-8316-73b738820700),segment_id=b4453f21-ac7f-498c-8316-73b738820700)] {{(pid=102992) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 23 19:33:55.330928 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [req-5176909e-415f-4c22-b863-70d02645fe82 req-315ee249-b4f7-4686-aef5-51dcf4a8d4da service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7918660', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-15067', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560168', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8783631423946', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8783631008732', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8783631008750'] for port, after_update {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:33:55.400792 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-315ee249-b4f7-4686-aef5-51dcf4a8d4da service neutron] Pushing event updated for resources: {'Port': ['ID=4b380ab6-f3ec-4e12-9a2a-b5a20828969d,revision_number=3']} {{(pid=102992) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 23 19:33:55.402865 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5176909e-415f-4c22-b863-70d02645fe82 req-315ee249-b4f7-4686-aef5-51dcf4a8d4da service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102992) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:33:55.403693 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [req-5176909e-415f-4c22-b863-70d02645fe82 req-315ee249-b4f7-4686-aef5-51dcf4a8d4da service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-514902', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-560186'] for port, before_response {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:33:55.405124 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-5176909e-415f-4c22-b863-70d02645fe82 req-315ee249-b4f7-4686-aef5-51dcf4a8d4da service neutron] 10.222.0.41 "PUT /v2.0/ports/4b380ab6-f3ec-4e12-9a2a-b5a20828969d HTTP/1.1" status: 200 len: 1093 time: 0.9189210 Nov 23 19:33:55.405633 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '85ea3d72-6c17-4ea2-82b7-90cce01633bd', 'tag': '4b380ab6-f3ec-4e12-9a2a-b5a20828969d'}] {{(pid=102992) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 23 19:33:55.408025 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.62/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}f86c332b591ae691ababa4b64e0601cbf242a448242f95367ce03daabfb7e1ce" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-598b4a8f-f250-4410-90d6-93cd961ad147" -d '{"events": [{"name": "network-changed", "server_uuid": "85ea3d72-6c17-4ea2-82b7-90cce01633bd", "tag": "4b380ab6-f3ec-4e12-9a2a-b5a20828969d"}]}' {{(pid=102992) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 23 19:33:55.448438 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Tue, 23 Nov 2021 19:33:55 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-18308a43-fc4a-4e12-b961-990720a971b5 x-openstack-request-id: req-18308a43-fc4a-4e12-b961-990720a971b5 {{(pid=102992) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 23 19:33:55.448739 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "85ea3d72-6c17-4ea2-82b7-90cce01633bd", "tag": "4b380ab6-f3ec-4e12-9a2a-b5a20828969d", "status": "completed", "code": 200}]} {{(pid=102992) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 23 19:33:55.449113 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.62/compute/v2.1/os-server-external-events used request id req-18308a43-fc4a-4e12-b961-990720a971b5 {{(pid=102992) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 23 19:33:55.449814 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '85ea3d72-6c17-4ea2-82b7-90cce01633bd', 'tag': '4b380ab6-f3ec-4e12-9a2a-b5a20828969d', 'status': 'completed', 'code': 200} Nov 23 19:33:55.527506 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-598b4a8f-f250-4410-90d6-93cd961ad147 req-ab7ec142-d1c8-48fa-bb45-5c4c00f313a0 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102992) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:33:55.529028 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-598b4a8f-f250-4410-90d6-93cd961ad147 req-ab7ec142-d1c8-48fa-bb45-5c4c00f313a0 service neutron] 10.222.0.41 "GET /v2.0/ports?tenant_id=2d925fb59ba34355aa85758374d76928&device_id=85ea3d72-6c17-4ea2-82b7-90cce01633bd HTTP/1.1" status: 200 len: 1096 time: 0.0525653 Nov 23 19:33:55.907674 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-efc7f7b7-8621-47da-995e-a829df546fea req-ea8df2af-b9f0-412c-b99d-956ca4b07283 tempest-AttachVolumeShelveTestJSON-1172915835 tempest-AttachVolumeShelveTestJSON-1172915835-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102992) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:33:55.913613 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-efc7f7b7-8621-47da-995e-a829df546fea req-ea8df2af-b9f0-412c-b99d-956ca4b07283 tempest-AttachVolumeShelveTestJSON-1172915835 tempest-AttachVolumeShelveTestJSON-1172915835-project] 10.222.0.62 "GET /v2.0/ports?device_id=85ea3d72-6c17-4ea2-82b7-90cce01633bd HTTP/1.1" status: 200 len: 943 time: 0.0537508 Nov 23 19:33:55.913697 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8e2e8ff2-975b-4ee3-8023-97055520b9d3 req-3f3df12f-4b35-4683-94fb-b26ddb8358fc tempest-ServerRescueNegativeTestJSON-1447477341 tempest-ServerRescueNegativeTestJSON-1447477341-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102993) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:33:55.913697 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-8e2e8ff2-975b-4ee3-8023-97055520b9d3 req-3f3df12f-4b35-4683-94fb-b26ddb8358fc tempest-ServerRescueNegativeTestJSON-1447477341 tempest-ServerRescueNegativeTestJSON-1447477341-project] 10.222.0.62 "GET /v2.0/ports?device_id=90cb32bd-c375-400a-b79a-97fc61e2a3a3 HTTP/1.1" status: 200 len: 943 time: 0.0527554 Nov 23 19:33:55.972769 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-efc7f7b7-8621-47da-995e-a829df546fea req-9e3c5f1d-8457-4c38-86f2-9a63a7a3ea9b tempest-AttachVolumeShelveTestJSON-1172915835 tempest-AttachVolumeShelveTestJSON-1172915835-project] 10.222.0.62 "GET /v2.0/security-groups?id=f1ca24d9-0a31-470d-a1d5-fa7059df0141&fields=id&fields=name HTTP/1.1" status: 200 len: 311 time: 0.0559199 Nov 23 19:33:55.983123 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-8e2e8ff2-975b-4ee3-8023-97055520b9d3 req-087314e1-9e8d-48a9-bba1-7b16ca2c21ae tempest-ServerRescueNegativeTestJSON-1447477341 tempest-ServerRescueNegativeTestJSON-1447477341-project] 10.222.0.62 "GET /v2.0/security-groups?id=62a09434-acf0-424f-9001-2c3a78119364&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0609009 Nov 23 19:33:56.143467 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0f2fb3a1-93c5-42d4-b674-64301bcd23fa req-19c18a67-5425-4fc1-b19d-f9b18f854029 tempest-DeleteServersTestJSON-453817978 tempest-DeleteServersTestJSON-453817978-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102993) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:33:56.146059 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-0f2fb3a1-93c5-42d4-b674-64301bcd23fa req-19c18a67-5425-4fc1-b19d-f9b18f854029 tempest-DeleteServersTestJSON-453817978 tempest-DeleteServersTestJSON-453817978-project] 10.222.0.62 "GET /v2.0/ports?device_id=5e3c1406-dc8c-414a-bcc5-55c7c963e1df HTTP/1.1" status: 200 len: 943 time: 0.0526745 Nov 23 19:33:56.194017 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-0f2fb3a1-93c5-42d4-b674-64301bcd23fa req-63260502-69eb-4a7d-8c76-9a5a6af31203 tempest-DeleteServersTestJSON-453817978 tempest-DeleteServersTestJSON-453817978-project] 10.222.0.62 "GET /v2.0/security-groups?id=5b5d5814-644d-45c2-ad35-f8920c3382b0&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0420709 Nov 23 19:33:56.676001 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-598b4a8f-f250-4410-90d6-93cd961ad147 req-560eefd4-c5c2-4e42-b971-ec93a1975671 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102992) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:33:56.677374 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-598b4a8f-f250-4410-90d6-93cd961ad147 req-560eefd4-c5c2-4e42-b971-ec93a1975671 service neutron] 10.222.0.41 "GET /v2.0/networks?tenant_id=2d925fb59ba34355aa85758374d76928&shared=False HTTP/1.1" status: 200 len: 918 time: 0.0982735 Nov 23 19:33:57.100556 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-38a4b2dd-cfc4-44d3-8ee9-a062f0ab121f req-57a245a7-4d9c-45d1-8159-73a56d60a807 tempest-ServerRescueNegativeTestJSON-1447477341 tempest-ServerRescueNegativeTestJSON-1447477341-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102992) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:33:57.101902 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b6cfcabc-57da-46a3-a094-fa629e79df5a req-319ce4a6-8833-4133-9fd9-f3d324836a3c tempest-AttachVolumeShelveTestJSON-1172915835 tempest-AttachVolumeShelveTestJSON-1172915835-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102993) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:33:57.102378 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-38a4b2dd-cfc4-44d3-8ee9-a062f0ab121f req-57a245a7-4d9c-45d1-8159-73a56d60a807 tempest-ServerRescueNegativeTestJSON-1447477341 tempest-ServerRescueNegativeTestJSON-1447477341-project] 10.222.0.62 "GET /v2.0/ports?device_id=90cb32bd-c375-400a-b79a-97fc61e2a3a3 HTTP/1.1" status: 200 len: 943 time: 0.0501168 Nov 23 19:33:57.103400 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-b6cfcabc-57da-46a3-a094-fa629e79df5a req-319ce4a6-8833-4133-9fd9-f3d324836a3c tempest-AttachVolumeShelveTestJSON-1172915835 tempest-AttachVolumeShelveTestJSON-1172915835-project] 10.222.0.62 "GET /v2.0/ports?device_id=85ea3d72-6c17-4ea2-82b7-90cce01633bd HTTP/1.1" status: 200 len: 943 time: 0.0478535 Nov 23 19:33:57.149286 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-38a4b2dd-cfc4-44d3-8ee9-a062f0ab121f req-6a183f7e-38ff-4b97-99a9-a65d6e70f155 tempest-ServerRescueNegativeTestJSON-1447477341 tempest-ServerRescueNegativeTestJSON-1447477341-project] 10.222.0.62 "GET /v2.0/security-groups?id=62a09434-acf0-424f-9001-2c3a78119364&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0410936 Nov 23 19:33:57.150269 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-b6cfcabc-57da-46a3-a094-fa629e79df5a req-e960e854-dd62-4a92-a85f-5c32a776133a tempest-AttachVolumeShelveTestJSON-1172915835 tempest-AttachVolumeShelveTestJSON-1172915835-project] 10.222.0.62 "GET /v2.0/security-groups?id=f1ca24d9-0a31-470d-a1d5-fa7059df0141&fields=id&fields=name HTTP/1.1" status: 200 len: 311 time: 0.0411482 Nov 23 19:33:57.309042 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-17991c57-3582-4f6a-a984-01e84e8a7f0a req-1764d801-6cfc-4f8f-9d1d-6061375ffda3 tempest-DeleteServersTestJSON-453817978 tempest-DeleteServersTestJSON-453817978-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102992) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:33:57.310556 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-17991c57-3582-4f6a-a984-01e84e8a7f0a req-1764d801-6cfc-4f8f-9d1d-6061375ffda3 tempest-DeleteServersTestJSON-453817978 tempest-DeleteServersTestJSON-453817978-project] 10.222.0.62 "GET /v2.0/ports?device_id=5e3c1406-dc8c-414a-bcc5-55c7c963e1df HTTP/1.1" status: 200 len: 943 time: 0.0497968 Nov 23 19:33:57.365508 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-17991c57-3582-4f6a-a984-01e84e8a7f0a req-70d86338-008d-449f-9118-84589a4dc7b0 tempest-DeleteServersTestJSON-453817978 tempest-DeleteServersTestJSON-453817978-project] 10.222.0.62 "GET /v2.0/security-groups?id=5b5d5814-644d-45c2-ad35-f8920c3382b0&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0422573 Nov 23 19:33:57.547775 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-598b4a8f-f250-4410-90d6-93cd961ad147 req-57b3de74-b849-439e-899f-9ac845c93c76 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102992) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:33:57.549292 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-598b4a8f-f250-4410-90d6-93cd961ad147 req-57b3de74-b849-439e-899f-9ac845c93c76 service neutron] 10.222.0.41 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 870 time: 0.0945809 Nov 23 19:33:58.265098 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-08caf578-b6e8-4ae4-b793-c6f36bfe375b req-ef2be506-cd24-4665-b0ba-900d9f1642c3 tempest-ServerRescueNegativeTestJSON-1447477341 tempest-ServerRescueNegativeTestJSON-1447477341-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102993) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:33:58.266567 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-08caf578-b6e8-4ae4-b793-c6f36bfe375b req-ef2be506-cd24-4665-b0ba-900d9f1642c3 tempest-ServerRescueNegativeTestJSON-1447477341 tempest-ServerRescueNegativeTestJSON-1447477341-project] 10.222.0.62 "GET /v2.0/ports?device_id=90cb32bd-c375-400a-b79a-97fc61e2a3a3 HTTP/1.1" status: 200 len: 943 time: 0.0519688 Nov 23 19:33:58.267339 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0a1f3fb1-2fde-4f99-bf7f-6f3b909c3dcb req-68416239-586c-4ae4-afd3-bd9ac89bab82 tempest-AttachVolumeShelveTestJSON-1172915835 tempest-AttachVolumeShelveTestJSON-1172915835-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102992) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:33:58.268834 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-0a1f3fb1-2fde-4f99-bf7f-6f3b909c3dcb req-68416239-586c-4ae4-afd3-bd9ac89bab82 tempest-AttachVolumeShelveTestJSON-1172915835 tempest-AttachVolumeShelveTestJSON-1172915835-project] 10.222.0.62 "GET /v2.0/ports?device_id=85ea3d72-6c17-4ea2-82b7-90cce01633bd HTTP/1.1" status: 200 len: 943 time: 0.0484402 Nov 23 19:33:58.315464 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-08caf578-b6e8-4ae4-b793-c6f36bfe375b req-e9c79826-b311-4b57-82e1-ab17bd94db56 tempest-ServerRescueNegativeTestJSON-1447477341 tempest-ServerRescueNegativeTestJSON-1447477341-project] 10.222.0.62 "GET /v2.0/security-groups?id=62a09434-acf0-424f-9001-2c3a78119364&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0422115 Nov 23 19:33:58.316489 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-0a1f3fb1-2fde-4f99-bf7f-6f3b909c3dcb req-8b01d86c-0407-49b5-b975-d7c90248c064 tempest-AttachVolumeShelveTestJSON-1172915835 tempest-AttachVolumeShelveTestJSON-1172915835-project] 10.222.0.62 "GET /v2.0/security-groups?id=f1ca24d9-0a31-470d-a1d5-fa7059df0141&fields=id&fields=name HTTP/1.1" status: 200 len: 311 time: 0.0418453 Nov 23 19:33:58.475370 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-32c41e3f-47b7-446d-b061-0dbeb8b1efe6 req-be4430b8-0809-477c-8409-5bb1cee71da3 tempest-DeleteServersTestJSON-453817978 tempest-DeleteServersTestJSON-453817978-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102992) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:33:58.476820 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-32c41e3f-47b7-446d-b061-0dbeb8b1efe6 req-be4430b8-0809-477c-8409-5bb1cee71da3 tempest-DeleteServersTestJSON-453817978 tempest-DeleteServersTestJSON-453817978-project] 10.222.0.62 "GET /v2.0/ports?device_id=5e3c1406-dc8c-414a-bcc5-55c7c963e1df HTTP/1.1" status: 200 len: 943 time: 0.0532284 Nov 23 19:33:58.508836 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.plugins.ml2.rpc [None req-4bf48ff4-ecfb-4168-8b63-249b8c6e9f04 None None] Device 50e9d93b-ad23-4b6b-bdd0-ae5afe6f80ea details requested by agent hyperv_hv-cinder-81901 with host hv-cinder-81901 {{(pid=102994) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Nov 23 19:33:58.531446 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-32c41e3f-47b7-446d-b061-0dbeb8b1efe6 req-9a4ae48e-adbf-4ede-b005-9a0e41c61f84 tempest-DeleteServersTestJSON-453817978 tempest-DeleteServersTestJSON-453817978-project] 10.222.0.62 "GET /v2.0/security-groups?id=5b5d5814-644d-45c2-ad35-f8920c3382b0&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0486515 Nov 23 19:33:58.588204 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5176909e-415f-4c22-b863-70d02645fe82 req-390b4d9f-2ab3-45ff-8ef0-9019b9021bbe service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102992) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:33:58.589759 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-5176909e-415f-4c22-b863-70d02645fe82 req-390b4d9f-2ab3-45ff-8ef0-9019b9021bbe service neutron] 10.222.0.41 "GET /v2.0/ports?tenant_id=2d925fb59ba34355aa85758374d76928&device_id=85ea3d72-6c17-4ea2-82b7-90cce01633bd HTTP/1.1" status: 200 len: 1096 time: 0.0463097 Nov 23 19:33:58.634195 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-5176909e-415f-4c22-b863-70d02645fe82 req-9e3482e6-8123-46d3-a99d-02b22524bd80 service neutron] 10.222.0.41 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.7&port_id=4b380ab6-f3ec-4e12-9a2a-b5a20828969d HTTP/1.1" status: 200 len: 217 time: 0.0349474 Nov 23 19:33:58.689654 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5176909e-415f-4c22-b863-70d02645fe82 req-0575c73d-06b1-47c5-9a79-45a3823c01e2 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=102992) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:33:58.691129 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-5176909e-415f-4c22-b863-70d02645fe82 req-0575c73d-06b1-47c5-9a79-45a3823c01e2 service neutron] 10.222.0.41 "GET /v2.0/subnets?id=2caca985-6ed6-4ef7-ba49-7b7410bea160 HTTP/1.1" status: 200 len: 856 time: 0.0490608 Nov 23 19:33:58.723602 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.plugins.ml2.db [None req-4bf48ff4-ecfb-4168-8b63-249b8c6e9f04 None None] For port 50e9d93b-ad23-4b6b-bdd0-ae5afe6f80ea, host hv-cinder-81901, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81901',level=0,port_id=50e9d93b-ad23-4b6b-bdd0-ae5afe6f80ea,segment=NetworkSegment(b8302c34-e78d-4c43-9d45-a2604c95a2d2),segment_id=b8302c34-e78d-4c43-9d45-a2604c95a2d2)] {{(pid=102994) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 23 19:33:58.734860 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.plugins.ml2.rpc [None req-4bf48ff4-ecfb-4168-8b63-249b8c6e9f04 None None] Returning: {'device': '50e9d93b-ad23-4b6b-bdd0-ae5afe6f80ea', 'network_id': '07eeb44e-4cdb-4c58-a83d-1dd8ab1ccb8a', 'port_id': '50e9d93b-ad23-4b6b-bdd0-ae5afe6f80ea', 'mac_address': 'fa:16:3e:4d:a6:4b', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 821, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'e4fda56f-85ff-422d-adad-ec00db6378af', 'ip_address': '172.20.0.3'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=102994) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Nov 23 19:33:58.748894 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5176909e-415f-4c22-b863-70d02645fe82 req-b6207a97-aa57-4446-9a1a-d12a2daba290 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102992) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:33:58.750464 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-5176909e-415f-4c22-b863-70d02645fe82 req-b6207a97-aa57-4446-9a1a-d12a2daba290 service neutron] 10.222.0.41 "GET /v2.0/ports?network_id=fc901312-2937-4784-8a6d-c046666e8bf8&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0516112 Nov 23 19:33:58.771981 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron_lib.callbacks.manager [None req-4bf48ff4-ecfb-4168-8b63-249b8c6e9f04 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7921281'] for port, before_update {{(pid=102994) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:33:58.787545 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.notifiers.nova [None req-4bf48ff4-ecfb-4168-8b63-249b8c6e9f04 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 50e9d93b-ad23-4b6b-bdd0-ae5afe6f80ea {{(pid=102994) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 23 19:33:58.807825 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.plugins.ml2.db [None req-4bf48ff4-ecfb-4168-8b63-249b8c6e9f04 None None] For port 50e9d93b-ad23-4b6b-bdd0-ae5afe6f80ea, host hv-cinder-81901, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81901',level=0,port_id=50e9d93b-ad23-4b6b-bdd0-ae5afe6f80ea,segment=NetworkSegment(b8302c34-e78d-4c43-9d45-a2604c95a2d2),segment_id=b8302c34-e78d-4c43-9d45-a2604c95a2d2)] {{(pid=102994) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 23 19:33:58.846043 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-5176909e-415f-4c22-b863-70d02645fe82 req-5539f4d2-b320-42fe-96aa-c211e14c54f0 service neutron] 10.222.0.41 "GET /v2.0/networks/fc901312-2937-4784-8a6d-c046666e8bf8?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0868621 Nov 23 19:33:58.879465 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron_lib.callbacks.manager [None req-4bf48ff4-ecfb-4168-8b63-249b8c6e9f04 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7918660', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-15067', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560168', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8783631423946', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8783631008732', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8783631008750'] for port, after_update {{(pid=102994) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:33:58.880146 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.plugins.ml2.rpc [None req-4bf48ff4-ecfb-4168-8b63-249b8c6e9f04 None None] Device 8c70d83a-558d-4a92-a3e8-15396107e64d details requested by agent hyperv_hv-cinder-81901 with host hv-cinder-81901 {{(pid=102994) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Nov 23 19:33:58.937269 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-5176909e-415f-4c22-b863-70d02645fe82 req-74a19311-1745-47c6-a154-cc1cd99924f7 service neutron] 10.222.0.41 "GET /v2.0/networks/fc901312-2937-4784-8a6d-c046666e8bf8?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0828996 Nov 23 19:33:58.970944 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4bf48ff4-ecfb-4168-8b63-249b8c6e9f04 None None] Pushing event updated for resources: {'Port': ['ID=50e9d93b-ad23-4b6b-bdd0-ae5afe6f80ea,revision_number=4']} {{(pid=102994) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 23 19:33:59.027200 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron_lib.callbacks.manager [None req-4bf48ff4-ecfb-4168-8b63-249b8c6e9f04 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8783631323329', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7978582'] for agent, after_update {{(pid=102994) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:33:59.033626 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.plugins.ml2.db [None req-4bf48ff4-ecfb-4168-8b63-249b8c6e9f04 None None] For port 8c70d83a-558d-4a92-a3e8-15396107e64d, host hv-cinder-81901, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81901',level=0,port_id=8c70d83a-558d-4a92-a3e8-15396107e64d,segment=NetworkSegment(6f1d4a41-ab87-4da1-b83c-5e20faf1683c),segment_id=6f1d4a41-ab87-4da1-b83c-5e20faf1683c)] {{(pid=102994) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 23 19:33:59.043823 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.plugins.ml2.rpc [None req-4bf48ff4-ecfb-4168-8b63-249b8c6e9f04 None None] Returning: {'device': '8c70d83a-558d-4a92-a3e8-15396107e64d', 'network_id': '2cf6d774-4b5e-4f5e-bb22-8de22e43722d', 'port_id': '8c70d83a-558d-4a92-a3e8-15396107e64d', 'mac_address': 'fa:16:3e:99:32:c4', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 823, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'c1e8e6ce-3e67-4ef5-bbc3-db04880e7fab', 'ip_address': '172.20.0.7'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=102994) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Nov 23 19:33:59.084864 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron_lib.callbacks.manager [None req-4bf48ff4-ecfb-4168-8b63-249b8c6e9f04 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7921281'] for port, before_update {{(pid=102994) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:33:59.097488 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.notifiers.nova [None req-4bf48ff4-ecfb-4168-8b63-249b8c6e9f04 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 8c70d83a-558d-4a92-a3e8-15396107e64d {{(pid=102994) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 23 19:33:59.116023 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.plugins.ml2.db [None req-4bf48ff4-ecfb-4168-8b63-249b8c6e9f04 None None] For port 8c70d83a-558d-4a92-a3e8-15396107e64d, host hv-cinder-81901, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81901',level=0,port_id=8c70d83a-558d-4a92-a3e8-15396107e64d,segment=NetworkSegment(6f1d4a41-ab87-4da1-b83c-5e20faf1683c),segment_id=6f1d4a41-ab87-4da1-b83c-5e20faf1683c)] {{(pid=102994) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 23 19:33:59.187421 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron_lib.callbacks.manager [None req-4bf48ff4-ecfb-4168-8b63-249b8c6e9f04 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7918660', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-15067', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560168', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8783631423946', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8783631008732', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8783631008750'] for port, after_update {{(pid=102994) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:33:59.188110 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.plugins.ml2.rpc [None req-4bf48ff4-ecfb-4168-8b63-249b8c6e9f04 None None] Device 0a64c11d-0cb3-4c1e-aa45-5bcdf2771c8c details requested by agent hyperv_hv-cinder-81901 with host hv-cinder-81901 {{(pid=102994) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Nov 23 19:33:59.253328 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4bf48ff4-ecfb-4168-8b63-249b8c6e9f04 None None] Pushing event updated for resources: {'Port': ['ID=8c70d83a-558d-4a92-a3e8-15396107e64d,revision_number=4']} {{(pid=102994) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 23 19:33:59.257206 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.plugins.ml2.db [None req-4bf48ff4-ecfb-4168-8b63-249b8c6e9f04 None None] For port 0a64c11d-0cb3-4c1e-aa45-5bcdf2771c8c, host hv-cinder-81901, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81901',level=0,port_id=0a64c11d-0cb3-4c1e-aa45-5bcdf2771c8c,segment=NetworkSegment(b8302c34-e78d-4c43-9d45-a2604c95a2d2),segment_id=b8302c34-e78d-4c43-9d45-a2604c95a2d2)] {{(pid=102994) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 23 19:33:59.267690 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.plugins.ml2.rpc [None req-4bf48ff4-ecfb-4168-8b63-249b8c6e9f04 None None] Returning: {'device': '0a64c11d-0cb3-4c1e-aa45-5bcdf2771c8c', 'network_id': '07eeb44e-4cdb-4c58-a83d-1dd8ab1ccb8a', 'port_id': '0a64c11d-0cb3-4c1e-aa45-5bcdf2771c8c', 'mac_address': 'fa:16:3e:9e:b3:bd', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 821, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'e4fda56f-85ff-422d-adad-ec00db6378af', 'ip_address': '172.20.0.2'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=102994) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Nov 23 19:33:59.305557 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron_lib.callbacks.manager [None req-4bf48ff4-ecfb-4168-8b63-249b8c6e9f04 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7921281'] for port, before_update {{(pid=102994) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:33:59.318728 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.notifiers.nova [None req-4bf48ff4-ecfb-4168-8b63-249b8c6e9f04 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 0a64c11d-0cb3-4c1e-aa45-5bcdf2771c8c {{(pid=102994) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 23 19:33:59.337871 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.plugins.ml2.db [None req-4bf48ff4-ecfb-4168-8b63-249b8c6e9f04 None None] For port 0a64c11d-0cb3-4c1e-aa45-5bcdf2771c8c, host hv-cinder-81901, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81901',level=0,port_id=0a64c11d-0cb3-4c1e-aa45-5bcdf2771c8c,segment=NetworkSegment(b8302c34-e78d-4c43-9d45-a2604c95a2d2),segment_id=b8302c34-e78d-4c43-9d45-a2604c95a2d2)] {{(pid=102994) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 23 19:33:59.387215 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron_lib.callbacks.manager [None req-4bf48ff4-ecfb-4168-8b63-249b8c6e9f04 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7918660', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-15067', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560168', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8783631423946', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8783631008732', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8783631008750'] for port, after_update {{(pid=102994) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:33:59.459882 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4bf48ff4-ecfb-4168-8b63-249b8c6e9f04 None None] Pushing event updated for resources: {'Port': ['ID=0a64c11d-0cb3-4c1e-aa45-5bcdf2771c8c,revision_number=4']} {{(pid=102994) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 23 19:33:59.467520 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8afe9f5f-71d3-4299-ad3c-edda6bd524d2 req-db729422-ee7e-439f-893e-184a755b6c8c tempest-ServerRescueNegativeTestJSON-1447477341 tempest-ServerRescueNegativeTestJSON-1447477341-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102993) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:33:59.468606 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-888242c7-49ed-49c1-bc7f-010f819c4752 req-a7cd50cd-0790-4e40-82c2-cbfc4cad5ea1 tempest-AttachVolumeShelveTestJSON-1172915835 tempest-AttachVolumeShelveTestJSON-1172915835-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102992) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:33:59.469124 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-8afe9f5f-71d3-4299-ad3c-edda6bd524d2 req-db729422-ee7e-439f-893e-184a755b6c8c tempest-ServerRescueNegativeTestJSON-1447477341 tempest-ServerRescueNegativeTestJSON-1447477341-project] 10.222.0.62 "GET /v2.0/ports?device_id=90cb32bd-c375-400a-b79a-97fc61e2a3a3 HTTP/1.1" status: 200 len: 944 time: 0.0536385 Nov 23 19:33:59.475118 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-888242c7-49ed-49c1-bc7f-010f819c4752 req-a7cd50cd-0790-4e40-82c2-cbfc4cad5ea1 tempest-AttachVolumeShelveTestJSON-1172915835 tempest-AttachVolumeShelveTestJSON-1172915835-project] 10.222.0.62 "GET /v2.0/ports?device_id=85ea3d72-6c17-4ea2-82b7-90cce01633bd HTTP/1.1" status: 200 len: 943 time: 0.0648918 Nov 23 19:33:59.520652 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-8afe9f5f-71d3-4299-ad3c-edda6bd524d2 req-99828a6c-1f31-407f-aa54-22e54152f83b tempest-ServerRescueNegativeTestJSON-1447477341 tempest-ServerRescueNegativeTestJSON-1447477341-project] 10.222.0.62 "GET /v2.0/security-groups?id=62a09434-acf0-424f-9001-2c3a78119364&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0442083 Nov 23 19:33:59.526439 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-888242c7-49ed-49c1-bc7f-010f819c4752 req-46d7abc7-6c45-41e3-a0a0-cc4e5c18e876 tempest-AttachVolumeShelveTestJSON-1172915835 tempest-AttachVolumeShelveTestJSON-1172915835-project] 10.222.0.62 "GET /v2.0/security-groups?id=f1ca24d9-0a31-470d-a1d5-fa7059df0141&fields=id&fields=name HTTP/1.1" status: 200 len: 311 time: 0.0450823 Nov 23 19:33:59.646821 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dbd7fbae-42ea-4614-b55d-5bf4c51c744f req-60e77c8e-5f89-43d6-b25f-eea7a81dff18 tempest-DeleteServersTestJSON-453817978 tempest-DeleteServersTestJSON-453817978-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102993) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:33:59.648263 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-dbd7fbae-42ea-4614-b55d-5bf4c51c744f req-60e77c8e-5f89-43d6-b25f-eea7a81dff18 tempest-DeleteServersTestJSON-453817978 tempest-DeleteServersTestJSON-453817978-project] 10.222.0.62 "GET /v2.0/ports?device_id=5e3c1406-dc8c-414a-bcc5-55c7c963e1df HTTP/1.1" status: 200 len: 944 time: 0.0492723 Nov 23 19:33:59.697576 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-dbd7fbae-42ea-4614-b55d-5bf4c51c744f req-a1652624-db0f-4692-8ce9-d3bd1e295285 tempest-DeleteServersTestJSON-453817978 tempest-DeleteServersTestJSON-453817978-project] 10.222.0.62 "GET /v2.0/security-groups?id=5b5d5814-644d-45c2-ad35-f8920c3382b0&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0431776 Nov 23 19:34:00.635458 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6f3f692a-a1d0-4e56-acb7-ef7b6ff94563 req-7b66700f-1e89-433d-9e21-c4101657324e tempest-ServerRescueNegativeTestJSON-1447477341 tempest-ServerRescueNegativeTestJSON-1447477341-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102992) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:34:00.636989 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-6f3f692a-a1d0-4e56-acb7-ef7b6ff94563 req-7b66700f-1e89-433d-9e21-c4101657324e tempest-ServerRescueNegativeTestJSON-1447477341 tempest-ServerRescueNegativeTestJSON-1447477341-project] 10.222.0.62 "GET /v2.0/ports?device_id=90cb32bd-c375-400a-b79a-97fc61e2a3a3 HTTP/1.1" status: 200 len: 944 time: 0.0481777 Nov 23 19:34:00.641682 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-daf74a62-c725-46f6-ae9a-5b212132ef02 req-4d9c8c66-3802-49fa-bfc9-8e10007da410 tempest-AttachVolumeShelveTestJSON-1172915835 tempest-AttachVolumeShelveTestJSON-1172915835-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102993) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:34:00.643130 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-daf74a62-c725-46f6-ae9a-5b212132ef02 req-4d9c8c66-3802-49fa-bfc9-8e10007da410 tempest-AttachVolumeShelveTestJSON-1172915835 tempest-AttachVolumeShelveTestJSON-1172915835-project] 10.222.0.62 "GET /v2.0/ports?device_id=85ea3d72-6c17-4ea2-82b7-90cce01633bd HTTP/1.1" status: 200 len: 943 time: 0.0473650 Nov 23 19:34:00.692852 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-daf74a62-c725-46f6-ae9a-5b212132ef02 req-9929a960-6c9f-49af-9c4c-9f7c4793bcdd tempest-AttachVolumeShelveTestJSON-1172915835 tempest-AttachVolumeShelveTestJSON-1172915835-project] 10.222.0.62 "GET /v2.0/security-groups?id=f1ca24d9-0a31-470d-a1d5-fa7059df0141&fields=id&fields=name HTTP/1.1" status: 200 len: 311 time: 0.0429168 Nov 23 19:34:00.693978 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-6f3f692a-a1d0-4e56-acb7-ef7b6ff94563 req-0455500e-fb45-4dab-8669-47608b97dfb1 tempest-ServerRescueNegativeTestJSON-1447477341 tempest-ServerRescueNegativeTestJSON-1447477341-project] 10.222.0.62 "GET /v2.0/security-groups?id=62a09434-acf0-424f-9001-2c3a78119364&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0508940 Nov 23 19:34:00.811227 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7140e752-d0c2-40f8-86ef-0a4024ac2096 req-9ad34217-ae0e-4787-88ce-b28473d6e8aa tempest-DeleteServersTestJSON-453817978 tempest-DeleteServersTestJSON-453817978-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102992) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:34:00.812713 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-7140e752-d0c2-40f8-86ef-0a4024ac2096 req-9ad34217-ae0e-4787-88ce-b28473d6e8aa tempest-DeleteServersTestJSON-453817978 tempest-DeleteServersTestJSON-453817978-project] 10.222.0.62 "GET /v2.0/ports?device_id=5e3c1406-dc8c-414a-bcc5-55c7c963e1df HTTP/1.1" status: 200 len: 944 time: 0.0505211 Nov 23 19:34:00.858747 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-7140e752-d0c2-40f8-86ef-0a4024ac2096 req-cd8575b1-79ef-442d-b146-c8522ddaf0de tempest-DeleteServersTestJSON-453817978 tempest-DeleteServersTestJSON-453817978-project] 10.222.0.62 "GET /v2.0/security-groups?id=5b5d5814-644d-45c2-ad35-f8920c3382b0&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0398161 Nov 23 19:34:01.814302 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3a43a8a3-c8c2-4c57-95e3-3584917ce5cf req-978f3683-9a39-454d-aa0d-c7cae82eccae tempest-ServerRescueNegativeTestJSON-1447477341 tempest-ServerRescueNegativeTestJSON-1447477341-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102993) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:34:01.815821 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-3a43a8a3-c8c2-4c57-95e3-3584917ce5cf req-978f3683-9a39-454d-aa0d-c7cae82eccae tempest-ServerRescueNegativeTestJSON-1447477341 tempest-ServerRescueNegativeTestJSON-1447477341-project] 10.222.0.62 "GET /v2.0/ports?device_id=90cb32bd-c375-400a-b79a-97fc61e2a3a3 HTTP/1.1" status: 200 len: 944 time: 0.0596516 Nov 23 19:34:01.823052 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cd3d49fd-b32a-4657-9b77-138af7045340 req-21cbb096-d7a7-4f43-b647-3c3a4ab3c33b tempest-AttachVolumeShelveTestJSON-1172915835 tempest-AttachVolumeShelveTestJSON-1172915835-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102992) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:34:01.824619 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-cd3d49fd-b32a-4657-9b77-138af7045340 req-21cbb096-d7a7-4f43-b647-3c3a4ab3c33b tempest-AttachVolumeShelveTestJSON-1172915835 tempest-AttachVolumeShelveTestJSON-1172915835-project] 10.222.0.62 "GET /v2.0/ports?device_id=85ea3d72-6c17-4ea2-82b7-90cce01633bd HTTP/1.1" status: 200 len: 943 time: 0.0603671 Nov 23 19:34:01.868011 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-3a43a8a3-c8c2-4c57-95e3-3584917ce5cf req-81e98544-c36b-434a-9c00-539a587cc1d8 tempest-ServerRescueNegativeTestJSON-1447477341 tempest-ServerRescueNegativeTestJSON-1447477341-project] 10.222.0.62 "GET /v2.0/security-groups?id=62a09434-acf0-424f-9001-2c3a78119364&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0446062 Nov 23 19:34:01.873006 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-cd3d49fd-b32a-4657-9b77-138af7045340 req-791ae9c3-1f39-4a4d-9cb7-e2040505430f tempest-AttachVolumeShelveTestJSON-1172915835 tempest-AttachVolumeShelveTestJSON-1172915835-project] 10.222.0.62 "GET /v2.0/security-groups?id=f1ca24d9-0a31-470d-a1d5-fa7059df0141&fields=id&fields=name HTTP/1.1" status: 200 len: 311 time: 0.0421965 Nov 23 19:34:02.143260 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0f363e6a-a88e-42e5-9c6f-e297543728ad req-3a429606-b14f-4a57-bd2a-68e2911b9169 tempest-DeleteServersTestJSON-453817978 tempest-DeleteServersTestJSON-453817978-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102993) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:34:02.144765 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-0f363e6a-a88e-42e5-9c6f-e297543728ad req-3a429606-b14f-4a57-bd2a-68e2911b9169 tempest-DeleteServersTestJSON-453817978 tempest-DeleteServersTestJSON-453817978-project] 10.222.0.62 "GET /v2.0/ports?device_id=5e3c1406-dc8c-414a-bcc5-55c7c963e1df HTTP/1.1" status: 200 len: 944 time: 0.2199650 Nov 23 19:34:02.196610 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-0f363e6a-a88e-42e5-9c6f-e297543728ad req-56c08496-fffe-45e6-9689-b3b9231d342a tempest-DeleteServersTestJSON-453817978 tempest-DeleteServersTestJSON-453817978-project] 10.222.0.62 "GET /v2.0/security-groups?id=5b5d5814-644d-45c2-ad35-f8920c3382b0&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0445697 Nov 23 19:34:02.268602 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.plugins.ml2.db [None req-4bf48ff4-ecfb-4168-8b63-249b8c6e9f04 None None] get_ports_and_sgs() called for port_ids ['0a64c11d-0cb3-4c1e-aa45-5bcdf2771c8c'] {{(pid=102994) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 23 19:34:02.313049 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.plugins.ml2.db [None req-4bf48ff4-ecfb-4168-8b63-249b8c6e9f04 None None] get_ports_and_sgs() called for port_ids ['8c70d83a-558d-4a92-a3e8-15396107e64d'] {{(pid=102994) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 23 19:34:02.321335 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.plugins.ml2.db [None req-4bf48ff4-ecfb-4168-8b63-249b8c6e9f04 None None] get_ports_and_sgs() called for port_ids ['50e9d93b-ad23-4b6b-bdd0-ae5afe6f80ea'] {{(pid=102994) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 23 19:34:02.988590 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6955bac6-c269-4d2b-882a-6bde9b27f434 req-1ea2ab5e-cc5b-4e51-a1cc-028f092616df tempest-ServerRescueNegativeTestJSON-1447477341 tempest-ServerRescueNegativeTestJSON-1447477341-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102992) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:34:02.990687 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-6955bac6-c269-4d2b-882a-6bde9b27f434 req-1ea2ab5e-cc5b-4e51-a1cc-028f092616df tempest-ServerRescueNegativeTestJSON-1447477341 tempest-ServerRescueNegativeTestJSON-1447477341-project] 10.222.0.62 "GET /v2.0/ports?device_id=90cb32bd-c375-400a-b79a-97fc61e2a3a3 HTTP/1.1" status: 200 len: 944 time: 0.0550981 Nov 23 19:34:03.005019 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-46be6170-aed6-46ed-bbf8-cc9e7f396c8f req-64077617-ee9b-4ffd-b87e-cd56f07bf0d1 tempest-AttachVolumeShelveTestJSON-1172915835 tempest-AttachVolumeShelveTestJSON-1172915835-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102993) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:34:03.007039 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-46be6170-aed6-46ed-bbf8-cc9e7f396c8f req-64077617-ee9b-4ffd-b87e-cd56f07bf0d1 tempest-AttachVolumeShelveTestJSON-1172915835 tempest-AttachVolumeShelveTestJSON-1172915835-project] 10.222.0.62 "GET /v2.0/ports?device_id=85ea3d72-6c17-4ea2-82b7-90cce01633bd HTTP/1.1" status: 200 len: 943 time: 0.0497942 Nov 23 19:34:03.039635 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-6955bac6-c269-4d2b-882a-6bde9b27f434 req-0f13a8a0-220d-4eb6-b514-4684b54858ab tempest-ServerRescueNegativeTestJSON-1447477341 tempest-ServerRescueNegativeTestJSON-1447477341-project] 10.222.0.62 "GET /v2.0/security-groups?id=62a09434-acf0-424f-9001-2c3a78119364&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0428491 Nov 23 19:34:03.057207 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-46be6170-aed6-46ed-bbf8-cc9e7f396c8f req-394dbc65-e774-480a-8523-d78889d92ff7 tempest-AttachVolumeShelveTestJSON-1172915835 tempest-AttachVolumeShelveTestJSON-1172915835-project] 10.222.0.62 "GET /v2.0/security-groups?id=f1ca24d9-0a31-470d-a1d5-fa7059df0141&fields=id&fields=name HTTP/1.1" status: 200 len: 311 time: 0.0442116 Nov 23 19:34:03.310581 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0407307d-f7fa-4d33-a622-52d9941d5410 req-a5c92d3c-bb3d-4c5e-9db6-158872b5cf0b tempest-DeleteServersTestJSON-453817978 tempest-DeleteServersTestJSON-453817978-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102992) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:34:03.312059 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-0407307d-f7fa-4d33-a622-52d9941d5410 req-a5c92d3c-bb3d-4c5e-9db6-158872b5cf0b tempest-DeleteServersTestJSON-453817978 tempest-DeleteServersTestJSON-453817978-project] 10.222.0.62 "GET /v2.0/ports?device_id=5e3c1406-dc8c-414a-bcc5-55c7c963e1df HTTP/1.1" status: 200 len: 944 time: 0.0506558 Nov 23 19:34:03.358760 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-0407307d-f7fa-4d33-a622-52d9941d5410 req-bb92b1fe-45f7-473d-ac8b-93eca39a7948 tempest-DeleteServersTestJSON-453817978 tempest-DeleteServersTestJSON-453817978-project] 10.222.0.62 "GET /v2.0/security-groups?id=5b5d5814-644d-45c2-ad35-f8920c3382b0&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0408564 Nov 23 19:34:04.168097 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bfdc7296-e153-49be-9af5-cf3c3e15d409 req-4acb45eb-967b-4266-aea5-8d4790c9e264 tempest-ServerRescueNegativeTestJSON-1447477341 tempest-ServerRescueNegativeTestJSON-1447477341-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102993) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:34:04.168988 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-bfdc7296-e153-49be-9af5-cf3c3e15d409 req-4acb45eb-967b-4266-aea5-8d4790c9e264 tempest-ServerRescueNegativeTestJSON-1447477341 tempest-ServerRescueNegativeTestJSON-1447477341-project] 10.222.0.62 "GET /v2.0/ports?device_id=90cb32bd-c375-400a-b79a-97fc61e2a3a3 HTTP/1.1" status: 200 len: 944 time: 0.0598757 Nov 23 19:34:04.182799 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3552db02-7f6c-46bc-8c2f-a91936b5a4ba req-e998fa28-e37a-4e6f-9a18-c62976021dfd tempest-AttachVolumeShelveTestJSON-1172915835 tempest-AttachVolumeShelveTestJSON-1172915835-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102992) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:34:04.184313 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-3552db02-7f6c-46bc-8c2f-a91936b5a4ba req-e998fa28-e37a-4e6f-9a18-c62976021dfd tempest-AttachVolumeShelveTestJSON-1172915835 tempest-AttachVolumeShelveTestJSON-1172915835-project] 10.222.0.62 "GET /v2.0/ports?device_id=85ea3d72-6c17-4ea2-82b7-90cce01633bd HTTP/1.1" status: 200 len: 943 time: 0.0505683 Nov 23 19:34:04.236280 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-bfdc7296-e153-49be-9af5-cf3c3e15d409 req-0f921ea5-e616-473a-984b-032746d67136 tempest-ServerRescueNegativeTestJSON-1447477341 tempest-ServerRescueNegativeTestJSON-1447477341-project] 10.222.0.62 "GET /v2.0/security-groups?id=62a09434-acf0-424f-9001-2c3a78119364&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0611136 Nov 23 19:34:04.252018 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-3552db02-7f6c-46bc-8c2f-a91936b5a4ba req-e48206be-48a9-4ae0-838f-0c54c93b22d1 tempest-AttachVolumeShelveTestJSON-1172915835 tempest-AttachVolumeShelveTestJSON-1172915835-project] 10.222.0.62 "GET /v2.0/security-groups?id=f1ca24d9-0a31-470d-a1d5-fa7059df0141&fields=id&fields=name HTTP/1.1" status: 200 len: 311 time: 0.0603836 Nov 23 19:34:04.480553 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a3c70385-f0de-4cf1-ade9-8b2293147716 req-ccdfa12e-2287-4c54-8b44-80322f79ec9a tempest-DeleteServersTestJSON-453817978 tempest-DeleteServersTestJSON-453817978-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102993) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:34:04.482040 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-a3c70385-f0de-4cf1-ade9-8b2293147716 req-ccdfa12e-2287-4c54-8b44-80322f79ec9a tempest-DeleteServersTestJSON-453817978 tempest-DeleteServersTestJSON-453817978-project] 10.222.0.62 "GET /v2.0/ports?device_id=5e3c1406-dc8c-414a-bcc5-55c7c963e1df HTTP/1.1" status: 200 len: 944 time: 0.0492153 Nov 23 19:34:04.528817 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-a3c70385-f0de-4cf1-ade9-8b2293147716 req-8feaaef7-8ae2-48de-936a-642bced33462 tempest-DeleteServersTestJSON-453817978 tempest-DeleteServersTestJSON-453817978-project] 10.222.0.62 "GET /v2.0/security-groups?id=5b5d5814-644d-45c2-ad35-f8920c3382b0&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0408931 Nov 23 19:34:05.356796 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b9e923a4-f9dc-4cc0-a988-4287eb0e3600 req-dfca8d22-79b5-46b0-81a2-d77182fb7ebd tempest-ServerRescueNegativeTestJSON-1447477341 tempest-ServerRescueNegativeTestJSON-1447477341-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102992) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:34:05.358299 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-b9e923a4-f9dc-4cc0-a988-4287eb0e3600 req-dfca8d22-79b5-46b0-81a2-d77182fb7ebd tempest-ServerRescueNegativeTestJSON-1447477341 tempest-ServerRescueNegativeTestJSON-1447477341-project] 10.222.0.62 "GET /v2.0/ports?device_id=90cb32bd-c375-400a-b79a-97fc61e2a3a3 HTTP/1.1" status: 200 len: 944 time: 0.0477726 Nov 23 19:34:05.366925 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9d222abb-f5dc-4f37-b8b5-2bc219aa2557 req-1cdf9c95-5f86-4f47-aa13-e64d798fbde1 tempest-AttachVolumeShelveTestJSON-1172915835 tempest-AttachVolumeShelveTestJSON-1172915835-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102993) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:34:05.368391 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-9d222abb-f5dc-4f37-b8b5-2bc219aa2557 req-1cdf9c95-5f86-4f47-aa13-e64d798fbde1 tempest-AttachVolumeShelveTestJSON-1172915835 tempest-AttachVolumeShelveTestJSON-1172915835-project] 10.222.0.62 "GET /v2.0/ports?device_id=85ea3d72-6c17-4ea2-82b7-90cce01633bd HTTP/1.1" status: 200 len: 943 time: 0.0476303 Nov 23 19:34:05.408021 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-b9e923a4-f9dc-4cc0-a988-4287eb0e3600 req-71b15c82-08d4-4cc1-b4e9-e366d516d5c1 tempest-ServerRescueNegativeTestJSON-1447477341 tempest-ServerRescueNegativeTestJSON-1447477341-project] 10.222.0.62 "GET /v2.0/security-groups?id=62a09434-acf0-424f-9001-2c3a78119364&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0439067 Nov 23 19:34:05.414482 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-9d222abb-f5dc-4f37-b8b5-2bc219aa2557 req-9b4a4308-80d8-4665-a936-b87e6add7f4a tempest-AttachVolumeShelveTestJSON-1172915835 tempest-AttachVolumeShelveTestJSON-1172915835-project] 10.222.0.62 "GET /v2.0/security-groups?id=f1ca24d9-0a31-470d-a1d5-fa7059df0141&fields=id&fields=name HTTP/1.1" status: 200 len: 311 time: 0.0403290 Nov 23 19:34:05.642932 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ca08384d-50ca-4862-9da5-1c61d06aca16 req-24a9af2a-f100-4ee2-bd0f-bf4daedd876b tempest-DeleteServersTestJSON-453817978 tempest-DeleteServersTestJSON-453817978-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102992) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:34:05.644389 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-ca08384d-50ca-4862-9da5-1c61d06aca16 req-24a9af2a-f100-4ee2-bd0f-bf4daedd876b tempest-DeleteServersTestJSON-453817978 tempest-DeleteServersTestJSON-453817978-project] 10.222.0.62 "GET /v2.0/ports?device_id=5e3c1406-dc8c-414a-bcc5-55c7c963e1df HTTP/1.1" status: 200 len: 944 time: 0.0482543 Nov 23 19:34:05.692736 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-ca08384d-50ca-4862-9da5-1c61d06aca16 req-3a759d8f-9e48-4d09-8d5f-387fab50b05a tempest-DeleteServersTestJSON-453817978 tempest-DeleteServersTestJSON-453817978-project] 10.222.0.62 "GET /v2.0/security-groups?id=5b5d5814-644d-45c2-ad35-f8920c3382b0&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0422430 Nov 23 19:34:06.526899 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7c06652c-21f6-46bb-b51f-46ec9a945744 req-1d2ad971-f4f3-4c38-bd67-f6d1ce9660e9 tempest-ServerRescueNegativeTestJSON-1447477341 tempest-ServerRescueNegativeTestJSON-1447477341-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102993) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:34:06.528395 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-7c06652c-21f6-46bb-b51f-46ec9a945744 req-1d2ad971-f4f3-4c38-bd67-f6d1ce9660e9 tempest-ServerRescueNegativeTestJSON-1447477341 tempest-ServerRescueNegativeTestJSON-1447477341-project] 10.222.0.62 "GET /v2.0/ports?device_id=90cb32bd-c375-400a-b79a-97fc61e2a3a3 HTTP/1.1" status: 200 len: 944 time: 0.0521910 Nov 23 19:34:06.540411 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e0fb3832-f853-48f2-aaa5-652945ac5012 req-fbb61de7-8d7c-46a5-9908-d8fb03c6c676 tempest-AttachVolumeShelveTestJSON-1172915835 tempest-AttachVolumeShelveTestJSON-1172915835-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102992) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:34:06.541931 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-e0fb3832-f853-48f2-aaa5-652945ac5012 req-fbb61de7-8d7c-46a5-9908-d8fb03c6c676 tempest-AttachVolumeShelveTestJSON-1172915835 tempest-AttachVolumeShelveTestJSON-1172915835-project] 10.222.0.62 "GET /v2.0/ports?device_id=85ea3d72-6c17-4ea2-82b7-90cce01633bd HTTP/1.1" status: 200 len: 943 time: 0.0526848 Nov 23 19:34:06.581303 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-7c06652c-21f6-46bb-b51f-46ec9a945744 req-63352ca1-964e-4b28-9915-98d0ef9e2ae7 tempest-ServerRescueNegativeTestJSON-1447477341 tempest-ServerRescueNegativeTestJSON-1447477341-project] 10.222.0.62 "GET /v2.0/security-groups?id=62a09434-acf0-424f-9001-2c3a78119364&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0464764 Nov 23 19:34:06.601158 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-e0fb3832-f853-48f2-aaa5-652945ac5012 req-8ab42c23-2cd1-4d63-a7ea-441c0cb88537 tempest-AttachVolumeShelveTestJSON-1172915835 tempest-AttachVolumeShelveTestJSON-1172915835-project] 10.222.0.62 "GET /v2.0/security-groups?id=f1ca24d9-0a31-470d-a1d5-fa7059df0141&fields=id&fields=name HTTP/1.1" status: 200 len: 311 time: 0.0441911 Nov 23 19:34:06.809761 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4cfebd6a-7969-47e2-be2b-ae65a34dc364 req-abfaa5ba-57ca-48e3-b3e2-3cd20008bffb tempest-DeleteServersTestJSON-453817978 tempest-DeleteServersTestJSON-453817978-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102993) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:34:06.811271 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-4cfebd6a-7969-47e2-be2b-ae65a34dc364 req-abfaa5ba-57ca-48e3-b3e2-3cd20008bffb tempest-DeleteServersTestJSON-453817978 tempest-DeleteServersTestJSON-453817978-project] 10.222.0.62 "GET /v2.0/ports?device_id=5e3c1406-dc8c-414a-bcc5-55c7c963e1df HTTP/1.1" status: 200 len: 944 time: 0.0520966 Nov 23 19:34:06.866095 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-4cfebd6a-7969-47e2-be2b-ae65a34dc364 req-b673340a-2911-4927-982c-afcaad3bc6b3 tempest-DeleteServersTestJSON-453817978 tempest-DeleteServersTestJSON-453817978-project] 10.222.0.62 "GET /v2.0/security-groups?id=5b5d5814-644d-45c2-ad35-f8920c3382b0&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0489748 Nov 23 19:34:07.301038 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.wsgi [-] (102993) accepted ('10.222.0.62', 42124) {{(pid=102993) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 23 19:34:07.363919 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.wsgi [-] (102993) accepted ('10.222.0.62', 42130) {{(pid=102993) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 23 19:34:07.459847 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-58ac01c9-9541-4ed2-8eed-5f5623d6988a admin admin] Publish callbacks [] for security_group, before_create {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:34:07.472461 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-64551368-8aa4-4a4e-bd51-ef566567b668 admin admin] Publish callbacks [] for security_group, before_create {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:34:07.592594 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-58ac01c9-9541-4ed2-8eed-5f5623d6988a admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:34:07.601558 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-64551368-8aa4-4a4e-bd51-ef566567b668 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:34:07.684275 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.plugins.ml2.rpc [None req-4bf48ff4-ecfb-4168-8b63-249b8c6e9f04 None None] Device 50e9d93b-ad23-4b6b-bdd0-ae5afe6f80ea up at agent hyperv_hv-cinder-81901 {{(pid=102994) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 23 19:34:07.692884 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-58ac01c9-9541-4ed2-8eed-5f5623d6988a admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-623933'] for security_group, after_create {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:34:07.719206 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-64551368-8aa4-4a4e-bd51-ef566567b668 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-623933'] for security_group, after_create {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:34:07.764958 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [None req-58ac01c9-9541-4ed2-8eed-5f5623d6988a admin admin] 10.222.0.62 "GET /v2.0/security-groups?tenant_id=459be06d15174b4b8a4f1092f4e4a5f1&name=default HTTP/1.1" status: 200 len: 2996 time: 0.4627604 Nov 23 19:34:07.769968 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-58ac01c9-9541-4ed2-8eed-5f5623d6988a admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=0031fada-08cf-4f10-9edf-c0c526a18d57,revision_number=1']} {{(pid=102993) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 23 19:34:07.773497 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.wsgi [-] (102993) accepted ('10.222.0.62', 42138) {{(pid=102993) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 23 19:34:07.791071 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2cb32a67-0176-404e-b1d8-22faca8b9ca4 req-71a72992-74ee-4acc-91ed-0f75d74f94cb tempest-AttachVolumeShelveTestJSON-1172915835 tempest-AttachVolumeShelveTestJSON-1172915835-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102993) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:34:07.792648 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-2cb32a67-0176-404e-b1d8-22faca8b9ca4 req-71a72992-74ee-4acc-91ed-0f75d74f94cb tempest-AttachVolumeShelveTestJSON-1172915835 tempest-AttachVolumeShelveTestJSON-1172915835-project] 10.222.0.62 "GET /v2.0/ports?device_id=85ea3d72-6c17-4ea2-82b7-90cce01633bd HTTP/1.1" status: 200 len: 943 time: 0.1269684 Nov 23 19:34:07.793572 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.db.provisioning_blocks [None req-4bf48ff4-ecfb-4168-8b63-249b8c6e9f04 None None] Provisioning for port 50e9d93b-ad23-4b6b-bdd0-ae5afe6f80ea completed by entity L2. {{(pid=102994) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 23 19:34:07.797872 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.db.provisioning_blocks [None req-4bf48ff4-ecfb-4168-8b63-249b8c6e9f04 None None] Provisioning complete for port 50e9d93b-ad23-4b6b-bdd0-ae5afe6f80ea triggered by entity L2. {{(pid=102994) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 23 19:34:07.798906 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron_lib.callbacks.manager [None req-4bf48ff4-ecfb-4168-8b63-249b8c6e9f04 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-8355713'] for port, provisioning_complete {{(pid=102994) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:34:07.799847 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [None req-64551368-8aa4-4a4e-bd51-ef566567b668 admin admin] 10.222.0.62 "GET /v2.0/security-groups?tenant_id=d43adfbe38b44fdbbe29abd5429c35eb&name=default HTTP/1.1" status: 200 len: 2996 time: 0.4347370 Nov 23 19:34:07.806103 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.wsgi [-] (102993) accepted ('10.222.0.62', 42140) {{(pid=102993) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 23 19:34:07.884037 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0b5c18f4-dd81-4b01-9fe4-1974ce93da58 req-1eead839-ed8a-4fbe-ad05-a96e33867e4c tempest-ServerRescueNegativeTestJSON-1447477341 tempest-ServerRescueNegativeTestJSON-1447477341-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102992) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:34:07.885036 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron_lib.callbacks.manager [None req-4bf48ff4-ecfb-4168-8b63-249b8c6e9f04 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7921281'] for port, before_update {{(pid=102994) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:34:07.885512 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-0b5c18f4-dd81-4b01-9fe4-1974ce93da58 req-1eead839-ed8a-4fbe-ad05-a96e33867e4c tempest-ServerRescueNegativeTestJSON-1447477341 tempest-ServerRescueNegativeTestJSON-1447477341-project] 10.222.0.62 "GET /v2.0/ports?device_id=90cb32bd-c375-400a-b79a-97fc61e2a3a3 HTTP/1.1" status: 200 len: 944 time: 0.2396936 Nov 23 19:34:07.889242 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-64551368-8aa4-4a4e-bd51-ef566567b668 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=b2ffcbfd-4f89-4609-bbd4-4db31b03d98b,revision_number=1']} {{(pid=102993) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 23 19:34:07.927315 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '671f1d44-7752-4a9d-835d-4d76164c900f', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '50e9d93b-ad23-4b6b-bdd0-ae5afe6f80ea'}] {{(pid=102994) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 23 19:34:07.935454 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-2cb32a67-0176-404e-b1d8-22faca8b9ca4 req-bdfaf9c7-272d-4f72-9d6c-cf4a86f948fc tempest-AttachVolumeShelveTestJSON-1172915835 tempest-AttachVolumeShelveTestJSON-1172915835-project] 10.222.0.62 "GET /v2.0/security-groups?id=f1ca24d9-0a31-470d-a1d5-fa7059df0141&fields=id&fields=name HTTP/1.1" status: 200 len: 311 time: 0.1214676 Nov 23 19:34:07.944966 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-0b5c18f4-dd81-4b01-9fe4-1974ce93da58 req-4a4ef688-7b3e-4c14-9b2d-24360a758f55 tempest-ServerRescueNegativeTestJSON-1447477341 tempest-ServerRescueNegativeTestJSON-1447477341-project] 10.222.0.62 "GET /v2.0/security-groups?id=62a09434-acf0-424f-9001-2c3a78119364&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0513384 Nov 23 19:34:07.952094 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-4c799a95-2ff9-4ae8-993e-1a80e00e3b75 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:34:07.961845 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-4d4b2684-962d-4447-9954-b4384a880886 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:34:07.989447 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-4c799a95-2ff9-4ae8-993e-1a80e00e3b75 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:34:08.002132 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.plugins.ml2.db [None req-4bf48ff4-ecfb-4168-8b63-249b8c6e9f04 None None] For port 50e9d93b-ad23-4b6b-bdd0-ae5afe6f80ea, host hv-cinder-81901, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81901',level=0,port_id=50e9d93b-ad23-4b6b-bdd0-ae5afe6f80ea,segment=NetworkSegment(b8302c34-e78d-4c43-9d45-a2604c95a2d2),segment_id=b8302c34-e78d-4c43-9d45-a2604c95a2d2)] {{(pid=102994) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 23 19:34:08.005910 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-4d4b2684-962d-4447-9954-b4384a880886 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:34:08.050559 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron_lib.callbacks.manager [None req-4bf48ff4-ecfb-4168-8b63-249b8c6e9f04 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7918660', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-15067', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560168', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8783631423946', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8783631008732', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8783631008750'] for port, after_update {{(pid=102994) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:34:08.051369 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.plugins.ml2.rpc [None req-4bf48ff4-ecfb-4168-8b63-249b8c6e9f04 None None] Device 8c70d83a-558d-4a92-a3e8-15396107e64d up at agent hyperv_hv-cinder-81901 {{(pid=102994) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 23 19:34:08.094904 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-900b9f70-6255-4339-bba0-bed36c8787d1 req-03269329-4c9d-409b-83d3-c1e2392d5de4 tempest-DeleteServersTestJSON-453817978 tempest-DeleteServersTestJSON-453817978-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102992) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:34:08.102812 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-900b9f70-6255-4339-bba0-bed36c8787d1 req-03269329-4c9d-409b-83d3-c1e2392d5de4 tempest-DeleteServersTestJSON-453817978 tempest-DeleteServersTestJSON-453817978-project] 10.222.0.62 "GET /v2.0/ports?device_id=5e3c1406-dc8c-414a-bcc5-55c7c963e1df HTTP/1.1" status: 200 len: 944 time: 0.0750873 Nov 23 19:34:08.138093 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4bf48ff4-ecfb-4168-8b63-249b8c6e9f04 None None] Pushing event updated for resources: {'Port': ['ID=50e9d93b-ad23-4b6b-bdd0-ae5afe6f80ea,revision_number=5']} {{(pid=102994) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 23 19:34:08.144766 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.62/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}09a7511da0d2ba1d728b27e36a8467ec5289399952f0059588048a7cb66d3a43" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-c7ee3c39-d2ee-455d-b531-a7d6160147ac" -d '{"events": [{"server_uuid": "671f1d44-7752-4a9d-835d-4d76164c900f", "name": "network-vif-plugged", "status": "completed", "tag": "50e9d93b-ad23-4b6b-bdd0-ae5afe6f80ea"}]}' {{(pid=102994) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 23 19:34:08.152699 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-4c799a95-2ff9-4ae8-993e-1a80e00e3b75 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-623933'] for security_group, after_delete {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:34:08.155421 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-4c799a95-2ff9-4ae8-993e-1a80e00e3b75 admin admin] Publish callbacks [] for security_group, before_response {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:34:08.156638 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [None req-4c799a95-2ff9-4ae8-993e-1a80e00e3b75 admin admin] 10.222.0.62 "DELETE /v2.0/security-groups/0031fada-08cf-4f10-9edf-c0c526a18d57 HTTP/1.1" status: 204 len: 168 time: 0.3806350 Nov 23 19:34:08.162103 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-900b9f70-6255-4339-bba0-bed36c8787d1 req-5dd79522-7f11-4ede-a44d-eac4b51a7780 tempest-DeleteServersTestJSON-453817978 tempest-DeleteServersTestJSON-453817978-project] 10.222.0.62 "GET /v2.0/security-groups?id=5b5d5814-644d-45c2-ad35-f8920c3382b0&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0582793 Nov 23 19:34:08.166959 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-4d4b2684-962d-4447-9954-b4384a880886 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-623933'] for security_group, after_delete {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:34:08.169582 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-4d4b2684-962d-4447-9954-b4384a880886 admin admin] Publish callbacks [] for security_group, before_response {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:34:08.172958 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [None req-4d4b2684-962d-4447-9954-b4384a880886 admin admin] 10.222.0.62 "DELETE /v2.0/security-groups/b2ffcbfd-4f89-4609-bbd4-4db31b03d98b HTTP/1.1" status: 204 len: 168 time: 0.3580129 Nov 23 19:34:08.175665 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4c799a95-2ff9-4ae8-993e-1a80e00e3b75 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=0031fada-08cf-4f10-9edf-c0c526a18d57,revision_number=None']} {{(pid=102993) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 23 19:34:08.197088 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4d4b2684-962d-4447-9954-b4384a880886 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=b2ffcbfd-4f89-4609-bbd4-4db31b03d98b,revision_number=None']} {{(pid=102993) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 23 19:34:08.264058 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 23 Nov 2021 19:34:08 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-b05c553f-7e6d-4c89-a127-446c2e3e915b x-openstack-request-id: req-b05c553f-7e6d-4c89-a127-446c2e3e915b {{(pid=102994) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 23 19:34:08.264356 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "671f1d44-7752-4a9d-835d-4d76164c900f", "name": "network-vif-plugged", "status": "completed", "tag": "50e9d93b-ad23-4b6b-bdd0-ae5afe6f80ea", "code": 200}]} {{(pid=102994) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 23 19:34:08.264617 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.62/compute/v2.1/os-server-external-events used request id req-b05c553f-7e6d-4c89-a127-446c2e3e915b {{(pid=102994) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 23 19:34:08.265089 dv-cinder-819011-1-iscsi neutron-server[102994]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '671f1d44-7752-4a9d-835d-4d76164c900f', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '50e9d93b-ad23-4b6b-bdd0-ae5afe6f80ea', 'code': 200} Nov 23 19:34:08.267106 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.db.provisioning_blocks [None req-4bf48ff4-ecfb-4168-8b63-249b8c6e9f04 None None] Provisioning for port 8c70d83a-558d-4a92-a3e8-15396107e64d completed by entity L2. {{(pid=102994) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 23 19:34:08.272064 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.db.provisioning_blocks [None req-4bf48ff4-ecfb-4168-8b63-249b8c6e9f04 None None] Provisioning complete for port 8c70d83a-558d-4a92-a3e8-15396107e64d triggered by entity L2. {{(pid=102994) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 23 19:34:08.272442 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron_lib.callbacks.manager [None req-4bf48ff4-ecfb-4168-8b63-249b8c6e9f04 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-8355713'] for port, provisioning_complete {{(pid=102994) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:34:08.349650 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron_lib.callbacks.manager [None req-4bf48ff4-ecfb-4168-8b63-249b8c6e9f04 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7921281'] for port, before_update {{(pid=102994) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:34:08.385802 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.plugins.ml2.db [None req-4bf48ff4-ecfb-4168-8b63-249b8c6e9f04 None None] For port 8c70d83a-558d-4a92-a3e8-15396107e64d, host hv-cinder-81901, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81901',level=0,port_id=8c70d83a-558d-4a92-a3e8-15396107e64d,segment=NetworkSegment(6f1d4a41-ab87-4da1-b83c-5e20faf1683c),segment_id=6f1d4a41-ab87-4da1-b83c-5e20faf1683c)] {{(pid=102994) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 23 19:34:08.491073 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron_lib.callbacks.manager [None req-4bf48ff4-ecfb-4168-8b63-249b8c6e9f04 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7918660', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-15067', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560168', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8783631423946', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8783631008732', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8783631008750'] for port, after_update {{(pid=102994) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:34:08.540494 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4bf48ff4-ecfb-4168-8b63-249b8c6e9f04 None None] Pushing event updated for resources: {'Port': ['ID=8c70d83a-558d-4a92-a3e8-15396107e64d,revision_number=5']} {{(pid=102994) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 23 19:34:08.859584 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.wsgi [-] (102993) accepted ('10.222.0.62', 42170) {{(pid=102993) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 23 19:34:08.874234 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-dbb35e49-72da-4515-9c42-b1cc787e2732 admin admin] Publish callbacks [] for security_group, before_create {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:34:08.924766 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.wsgi [-] (102992) accepted ('10.222.0.62', 42172) {{(pid=102992) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 23 19:34:08.938707 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [None req-cc831a4c-c611-43a4-b6ae-9c0fdb8e6dea admin admin] Publish callbacks [] for security_group, before_create {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:34:08.951284 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-dbb35e49-72da-4515-9c42-b1cc787e2732 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:34:09.025771 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [None req-cc831a4c-c611-43a4-b6ae-9c0fdb8e6dea admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:34:09.076541 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-dbb35e49-72da-4515-9c42-b1cc787e2732 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-623933'] for security_group, after_create {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:34:09.109330 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [None req-cc831a4c-c611-43a4-b6ae-9c0fdb8e6dea admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-623933'] for security_group, after_create {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:34:09.123006 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-dbb35e49-72da-4515-9c42-b1cc787e2732 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=935c32bf-bc0a-4e2c-9eba-8cef03759cd9,revision_number=1']} {{(pid=102993) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 23 19:34:09.128815 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [None req-dbb35e49-72da-4515-9c42-b1cc787e2732 admin admin] 10.222.0.62 "GET /v2.0/security-groups?tenant_id=479baebddd6642f39e8dd4e65c609c4b&name=default HTTP/1.1" status: 200 len: 2996 time: 0.2665136 Nov 23 19:34:09.130330 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.wsgi [-] (102993) accepted ('10.222.0.62', 42178) {{(pid=102993) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 23 19:34:09.141526 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-289f1947-3220-43c6-bcf6-62f61a3ca8c6 req-5c58f5b3-152b-4517-9509-4a526661c280 tempest-AttachVolumeShelveTestJSON-1172915835 tempest-AttachVolumeShelveTestJSON-1172915835-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102993) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:34:09.143032 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-289f1947-3220-43c6-bcf6-62f61a3ca8c6 req-5c58f5b3-152b-4517-9509-4a526661c280 tempest-AttachVolumeShelveTestJSON-1172915835 tempest-AttachVolumeShelveTestJSON-1172915835-project] 10.222.0.62 "GET /v2.0/ports?device_id=85ea3d72-6c17-4ea2-82b7-90cce01633bd HTTP/1.1" status: 200 len: 943 time: 0.0987411 Nov 23 19:34:09.176090 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8fc4d131-a4b2-47ef-8f9a-12a12a426226 req-ed2261be-fffa-4c76-9d60-0bf1b16a6f11 tempest-ServerRescueNegativeTestJSON-1447477341 tempest-ServerRescueNegativeTestJSON-1447477341-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102992) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:34:09.180699 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-8fc4d131-a4b2-47ef-8f9a-12a12a426226 req-ed2261be-fffa-4c76-9d60-0bf1b16a6f11 tempest-ServerRescueNegativeTestJSON-1447477341 tempest-ServerRescueNegativeTestJSON-1447477341-project] 10.222.0.62 "GET /v2.0/ports?device_id=90cb32bd-c375-400a-b79a-97fc61e2a3a3 HTTP/1.1" status: 200 len: 944 time: 0.1456249 Nov 23 19:34:09.201000 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [None req-cc831a4c-c611-43a4-b6ae-9c0fdb8e6dea admin admin] 10.222.0.62 "GET /v2.0/security-groups?tenant_id=4b3ab6b6253d42d693eaf4b8773f0e45&name=default HTTP/1.1" status: 200 len: 2996 time: 0.2742519 Nov 23 19:34:09.203945 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.wsgi [-] (102992) accepted ('10.222.0.62', 42188) {{(pid=102992) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 23 19:34:09.244225 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cc831a4c-c611-43a4-b6ae-9c0fdb8e6dea admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=c4db3a60-09d1-40fd-80d2-b2bb92282b7f,revision_number=1']} {{(pid=102992) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 23 19:34:09.244318 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-289f1947-3220-43c6-bcf6-62f61a3ca8c6 req-8117217b-2b2b-4a80-80ef-f7af8b971ea6 tempest-AttachVolumeShelveTestJSON-1172915835 tempest-AttachVolumeShelveTestJSON-1172915835-project] 10.222.0.62 "GET /v2.0/security-groups?id=f1ca24d9-0a31-470d-a1d5-fa7059df0141&fields=id&fields=name HTTP/1.1" status: 200 len: 311 time: 0.0841978 Nov 23 19:34:09.252061 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-38c4e473-4c50-4e4f-b0ff-79dffcf50625 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:34:09.264139 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.plugins.ml2.rpc [None req-4bf48ff4-ecfb-4168-8b63-249b8c6e9f04 None None] Device 4b380ab6-f3ec-4e12-9a2a-b5a20828969d details requested by agent hyperv_hv-cinder-81901 with host hv-cinder-81901 {{(pid=102994) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Nov 23 19:34:09.272628 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7c0137c5-616d-43dd-b5fe-5ad18d6e098e req-b80f8023-f73d-4df6-8b40-72ed1b32bf25 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102992) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:34:09.274429 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-7c0137c5-616d-43dd-b5fe-5ad18d6e098e req-b80f8023-f73d-4df6-8b40-72ed1b32bf25 service neutron] 10.222.0.41 "GET /v2.0/ports?device_id=671f1d44-7752-4a9d-835d-4d76164c900f HTTP/1.1" status: 200 len: 1098 time: 0.2118919 Nov 23 19:34:09.279050 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-38c4e473-4c50-4e4f-b0ff-79dffcf50625 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:34:09.325649 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [req-7c0137c5-616d-43dd-b5fe-5ad18d6e098e req-45077b59-2823-4091-9ddc-16bb72dc3b98 service neutron] Publish callbacks [] for security_group, before_create {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:34:09.328630 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.plugins.ml2.rpc [None req-4bf48ff4-ecfb-4168-8b63-249b8c6e9f04 None None] Device 0a64c11d-0cb3-4c1e-aa45-5bcdf2771c8c up at agent hyperv_hv-cinder-81901 {{(pid=102994) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 23 19:34:09.352530 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-8fc4d131-a4b2-47ef-8f9a-12a12a426226 req-6b066dbf-1a94-48df-b49e-dff13b3e409b tempest-ServerRescueNegativeTestJSON-1447477341 tempest-ServerRescueNegativeTestJSON-1447477341-project] 10.222.0.62 "GET /v2.0/security-groups?id=62a09434-acf0-424f-9001-2c3a78119364&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1579976 Nov 23 19:34:09.353948 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [None req-aa5e22fa-4f48-4264-8b61-41e4b7545ce5 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:34:09.391117 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cd588dcc-ec9d-4b67-ad82-3d43c1972775 req-ade234e3-3a7b-4815-900f-41783c95971d tempest-DeleteServersTestJSON-453817978 tempest-DeleteServersTestJSON-453817978-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102993) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:34:09.394507 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [None req-aa5e22fa-4f48-4264-8b61-41e4b7545ce5 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:34:09.399447 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-cd588dcc-ec9d-4b67-ad82-3d43c1972775 req-ade234e3-3a7b-4815-900f-41783c95971d tempest-DeleteServersTestJSON-453817978 tempest-DeleteServersTestJSON-453817978-project] 10.222.0.62 "GET /v2.0/ports?device_id=5e3c1406-dc8c-414a-bcc5-55c7c963e1df HTTP/1.1" status: 200 len: 945 time: 0.0718529 Nov 23 19:34:09.423805 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.plugins.ml2.db [None req-4bf48ff4-ecfb-4168-8b63-249b8c6e9f04 None None] For port 4b380ab6-f3ec-4e12-9a2a-b5a20828969d, host hv-cinder-81901, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81901',level=0,port_id=4b380ab6-f3ec-4e12-9a2a-b5a20828969d,segment=NetworkSegment(b4453f21-ac7f-498c-8316-73b738820700),segment_id=b4453f21-ac7f-498c-8316-73b738820700)] {{(pid=102994) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 23 19:34:09.440034 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.plugins.ml2.rpc [None req-4bf48ff4-ecfb-4168-8b63-249b8c6e9f04 None None] Returning: {'device': '4b380ab6-f3ec-4e12-9a2a-b5a20828969d', 'network_id': 'fc901312-2937-4784-8a6d-c046666e8bf8', 'port_id': '4b380ab6-f3ec-4e12-9a2a-b5a20828969d', 'mac_address': 'fa:16:3e:c0:19:59', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 825, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '2caca985-6ed6-4ef7-ba49-7b7410bea160', 'ip_address': '172.20.0.7'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=102994) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Nov 23 19:34:09.460730 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-cd588dcc-ec9d-4b67-ad82-3d43c1972775 req-cc984874-16c0-4b40-8d6c-84f22e665dfa tempest-DeleteServersTestJSON-453817978 tempest-DeleteServersTestJSON-453817978-project] 10.222.0.62 "GET /v2.0/security-groups?id=5b5d5814-644d-45c2-ad35-f8920c3382b0&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0601993 Nov 23 19:34:09.487700 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron_lib.callbacks.manager [None req-4bf48ff4-ecfb-4168-8b63-249b8c6e9f04 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7921281'] for port, before_update {{(pid=102994) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:34:09.490517 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-38c4e473-4c50-4e4f-b0ff-79dffcf50625 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-623933'] for security_group, after_delete {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:34:09.493695 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [req-7c0137c5-616d-43dd-b5fe-5ad18d6e098e req-45077b59-2823-4091-9ddc-16bb72dc3b98 service neutron] Publish callbacks [] for security_group, precommit_create {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:34:09.494544 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-38c4e473-4c50-4e4f-b0ff-79dffcf50625 admin admin] Publish callbacks [] for security_group, before_response {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:34:09.496352 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [None req-38c4e473-4c50-4e4f-b0ff-79dffcf50625 admin admin] 10.222.0.62 "DELETE /v2.0/security-groups/935c32bf-bc0a-4e2c-9eba-8cef03759cd9 HTTP/1.1" status: 204 len: 168 time: 0.3520756 Nov 23 19:34:09.506319 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.notifiers.nova [None req-4bf48ff4-ecfb-4168-8b63-249b8c6e9f04 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 4b380ab6-f3ec-4e12-9a2a-b5a20828969d {{(pid=102994) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 23 19:34:09.514755 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-38c4e473-4c50-4e4f-b0ff-79dffcf50625 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=935c32bf-bc0a-4e2c-9eba-8cef03759cd9,revision_number=None']} {{(pid=102993) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 23 19:34:09.531185 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.plugins.ml2.db [None req-4bf48ff4-ecfb-4168-8b63-249b8c6e9f04 None None] For port 4b380ab6-f3ec-4e12-9a2a-b5a20828969d, host hv-cinder-81901, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81901',level=0,port_id=4b380ab6-f3ec-4e12-9a2a-b5a20828969d,segment=NetworkSegment(b4453f21-ac7f-498c-8316-73b738820700),segment_id=b4453f21-ac7f-498c-8316-73b738820700)] {{(pid=102994) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 23 19:34:09.541996 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.db.provisioning_blocks [None req-4bf48ff4-ecfb-4168-8b63-249b8c6e9f04 None None] Provisioning for port 0a64c11d-0cb3-4c1e-aa45-5bcdf2771c8c completed by entity L2. {{(pid=102994) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 23 19:34:09.546948 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.db.provisioning_blocks [None req-4bf48ff4-ecfb-4168-8b63-249b8c6e9f04 None None] Provisioning complete for port 0a64c11d-0cb3-4c1e-aa45-5bcdf2771c8c triggered by entity L2. {{(pid=102994) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 23 19:34:09.547404 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron_lib.callbacks.manager [None req-4bf48ff4-ecfb-4168-8b63-249b8c6e9f04 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-8355713'] for port, provisioning_complete {{(pid=102994) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:34:09.639220 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [req-7c0137c5-616d-43dd-b5fe-5ad18d6e098e req-45077b59-2823-4091-9ddc-16bb72dc3b98 service neutron] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-623933'] for security_group, after_create {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:34:09.676880 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [None req-aa5e22fa-4f48-4264-8b61-41e4b7545ce5 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-623933'] for security_group, after_delete {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:34:09.679955 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [None req-aa5e22fa-4f48-4264-8b61-41e4b7545ce5 admin admin] Publish callbacks [] for security_group, before_response {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:34:09.681140 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [None req-aa5e22fa-4f48-4264-8b61-41e4b7545ce5 admin admin] 10.222.0.62 "DELETE /v2.0/security-groups/c4db3a60-09d1-40fd-80d2-b2bb92282b7f HTTP/1.1" status: 204 len: 168 time: 0.4747746 Nov 23 19:34:09.696212 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-7c0137c5-616d-43dd-b5fe-5ad18d6e098e req-45077b59-2823-4091-9ddc-16bb72dc3b98 service neutron] 10.222.0.41 "GET /v2.0/security-groups?id=62a09434-acf0-424f-9001-2c3a78119364&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.4110601 Nov 23 19:34:09.700404 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-45077b59-2823-4091-9ddc-16bb72dc3b98 service neutron] Pushing event updated for resources: {'SecurityGroup': ['ID=3874e2a1-e42b-44e4-8a5d-c917af2a1fed,revision_number=1']} {{(pid=102992) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 23 19:34:09.707883 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-aa5e22fa-4f48-4264-8b61-41e4b7545ce5 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=c4db3a60-09d1-40fd-80d2-b2bb92282b7f,revision_number=None']} {{(pid=102992) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 23 19:34:09.725464 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron_lib.callbacks.manager [None req-4bf48ff4-ecfb-4168-8b63-249b8c6e9f04 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7918660', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-15067', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560168', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8783631423946', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8783631008732', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8783631008750'] for port, after_update {{(pid=102994) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:34:09.768650 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron_lib.callbacks.manager [None req-4bf48ff4-ecfb-4168-8b63-249b8c6e9f04 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7921281'] for port, before_update {{(pid=102994) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:34:09.811715 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4bf48ff4-ecfb-4168-8b63-249b8c6e9f04 None None] Pushing event updated for resources: {'Port': ['ID=4b380ab6-f3ec-4e12-9a2a-b5a20828969d,revision_number=4']} {{(pid=102994) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 23 19:34:09.822374 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.plugins.ml2.db [None req-4bf48ff4-ecfb-4168-8b63-249b8c6e9f04 None None] For port 0a64c11d-0cb3-4c1e-aa45-5bcdf2771c8c, host hv-cinder-81901, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81901',level=0,port_id=0a64c11d-0cb3-4c1e-aa45-5bcdf2771c8c,segment=NetworkSegment(b8302c34-e78d-4c43-9d45-a2604c95a2d2),segment_id=b8302c34-e78d-4c43-9d45-a2604c95a2d2)] {{(pid=102994) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 23 19:34:09.890764 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron_lib.callbacks.manager [None req-4bf48ff4-ecfb-4168-8b63-249b8c6e9f04 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7918660', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-15067', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560168', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8783631423946', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8783631008732', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8783631008750'] for port, after_update {{(pid=102994) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:34:09.945178 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4bf48ff4-ecfb-4168-8b63-249b8c6e9f04 None None] Pushing event updated for resources: {'Port': ['ID=0a64c11d-0cb3-4c1e-aa45-5bcdf2771c8c,revision_number=5']} {{(pid=102994) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 23 19:34:10.266229 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '5e3c1406-dc8c-414a-bcc5-55c7c963e1df', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '8c70d83a-558d-4a92-a3e8-15396107e64d'}, {'server_uuid': '90cb32bd-c375-400a-b79a-97fc61e2a3a3', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '0a64c11d-0cb3-4c1e-aa45-5bcdf2771c8c'}] {{(pid=102994) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 23 19:34:10.268566 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.62/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}09a7511da0d2ba1d728b27e36a8467ec5289399952f0059588048a7cb66d3a43" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-10fe5674-3736-4b2b-b8d2-83f59186fb31" -d '{"events": [{"server_uuid": "5e3c1406-dc8c-414a-bcc5-55c7c963e1df", "name": "network-vif-plugged", "status": "completed", "tag": "8c70d83a-558d-4a92-a3e8-15396107e64d"}, {"server_uuid": "90cb32bd-c375-400a-b79a-97fc61e2a3a3", "name": "network-vif-plugged", "status": "completed", "tag": "0a64c11d-0cb3-4c1e-aa45-5bcdf2771c8c"}]}' {{(pid=102994) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 23 19:34:10.326496 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 354 Content-Type: application/json Date: Tue, 23 Nov 2021 19:34:10 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-8e2477e0-e78a-4efe-975a-33396d5901b6 x-openstack-request-id: req-8e2477e0-e78a-4efe-975a-33396d5901b6 {{(pid=102994) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 23 19:34:10.326903 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "5e3c1406-dc8c-414a-bcc5-55c7c963e1df", "name": "network-vif-plugged", "status": "completed", "tag": "8c70d83a-558d-4a92-a3e8-15396107e64d", "code": 200}, {"server_uuid": "90cb32bd-c375-400a-b79a-97fc61e2a3a3", "name": "network-vif-plugged", "status": "completed", "tag": "0a64c11d-0cb3-4c1e-aa45-5bcdf2771c8c", "code": 200}]} {{(pid=102994) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 23 19:34:10.327248 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.62/compute/v2.1/os-server-external-events used request id req-8e2477e0-e78a-4efe-975a-33396d5901b6 {{(pid=102994) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 23 19:34:10.327714 dv-cinder-819011-1-iscsi neutron-server[102994]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '5e3c1406-dc8c-414a-bcc5-55c7c963e1df', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '8c70d83a-558d-4a92-a3e8-15396107e64d', 'code': 200} Nov 23 19:34:10.328053 dv-cinder-819011-1-iscsi neutron-server[102994]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '90cb32bd-c375-400a-b79a-97fc61e2a3a3', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '0a64c11d-0cb3-4c1e-aa45-5bcdf2771c8c', 'code': 200} Nov 23 19:34:10.378258 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a3fca7cd-6644-4a39-a3b8-7ad00a68f811 req-2a2edf84-0d98-4861-a1c8-9dc01b479e11 tempest-AttachVolumeShelveTestJSON-1172915835 tempest-AttachVolumeShelveTestJSON-1172915835-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102993) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:34:10.379735 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-a3fca7cd-6644-4a39-a3b8-7ad00a68f811 req-2a2edf84-0d98-4861-a1c8-9dc01b479e11 tempest-AttachVolumeShelveTestJSON-1172915835 tempest-AttachVolumeShelveTestJSON-1172915835-project] 10.222.0.62 "GET /v2.0/ports?device_id=85ea3d72-6c17-4ea2-82b7-90cce01633bd HTTP/1.1" status: 200 len: 944 time: 0.0504858 Nov 23 19:34:10.460990 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-a3fca7cd-6644-4a39-a3b8-7ad00a68f811 req-b896017a-1576-496e-b587-2ac2dd130bde tempest-AttachVolumeShelveTestJSON-1172915835 tempest-AttachVolumeShelveTestJSON-1172915835-project] 10.222.0.62 "GET /v2.0/security-groups?id=f1ca24d9-0a31-470d-a1d5-fa7059df0141&fields=id&fields=name HTTP/1.1" status: 200 len: 311 time: 0.0684497 Nov 23 19:34:10.534211 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2d5d5846-671e-437f-b52e-c3f0d29a1653 req-b8f02fb9-d00a-4e7d-ae50-8791ba2a8384 tempest-ServerRescueNegativeTestJSON-1447477341 tempest-ServerRescueNegativeTestJSON-1447477341-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102992) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:34:10.535968 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-2d5d5846-671e-437f-b52e-c3f0d29a1653 req-b8f02fb9-d00a-4e7d-ae50-8791ba2a8384 tempest-ServerRescueNegativeTestJSON-1447477341 tempest-ServerRescueNegativeTestJSON-1447477341-project] 10.222.0.62 "GET /v2.0/ports?device_id=90cb32bd-c375-400a-b79a-97fc61e2a3a3 HTTP/1.1" status: 200 len: 945 time: 0.0942309 Nov 23 19:34:10.603299 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-2d5d5846-671e-437f-b52e-c3f0d29a1653 req-47604df5-acd9-4a9b-8289-4b4318dfc6fa tempest-ServerRescueNegativeTestJSON-1447477341 tempest-ServerRescueNegativeTestJSON-1447477341-project] 10.222.0.62 "GET /v2.0/security-groups?id=62a09434-acf0-424f-9001-2c3a78119364&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0581095 Nov 23 19:34:10.632262 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6d5b5f70-ae68-4301-bf61-b2a430c6bf4d req-5e0c434b-db45-4bc1-bace-7fd1dd1a1416 tempest-DeleteServersTestJSON-453817978 tempest-DeleteServersTestJSON-453817978-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102993) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:34:10.633717 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-6d5b5f70-ae68-4301-bf61-b2a430c6bf4d req-5e0c434b-db45-4bc1-bace-7fd1dd1a1416 tempest-DeleteServersTestJSON-453817978 tempest-DeleteServersTestJSON-453817978-project] 10.222.0.62 "GET /v2.0/ports?device_id=5e3c1406-dc8c-414a-bcc5-55c7c963e1df HTTP/1.1" status: 200 len: 945 time: 0.0540307 Nov 23 19:34:10.688790 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-6d5b5f70-ae68-4301-bf61-b2a430c6bf4d req-0b6e5099-cd46-4d53-8aa1-5e17a8961923 tempest-DeleteServersTestJSON-453817978 tempest-DeleteServersTestJSON-453817978-project] 10.222.0.62 "GET /v2.0/security-groups?id=5b5d5814-644d-45c2-ad35-f8920c3382b0&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0490706 Nov 23 19:34:11.314738 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.wsgi [-] (102993) accepted ('10.222.0.62', 42282) {{(pid=102993) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 23 19:34:11.518481 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-fef5084f-bdbd-4deb-9b07-bc371d4fbc24 admin admin] Publish callbacks [] for security_group, before_create {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:34:11.597861 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-13744c1a-a2c1-4b3e-8dc1-a031efdf21ec req-f4a68957-51da-475a-8b02-06f1837ae82f tempest-AttachVolumeShelveTestJSON-1172915835 tempest-AttachVolumeShelveTestJSON-1172915835-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102992) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:34:11.601519 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-13744c1a-a2c1-4b3e-8dc1-a031efdf21ec req-f4a68957-51da-475a-8b02-06f1837ae82f tempest-AttachVolumeShelveTestJSON-1172915835 tempest-AttachVolumeShelveTestJSON-1172915835-project] 10.222.0.62 "GET /v2.0/ports?device_id=85ea3d72-6c17-4ea2-82b7-90cce01633bd HTTP/1.1" status: 200 len: 944 time: 0.0560200 Nov 23 19:34:11.601688 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-fef5084f-bdbd-4deb-9b07-bc371d4fbc24 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:34:11.661645 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-13744c1a-a2c1-4b3e-8dc1-a031efdf21ec req-0a32ce8a-6d22-4dad-ae5e-1662e82430b0 tempest-AttachVolumeShelveTestJSON-1172915835 tempest-AttachVolumeShelveTestJSON-1172915835-project] 10.222.0.62 "GET /v2.0/security-groups?id=f1ca24d9-0a31-470d-a1d5-fa7059df0141&fields=id&fields=name HTTP/1.1" status: 200 len: 311 time: 0.0529969 Nov 23 19:34:11.678600 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-fef5084f-bdbd-4deb-9b07-bc371d4fbc24 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-623933'] for security_group, after_create {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:34:11.732169 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron_lib.callbacks.manager [None req-a354bf83-466f-403f-bb1e-a689ac2d0a4a None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8783631323329', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7978582'] for agent, after_update {{(pid=102994) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:34:11.746894 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [None req-fef5084f-bdbd-4deb-9b07-bc371d4fbc24 admin admin] 10.222.0.62 "GET /v2.0/security-groups?tenant_id=782a8506433445c0b68f88fe585578f1&name=default HTTP/1.1" status: 200 len: 2996 time: 0.4309919 Nov 23 19:34:11.749626 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.wsgi [-] (102992) accepted ('10.222.0.62', 42304) {{(pid=102992) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 23 19:34:11.750742 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fef5084f-bdbd-4deb-9b07-bc371d4fbc24 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=a22a1697-1dcf-47d1-9593-1829d5dea030,revision_number=1']} {{(pid=102993) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 23 19:34:11.777244 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fde6bf30-1d46-4086-bc8c-01642cf1f786 req-9e97a1ba-8019-4a79-bddb-368561f52631 tempest-ServerRescueNegativeTestJSON-1447477341 tempest-ServerRescueNegativeTestJSON-1447477341-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102993) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:34:11.778972 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-fde6bf30-1d46-4086-bc8c-01642cf1f786 req-9e97a1ba-8019-4a79-bddb-368561f52631 tempest-ServerRescueNegativeTestJSON-1447477341 tempest-ServerRescueNegativeTestJSON-1447477341-project] 10.222.0.62 "GET /v2.0/ports?device_id=90cb32bd-c375-400a-b79a-97fc61e2a3a3 HTTP/1.1" status: 200 len: 945 time: 0.1053071 Nov 23 19:34:11.838948 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-fde6bf30-1d46-4086-bc8c-01642cf1f786 req-5de33da5-1e5e-48ba-852e-5bf198748ed6 tempest-ServerRescueNegativeTestJSON-1447477341 tempest-ServerRescueNegativeTestJSON-1447477341-project] 10.222.0.62 "GET /v2.0/security-groups?id=62a09434-acf0-424f-9001-2c3a78119364&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0536075 Nov 23 19:34:11.846286 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-049a8eb2-c655-4af8-b989-05afc77593ab req-2f131066-8271-416a-9299-cbee62e40c84 tempest-DeleteServersTestJSON-453817978 tempest-DeleteServersTestJSON-453817978-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102992) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:34:11.849922 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-049a8eb2-c655-4af8-b989-05afc77593ab req-2f131066-8271-416a-9299-cbee62e40c84 tempest-DeleteServersTestJSON-453817978 tempest-DeleteServersTestJSON-453817978-project] 10.222.0.62 "GET /v2.0/ports?device_id=5e3c1406-dc8c-414a-bcc5-55c7c963e1df HTTP/1.1" status: 200 len: 945 time: 0.0810931 Nov 23 19:34:11.872373 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [None req-314db443-4806-477a-a0c5-60e92c3ea428 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:34:11.925781 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [None req-314db443-4806-477a-a0c5-60e92c3ea428 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:34:11.942745 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-049a8eb2-c655-4af8-b989-05afc77593ab req-3b6c156c-ab7d-4036-8388-207593d810da tempest-DeleteServersTestJSON-453817978 tempest-DeleteServersTestJSON-453817978-project] 10.222.0.62 "GET /v2.0/security-groups?id=5b5d5814-644d-45c2-ad35-f8920c3382b0&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0885687 Nov 23 19:34:12.044784 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [None req-314db443-4806-477a-a0c5-60e92c3ea428 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-623933'] for security_group, after_delete {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:34:12.047575 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [None req-314db443-4806-477a-a0c5-60e92c3ea428 admin admin] Publish callbacks [] for security_group, before_response {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:34:12.048746 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [None req-314db443-4806-477a-a0c5-60e92c3ea428 admin admin] 10.222.0.62 "DELETE /v2.0/security-groups/a22a1697-1dcf-47d1-9593-1829d5dea030 HTTP/1.1" status: 204 len: 168 time: 0.2977204 Nov 23 19:34:12.058952 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-314db443-4806-477a-a0c5-60e92c3ea428 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=a22a1697-1dcf-47d1-9593-1829d5dea030,revision_number=None']} {{(pid=102992) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 23 19:34:12.790848 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-de59ad91-5fb9-48ed-ab1a-342a023c668b req-777d4429-72ea-41d5-9404-925626ff3da6 tempest-AttachVolumeShelveTestJSON-1172915835 tempest-AttachVolumeShelveTestJSON-1172915835-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102993) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:34:12.792984 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-de59ad91-5fb9-48ed-ab1a-342a023c668b req-777d4429-72ea-41d5-9404-925626ff3da6 tempest-AttachVolumeShelveTestJSON-1172915835 tempest-AttachVolumeShelveTestJSON-1172915835-project] 10.222.0.62 "GET /v2.0/ports?device_id=85ea3d72-6c17-4ea2-82b7-90cce01633bd HTTP/1.1" status: 200 len: 944 time: 0.0572619 Nov 23 19:34:12.840160 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-de59ad91-5fb9-48ed-ab1a-342a023c668b req-5da1023c-f548-44dd-8e01-ce5227c78276 tempest-AttachVolumeShelveTestJSON-1172915835 tempest-AttachVolumeShelveTestJSON-1172915835-project] 10.222.0.62 "GET /v2.0/security-groups?id=f1ca24d9-0a31-470d-a1d5-fa7059df0141&fields=id&fields=name HTTP/1.1" status: 200 len: 311 time: 0.0412500 Nov 23 19:34:12.965204 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.plugins.ml2.db [None req-4bf48ff4-ecfb-4168-8b63-249b8c6e9f04 None None] get_ports_and_sgs() called for port_ids ['4b380ab6-f3ec-4e12-9a2a-b5a20828969d'] {{(pid=102994) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 23 19:34:13.015083 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e7e91650-b618-42a1-99a5-34c99b85349f req-9f351968-67e7-4ad0-a01a-c73152355047 tempest-ServerRescueNegativeTestJSON-1447477341 tempest-ServerRescueNegativeTestJSON-1447477341-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102992) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:34:13.016956 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-e7e91650-b618-42a1-99a5-34c99b85349f req-9f351968-67e7-4ad0-a01a-c73152355047 tempest-ServerRescueNegativeTestJSON-1447477341 tempest-ServerRescueNegativeTestJSON-1447477341-project] 10.222.0.62 "GET /v2.0/ports?device_id=90cb32bd-c375-400a-b79a-97fc61e2a3a3 HTTP/1.1" status: 200 len: 945 time: 0.1029022 Nov 23 19:34:13.092012 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-e7e91650-b618-42a1-99a5-34c99b85349f req-24fa7e5e-d610-48e7-b4d3-a34a2df2ee9b tempest-ServerRescueNegativeTestJSON-1447477341 tempest-ServerRescueNegativeTestJSON-1447477341-project] 10.222.0.62 "GET /v2.0/security-groups?id=62a09434-acf0-424f-9001-2c3a78119364&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0681069 Nov 23 19:34:13.097733 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a3ea5830-48ec-4e3d-84b1-466cec86376f req-98d0440a-62f7-4c44-8eb6-264feeef5cff tempest-DeleteServersTestJSON-453817978 tempest-DeleteServersTestJSON-453817978-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102993) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:34:13.099892 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-a3ea5830-48ec-4e3d-84b1-466cec86376f req-98d0440a-62f7-4c44-8eb6-264feeef5cff tempest-DeleteServersTestJSON-453817978 tempest-DeleteServersTestJSON-453817978-project] 10.222.0.62 "GET /v2.0/ports?device_id=5e3c1406-dc8c-414a-bcc5-55c7c963e1df HTTP/1.1" status: 200 len: 945 time: 0.0574362 Nov 23 19:34:13.179091 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-a3ea5830-48ec-4e3d-84b1-466cec86376f req-5e08e17c-a6b5-465d-b582-35ddecd6e15b tempest-DeleteServersTestJSON-453817978 tempest-DeleteServersTestJSON-453817978-project] 10.222.0.62 "GET /v2.0/security-groups?id=5b5d5814-644d-45c2-ad35-f8920c3382b0&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0669639 Nov 23 19:34:13.280186 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.wsgi [-] (102993) accepted ('10.222.0.62', 42376) {{(pid=102993) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 23 19:34:13.289386 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f1ae687c-f646-4bd1-bd3c-f79c325c8799 req-55272813-e5b3-48a7-8d00-9b68af7ca2e4 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102992) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:34:13.291254 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-f1ae687c-f646-4bd1-bd3c-f79c325c8799 req-55272813-e5b3-48a7-8d00-9b68af7ca2e4 service neutron] 10.222.0.41 "GET /v2.0/ports?device_id=90cb32bd-c375-400a-b79a-97fc61e2a3a3 HTTP/1.1" status: 200 len: 1098 time: 0.0462136 Nov 23 19:34:13.375560 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-f1ae687c-f646-4bd1-bd3c-f79c325c8799 req-8baef08e-5deb-45de-9feb-8c2f4d210634 service neutron] 10.222.0.41 "GET /v2.0/security-groups?id=62a09434-acf0-424f-9001-2c3a78119364&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0702291 Nov 23 19:34:13.394420 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b52e404a-8fcb-4bbb-b4ef-c7f13f269da4 req-c20174cd-34cd-4d06-91d3-0109235768b8 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102993) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:34:13.395925 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-b52e404a-8fcb-4bbb-b4ef-c7f13f269da4 req-c20174cd-34cd-4d06-91d3-0109235768b8 service neutron] 10.222.0.41 "GET /v2.0/ports?device_id=5e3c1406-dc8c-414a-bcc5-55c7c963e1df HTTP/1.1" status: 200 len: 1098 time: 0.0910141 Nov 23 19:34:13.420468 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-65fcebab-140a-4273-afdd-da7a715dbbde admin admin] Publish callbacks [] for security_group, before_create {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:34:13.499906 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-65fcebab-140a-4273-afdd-da7a715dbbde admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:34:13.570676 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-65fcebab-140a-4273-afdd-da7a715dbbde admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-623933'] for security_group, after_create {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:34:13.610436 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [None req-65fcebab-140a-4273-afdd-da7a715dbbde admin admin] 10.222.0.62 "GET /v2.0/security-groups?tenant_id=a9f1ee8eeb854e37bdd20f9562452350&name=default HTTP/1.1" status: 200 len: 2996 time: 0.3282390 Nov 23 19:34:13.613517 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.wsgi [-] (102992) accepted ('10.222.0.62', 42388) {{(pid=102992) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 23 19:34:13.617619 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-65fcebab-140a-4273-afdd-da7a715dbbde admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=5013de38-37e4-4709-86d9-fbbba32ab915,revision_number=1']} {{(pid=102993) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 23 19:34:13.660157 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-b52e404a-8fcb-4bbb-b4ef-c7f13f269da4 req-135a1161-4205-4285-8c46-4f59f66810d4 service neutron] 10.222.0.41 "GET /v2.0/security-groups?id=5b5d5814-644d-45c2-ad35-f8920c3382b0&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0524738 Nov 23 19:34:13.677889 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [None req-66601829-a6e6-4a6c-9d19-c23e23f0efb7 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:34:13.700299 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [None req-66601829-a6e6-4a6c-9d19-c23e23f0efb7 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:34:13.825328 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [None req-66601829-a6e6-4a6c-9d19-c23e23f0efb7 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-623933'] for security_group, after_delete {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:34:13.825328 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [None req-66601829-a6e6-4a6c-9d19-c23e23f0efb7 admin admin] Publish callbacks [] for security_group, before_response {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:34:13.825328 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [None req-66601829-a6e6-4a6c-9d19-c23e23f0efb7 admin admin] 10.222.0.62 "DELETE /v2.0/security-groups/5013de38-37e4-4709-86d9-fbbba32ab915 HTTP/1.1" status: 204 len: 168 time: 0.1953192 Nov 23 19:34:13.825328 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-66601829-a6e6-4a6c-9d19-c23e23f0efb7 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=5013de38-37e4-4709-86d9-fbbba32ab915,revision_number=None']} {{(pid=102992) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 23 19:34:13.969485 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b17b4d84-41ec-4376-9a3f-573ae18bbb46 req-54c818ae-d708-4813-a90e-b592ba44b3b2 tempest-AttachVolumeShelveTestJSON-1172915835 tempest-AttachVolumeShelveTestJSON-1172915835-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102992) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:34:13.971108 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-b17b4d84-41ec-4376-9a3f-573ae18bbb46 req-54c818ae-d708-4813-a90e-b592ba44b3b2 tempest-AttachVolumeShelveTestJSON-1172915835 tempest-AttachVolumeShelveTestJSON-1172915835-project] 10.222.0.62 "GET /v2.0/ports?device_id=85ea3d72-6c17-4ea2-82b7-90cce01633bd HTTP/1.1" status: 200 len: 944 time: 0.0502775 Nov 23 19:34:14.029000 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-b17b4d84-41ec-4376-9a3f-573ae18bbb46 req-12d05bb9-7e75-48c8-a088-1941870667e5 tempest-AttachVolumeShelveTestJSON-1172915835 tempest-AttachVolumeShelveTestJSON-1172915835-project] 10.222.0.62 "GET /v2.0/security-groups?id=f1ca24d9-0a31-470d-a1d5-fa7059df0141&fields=id&fields=name HTTP/1.1" status: 200 len: 311 time: 0.0460949 Nov 23 19:34:14.176536 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron_lib.callbacks.manager [None req-ff8bc01e-43c1-4975-9b49-73583e18b743 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8783631323329', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7978582'] for agent, after_update {{(pid=102994) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:34:14.258229 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b8ca1d3a-31ab-4654-8299-eaf2e6ae429f req-8f77f8e7-6df6-4c35-a270-31181f796a75 tempest-ServerRescueNegativeTestJSON-1447477341 tempest-ServerRescueNegativeTestJSON-1447477341-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102993) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:34:14.268366 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-b8ca1d3a-31ab-4654-8299-eaf2e6ae429f req-8f77f8e7-6df6-4c35-a270-31181f796a75 tempest-ServerRescueNegativeTestJSON-1447477341 tempest-ServerRescueNegativeTestJSON-1447477341-project] 10.222.0.62 "GET /v2.0/ports?device_id=90cb32bd-c375-400a-b79a-97fc61e2a3a3 HTTP/1.1" status: 200 len: 945 time: 0.0967979 Nov 23 19:34:14.320055 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6e1ffe88-5ccc-4a11-9061-4891a682e744 req-e6fab25a-0d4d-4c49-b3c4-3d37775639c0 tempest-DeleteServersTestJSON-453817978 tempest-DeleteServersTestJSON-453817978-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102992) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:34:14.321260 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-b8ca1d3a-31ab-4654-8299-eaf2e6ae429f req-683e7d66-b157-4b17-a18b-142440d02884 tempest-ServerRescueNegativeTestJSON-1447477341 tempest-ServerRescueNegativeTestJSON-1447477341-project] 10.222.0.62 "GET /v2.0/security-groups?id=62a09434-acf0-424f-9001-2c3a78119364&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0548465 Nov 23 19:34:14.323832 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-6e1ffe88-5ccc-4a11-9061-4891a682e744 req-e6fab25a-0d4d-4c49-b3c4-3d37775639c0 tempest-DeleteServersTestJSON-453817978 tempest-DeleteServersTestJSON-453817978-project] 10.222.0.62 "GET /v2.0/ports?device_id=5e3c1406-dc8c-414a-bcc5-55c7c963e1df HTTP/1.1" status: 200 len: 945 time: 0.0716245 Nov 23 19:34:14.370545 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-6e1ffe88-5ccc-4a11-9061-4891a682e744 req-642a24be-f772-490c-833c-63b1fc4ff5f9 tempest-DeleteServersTestJSON-453817978 tempest-DeleteServersTestJSON-453817978-project] 10.222.0.62 "GET /v2.0/security-groups?id=5b5d5814-644d-45c2-ad35-f8920c3382b0&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0425990 Nov 23 19:34:14.479876 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.wsgi [-] (102993) accepted ('10.222.0.62', 42426) {{(pid=102993) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 23 19:34:14.495777 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-26829507-3c56-4f49-8400-c111bc066a29 admin admin] Publish callbacks [] for security_group, before_create {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:34:14.590910 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-26829507-3c56-4f49-8400-c111bc066a29 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:34:14.641644 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.plugins.ml2.rpc [None req-4bf48ff4-ecfb-4168-8b63-249b8c6e9f04 None None] Device 4b380ab6-f3ec-4e12-9a2a-b5a20828969d up at agent hyperv_hv-cinder-81901 {{(pid=102994) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 23 19:34:14.656066 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-26829507-3c56-4f49-8400-c111bc066a29 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-623933'] for security_group, after_create {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:34:14.695109 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [None req-26829507-3c56-4f49-8400-c111bc066a29 admin admin] 10.222.0.62 "GET /v2.0/security-groups?tenant_id=b86e869ee9404677ad2ec024eab2c81a&name=default HTTP/1.1" status: 200 len: 2996 time: 0.2140455 Nov 23 19:34:14.697967 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.wsgi [-] (102992) accepted ('10.222.0.62', 42438) {{(pid=102992) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 23 19:34:14.700641 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-26829507-3c56-4f49-8400-c111bc066a29 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=91b80d4b-4280-4a28-b30e-483b3921c024,revision_number=1']} {{(pid=102993) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 23 19:34:14.750587 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [None req-2ba2b2df-7fd2-4830-b3f4-d1c866e364ef admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:34:14.771193 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [None req-2ba2b2df-7fd2-4830-b3f4-d1c866e364ef admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:34:14.781909 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.db.provisioning_blocks [None req-4bf48ff4-ecfb-4168-8b63-249b8c6e9f04 None None] Provisioning for port 4b380ab6-f3ec-4e12-9a2a-b5a20828969d completed by entity L2. {{(pid=102994) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 23 19:34:14.791679 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.db.provisioning_blocks [None req-4bf48ff4-ecfb-4168-8b63-249b8c6e9f04 None None] Provisioning complete for port 4b380ab6-f3ec-4e12-9a2a-b5a20828969d triggered by entity L2. {{(pid=102994) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 23 19:34:14.792407 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron_lib.callbacks.manager [None req-4bf48ff4-ecfb-4168-8b63-249b8c6e9f04 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-8355713'] for port, provisioning_complete {{(pid=102994) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:34:14.879306 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron_lib.callbacks.manager [None req-4bf48ff4-ecfb-4168-8b63-249b8c6e9f04 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7921281'] for port, before_update {{(pid=102994) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:34:14.901966 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '85ea3d72-6c17-4ea2-82b7-90cce01633bd', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '4b380ab6-f3ec-4e12-9a2a-b5a20828969d'}] {{(pid=102994) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 23 19:34:14.904181 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.62/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}09a7511da0d2ba1d728b27e36a8467ec5289399952f0059588048a7cb66d3a43" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-3c1fff4b-5e08-4b86-8101-790012784ca5" -d '{"events": [{"server_uuid": "85ea3d72-6c17-4ea2-82b7-90cce01633bd", "name": "network-vif-plugged", "status": "completed", "tag": "4b380ab6-f3ec-4e12-9a2a-b5a20828969d"}]}' {{(pid=102994) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 23 19:34:14.917339 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.plugins.ml2.db [None req-4bf48ff4-ecfb-4168-8b63-249b8c6e9f04 None None] For port 4b380ab6-f3ec-4e12-9a2a-b5a20828969d, host hv-cinder-81901, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81901',level=0,port_id=4b380ab6-f3ec-4e12-9a2a-b5a20828969d,segment=NetworkSegment(b4453f21-ac7f-498c-8316-73b738820700),segment_id=b4453f21-ac7f-498c-8316-73b738820700)] {{(pid=102994) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 23 19:34:14.921185 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [None req-2ba2b2df-7fd2-4830-b3f4-d1c866e364ef admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-623933'] for security_group, after_delete {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:34:14.924011 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [None req-2ba2b2df-7fd2-4830-b3f4-d1c866e364ef admin admin] Publish callbacks [] for security_group, before_response {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:34:14.925164 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [None req-2ba2b2df-7fd2-4830-b3f4-d1c866e364ef admin admin] 10.222.0.62 "DELETE /v2.0/security-groups/91b80d4b-4280-4a28-b30e-483b3921c024 HTTP/1.1" status: 204 len: 168 time: 0.2255077 Nov 23 19:34:14.935720 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2ba2b2df-7fd2-4830-b3f4-d1c866e364ef admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=91b80d4b-4280-4a28-b30e-483b3921c024,revision_number=None']} {{(pid=102992) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 23 19:34:14.952704 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 23 Nov 2021 19:34:14 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-2a94c430-4941-4688-b529-9651b98540a9 x-openstack-request-id: req-2a94c430-4941-4688-b529-9651b98540a9 {{(pid=102994) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 23 19:34:14.953023 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "85ea3d72-6c17-4ea2-82b7-90cce01633bd", "name": "network-vif-plugged", "status": "completed", "tag": "4b380ab6-f3ec-4e12-9a2a-b5a20828969d", "code": 200}]} {{(pid=102994) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 23 19:34:14.953285 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.62/compute/v2.1/os-server-external-events used request id req-2a94c430-4941-4688-b529-9651b98540a9 {{(pid=102994) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 23 19:34:14.953711 dv-cinder-819011-1-iscsi neutron-server[102994]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '85ea3d72-6c17-4ea2-82b7-90cce01633bd', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '4b380ab6-f3ec-4e12-9a2a-b5a20828969d', 'code': 200} Nov 23 19:34:15.011384 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron_lib.callbacks.manager [None req-4bf48ff4-ecfb-4168-8b63-249b8c6e9f04 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7918660', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-15067', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560168', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8783631423946', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8783631008732', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8783631008750'] for port, after_update {{(pid=102994) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:34:15.047550 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron_lib.callbacks.manager [None req-8346ef05-f685-4c3d-af3d-a159b683bec2 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8783631323329', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7978582'] for agent, after_update {{(pid=102994) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:34:15.062425 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4bf48ff4-ecfb-4168-8b63-249b8c6e9f04 None None] Pushing event updated for resources: {'Port': ['ID=4b380ab6-f3ec-4e12-9a2a-b5a20828969d,revision_number=5']} {{(pid=102994) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 23 19:34:15.166264 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-af6694cb-d98d-4c25-9368-9758787d2335 req-ce40e43f-7500-46f8-8e01-46df6dc62985 tempest-AttachVolumeShelveTestJSON-1172915835 tempest-AttachVolumeShelveTestJSON-1172915835-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102992) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:34:15.167904 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-af6694cb-d98d-4c25-9368-9758787d2335 req-ce40e43f-7500-46f8-8e01-46df6dc62985 tempest-AttachVolumeShelveTestJSON-1172915835 tempest-AttachVolumeShelveTestJSON-1172915835-project] 10.222.0.62 "GET /v2.0/ports?device_id=85ea3d72-6c17-4ea2-82b7-90cce01633bd HTTP/1.1" status: 200 len: 945 time: 0.0554225 Nov 23 19:34:15.225665 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-af6694cb-d98d-4c25-9368-9758787d2335 req-a5228249-8c43-44b1-84bf-c41f32a988c2 tempest-AttachVolumeShelveTestJSON-1172915835 tempest-AttachVolumeShelveTestJSON-1172915835-project] 10.222.0.62 "GET /v2.0/security-groups?id=f1ca24d9-0a31-470d-a1d5-fa7059df0141&fields=id&fields=name HTTP/1.1" status: 200 len: 311 time: 0.0512798 Nov 23 19:34:15.305625 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7d5b64cd-494e-4c0a-8db6-f46ad552366c req-744e23ca-e033-40fa-87c4-ed5ea601d137 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102993) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:34:15.307107 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-7d5b64cd-494e-4c0a-8db6-f46ad552366c req-744e23ca-e033-40fa-87c4-ed5ea601d137 service neutron] 10.222.0.41 "GET /v2.0/ports?device_id=85ea3d72-6c17-4ea2-82b7-90cce01633bd HTTP/1.1" status: 200 len: 1098 time: 0.0495837 Nov 23 19:34:15.369251 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-7d5b64cd-494e-4c0a-8db6-f46ad552366c req-0447d8ff-5f92-4f10-8c8e-2b8bb090887d service neutron] 10.222.0.41 "GET /v2.0/security-groups?id=f1ca24d9-0a31-470d-a1d5-fa7059df0141&fields=id&fields=name HTTP/1.1" status: 200 len: 311 time: 0.0473306 Nov 23 19:34:15.475668 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b7ae482c-3904-4e4f-b687-78e2e8f491b0 req-6ae0bbed-611c-47a7-ba41-0be6681a00dd tempest-ServerRescueNegativeTestJSON-1447477341 tempest-ServerRescueNegativeTestJSON-1447477341-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102993) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:34:15.477162 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-b7ae482c-3904-4e4f-b687-78e2e8f491b0 req-6ae0bbed-611c-47a7-ba41-0be6681a00dd tempest-ServerRescueNegativeTestJSON-1447477341 tempest-ServerRescueNegativeTestJSON-1447477341-project] 10.222.0.62 "GET /v2.0/ports?device_id=90cb32bd-c375-400a-b79a-97fc61e2a3a3 HTTP/1.1" status: 200 len: 945 time: 0.0659177 Nov 23 19:34:15.514887 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bf20e2c7-965e-4702-9f39-7f0ce889e94f req-bae1521a-02fe-4c0a-8a32-bde3c8af5408 tempest-DeleteServersTestJSON-453817978 tempest-DeleteServersTestJSON-453817978-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102992) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:34:15.516438 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-bf20e2c7-965e-4702-9f39-7f0ce889e94f req-bae1521a-02fe-4c0a-8a32-bde3c8af5408 tempest-DeleteServersTestJSON-453817978 tempest-DeleteServersTestJSON-453817978-project] 10.222.0.62 "GET /v2.0/ports?device_id=5e3c1406-dc8c-414a-bcc5-55c7c963e1df HTTP/1.1" status: 200 len: 945 time: 0.0649216 Nov 23 19:34:15.552280 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-b7ae482c-3904-4e4f-b687-78e2e8f491b0 req-edaccb6e-e5eb-4ee6-8df8-03b6d45ee7a3 tempest-ServerRescueNegativeTestJSON-1447477341 tempest-ServerRescueNegativeTestJSON-1447477341-project] 10.222.0.62 "GET /v2.0/security-groups?id=62a09434-acf0-424f-9001-2c3a78119364&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0690951 Nov 23 19:34:15.583372 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-bf20e2c7-965e-4702-9f39-7f0ce889e94f req-aaef7836-425e-44b9-8c81-968ff4397ec3 tempest-DeleteServersTestJSON-453817978 tempest-DeleteServersTestJSON-453817978-project] 10.222.0.62 "GET /v2.0/security-groups?id=5b5d5814-644d-45c2-ad35-f8920c3382b0&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0556312 Nov 23 19:34:16.355182 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-266b1b90-5828-4448-ba9d-726045b4cf87 req-0e897ad3-8474-47e5-a92b-f65e3e7fcbcc tempest-AttachVolumeShelveTestJSON-1172915835 tempest-AttachVolumeShelveTestJSON-1172915835-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102993) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:34:16.356802 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-266b1b90-5828-4448-ba9d-726045b4cf87 req-0e897ad3-8474-47e5-a92b-f65e3e7fcbcc tempest-AttachVolumeShelveTestJSON-1172915835 tempest-AttachVolumeShelveTestJSON-1172915835-project] 10.222.0.62 "GET /v2.0/ports?device_id=85ea3d72-6c17-4ea2-82b7-90cce01633bd HTTP/1.1" status: 200 len: 945 time: 0.0525026 Nov 23 19:34:16.406006 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-266b1b90-5828-4448-ba9d-726045b4cf87 req-92a95346-c2bc-4648-8be8-e0cba8639117 tempest-AttachVolumeShelveTestJSON-1172915835 tempest-AttachVolumeShelveTestJSON-1172915835-project] 10.222.0.62 "GET /v2.0/security-groups?id=f1ca24d9-0a31-470d-a1d5-fa7059df0141&fields=id&fields=name HTTP/1.1" status: 200 len: 311 time: 0.0430388 Nov 23 19:34:16.536642 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron_lib.callbacks.manager [None req-785c1d26-11ba-42d8-b5a6-51a8b3daeef0 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8783631323329', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7978582'] for agent, after_update {{(pid=102994) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:34:16.688793 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fe1535e4-74fb-4af3-9aa8-9271c0f0a7b5 req-127161f4-934d-43d8-be91-3a1723ef6468 tempest-ServerRescueNegativeTestJSON-1447477341 tempest-ServerRescueNegativeTestJSON-1447477341-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102992) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:34:16.699873 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-fe1535e4-74fb-4af3-9aa8-9271c0f0a7b5 req-127161f4-934d-43d8-be91-3a1723ef6468 tempest-ServerRescueNegativeTestJSON-1447477341 tempest-ServerRescueNegativeTestJSON-1447477341-project] 10.222.0.62 "GET /v2.0/ports?device_id=90cb32bd-c375-400a-b79a-97fc61e2a3a3 HTTP/1.1" status: 200 len: 945 time: 0.0756192 Nov 23 19:34:16.725873 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ed2689c3-0f5c-4191-b0c6-88c848d62440 req-c7c0c117-302f-4adf-8610-d4abb75b5f77 tempest-DeleteServersTestJSON-453817978 tempest-DeleteServersTestJSON-453817978-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102993) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:34:16.727921 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-ed2689c3-0f5c-4191-b0c6-88c848d62440 req-c7c0c117-302f-4adf-8610-d4abb75b5f77 tempest-DeleteServersTestJSON-453817978 tempest-DeleteServersTestJSON-453817978-project] 10.222.0.62 "GET /v2.0/ports?device_id=5e3c1406-dc8c-414a-bcc5-55c7c963e1df HTTP/1.1" status: 200 len: 945 time: 0.0628662 Nov 23 19:34:16.755042 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-fe1535e4-74fb-4af3-9aa8-9271c0f0a7b5 req-900a1e3b-205a-4646-9754-b8c118f0dcab tempest-ServerRescueNegativeTestJSON-1447477341 tempest-ServerRescueNegativeTestJSON-1447477341-project] 10.222.0.62 "GET /v2.0/security-groups?id=62a09434-acf0-424f-9001-2c3a78119364&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0542269 Nov 23 19:34:16.792317 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-ed2689c3-0f5c-4191-b0c6-88c848d62440 req-f3367211-eb54-4bc5-b56c-0bfafb9586db tempest-DeleteServersTestJSON-453817978 tempest-DeleteServersTestJSON-453817978-project] 10.222.0.62 "GET /v2.0/security-groups?id=5b5d5814-644d-45c2-ad35-f8920c3382b0&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0586717 Nov 23 19:34:17.299820 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron_lib.callbacks.manager [None req-eb87b2c3-3339-4249-8b85-e695b5b4e1f9 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8783631323329', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7978582'] for agent, after_update {{(pid=102994) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:34:17.352206 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-616fb62f-e250-468e-bf16-fbaf197cd35a req-5382c91b-e41b-4719-b877-3257428e7309 tempest-ServerRescueNegativeTestJSON-1447477341 tempest-ServerRescueNegativeTestJSON-1447477341-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102993) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:34:17.353695 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-616fb62f-e250-468e-bf16-fbaf197cd35a req-5382c91b-e41b-4719-b877-3257428e7309 tempest-ServerRescueNegativeTestJSON-1447477341 tempest-ServerRescueNegativeTestJSON-1447477341-project] 10.222.0.62 "GET /v2.0/ports?device_id=90cb32bd-c375-400a-b79a-97fc61e2a3a3 HTTP/1.1" status: 200 len: 945 time: 0.0571697 Nov 23 19:34:17.405209 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-616fb62f-e250-468e-bf16-fbaf197cd35a req-d4b1ddf9-f17d-40a6-9649-f16b51a564a9 tempest-ServerRescueNegativeTestJSON-1447477341 tempest-ServerRescueNegativeTestJSON-1447477341-project] 10.222.0.62 "GET /v2.0/security-groups?id=62a09434-acf0-424f-9001-2c3a78119364&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0419416 Nov 23 19:34:17.533453 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fa975008-b719-4f73-8fb8-2bab29669dbe req-10320f8e-9694-4ee4-9bc2-04f5151dd31e tempest-AttachVolumeShelveTestJSON-1172915835 tempest-AttachVolumeShelveTestJSON-1172915835-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102992) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:34:17.535064 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-fa975008-b719-4f73-8fb8-2bab29669dbe req-10320f8e-9694-4ee4-9bc2-04f5151dd31e tempest-AttachVolumeShelveTestJSON-1172915835 tempest-AttachVolumeShelveTestJSON-1172915835-project] 10.222.0.62 "GET /v2.0/ports?device_id=85ea3d72-6c17-4ea2-82b7-90cce01633bd HTTP/1.1" status: 200 len: 945 time: 0.0490537 Nov 23 19:34:17.581867 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-fa975008-b719-4f73-8fb8-2bab29669dbe req-04ed6c1d-65ee-468f-83c6-bf6f373935e2 tempest-AttachVolumeShelveTestJSON-1172915835 tempest-AttachVolumeShelveTestJSON-1172915835-project] 10.222.0.62 "GET /v2.0/security-groups?id=f1ca24d9-0a31-470d-a1d5-fa7059df0141&fields=id&fields=name HTTP/1.1" status: 200 len: 311 time: 0.0404172 Nov 23 19:34:17.699829 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.wsgi [-] (102992) accepted ('10.222.0.62', 42588) {{(pid=102992) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 23 19:34:17.823846 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [None req-ffc2529c-565b-4b4d-aa38-11111e62cdce admin admin] Publish callbacks [] for security_group, before_create {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:34:17.899879 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [None req-ffc2529c-565b-4b4d-aa38-11111e62cdce admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:34:17.919605 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d41889a4-d23b-4519-8938-d8f69b836e54 req-e1ed3736-c59d-41e7-b532-feb42747e26c tempest-DeleteServersTestJSON-453817978 tempest-DeleteServersTestJSON-453817978-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102993) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:34:17.921171 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-d41889a4-d23b-4519-8938-d8f69b836e54 req-e1ed3736-c59d-41e7-b532-feb42747e26c tempest-DeleteServersTestJSON-453817978 tempest-DeleteServersTestJSON-453817978-project] 10.222.0.62 "GET /v2.0/ports?device_id=5e3c1406-dc8c-414a-bcc5-55c7c963e1df HTTP/1.1" status: 200 len: 945 time: 0.0505893 Nov 23 19:34:17.953072 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [None req-ffc2529c-565b-4b4d-aa38-11111e62cdce admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-623933'] for security_group, after_create {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:34:17.976096 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-d41889a4-d23b-4519-8938-d8f69b836e54 req-990d8f63-5fb5-461c-9b52-75d1db4ca2e1 tempest-DeleteServersTestJSON-453817978 tempest-DeleteServersTestJSON-453817978-project] 10.222.0.62 "GET /v2.0/security-groups?id=5b5d5814-644d-45c2-ad35-f8920c3382b0&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0487354 Nov 23 19:34:17.992554 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [None req-ffc2529c-565b-4b4d-aa38-11111e62cdce admin admin] 10.222.0.62 "GET /v2.0/security-groups?tenant_id=cbf01f9dce2e4734b7cd7574cf1820ce&name=default HTTP/1.1" status: 200 len: 2996 time: 0.2913163 Nov 23 19:34:17.993683 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ffc2529c-565b-4b4d-aa38-11111e62cdce admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=79e75aa3-207d-47e7-b165-964a29da9e62,revision_number=1']} {{(pid=102992) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 23 19:34:17.995226 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.wsgi [-] (102993) accepted ('10.222.0.62', 42598) {{(pid=102993) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 23 19:34:18.045914 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-e46ffe6f-112c-45ae-b00f-a8e7d23e9eb8 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:34:18.067686 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-e46ffe6f-112c-45ae-b00f-a8e7d23e9eb8 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:34:18.097369 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.wsgi [-] (102993) accepted ('10.222.0.62', 42602) {{(pid=102993) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 23 19:34:18.153560 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-e46ffe6f-112c-45ae-b00f-a8e7d23e9eb8 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-623933'] for security_group, after_delete {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:34:18.156223 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-e46ffe6f-112c-45ae-b00f-a8e7d23e9eb8 admin admin] Publish callbacks [] for security_group, before_response {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:34:18.157378 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [None req-e46ffe6f-112c-45ae-b00f-a8e7d23e9eb8 admin admin] 10.222.0.62 "DELETE /v2.0/security-groups/79e75aa3-207d-47e7-b165-964a29da9e62 HTTP/1.1" status: 204 len: 168 time: 0.1610620 Nov 23 19:34:18.165334 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e46ffe6f-112c-45ae-b00f-a8e7d23e9eb8 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=79e75aa3-207d-47e7-b165-964a29da9e62,revision_number=None']} {{(pid=102993) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 23 19:34:18.212668 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-5858b6a6-a2e3-4dbd-8453-e1fe3fbc9fa3 admin admin] Publish callbacks [] for security_group, before_create {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:34:18.283556 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-5858b6a6-a2e3-4dbd-8453-e1fe3fbc9fa3 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:34:18.359230 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-5858b6a6-a2e3-4dbd-8453-e1fe3fbc9fa3 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-623933'] for security_group, after_create {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:34:18.402619 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [None req-5858b6a6-a2e3-4dbd-8453-e1fe3fbc9fa3 admin admin] 10.222.0.62 "GET /v2.0/security-groups?tenant_id=45afce4bbc5f4ec1adc958c9ae38812f&name=default HTTP/1.1" status: 200 len: 2996 time: 0.3039904 Nov 23 19:34:18.407238 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5858b6a6-a2e3-4dbd-8453-e1fe3fbc9fa3 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=afffb85e-9896-4660-8a79-81b6e5182025,revision_number=1']} {{(pid=102993) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 23 19:34:18.409257 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.wsgi [-] (102993) accepted ('10.222.0.62', 42614) {{(pid=102993) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 23 19:34:18.463915 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-9d31e2b8-548c-417a-9cc9-0617c01052cc admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:34:18.489144 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-9d31e2b8-548c-417a-9cc9-0617c01052cc admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:34:18.525701 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-22e56219-e74e-4e47-8284-02e46712de46 req-d68dd706-4eaa-4601-8a06-08e00bc200d6 tempest-ServerRescueNegativeTestJSON-1447477341 tempest-ServerRescueNegativeTestJSON-1447477341-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102992) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:34:18.527088 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-22e56219-e74e-4e47-8284-02e46712de46 req-d68dd706-4eaa-4601-8a06-08e00bc200d6 tempest-ServerRescueNegativeTestJSON-1447477341 tempest-ServerRescueNegativeTestJSON-1447477341-project] 10.222.0.62 "GET /v2.0/ports?device_id=90cb32bd-c375-400a-b79a-97fc61e2a3a3 HTTP/1.1" status: 200 len: 945 time: 0.0540771 Nov 23 19:34:18.574286 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-22e56219-e74e-4e47-8284-02e46712de46 req-eee9b919-77be-4c15-8dcb-5a53a4e4d753 tempest-ServerRescueNegativeTestJSON-1447477341 tempest-ServerRescueNegativeTestJSON-1447477341-project] 10.222.0.62 "GET /v2.0/security-groups?id=62a09434-acf0-424f-9001-2c3a78119364&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0410244 Nov 23 19:34:18.593357 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-9d31e2b8-548c-417a-9cc9-0617c01052cc admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-623933'] for security_group, after_delete {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:34:18.596015 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-9d31e2b8-548c-417a-9cc9-0617c01052cc admin admin] Publish callbacks [] for security_group, before_response {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:34:18.597129 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [None req-9d31e2b8-548c-417a-9cc9-0617c01052cc admin admin] 10.222.0.62 "DELETE /v2.0/security-groups/afffb85e-9896-4660-8a79-81b6e5182025 HTTP/1.1" status: 204 len: 168 time: 0.1866651 Nov 23 19:34:18.609868 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9d31e2b8-548c-417a-9cc9-0617c01052cc admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=afffb85e-9896-4660-8a79-81b6e5182025,revision_number=None']} {{(pid=102993) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 23 19:34:18.612929 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9d31e2b8-548c-417a-9cc9-0617c01052cc admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-819011-1-iscsi {{(pid=102993) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 23 19:34:18.613276 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9d31e2b8-548c-417a-9cc9-0617c01052cc admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-819011-1-iscsi {{(pid=102993) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 23 19:34:18.613651 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9d31e2b8-548c-417a-9cc9-0617c01052cc admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-819011-1-iscsi {{(pid=102993) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 23 19:34:18.613983 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9d31e2b8-548c-417a-9cc9-0617c01052cc admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-819011-1-iscsi {{(pid=102993) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 23 19:34:18.614314 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9d31e2b8-548c-417a-9cc9-0617c01052cc admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-819011-1-iscsi {{(pid=102993) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 23 19:34:18.614643 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9d31e2b8-548c-417a-9cc9-0617c01052cc admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-819011-1-iscsi {{(pid=102993) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 23 19:34:18.615618 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9d31e2b8-548c-417a-9cc9-0617c01052cc admin admin] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-819011-1-iscsi {{(pid=102993) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 23 19:34:18.615954 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9d31e2b8-548c-417a-9cc9-0617c01052cc admin admin] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-819011-1-iscsi {{(pid=102993) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 23 19:34:18.616283 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9d31e2b8-548c-417a-9cc9-0617c01052cc admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-819011-1-iscsi {{(pid=102993) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 23 19:34:18.616842 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9d31e2b8-548c-417a-9cc9-0617c01052cc admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-819011-1-iscsi {{(pid=102993) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 23 19:34:18.616937 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9d31e2b8-548c-417a-9cc9-0617c01052cc admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-819011-1-iscsi {{(pid=102993) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 23 19:34:18.617220 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9d31e2b8-548c-417a-9cc9-0617c01052cc admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-819011-1-iscsi {{(pid=102993) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 23 19:34:18.707200 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f7fb2de0-12b2-41e8-8fde-6d838b6538fa req-112ab6d8-426d-4699-b0f7-57e45e859acb tempest-AttachVolumeShelveTestJSON-1172915835 tempest-AttachVolumeShelveTestJSON-1172915835-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102993) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:34:18.708693 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-f7fb2de0-12b2-41e8-8fde-6d838b6538fa req-112ab6d8-426d-4699-b0f7-57e45e859acb tempest-AttachVolumeShelveTestJSON-1172915835 tempest-AttachVolumeShelveTestJSON-1172915835-project] 10.222.0.62 "GET /v2.0/ports?device_id=85ea3d72-6c17-4ea2-82b7-90cce01633bd HTTP/1.1" status: 200 len: 945 time: 0.0511763 Nov 23 19:34:18.756675 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-f7fb2de0-12b2-41e8-8fde-6d838b6538fa req-d1dece3f-4523-46fd-8db5-f25fe47027d2 tempest-AttachVolumeShelveTestJSON-1172915835 tempest-AttachVolumeShelveTestJSON-1172915835-project] 10.222.0.62 "GET /v2.0/security-groups?id=f1ca24d9-0a31-470d-a1d5-fa7059df0141&fields=id&fields=name HTTP/1.1" status: 200 len: 311 time: 0.0420926 Nov 23 19:34:18.789975 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.wsgi [-] (102992) accepted ('10.222.0.62', 42624) {{(pid=102992) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 23 19:34:18.802130 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [None req-1d2d9c5d-7e63-45f9-afdf-63cd018388ea admin admin] Publish callbacks [] for security_group, before_create {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:34:18.879701 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [None req-1d2d9c5d-7e63-45f9-afdf-63cd018388ea admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:34:18.919636 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [None req-1d2d9c5d-7e63-45f9-afdf-63cd018388ea admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-623933'] for security_group, after_create {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:34:18.977688 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [None req-1d2d9c5d-7e63-45f9-afdf-63cd018388ea admin admin] 10.222.0.62 "GET /v2.0/security-groups?tenant_id=323ba636e6174e7bba3fbb1c5c8219f2&name=default HTTP/1.1" status: 200 len: 2996 time: 0.1800900 Nov 23 19:34:18.977688 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1d2d9c5d-7e63-45f9-afdf-63cd018388ea admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=c16c34ac-9d91-490d-9747-9c3507a40b86,revision_number=1']} {{(pid=102992) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 23 19:34:18.977688 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.wsgi [-] (102992) accepted ('10.222.0.62', 42628) {{(pid=102992) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 23 19:34:19.002154 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d110ecdd-f429-4382-b3ab-c2d7e32eaa11 req-cb39e51d-3529-4acf-a503-d992288d03ce service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102993) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:34:19.004596 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-d110ecdd-f429-4382-b3ab-c2d7e32eaa11 req-cb39e51d-3529-4acf-a503-d992288d03ce service neutron] 10.222.0.41 "GET /v2.0/ports?tenant_id=c15ab51e579448cfb7a4b3e4f8049687&device_id=90cb32bd-c375-400a-b79a-97fc61e2a3a3 HTTP/1.1" status: 200 len: 1098 time: 0.0438092 Nov 23 19:34:19.027651 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [None req-cc0b033a-574d-4e40-b1c9-d5a47db57489 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:34:19.065549 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [None req-cc0b033a-574d-4e40-b1c9-d5a47db57489 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:34:19.128076 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4e0cc6f5-72de-4131-ac41-b96f5b86b470 req-c267f569-8fdd-45b4-9c79-513a32db083b tempest-DeleteServersTestJSON-453817978 tempest-DeleteServersTestJSON-453817978-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102992) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:34:19.129599 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-4e0cc6f5-72de-4131-ac41-b96f5b86b470 req-c267f569-8fdd-45b4-9c79-513a32db083b tempest-DeleteServersTestJSON-453817978 tempest-DeleteServersTestJSON-453817978-project] 10.222.0.62 "GET /v2.0/ports?device_id=5e3c1406-dc8c-414a-bcc5-55c7c963e1df HTTP/1.1" status: 200 len: 945 time: 0.0830815 Nov 23 19:34:19.190755 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-4e0cc6f5-72de-4131-ac41-b96f5b86b470 req-b453c35a-eb14-497d-b43b-90b0ecc0a08a tempest-DeleteServersTestJSON-453817978 tempest-DeleteServersTestJSON-453817978-project] 10.222.0.62 "GET /v2.0/security-groups?id=5b5d5814-644d-45c2-ad35-f8920c3382b0&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0480735 Nov 23 19:34:19.193878 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [None req-cc0b033a-574d-4e40-b1c9-d5a47db57489 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-623933'] for security_group, after_delete {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:34:19.195045 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d110ecdd-f429-4382-b3ab-c2d7e32eaa11 req-fc33b401-9a84-4051-ad5d-3ededcb974d9 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102993) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:34:19.196640 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-d110ecdd-f429-4382-b3ab-c2d7e32eaa11 req-fc33b401-9a84-4051-ad5d-3ededcb974d9 service neutron] 10.222.0.41 "GET /v2.0/networks?id=07eeb44e-4cdb-4c58-a83d-1dd8ab1ccb8a HTTP/1.1" status: 200 len: 920 time: 0.1806536 Nov 23 19:34:19.196761 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [None req-cc0b033a-574d-4e40-b1c9-d5a47db57489 admin admin] Publish callbacks [] for security_group, before_response {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:34:19.197802 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [None req-cc0b033a-574d-4e40-b1c9-d5a47db57489 admin admin] 10.222.0.62 "DELETE /v2.0/security-groups/c16c34ac-9d91-490d-9747-9c3507a40b86 HTTP/1.1" status: 204 len: 168 time: 0.2223730 Nov 23 19:34:19.206441 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cc0b033a-574d-4e40-b1c9-d5a47db57489 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=c16c34ac-9d91-490d-9747-9c3507a40b86,revision_number=None']} {{(pid=102992) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 23 19:34:19.214597 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cc0b033a-574d-4e40-b1c9-d5a47db57489 admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-819011-1-iscsi {{(pid=102992) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 23 19:34:19.215182 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cc0b033a-574d-4e40-b1c9-d5a47db57489 admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-819011-1-iscsi {{(pid=102992) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 23 19:34:19.215352 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cc0b033a-574d-4e40-b1c9-d5a47db57489 admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-819011-1-iscsi {{(pid=102992) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 23 19:34:19.225046 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cc0b033a-574d-4e40-b1c9-d5a47db57489 admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-819011-1-iscsi {{(pid=102992) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 23 19:34:19.225046 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cc0b033a-574d-4e40-b1c9-d5a47db57489 admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-819011-1-iscsi {{(pid=102992) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 23 19:34:19.225046 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cc0b033a-574d-4e40-b1c9-d5a47db57489 admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-819011-1-iscsi {{(pid=102992) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 23 19:34:19.225046 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cc0b033a-574d-4e40-b1c9-d5a47db57489 admin admin] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-819011-1-iscsi {{(pid=102992) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 23 19:34:19.225046 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cc0b033a-574d-4e40-b1c9-d5a47db57489 admin admin] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-819011-1-iscsi {{(pid=102992) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 23 19:34:19.225046 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cc0b033a-574d-4e40-b1c9-d5a47db57489 admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-819011-1-iscsi {{(pid=102992) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 23 19:34:19.225046 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cc0b033a-574d-4e40-b1c9-d5a47db57489 admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-819011-1-iscsi {{(pid=102992) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 23 19:34:19.225046 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cc0b033a-574d-4e40-b1c9-d5a47db57489 admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-819011-1-iscsi {{(pid=102992) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 23 19:34:19.225046 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cc0b033a-574d-4e40-b1c9-d5a47db57489 admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-819011-1-iscsi {{(pid=102992) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 23 19:34:19.230948 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.wsgi [-] (102993) accepted ('10.222.0.62', 42636) {{(pid=102993) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 23 19:34:19.265912 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-d110ecdd-f429-4382-b3ab-c2d7e32eaa11 req-f89f4b49-4880-43fa-ba7e-ae41a007795d service neutron] 10.222.0.41 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.2&port_id=0a64c11d-0cb3-4c1e-aa45-5bcdf2771c8c HTTP/1.1" status: 200 len: 217 time: 0.0513539 Nov 23 19:34:19.271143 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-18f02d5a-a411-4eb4-94f8-922de692c42c admin admin] Publish callbacks [] for security_group, before_create {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:34:19.353161 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d110ecdd-f429-4382-b3ab-c2d7e32eaa11 req-c10ef926-e0f6-4966-b7e8-b6681c62f850 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=102993) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:34:19.354655 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-d110ecdd-f429-4382-b3ab-c2d7e32eaa11 req-c10ef926-e0f6-4966-b7e8-b6681c62f850 service neutron] 10.222.0.41 "GET /v2.0/subnets?id=e4fda56f-85ff-422d-adad-ec00db6378af HTTP/1.1" status: 200 len: 859 time: 0.0677981 Nov 23 19:34:19.400605 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-d110ecdd-f429-4382-b3ab-c2d7e32eaa11 req-9b311a59-6418-41ef-b58b-3f81b401a6db service neutron] 10.222.0.41 "GET /v2.0/ports?network_id=07eeb44e-4cdb-4c58-a83d-1dd8ab1ccb8a&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0329833 Nov 23 19:34:19.426063 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-18f02d5a-a411-4eb4-94f8-922de692c42c admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:34:19.506572 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-d110ecdd-f429-4382-b3ab-c2d7e32eaa11 req-caadebe3-2b25-42e2-a6e5-6d362b75b0f0 service neutron] 10.222.0.41 "GET /v2.0/networks/07eeb44e-4cdb-4c58-a83d-1dd8ab1ccb8a?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0918546 Nov 23 19:34:19.525024 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-18f02d5a-a411-4eb4-94f8-922de692c42c admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-623933'] for security_group, after_create {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:34:19.565929 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-18f02d5a-a411-4eb4-94f8-922de692c42c admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=ad25d73e-cb89-47b8-89f9-437684057adc,revision_number=1']} {{(pid=102993) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 23 19:34:19.571829 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [None req-18f02d5a-a411-4eb4-94f8-922de692c42c admin admin] 10.222.0.62 "GET /v2.0/security-groups?tenant_id=ab26ce103b4c4d39bbb0f1cb7f8b1b36&name=default HTTP/1.1" status: 200 len: 2996 time: 0.3398907 Nov 23 19:34:19.572446 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.wsgi [-] (102992) accepted ('10.222.0.62', 42648) {{(pid=102992) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 23 19:34:19.628798 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [None req-3b2c034f-420a-407b-b8a8-5d26474a0ac2 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:34:19.666741 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [None req-3b2c034f-420a-407b-b8a8-5d26474a0ac2 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:34:19.701153 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7587f0db-9926-4221-9c54-449d019d2b1b req-730eba7c-8982-4cfc-92a6-f5c815b2ffe3 tempest-ServerRescueNegativeTestJSON-1447477341 tempest-ServerRescueNegativeTestJSON-1447477341-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102993) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:34:19.702706 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-7587f0db-9926-4221-9c54-449d019d2b1b req-730eba7c-8982-4cfc-92a6-f5c815b2ffe3 tempest-ServerRescueNegativeTestJSON-1447477341 tempest-ServerRescueNegativeTestJSON-1447477341-project] 10.222.0.62 "GET /v2.0/ports?device_id=90cb32bd-c375-400a-b79a-97fc61e2a3a3 HTTP/1.1" status: 200 len: 945 time: 0.0525336 Nov 23 19:34:19.757135 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-7587f0db-9926-4221-9c54-449d019d2b1b req-3731b82a-ffe3-4d0b-8f06-740a0b109e09 tempest-ServerRescueNegativeTestJSON-1447477341 tempest-ServerRescueNegativeTestJSON-1447477341-project] 10.222.0.62 "GET /v2.0/security-groups?id=62a09434-acf0-424f-9001-2c3a78119364&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0469437 Nov 23 19:34:19.776396 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [None req-3b2c034f-420a-407b-b8a8-5d26474a0ac2 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-623933'] for security_group, after_delete {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:34:19.779170 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [None req-3b2c034f-420a-407b-b8a8-5d26474a0ac2 admin admin] Publish callbacks [] for security_group, before_response {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:34:19.780354 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [None req-3b2c034f-420a-407b-b8a8-5d26474a0ac2 admin admin] 10.222.0.62 "DELETE /v2.0/security-groups/ad25d73e-cb89-47b8-89f9-437684057adc HTTP/1.1" status: 204 len: 168 time: 0.2068133 Nov 23 19:34:19.790453 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3b2c034f-420a-407b-b8a8-5d26474a0ac2 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=ad25d73e-cb89-47b8-89f9-437684057adc,revision_number=None']} {{(pid=102992) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 23 19:34:19.894305 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9285eea6-ef3f-4c75-b9a6-5e2507e95447 req-474d9aa7-86fd-4238-a84a-b0afd35c48be tempest-AttachVolumeShelveTestJSON-1172915835 tempest-AttachVolumeShelveTestJSON-1172915835-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102992) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:34:19.895828 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-9285eea6-ef3f-4c75-b9a6-5e2507e95447 req-474d9aa7-86fd-4238-a84a-b0afd35c48be tempest-AttachVolumeShelveTestJSON-1172915835 tempest-AttachVolumeShelveTestJSON-1172915835-project] 10.222.0.62 "GET /v2.0/ports?device_id=85ea3d72-6c17-4ea2-82b7-90cce01633bd HTTP/1.1" status: 200 len: 945 time: 0.0557387 Nov 23 19:34:19.946146 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-9285eea6-ef3f-4c75-b9a6-5e2507e95447 req-1b9e321e-52e0-4ead-bce8-80c183c583a4 tempest-AttachVolumeShelveTestJSON-1172915835 tempest-AttachVolumeShelveTestJSON-1172915835-project] 10.222.0.62 "GET /v2.0/security-groups?id=f1ca24d9-0a31-470d-a1d5-fa7059df0141&fields=id&fields=name HTTP/1.1" status: 200 len: 311 time: 0.0434182 Nov 23 19:34:20.320592 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-90f66350-d8dd-48d9-8226-6c428f56d879 req-a446ac3c-17bc-4747-810e-8d46481430a2 tempest-DeleteServersTestJSON-453817978 tempest-DeleteServersTestJSON-453817978-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102993) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:34:20.322097 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-90f66350-d8dd-48d9-8226-6c428f56d879 req-a446ac3c-17bc-4747-810e-8d46481430a2 tempest-DeleteServersTestJSON-453817978 tempest-DeleteServersTestJSON-453817978-project] 10.222.0.62 "GET /v2.0/ports?device_id=5e3c1406-dc8c-414a-bcc5-55c7c963e1df HTTP/1.1" status: 200 len: 945 time: 0.0519581 Nov 23 19:34:20.375091 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-90f66350-d8dd-48d9-8226-6c428f56d879 req-d599e58f-735b-46ac-ad8d-1cb447ba8c84 tempest-DeleteServersTestJSON-453817978 tempest-DeleteServersTestJSON-453817978-project] 10.222.0.62 "GET /v2.0/security-groups?id=5b5d5814-644d-45c2-ad35-f8920c3382b0&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0464537 Nov 23 19:34:20.610594 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-d110ecdd-f429-4382-b3ab-c2d7e32eaa11 req-fdc3b41a-3ccd-45fc-9f7c-ce0ba099a8c1 service neutron] 10.222.0.41 "GET /v2.0/networks/07eeb44e-4cdb-4c58-a83d-1dd8ab1ccb8a?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0854375 Nov 23 19:34:20.847655 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.wsgi [-] (102993) accepted ('10.222.0.62', 42712) {{(pid=102993) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 23 19:34:20.888269 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-37c89c4c-4609-4e3f-b144-99875b5c50e1 req-2373ef81-9a1d-4aca-8092-5cba459923b2 tempest-ServerRescueNegativeTestJSON-1447477341 tempest-ServerRescueNegativeTestJSON-1447477341-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102992) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:34:20.889839 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-37c89c4c-4609-4e3f-b144-99875b5c50e1 req-2373ef81-9a1d-4aca-8092-5cba459923b2 tempest-ServerRescueNegativeTestJSON-1447477341 tempest-ServerRescueNegativeTestJSON-1447477341-project] 10.222.0.62 "GET /v2.0/ports?device_id=90cb32bd-c375-400a-b79a-97fc61e2a3a3 HTTP/1.1" status: 200 len: 945 time: 0.0622790 Nov 23 19:34:20.939657 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-37c89c4c-4609-4e3f-b144-99875b5c50e1 req-c6d5a6f6-d2c9-4212-83ee-f1c79bbc677a tempest-ServerRescueNegativeTestJSON-1447477341 tempest-ServerRescueNegativeTestJSON-1447477341-project] 10.222.0.62 "GET /v2.0/security-groups?id=62a09434-acf0-424f-9001-2c3a78119364&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0430574 Nov 23 19:34:20.972549 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.api.v2.base [None req-12e01ef5-7687-489b-87e8-48a17195663b admin admin] Request body: {'network': {'name': 'tempest-VolumesActionsTest-1884160271-network', 'tenant_id': '11b44d27020442f1a83627c7c46cce22'}} {{(pid=102993) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 23 19:34:21.066482 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-12e01ef5-7687-489b-87e8-48a17195663b admin admin] Made reservation on behalf of 11b44d27020442f1a83627c7c46cce22 for: {'network': 1} {{(pid=102993) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 23 19:34:21.066482 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-12e01ef5-7687-489b-87e8-48a17195663b admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7921281'] for network, before_create {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:34:21.082192 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dcd7b29f-7c91-4881-aca8-b39c45a8e612 req-c8d3e378-82be-474a-adef-5302af9ea319 tempest-AttachVolumeShelveTestJSON-1172915835 tempest-AttachVolumeShelveTestJSON-1172915835-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102993) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:34:21.084324 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-dcd7b29f-7c91-4881-aca8-b39c45a8e612 req-c8d3e378-82be-474a-adef-5302af9ea319 tempest-AttachVolumeShelveTestJSON-1172915835 tempest-AttachVolumeShelveTestJSON-1172915835-project] 10.222.0.62 "GET /v2.0/ports?device_id=85ea3d72-6c17-4ea2-82b7-90cce01633bd HTTP/1.1" status: 200 len: 945 time: 0.0632353 Nov 23 19:34:21.092389 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-12e01ef5-7687-489b-87e8-48a17195663b admin admin] Publish callbacks [] for security_group, before_create {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:34:21.173730 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-dcd7b29f-7c91-4881-aca8-b39c45a8e612 req-6d13069c-68ea-48ea-814f-e39724d8626a tempest-AttachVolumeShelveTestJSON-1172915835 tempest-AttachVolumeShelveTestJSON-1172915835-project] 10.222.0.62 "GET /v2.0/security-groups?id=f1ca24d9-0a31-470d-a1d5-fa7059df0141&fields=id&fields=name HTTP/1.1" status: 200 len: 311 time: 0.0824184 Nov 23 19:34:21.221289 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-12e01ef5-7687-489b-87e8-48a17195663b admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:34:21.284721 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-12e01ef5-7687-489b-87e8-48a17195663b admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-623933'] for security_group, after_create {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:34:21.306441 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-12e01ef5-7687-489b-87e8-48a17195663b admin admin] vlan segment allocate from pool success with {'vlan_id': 824, 'physical_network': 'physnet1'} {{(pid=102993) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 23 19:34:21.319661 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-12e01ef5-7687-489b-87e8-48a17195663b admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=2ddcad07-c0ca-429d-8be8-fb4205ff6766,revision_number=1']} {{(pid=102993) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 23 19:34:21.324273 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-12e01ef5-7687-489b-87e8-48a17195663b admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7982218'] for segment, precommit_create {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:34:21.324608 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.db.segments_db [None req-12e01ef5-7687-489b-87e8-48a17195663b admin admin] Added segment d31e81f7-47be-49ce-acc7-dd9bb979d4b9 of type vlan for network febefec9-9d20-4631-b16a-171834b4299f Nov 23 19:34:21.369460 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-12e01ef5-7687-489b-87e8-48a17195663b admin admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8783630993713'] for network, precommit_create {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:34:21.439082 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-12e01ef5-7687-489b-87e8-48a17195663b admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-554949', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560168'] for network, after_create {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:34:21.440049 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-12e01ef5-7687-489b-87e8-48a17195663b admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102993) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:34:21.440674 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-12e01ef5-7687-489b-87e8-48a17195663b admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-560186'] for network, before_response {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:34:21.501309 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-12e01ef5-7687-489b-87e8-48a17195663b admin admin] Pushing event updated for resources: {'Network': ['ID=febefec9-9d20-4631-b16a-171834b4299f,revision_number=1']} {{(pid=102993) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 23 19:34:21.513752 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.plugins.ml2.rpc [None req-eb87b2c3-3339-4249-8b85-e695b5b4e1f9 None None] Network febefec9-9d20-4631-b16a-171834b4299f details requested by agent ovs-agent-dv-cinder-819011-1-iscsi with host dv-cinder-819011-1-iscsi {{(pid=102994) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Nov 23 19:34:21.527702 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [None req-12e01ef5-7687-489b-87e8-48a17195663b admin admin] 10.222.0.62 "POST /v2.0/networks HTTP/1.1" status: 201 len: 882 time: 0.6789536 Nov 23 19:34:21.530708 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.wsgi [-] (102993) accepted ('10.222.0.62', 42748) {{(pid=102993) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 23 19:34:21.536824 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.api.v2.base [None req-f75a6a96-fe09-4f08-8301-eb150403285b admin admin] Request body: {'subnet': {'network_id': 'febefec9-9d20-4631-b16a-171834b4299f', 'cidr': '172.20.0.0/28', 'name': 'tempest-VolumesActionsTest-1884160271-subnet', 'tenant_id': '11b44d27020442f1a83627c7c46cce22', 'enable_dhcp': False, 'ip_version': 4}} {{(pid=102993) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 23 19:34:21.604981 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-f75a6a96-fe09-4f08-8301-eb150403285b admin admin] Made reservation on behalf of 11b44d27020442f1a83627c7c46cce22 for: {'subnet': 1} {{(pid=102993) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 23 19:34:21.607414 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-f75a6a96-fe09-4f08-8301-eb150403285b admin admin] Publish callbacks [] for subnet, before_create {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:34:21.833691 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-f75a6a96-fe09-4f08-8301-eb150403285b admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-554858', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560168'] for subnet, after_create {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:34:21.882949 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.wsgi [-] (102992) accepted ('10.222.0.62', 42754) {{(pid=102992) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 23 19:34:21.890041 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f75a6a96-fe09-4f08-8301-eb150403285b admin admin] Pushing event updated for resources: {'Subnet': ['ID=0abb3a5c-c9ac-4da5-84df-f99818afe0a2,revision_number=0']} {{(pid=102993) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 23 19:34:21.899755 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-f75a6a96-fe09-4f08-8301-eb150403285b admin admin] Checking segment: {'id': 'd31e81f7-47be-49ce-acc7-dd9bb979d4b9', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 824, 'network_id': 'febefec9-9d20-4631-b16a-171834b4299f'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102993) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 23 19:34:21.900109 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-f75a6a96-fe09-4f08-8301-eb150403285b admin admin] Network hostable DHCP agents. Network: febefec9-9d20-4631-b16a-171834b4299f, hostable agents: ['e51c95c7-6a36-4263-ba47-1839054f3e7a'], hosted agents: [] {{(pid=102993) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 23 19:34:21.999424 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-f75a6a96-fe09-4f08-8301-eb150403285b admin admin] Network febefec9-9d20-4631-b16a-171834b4299f is scheduled to be hosted by DHCP agent e51c95c7-6a36-4263-ba47-1839054f3e7a with binding_index 1 {{(pid=102993) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 23 19:34:22.003334 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [None req-63ede106-8664-4286-be4f-d27a6543e0af admin admin] Publish callbacks [] for security_group, before_create {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:34:22.073738 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.scheduler.base_scheduler [None req-f75a6a96-fe09-4f08-8301-eb150403285b admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-819011-1-iscsi, febefec9-9d20-4631-b16a-171834b4299f) {{(pid=102993) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 23 19:34:22.078362 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-f75a6a96-fe09-4f08-8301-eb150403285b admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'network'] {{(pid=102993) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:34:22.079015 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-f75a6a96-fe09-4f08-8301-eb150403285b admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-560186'] for subnet, before_response {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:34:22.084884 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-04ec847e-d0e4-44c8-bd6d-3c4cfd8b0987 None None] Network febefec9-9d20-4631-b16a-171834b4299f requested from dv-cinder-819011-1-iscsi {{(pid=102994) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 23 19:34:22.087012 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-762dcf23-fd56-4183-9403-8e17d99680fc req-8ee558a4-3584-45c7-8482-9dbc30384848 tempest-ServerRescueNegativeTestJSON-1447477341 tempest-ServerRescueNegativeTestJSON-1447477341-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102992) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:34:22.088546 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-762dcf23-fd56-4183-9403-8e17d99680fc req-8ee558a4-3584-45c7-8482-9dbc30384848 tempest-ServerRescueNegativeTestJSON-1447477341 tempest-ServerRescueNegativeTestJSON-1447477341-project] 10.222.0.62 "GET /v2.0/ports?device_id=90cb32bd-c375-400a-b79a-97fc61e2a3a3 HTTP/1.1" status: 200 len: 945 time: 0.0756345 Nov 23 19:34:22.153361 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [None req-f75a6a96-fe09-4f08-8301-eb150403285b admin admin] 10.222.0.62 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 846 time: 0.6137433 Nov 23 19:34:22.169105 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [None req-63ede106-8664-4286-be4f-d27a6543e0af admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:34:22.180328 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-762dcf23-fd56-4183-9403-8e17d99680fc req-080874b1-b5bc-4a17-a8ed-7a0bc8cae909 tempest-ServerRescueNegativeTestJSON-1447477341 tempest-ServerRescueNegativeTestJSON-1447477341-project] 10.222.0.62 "GET /v2.0/security-groups?id=62a09434-acf0-424f-9001-2c3a78119364&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0833335 Nov 23 19:34:22.229222 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-02cc8dbf-faec-4ba4-b7e6-30c7edb5e6a5 None None] Network febefec9-9d20-4631-b16a-171834b4299f requested from dv-cinder-819011-1-iscsi {{(pid=102994) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 23 19:34:22.247899 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [None req-63ede106-8664-4286-be4f-d27a6543e0af admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-623933'] for security_group, after_create {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:34:22.291431 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [None req-63ede106-8664-4286-be4f-d27a6543e0af admin admin] 10.222.0.62 "GET /v2.0/security-groups?tenant_id=ad8610e84f554da7913c01b5c3d2daaa&name=default HTTP/1.1" status: 200 len: 2996 time: 0.4048209 Nov 23 19:34:22.291431 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-63ede106-8664-4286-be4f-d27a6543e0af admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=61dfea81-6011-46ed-8d19-9829c9ac8fd6,revision_number=1']} {{(pid=102992) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 23 19:34:22.292099 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.wsgi [-] (102992) accepted ('10.222.0.62', 42770) {{(pid=102992) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 23 19:34:22.353923 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [None req-29618f97-1c40-4284-847d-862e1c6a1e1b admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:34:22.372273 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e50d0d80-ae7b-4164-ae4a-468a8750ecab req-589f8f06-a46c-4b7e-bd62-e477b71bb388 tempest-AttachVolumeShelveTestJSON-1172915835 tempest-AttachVolumeShelveTestJSON-1172915835-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102993) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:34:22.372273 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-e50d0d80-ae7b-4164-ae4a-468a8750ecab req-589f8f06-a46c-4b7e-bd62-e477b71bb388 tempest-AttachVolumeShelveTestJSON-1172915835 tempest-AttachVolumeShelveTestJSON-1172915835-project] 10.222.0.62 "GET /v2.0/ports?device_id=85ea3d72-6c17-4ea2-82b7-90cce01633bd HTTP/1.1" status: 200 len: 945 time: 0.1068022 Nov 23 19:34:22.379249 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [None req-29618f97-1c40-4284-847d-862e1c6a1e1b admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:34:22.421527 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-e50d0d80-ae7b-4164-ae4a-468a8750ecab req-f360dc8e-a1f7-4142-b77d-8e3b4eb8db5b tempest-AttachVolumeShelveTestJSON-1172915835 tempest-AttachVolumeShelveTestJSON-1172915835-project] 10.222.0.62 "GET /v2.0/security-groups?id=f1ca24d9-0a31-470d-a1d5-fa7059df0141&fields=id&fields=name HTTP/1.1" status: 200 len: 311 time: 0.0431674 Nov 23 19:34:22.479395 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [None req-29618f97-1c40-4284-847d-862e1c6a1e1b admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-623933'] for security_group, after_delete {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:34:22.482168 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [None req-29618f97-1c40-4284-847d-862e1c6a1e1b admin admin] Publish callbacks [] for security_group, before_response {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:34:22.483443 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [None req-29618f97-1c40-4284-847d-862e1c6a1e1b admin admin] 10.222.0.62 "DELETE /v2.0/security-groups/61dfea81-6011-46ed-8d19-9829c9ac8fd6 HTTP/1.1" status: 204 len: 168 time: 0.1899152 Nov 23 19:34:22.492038 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-29618f97-1c40-4284-847d-862e1c6a1e1b admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=61dfea81-6011-46ed-8d19-9829c9ac8fd6,revision_number=None']} {{(pid=102992) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 23 19:34:22.878678 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.wsgi [-] (102993) accepted ('10.222.0.62', 42794) {{(pid=102993) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 23 19:34:22.884544 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.api.v2.base [None req-19543f41-e19d-4240-a7c9-7f5d7e8d17ad admin admin] Request body: {'network': {'name': 'tempest-VolumesActionsTest-1390727923-network', 'tenant_id': '0f471fb0d1ee46ceac1bf2ea7ca3ab29'}} {{(pid=102993) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 23 19:34:22.947919 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-19543f41-e19d-4240-a7c9-7f5d7e8d17ad admin admin] Made reservation on behalf of 0f471fb0d1ee46ceac1bf2ea7ca3ab29 for: {'network': 1} {{(pid=102993) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 23 19:34:22.950551 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-19543f41-e19d-4240-a7c9-7f5d7e8d17ad admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7921281'] for network, before_create {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:34:22.963952 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-19543f41-e19d-4240-a7c9-7f5d7e8d17ad admin admin] Publish callbacks [] for security_group, before_create {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:34:23.004959 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.wsgi [-] (102992) accepted ('10.222.0.62', 42798) {{(pid=102992) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 23 19:34:23.025197 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [None req-84481929-7255-4b1c-a816-4d99b5d11fe8 admin admin] Publish callbacks [] for security_group, before_create {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:34:23.110232 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [None req-84481929-7255-4b1c-a816-4d99b5d11fe8 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:34:23.176711 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [None req-84481929-7255-4b1c-a816-4d99b5d11fe8 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-623933'] for security_group, after_create {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:34:23.220439 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [None req-84481929-7255-4b1c-a816-4d99b5d11fe8 admin admin] 10.222.0.62 "GET /v2.0/security-groups?tenant_id=7ec7ed9c11634959a176e9dfa16aaa31&name=default HTTP/1.1" status: 200 len: 2996 time: 0.2129898 Nov 23 19:34:23.223072 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-84481929-7255-4b1c-a816-4d99b5d11fe8 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=e46485b4-0d36-402b-95b3-7400ed06c90b,revision_number=1']} {{(pid=102992) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 23 19:34:23.225940 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.wsgi [-] (102992) accepted ('10.222.0.62', 42804) {{(pid=102992) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 23 19:34:23.273257 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-19543f41-e19d-4240-a7c9-7f5d7e8d17ad admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:34:23.289825 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-8d30fdc4-0f05-4463-b46a-ad052b72cabd req-fb4c420a-29b2-46c3-90da-f8129913174b service neutron] 10.222.0.41 "GET /v2.0/ports?device_id=5e3c1406-dc8c-414a-bcc5-55c7c963e1df&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 275 time: 0.1224849 Nov 23 19:34:23.315191 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [None req-89e8788c-a10c-4168-a911-2b35fbbce37c admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:34:23.344297 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-19543f41-e19d-4240-a7c9-7f5d7e8d17ad admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-623933'] for security_group, after_create {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:34:23.353713 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-57c92875-7e04-43e8-8ada-fee70158768e req-a8aa6532-b8ef-4347-911a-e813664ea785 tempest-ServerRescueNegativeTestJSON-1447477341 tempest-ServerRescueNegativeTestJSON-1447477341-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102992) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:34:23.355280 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-57c92875-7e04-43e8-8ada-fee70158768e req-a8aa6532-b8ef-4347-911a-e813664ea785 tempest-ServerRescueNegativeTestJSON-1447477341 tempest-ServerRescueNegativeTestJSON-1447477341-project] 10.222.0.62 "GET /v2.0/ports?device_id=90cb32bd-c375-400a-b79a-97fc61e2a3a3 HTTP/1.1" status: 200 len: 945 time: 0.0909760 Nov 23 19:34:23.357304 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [None req-89e8788c-a10c-4168-a911-2b35fbbce37c admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:34:23.384590 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-19543f41-e19d-4240-a7c9-7f5d7e8d17ad admin admin] vlan segment allocate from pool success with {'vlan_id': 840, 'physical_network': 'physnet1'} {{(pid=102993) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 23 19:34:23.412129 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-19543f41-e19d-4240-a7c9-7f5d7e8d17ad admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=60afb6b3-875f-408b-8716-084f2e71ea81,revision_number=1']} {{(pid=102993) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 23 19:34:23.423092 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-19543f41-e19d-4240-a7c9-7f5d7e8d17ad admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7982218'] for segment, precommit_create {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:34:23.423631 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.db.segments_db [None req-19543f41-e19d-4240-a7c9-7f5d7e8d17ad admin admin] Added segment 89181dee-3c67-43a1-8d3e-f96fd0fb7142 of type vlan for network f7e55161-fa06-4ef2-9321-13f9e46bf524 Nov 23 19:34:23.488919 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-57c92875-7e04-43e8-8ada-fee70158768e req-bf7b3f4d-f6bf-4cfb-a1c6-c8e3aa1853ac tempest-ServerRescueNegativeTestJSON-1447477341 tempest-ServerRescueNegativeTestJSON-1447477341-project] 10.222.0.62 "GET /v2.0/security-groups?id=62a09434-acf0-424f-9001-2c3a78119364&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1245987 Nov 23 19:34:23.525550 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8d30fdc4-0f05-4463-b46a-ad052b72cabd req-2fcd94ad-4b57-4f61-9512-6ff4b7f22f20 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102993) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:34:23.527708 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-8d30fdc4-0f05-4463-b46a-ad052b72cabd req-2fcd94ad-4b57-4f61-9512-6ff4b7f22f20 service neutron] 10.222.0.41 "GET /v2.0/ports?tenant_id=69ab6d68b3f1442f9785568cd27eb367&device_id=5e3c1406-dc8c-414a-bcc5-55c7c963e1df HTTP/1.1" status: 200 len: 1098 time: 0.1635640 Nov 23 19:34:23.531566 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-19543f41-e19d-4240-a7c9-7f5d7e8d17ad admin admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8783630993713'] for network, precommit_create {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:34:23.587638 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [None req-89e8788c-a10c-4168-a911-2b35fbbce37c admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-623933'] for security_group, after_delete {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:34:23.590393 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [None req-89e8788c-a10c-4168-a911-2b35fbbce37c admin admin] Publish callbacks [] for security_group, before_response {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:34:23.591509 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [None req-89e8788c-a10c-4168-a911-2b35fbbce37c admin admin] 10.222.0.62 "DELETE /v2.0/security-groups/e46485b4-0d36-402b-95b3-7400ed06c90b HTTP/1.1" status: 204 len: 168 time: 0.3644750 Nov 23 19:34:23.599430 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-89e8788c-a10c-4168-a911-2b35fbbce37c admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=e46485b4-0d36-402b-95b3-7400ed06c90b,revision_number=None']} {{(pid=102992) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 23 19:34:23.652663 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8d30fdc4-0f05-4463-b46a-ad052b72cabd req-e8a21532-a623-498b-8023-16e363ae16eb service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102993) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:34:23.654320 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-8d30fdc4-0f05-4463-b46a-ad052b72cabd req-e8a21532-a623-498b-8023-16e363ae16eb service neutron] 10.222.0.41 "GET /v2.0/networks?id=2cf6d774-4b5e-4f5e-bb22-8de22e43722d HTTP/1.1" status: 200 len: 913 time: 0.1032236 Nov 23 19:34:23.679996 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-19543f41-e19d-4240-a7c9-7f5d7e8d17ad admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-554949', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560168'] for network, after_create {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:34:23.681486 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-19543f41-e19d-4240-a7c9-7f5d7e8d17ad admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102993) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:34:23.682127 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-19543f41-e19d-4240-a7c9-7f5d7e8d17ad admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-560186'] for network, before_response {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:34:23.703261 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3597d56b-04e7-40d8-a140-b678908e99a4 req-802a4f3a-4dad-4fd8-99b9-b80288c20d8a tempest-AttachVolumeShelveTestJSON-1172915835 tempest-AttachVolumeShelveTestJSON-1172915835-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102992) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:34:23.704837 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-3597d56b-04e7-40d8-a140-b678908e99a4 req-802a4f3a-4dad-4fd8-99b9-b80288c20d8a tempest-AttachVolumeShelveTestJSON-1172915835 tempest-AttachVolumeShelveTestJSON-1172915835-project] 10.222.0.62 "GET /v2.0/ports?device_id=85ea3d72-6c17-4ea2-82b7-90cce01633bd HTTP/1.1" status: 200 len: 945 time: 0.0718031 Nov 23 19:34:23.727055 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-8d30fdc4-0f05-4463-b46a-ad052b72cabd req-f3aa1698-4882-48e5-a5d7-7c91219a762f service neutron] 10.222.0.41 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.7&port_id=8c70d83a-558d-4a92-a3e8-15396107e64d HTTP/1.1" status: 200 len: 217 time: 0.0603337 Nov 23 19:34:23.774008 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-3597d56b-04e7-40d8-a140-b678908e99a4 req-dec327d3-2ba1-49e8-9b4d-35bff7654c07 tempest-AttachVolumeShelveTestJSON-1172915835 tempest-AttachVolumeShelveTestJSON-1172915835-project] 10.222.0.62 "GET /v2.0/security-groups?id=f1ca24d9-0a31-470d-a1d5-fa7059df0141&fields=id&fields=name HTTP/1.1" status: 200 len: 311 time: 0.0596983 Nov 23 19:34:23.817822 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [None req-19543f41-e19d-4240-a7c9-7f5d7e8d17ad admin admin] 10.222.0.62 "POST /v2.0/networks HTTP/1.1" status: 201 len: 882 time: 0.9380271 Nov 23 19:34:23.820533 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.wsgi [-] (102993) accepted ('10.222.0.62', 42830) {{(pid=102993) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 23 19:34:23.827900 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.api.v2.base [None req-e4ee94a2-fdfd-4639-9496-18007e3082ee admin admin] Request body: {'subnet': {'network_id': 'f7e55161-fa06-4ef2-9321-13f9e46bf524', 'cidr': '172.20.0.0/28', 'name': 'tempest-VolumesActionsTest-1390727923-subnet', 'tenant_id': '0f471fb0d1ee46ceac1bf2ea7ca3ab29', 'enable_dhcp': False, 'ip_version': 4}} {{(pid=102993) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 23 19:34:23.830551 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-19543f41-e19d-4240-a7c9-7f5d7e8d17ad admin admin] Pushing event updated for resources: {'Network': ['ID=f7e55161-fa06-4ef2-9321-13f9e46bf524,revision_number=1']} {{(pid=102993) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 23 19:34:23.844812 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.plugins.ml2.rpc [None req-eb87b2c3-3339-4249-8b85-e695b5b4e1f9 None None] Network f7e55161-fa06-4ef2-9321-13f9e46bf524 details requested by agent ovs-agent-dv-cinder-819011-1-iscsi with host dv-cinder-819011-1-iscsi {{(pid=102994) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Nov 23 19:34:23.845288 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8d30fdc4-0f05-4463-b46a-ad052b72cabd req-4ee4c52b-011d-48c7-9e29-536cb6b8537c service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=102993) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:34:23.846797 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-8d30fdc4-0f05-4463-b46a-ad052b72cabd req-4ee4c52b-011d-48c7-9e29-536cb6b8537c service neutron] 10.222.0.41 "GET /v2.0/subnets?id=c1e8e6ce-3e67-4ef5-bbc3-db04880e7fab HTTP/1.1" status: 200 len: 852 time: 0.1097832 Nov 23 19:34:23.897184 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-8d30fdc4-0f05-4463-b46a-ad052b72cabd req-33750058-719b-450a-831c-0ff54d2ccd17 service neutron] 10.222.0.41 "GET /v2.0/ports?network_id=2cf6d774-4b5e-4f5e-bb22-8de22e43722d&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0308371 Nov 23 19:34:23.926214 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fcd66f73-5753-43d1-aca7-3aa7f6a9cfb6 req-9d0346a5-1d05-4ed4-abd8-402dfac1d96d tempest-AttachVolumeShelveTestJSON-1172915835 tempest-AttachVolumeShelveTestJSON-1172915835-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102992) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:34:23.928644 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-fcd66f73-5753-43d1-aca7-3aa7f6a9cfb6 req-9d0346a5-1d05-4ed4-abd8-402dfac1d96d tempest-AttachVolumeShelveTestJSON-1172915835 tempest-AttachVolumeShelveTestJSON-1172915835-project] 10.222.0.62 "GET /v2.0/ports?device_id=85ea3d72-6c17-4ea2-82b7-90cce01633bd HTTP/1.1" status: 200 len: 945 time: 0.0636036 Nov 23 19:34:23.937379 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.wsgi [-] (102992) accepted ('10.222.0.62', 42832) {{(pid=102992) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 23 19:34:23.941820 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.api.v2.base [None req-8c11bbf2-c6f5-4290-a857-7dd64a44f344 tempest-AttachVolumeShelveTestJSON-1172915835 tempest-AttachVolumeShelveTestJSON-1172915835-project] Request body: {'floatingip': {'port_id': '4b380ab6-f3ec-4e12-9a2a-b5a20828969d'}} {{(pid=102992) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 23 19:34:24.011261 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-8d30fdc4-0f05-4463-b46a-ad052b72cabd req-27433c2b-92fe-4796-a0bf-0fcd3ae12627 service neutron] 10.222.0.41 "GET /v2.0/networks/2cf6d774-4b5e-4f5e-bb22-8de22e43722d?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1054530 Nov 23 19:34:24.012252 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-e4ee94a2-fdfd-4639-9496-18007e3082ee admin admin] Made reservation on behalf of 0f471fb0d1ee46ceac1bf2ea7ca3ab29 for: {'subnet': 1} {{(pid=102993) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 23 19:34:24.014622 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-e4ee94a2-fdfd-4639-9496-18007e3082ee admin admin] Publish callbacks [] for subnet, before_create {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:34:24.017894 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [None req-8c11bbf2-c6f5-4290-a857-7dd64a44f344 tempest-AttachVolumeShelveTestJSON-1172915835 tempest-AttachVolumeShelveTestJSON-1172915835-project] Publish callbacks [] for floatingip, before_update {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:34:24.189042 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-8d30fdc4-0f05-4463-b46a-ad052b72cabd req-8f5ab464-df58-4e36-9c0c-81754d588778 service neutron] 10.222.0.41 "GET /v2.0/networks/2cf6d774-4b5e-4f5e-bb22-8de22e43722d?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1619580 Nov 23 19:34:24.399843 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-e4ee94a2-fdfd-4639-9496-18007e3082ee admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-554858', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560168'] for subnet, after_create {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:34:24.451499 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e4ee94a2-fdfd-4639-9496-18007e3082ee admin admin] Pushing event updated for resources: {'Subnet': ['ID=bd077d39-49d5-4e6b-a1da-3b01cf2fcba1,revision_number=0']} {{(pid=102993) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 23 19:34:24.474168 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-e4ee94a2-fdfd-4639-9496-18007e3082ee admin admin] Checking segment: {'id': '89181dee-3c67-43a1-8d3e-f96fd0fb7142', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 840, 'network_id': 'f7e55161-fa06-4ef2-9321-13f9e46bf524'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102993) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 23 19:34:24.474697 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-e4ee94a2-fdfd-4639-9496-18007e3082ee admin admin] Network hostable DHCP agents. Network: f7e55161-fa06-4ef2-9321-13f9e46bf524, hostable agents: ['e51c95c7-6a36-4263-ba47-1839054f3e7a'], hosted agents: [] {{(pid=102993) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 23 19:34:24.594287 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-e4ee94a2-fdfd-4639-9496-18007e3082ee admin admin] Network f7e55161-fa06-4ef2-9321-13f9e46bf524 is scheduled to be hosted by DHCP agent e51c95c7-6a36-4263-ba47-1839054f3e7a with binding_index 1 {{(pid=102993) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 23 19:34:24.685192 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.scheduler.base_scheduler [None req-e4ee94a2-fdfd-4639-9496-18007e3082ee admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-819011-1-iscsi, f7e55161-fa06-4ef2-9321-13f9e46bf524) {{(pid=102993) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 23 19:34:24.689472 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-e4ee94a2-fdfd-4639-9496-18007e3082ee admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'network'] {{(pid=102993) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:34:24.690110 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-e4ee94a2-fdfd-4639-9496-18007e3082ee admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-560186'] for subnet, before_response {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:34:24.697656 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-aac4b32f-7589-4e09-acbf-b3ace5a415cf None None] Network f7e55161-fa06-4ef2-9321-13f9e46bf524 requested from dv-cinder-819011-1-iscsi {{(pid=102994) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 23 19:34:24.790249 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [None req-e4ee94a2-fdfd-4639-9496-18007e3082ee admin admin] 10.222.0.62 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 846 time: 0.9676311 Nov 23 19:34:24.898755 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.wsgi [-] (102993) accepted ('10.222.0.62', 42870) {{(pid=102993) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 23 19:34:24.914584 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-eddc3c54-708c-4896-b274-b2b1f55dd760 None None] Network f7e55161-fa06-4ef2-9321-13f9e46bf524 requested from dv-cinder-819011-1-iscsi {{(pid=102994) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 23 19:34:25.089446 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-fdc4994f-7aeb-4284-aeee-29b6d16d5718 admin admin] Publish callbacks [] for security_group, before_create {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:34:25.116096 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-18261801-675e-4f57-868c-4177089811e1 req-7370c1ad-fd77-40fe-914f-94bcfecfd987 tempest-ServerRescueNegativeTestJSON-1447477341 tempest-ServerRescueNegativeTestJSON-1447477341-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102992) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:34:25.117661 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-18261801-675e-4f57-868c-4177089811e1 req-7370c1ad-fd77-40fe-914f-94bcfecfd987 tempest-ServerRescueNegativeTestJSON-1447477341 tempest-ServerRescueNegativeTestJSON-1447477341-project] 10.222.0.62 "GET /v2.0/ports?device_id=90cb32bd-c375-400a-b79a-97fc61e2a3a3 HTTP/1.1" status: 200 len: 945 time: 0.5500140 Nov 23 19:34:25.146242 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [None req-8c11bbf2-c6f5-4290-a857-7dd64a44f344 tempest-AttachVolumeShelveTestJSON-1172915835 tempest-AttachVolumeShelveTestJSON-1172915835-project] Publish callbacks [] for floatingip, precommit_update {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:34:25.195980 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-18261801-675e-4f57-868c-4177089811e1 req-3742f200-2c38-4578-9b4c-8c0f315afc3c tempest-ServerRescueNegativeTestJSON-1447477341 tempest-ServerRescueNegativeTestJSON-1447477341-project] 10.222.0.62 "GET /v2.0/security-groups?id=62a09434-acf0-424f-9001-2c3a78119364&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0652912 Nov 23 19:34:25.196191 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-fdc4994f-7aeb-4284-aeee-29b6d16d5718 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:34:25.211887 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [None req-8c11bbf2-c6f5-4290-a857-7dd64a44f344 tempest-AttachVolumeShelveTestJSON-1172915835 tempest-AttachVolumeShelveTestJSON-1172915835-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-926531'] for floatingip, after_update {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:34:25.262588 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-fdc4994f-7aeb-4284-aeee-29b6d16d5718 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-623933'] for security_group, after_create {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:34:25.314638 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [None req-fdc4994f-7aeb-4284-aeee-29b6d16d5718 admin admin] 10.222.0.62 "GET /v2.0/security-groups?tenant_id=36b0e454874347efa954172edc69c5c8&name=default HTTP/1.1" status: 200 len: 2996 time: 0.4123669 Nov 23 19:34:25.314638 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fdc4994f-7aeb-4284-aeee-29b6d16d5718 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=dcdd763e-81c4-4c0e-ba5d-967c625f2d0f,revision_number=1']} {{(pid=102993) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 23 19:34:25.315862 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.wsgi [-] (102993) accepted ('10.222.0.62', 42884) {{(pid=102993) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 23 19:34:25.346053 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.db.l3_db [None req-8c11bbf2-c6f5-4290-a857-7dd64a44f344 tempest-AttachVolumeShelveTestJSON-1172915835 tempest-AttachVolumeShelveTestJSON-1172915835-project] Floating IP 688c5865-c524-4e4a-9ee8-836f2272655b associated. External IP: 172.27.1.211, port: 4b380ab6-f3ec-4e12-9a2a-b5a20828969d. Nov 23 19:34:25.368314 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-492781e6-3489-4994-967c-468f07620854 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:34:25.391062 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-492781e6-3489-4994-967c-468f07620854 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:34:25.531232 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-492781e6-3489-4994-967c-468f07620854 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-623933'] for security_group, after_delete {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:34:25.534129 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-492781e6-3489-4994-967c-468f07620854 admin admin] Publish callbacks [] for security_group, before_response {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:34:25.538261 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [None req-492781e6-3489-4994-967c-468f07620854 admin admin] 10.222.0.62 "DELETE /v2.0/security-groups/dcdd763e-81c4-4c0e-ba5d-967c625f2d0f HTTP/1.1" status: 204 len: 168 time: 0.2187827 Nov 23 19:34:25.544591 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-492781e6-3489-4994-967c-468f07620854 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=dcdd763e-81c4-4c0e-ba5d-967c625f2d0f,revision_number=None']} {{(pid=102993) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 23 19:34:25.578782 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-8c11bbf2-c6f5-4290-a857-7dd64a44f344 tempest-AttachVolumeShelveTestJSON-1172915835 tempest-AttachVolumeShelveTestJSON-1172915835-project] Router 01438284-e62a-4056-8ee2-4899a051e144 has already been hosted by L3 agent 1b20f2c4-70b6-43c3-b9bd-0062cc9e57ac {{(pid=102992) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 23 19:34:25.696702 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-8c11bbf2-c6f5-4290-a857-7dd64a44f344 tempest-AttachVolumeShelveTestJSON-1172915835 tempest-AttachVolumeShelveTestJSON-1172915835-project] Notify agent at l3_agent.dv-cinder-819011-1-iscsi the message routers_updated {{(pid=102992) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 23 19:34:25.702023 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [None req-8c11bbf2-c6f5-4290-a857-7dd64a44f344 tempest-AttachVolumeShelveTestJSON-1172915835 tempest-AttachVolumeShelveTestJSON-1172915835-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-514902'] for floatingip, before_response {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:34:25.715181 dv-cinder-819011-1-iscsi neutron-server[102995]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-3a211590-1079-47f9-be55-daf002f8935c None None] Sync routers for ids ['01438284-e62a-4056-8ee2-4899a051e144'] in dv-cinder-819011-1-iscsi {{(pid=102995) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 23 19:34:25.727453 dv-cinder-819011-1-iscsi neutron-server[102995]: DEBUG neutron.db.l3_dvrscheduler_db [None req-3a211590-1079-47f9-be55-daf002f8935c None None] Routers {'01438284-e62a-4056-8ee2-4899a051e144'} bound to L3 agent in host dv-cinder-819011-1-iscsi {{(pid=102995) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 23 19:34:25.728368 dv-cinder-819011-1-iscsi neutron-server[102995]: DEBUG neutron.db.l3_hamode_db [None req-3a211590-1079-47f9-be55-daf002f8935c None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-819011-1-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-23T19:25:14Z,description=,heartbeat_timestamp=2021-11-23T19:34:14Z,host='dv-cinder-819011-1-iscsi',id=1b20f2c4-70b6-43c3-b9bd-0062cc9e57ac,load=0,resource_versions=,resources_synced=,started_at=2021-11-23T19:25:15Z,topic='l3_agent')) {'router_ids': ['01438284-e62a-4056-8ee2-4899a051e144'], 'active': True} {{(pid=102995) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 23 19:34:25.736912 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [None req-8c11bbf2-c6f5-4290-a857-7dd64a44f344 tempest-AttachVolumeShelveTestJSON-1172915835 tempest-AttachVolumeShelveTestJSON-1172915835-project] 10.222.0.62 "PUT /v2.0/floatingips/688c5865-c524-4e4a-9ee8-836f2272655b HTTP/1.1" status: 200 len: 991 time: 1.7980571 Nov 23 19:34:25.738111 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '85ea3d72-6c17-4ea2-82b7-90cce01633bd', 'tag': '4b380ab6-f3ec-4e12-9a2a-b5a20828969d'}] {{(pid=102992) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 23 19:34:25.741155 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.62/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}f86c332b591ae691ababa4b64e0601cbf242a448242f95367ce03daabfb7e1ce" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-a896c306-5664-4fb2-8192-e5692599d9de" -d '{"events": [{"name": "network-changed", "server_uuid": "85ea3d72-6c17-4ea2-82b7-90cce01633bd", "tag": "4b380ab6-f3ec-4e12-9a2a-b5a20828969d"}]}' {{(pid=102992) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 23 19:34:25.811022 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Tue, 23 Nov 2021 19:34:25 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-b2089ff4-2464-463f-8fc7-df331b5771f6 x-openstack-request-id: req-b2089ff4-2464-463f-8fc7-df331b5771f6 {{(pid=102992) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 23 19:34:25.811318 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "85ea3d72-6c17-4ea2-82b7-90cce01633bd", "tag": "4b380ab6-f3ec-4e12-9a2a-b5a20828969d", "status": "completed", "code": 200}]} {{(pid=102992) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 23 19:34:25.811601 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.62/compute/v2.1/os-server-external-events used request id req-b2089ff4-2464-463f-8fc7-df331b5771f6 {{(pid=102992) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 23 19:34:25.812000 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '85ea3d72-6c17-4ea2-82b7-90cce01633bd', 'tag': '4b380ab6-f3ec-4e12-9a2a-b5a20828969d', 'status': 'completed', 'code': 200} Nov 23 19:34:25.882196 dv-cinder-819011-1-iscsi neutron-server[102995]: DEBUG neutron.db.l3_dvr_db [None req-3a211590-1079-47f9-be55-daf002f8935c None None] Set router 01438284-e62a-4056-8ee2-4899a051e144 gateway port host: dv-cinder-819011-1-iscsi {{(pid=102995) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 23 19:34:26.242208 dv-cinder-819011-1-iscsi neutron-server[102995]: DEBUG neutron.db.l3_hamode_db [None req-3a211590-1079-47f9-be55-daf002f8935c None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '01438284-e62a-4056-8ee2-4899a051e144', 'name': 'tempest-AttachVolumeShelveTestJSON-1609224522-router', 'tenant_id': '2d925fb59ba34355aa85758374d76928', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'a93e254e-aac9-4233-9e4d-4290fd0458e4', 'external_fixed_ips': [{'subnet_id': 'e0b32f3d-83d6-439a-bbed-01df7cf01051', 'ip_address': '172.27.1.99'}], 'enable_snat': True}, 'gw_port_id': 'a6140c41-82e2-4d62-8e5f-f3fc119a374e', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-23T19:33:21Z', 'updated_at': '2021-11-23T19:33:28Z', 'revision_number': 4, 'project_id': '2d925fb59ba34355aa85758374d76928', 'gw_port': {'id': 'a6140c41-82e2-4d62-8e5f-f3fc119a374e', 'name': '', 'network_id': 'a93e254e-aac9-4233-9e4d-4290fd0458e4', 'tenant_id': '', 'mac_address': 'fa:16:3e:32:52:e2', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '01438284-e62a-4056-8ee2-4899a051e144', 'device_owner': 'network:router_gateway', 'standard_attr_id': 59, 'fixed_ips': [{'subnet_id': 'e0b32f3d-83d6-439a-bbed-01df7cf01051', 'ip_address': '172.27.1.99', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-819011-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-23T19:33:22Z', 'updated_at': '2021-11-23T19:33:30Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'e0b32f3d-83d6-439a-bbed-01df7cf01051', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-819011-1-iscsi', '_floatingips': [{'id': '688c5865-c524-4e4a-9ee8-836f2272655b', 'tenant_id': '2d925fb59ba34355aa85758374d76928', 'floating_ip_address': '172.27.1.211', 'floating_network_id': 'a93e254e-aac9-4233-9e4d-4290fd0458e4', 'router_id': '01438284-e62a-4056-8ee2-4899a051e144', 'port_id': '4b380ab6-f3ec-4e12-9a2a-b5a20828969d', 'fixed_ip_address': '172.20.0.7', 'status': 'DOWN', 'standard_attr_id': 100, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': 'fc901312-2937-4784-8a6d-c046666e8bf8', 'mac_address': 'fa:16:3e:c0:19:59', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '85ea3d72-6c17-4ea2-82b7-90cce01633bd', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-23T19:33:35Z', 'updated_at': '2021-11-23T19:34:24Z', 'revision_number': 1, 'project_id': '2d925fb59ba34355aa85758374d76928', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'c96e4c46-b1fa-4e6c-9fe8-9c516c4ee278', 'name': '', 'network_id': 'fc901312-2937-4784-8a6d-c046666e8bf8', 'tenant_id': '2d925fb59ba34355aa85758374d76928', 'mac_address': 'fa:16:3e:b7:43:ca', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '01438284-e62a-4056-8ee2-4899a051e144', 'device_owner': 'network:router_interface', 'standard_attr_id': 71, 'fixed_ips': [{'subnet_id': '2caca985-6ed6-4ef7-ba49-7b7410bea160', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-819011-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-23T19:33:26Z', 'updated_at': '2021-11-23T19:33:35Z', 'revision_number': 5, 'project_id': '2d925fb59ba34355aa85758374d76928', 'subnets': [{'id': '2caca985-6ed6-4ef7-ba49-7b7410bea160', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-819011-1-iscsi', False) {} {{(pid=102995) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 23 19:34:26.273370 dv-cinder-819011-1-iscsi neutron-server[102995]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-3a211590-1079-47f9-be55-daf002f8935c None None] Checking router: 01438284-e62a-4056-8ee2-4899a051e144 for host: dv-cinder-819011-1-iscsi {{(pid=102995) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 23 19:34:26.281932 dv-cinder-819011-1-iscsi neutron-server[102995]: DEBUG neutron.db.l3_dvrscheduler_db [None req-3a211590-1079-47f9-be55-daf002f8935c None None] Routers {'01438284-e62a-4056-8ee2-4899a051e144'} bound to L3 agent in host dv-cinder-819011-1-iscsi {{(pid=102995) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 23 19:34:26.282543 dv-cinder-819011-1-iscsi neutron-server[102995]: DEBUG neutron.db.l3_hamode_db [None req-3a211590-1079-47f9-be55-daf002f8935c None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-819011-1-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-23T19:25:14Z,description=,heartbeat_timestamp=2021-11-23T19:34:14Z,host='dv-cinder-819011-1-iscsi',id=1b20f2c4-70b6-43c3-b9bd-0062cc9e57ac,load=0,resource_versions=,resources_synced=,started_at=2021-11-23T19:25:15Z,topic='l3_agent')) {'router_ids': ['01438284-e62a-4056-8ee2-4899a051e144'], 'active': True} {{(pid=102995) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 23 19:34:26.349220 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f0382f57-2e91-4b7f-9928-8db9cea3787b req-37940715-9a42-4685-bb91-9282df4a9ed5 tempest-ServerRescueNegativeTestJSON-1447477341 tempest-ServerRescueNegativeTestJSON-1447477341-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102992) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:34:26.351402 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-f0382f57-2e91-4b7f-9928-8db9cea3787b req-37940715-9a42-4685-bb91-9282df4a9ed5 tempest-ServerRescueNegativeTestJSON-1447477341 tempest-ServerRescueNegativeTestJSON-1447477341-project] 10.222.0.62 "GET /v2.0/ports?device_id=90cb32bd-c375-400a-b79a-97fc61e2a3a3 HTTP/1.1" status: 200 len: 945 time: 0.0846314 Nov 23 19:34:26.404068 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-f0382f57-2e91-4b7f-9928-8db9cea3787b req-7d8cc858-c8cc-4dbb-a5db-91cf2331873c tempest-ServerRescueNegativeTestJSON-1447477341 tempest-ServerRescueNegativeTestJSON-1447477341-project] 10.222.0.62 "GET /v2.0/security-groups?id=62a09434-acf0-424f-9001-2c3a78119364&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0467474 Nov 23 19:34:26.505843 dv-cinder-819011-1-iscsi neutron-server[102995]: DEBUG neutron.db.l3_dvr_db [None req-3a211590-1079-47f9-be55-daf002f8935c None None] Set router 01438284-e62a-4056-8ee2-4899a051e144 gateway port host: dv-cinder-819011-1-iscsi {{(pid=102995) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 23 19:34:26.738825 dv-cinder-819011-1-iscsi neutron-server[102995]: DEBUG neutron.db.l3_hamode_db [None req-3a211590-1079-47f9-be55-daf002f8935c None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '01438284-e62a-4056-8ee2-4899a051e144', 'name': 'tempest-AttachVolumeShelveTestJSON-1609224522-router', 'tenant_id': '2d925fb59ba34355aa85758374d76928', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'a93e254e-aac9-4233-9e4d-4290fd0458e4', 'external_fixed_ips': [{'subnet_id': 'e0b32f3d-83d6-439a-bbed-01df7cf01051', 'ip_address': '172.27.1.99'}], 'enable_snat': True}, 'gw_port_id': 'a6140c41-82e2-4d62-8e5f-f3fc119a374e', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-23T19:33:21Z', 'updated_at': '2021-11-23T19:33:28Z', 'revision_number': 4, 'project_id': '2d925fb59ba34355aa85758374d76928', 'gw_port': {'id': 'a6140c41-82e2-4d62-8e5f-f3fc119a374e', 'name': '', 'network_id': 'a93e254e-aac9-4233-9e4d-4290fd0458e4', 'tenant_id': '', 'mac_address': 'fa:16:3e:32:52:e2', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '01438284-e62a-4056-8ee2-4899a051e144', 'device_owner': 'network:router_gateway', 'standard_attr_id': 59, 'fixed_ips': [{'subnet_id': 'e0b32f3d-83d6-439a-bbed-01df7cf01051', 'ip_address': '172.27.1.99', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-819011-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-23T19:33:22Z', 'updated_at': '2021-11-23T19:33:30Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'e0b32f3d-83d6-439a-bbed-01df7cf01051', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-819011-1-iscsi', '_floatingips': [{'id': '688c5865-c524-4e4a-9ee8-836f2272655b', 'tenant_id': '2d925fb59ba34355aa85758374d76928', 'floating_ip_address': '172.27.1.211', 'floating_network_id': 'a93e254e-aac9-4233-9e4d-4290fd0458e4', 'router_id': '01438284-e62a-4056-8ee2-4899a051e144', 'port_id': '4b380ab6-f3ec-4e12-9a2a-b5a20828969d', 'fixed_ip_address': '172.20.0.7', 'status': 'DOWN', 'standard_attr_id': 100, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': 'fc901312-2937-4784-8a6d-c046666e8bf8', 'mac_address': 'fa:16:3e:c0:19:59', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '85ea3d72-6c17-4ea2-82b7-90cce01633bd', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-23T19:33:35Z', 'updated_at': '2021-11-23T19:34:24Z', 'revision_number': 1, 'project_id': '2d925fb59ba34355aa85758374d76928', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'c96e4c46-b1fa-4e6c-9fe8-9c516c4ee278', 'name': '', 'network_id': 'fc901312-2937-4784-8a6d-c046666e8bf8', 'tenant_id': '2d925fb59ba34355aa85758374d76928', 'mac_address': 'fa:16:3e:b7:43:ca', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '01438284-e62a-4056-8ee2-4899a051e144', 'device_owner': 'network:router_interface', 'standard_attr_id': 71, 'fixed_ips': [{'subnet_id': '2caca985-6ed6-4ef7-ba49-7b7410bea160', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-819011-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-23T19:33:26Z', 'updated_at': '2021-11-23T19:33:35Z', 'revision_number': 5, 'project_id': '2d925fb59ba34355aa85758374d76928', 'subnets': [{'id': '2caca985-6ed6-4ef7-ba49-7b7410bea160', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-819011-1-iscsi', False) {} {{(pid=102995) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 23 19:34:26.766272 dv-cinder-819011-1-iscsi neutron-server[102995]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-3a211590-1079-47f9-be55-daf002f8935c None None] The sync data for ids ['01438284-e62a-4056-8ee2-4899a051e144'] in dv-cinder-819011-1-iscsi is: [{'id': '01438284-e62a-4056-8ee2-4899a051e144', 'name': 'tempest-AttachVolumeShelveTestJSON-1609224522-router', 'tenant_id': '2d925fb59ba34355aa85758374d76928', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'a93e254e-aac9-4233-9e4d-4290fd0458e4', 'external_fixed_ips': [{'subnet_id': 'e0b32f3d-83d6-439a-bbed-01df7cf01051', 'ip_address': '172.27.1.99'}], 'enable_snat': True}, 'gw_port_id': 'a6140c41-82e2-4d62-8e5f-f3fc119a374e', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-23T19:33:21Z', 'updated_at': '2021-11-23T19:33:28Z', 'revision_number': 4, 'project_id': '2d925fb59ba34355aa85758374d76928', 'gw_port': {'id': 'a6140c41-82e2-4d62-8e5f-f3fc119a374e', 'name': '', 'network_id': 'a93e254e-aac9-4233-9e4d-4290fd0458e4', 'tenant_id': '', 'mac_address': 'fa:16:3e:32:52:e2', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '01438284-e62a-4056-8ee2-4899a051e144', 'device_owner': 'network:router_gateway', 'standard_attr_id': 59, 'fixed_ips': [{'subnet_id': 'e0b32f3d-83d6-439a-bbed-01df7cf01051', 'ip_address': '172.27.1.99', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-819011-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-23T19:33:22Z', 'updated_at': '2021-11-23T19:33:30Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'e0b32f3d-83d6-439a-bbed-01df7cf01051', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-819011-1-iscsi', '_floatingips': [{'id': '688c5865-c524-4e4a-9ee8-836f2272655b', 'tenant_id': '2d925fb59ba34355aa85758374d76928', 'floating_ip_address': '172.27.1.211', 'floating_network_id': 'a93e254e-aac9-4233-9e4d-4290fd0458e4', 'router_id': '01438284-e62a-4056-8ee2-4899a051e144', 'port_id': '4b380ab6-f3ec-4e12-9a2a-b5a20828969d', 'fixed_ip_address': '172.20.0.7', 'status': 'DOWN', 'standard_attr_id': 100, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': 'fc901312-2937-4784-8a6d-c046666e8bf8', 'mac_address': 'fa:16:3e:c0:19:59', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '85ea3d72-6c17-4ea2-82b7-90cce01633bd', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-23T19:33:35Z', 'updated_at': '2021-11-23T19:34:24Z', 'revision_number': 1, 'project_id': '2d925fb59ba34355aa85758374d76928', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'c96e4c46-b1fa-4e6c-9fe8-9c516c4ee278', 'name': '', 'network_id': 'fc901312-2937-4784-8a6d-c046666e8bf8', 'tenant_id': '2d925fb59ba34355aa85758374d76928', 'mac_address': 'fa:16:3e:b7:43:ca', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '01438284-e62a-4056-8ee2-4899a051e144', 'device_owner': 'network:router_interface', 'standard_attr_id': 71, 'fixed_ips': [{'subnet_id': '2caca985-6ed6-4ef7-ba49-7b7410bea160', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-819011-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-23T19:33:26Z', 'updated_at': '2021-11-23T19:33:35Z', 'revision_number': 5, 'project_id': '2d925fb59ba34355aa85758374d76928', 'subnets': [{'id': '2caca985-6ed6-4ef7-ba49-7b7410bea160', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=102995) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 23 19:34:26.984506 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-fbb00ff2-bd61-42fb-8f47-78aeb19c734a None None] New status for floating IP 688c5865-c524-4e4a-9ee8-836f2272655b: ACTIVE {{(pid=102994) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Nov 23 19:34:27.522157 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6d264a09-fb3b-4ac1-9d3a-05d90bb3344c req-208afe95-6d1b-4676-a105-c24283ee9eeb tempest-ServerRescueNegativeTestJSON-1447477341 tempest-ServerRescueNegativeTestJSON-1447477341-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102992) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:34:27.523703 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-6d264a09-fb3b-4ac1-9d3a-05d90bb3344c req-208afe95-6d1b-4676-a105-c24283ee9eeb tempest-ServerRescueNegativeTestJSON-1447477341 tempest-ServerRescueNegativeTestJSON-1447477341-project] 10.222.0.62 "GET /v2.0/ports?device_id=90cb32bd-c375-400a-b79a-97fc61e2a3a3 HTTP/1.1" status: 200 len: 945 time: 0.0519218 Nov 23 19:34:27.578053 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-6d264a09-fb3b-4ac1-9d3a-05d90bb3344c req-48a2e12c-9e66-41b5-820e-0a65dd8b9c33 tempest-ServerRescueNegativeTestJSON-1447477341 tempest-ServerRescueNegativeTestJSON-1447477341-project] 10.222.0.62 "GET /v2.0/security-groups?id=62a09434-acf0-424f-9001-2c3a78119364&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0485363 Nov 23 19:34:28.004729 dv-cinder-819011-1-iscsi neutron-server[102995]: DEBUG neutron.db.agents_db [None req-84bdc9b2-57ea-4bdb-a245-07c78d37cea8 None None] Agent healthcheck: found 6 active agents {{(pid=102995) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 23 19:34:28.343558 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a896c306-5664-4fb2-8192-e5692599d9de req-653dd148-dc51-4310-b9d3-a982c506066c service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102993) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:34:28.345149 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-a896c306-5664-4fb2-8192-e5692599d9de req-653dd148-dc51-4310-b9d3-a982c506066c service neutron] 10.222.0.41 "GET /v2.0/ports?tenant_id=2d925fb59ba34355aa85758374d76928&device_id=85ea3d72-6c17-4ea2-82b7-90cce01633bd HTTP/1.1" status: 200 len: 1098 time: 0.0628469 Nov 23 19:34:28.441032 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a896c306-5664-4fb2-8192-e5692599d9de req-949d9dbb-d72a-4587-ba05-a32b056c05be service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102993) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:34:28.442586 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-a896c306-5664-4fb2-8192-e5692599d9de req-949d9dbb-d72a-4587-ba05-a32b056c05be service neutron] 10.222.0.41 "GET /v2.0/networks?id=fc901312-2937-4784-8a6d-c046666e8bf8 HTTP/1.1" status: 200 len: 918 time: 0.0884778 Nov 23 19:34:28.542053 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-a896c306-5664-4fb2-8192-e5692599d9de req-91249b2e-23a0-4a56-8906-35c63f167685 service neutron] 10.222.0.41 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.7&port_id=4b380ab6-f3ec-4e12-9a2a-b5a20828969d HTTP/1.1" status: 200 len: 1001 time: 0.0912454 Nov 23 19:34:28.597805 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a896c306-5664-4fb2-8192-e5692599d9de req-ffdf2f4c-9390-4634-9e58-2e22bae42336 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=102993) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:34:28.599262 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-a896c306-5664-4fb2-8192-e5692599d9de req-ffdf2f4c-9390-4634-9e58-2e22bae42336 service neutron] 10.222.0.41 "GET /v2.0/subnets?id=2caca985-6ed6-4ef7-ba49-7b7410bea160 HTTP/1.1" status: 200 len: 856 time: 0.0477552 Nov 23 19:34:28.665340 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a896c306-5664-4fb2-8192-e5692599d9de req-8aa2fa9a-f5ac-46d9-b6dc-d3b6066e550e service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102993) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:34:28.666995 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-a896c306-5664-4fb2-8192-e5692599d9de req-8aa2fa9a-f5ac-46d9-b6dc-d3b6066e550e service neutron] 10.222.0.41 "GET /v2.0/ports?network_id=fc901312-2937-4784-8a6d-c046666e8bf8&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0529959 Nov 23 19:34:28.699170 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5f0a56c4-ecd5-4d7d-b894-3e2f00dd67c2 req-cd60a1ff-fba6-4fb8-8869-5192d50a73f3 tempest-ServerRescueNegativeTestJSON-1447477341 tempest-ServerRescueNegativeTestJSON-1447477341-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102992) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:34:28.700207 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-5f0a56c4-ecd5-4d7d-b894-3e2f00dd67c2 req-cd60a1ff-fba6-4fb8-8869-5192d50a73f3 tempest-ServerRescueNegativeTestJSON-1447477341 tempest-ServerRescueNegativeTestJSON-1447477341-project] 10.222.0.62 "GET /v2.0/ports?device_id=90cb32bd-c375-400a-b79a-97fc61e2a3a3 HTTP/1.1" status: 200 len: 945 time: 0.0547810 Nov 23 19:34:28.747060 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-5f0a56c4-ecd5-4d7d-b894-3e2f00dd67c2 req-ba988ed7-a6c2-43cd-a6c2-c907b165851a tempest-ServerRescueNegativeTestJSON-1447477341 tempest-ServerRescueNegativeTestJSON-1447477341-project] 10.222.0.62 "GET /v2.0/security-groups?id=62a09434-acf0-424f-9001-2c3a78119364&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0415788 Nov 23 19:34:28.770696 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-a896c306-5664-4fb2-8192-e5692599d9de req-6e6bb2c3-a7b3-45a2-a8b7-4fa36091f8e5 service neutron] 10.222.0.41 "GET /v2.0/networks/fc901312-2937-4784-8a6d-c046666e8bf8?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0908487 Nov 23 19:34:28.883425 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-a896c306-5664-4fb2-8192-e5692599d9de req-eecb87ae-3c35-4874-ab94-bab9b223097e service neutron] 10.222.0.41 "GET /v2.0/networks/fc901312-2937-4784-8a6d-c046666e8bf8?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0968173 Nov 23 19:34:29.023421 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron_lib.callbacks.manager [None req-4bf48ff4-ecfb-4168-8b63-249b8c6e9f04 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8783631323329', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7978582'] for agent, after_update {{(pid=102994) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:34:29.867149 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bb78f2e2-3e1a-4bea-88a8-8fd21e737604 req-a6bc57e7-6a84-4367-8457-397316ca934e tempest-ServerRescueNegativeTestJSON-1447477341 tempest-ServerRescueNegativeTestJSON-1447477341-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102992) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:34:29.868648 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-bb78f2e2-3e1a-4bea-88a8-8fd21e737604 req-a6bc57e7-6a84-4367-8457-397316ca934e tempest-ServerRescueNegativeTestJSON-1447477341 tempest-ServerRescueNegativeTestJSON-1447477341-project] 10.222.0.62 "GET /v2.0/ports?device_id=90cb32bd-c375-400a-b79a-97fc61e2a3a3 HTTP/1.1" status: 200 len: 945 time: 0.0522161 Nov 23 19:34:29.917998 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-bb78f2e2-3e1a-4bea-88a8-8fd21e737604 req-b867124b-0b99-4c8a-a555-7d85192908d4 tempest-ServerRescueNegativeTestJSON-1447477341 tempest-ServerRescueNegativeTestJSON-1447477341-project] 10.222.0.62 "GET /v2.0/security-groups?id=62a09434-acf0-424f-9001-2c3a78119364&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0429552 Nov 23 19:34:31.052214 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cafaf794-ac30-4751-805d-31f705e930e8 req-290815da-0c9e-4c79-b0d7-bade15ddd9b0 tempest-ServerRescueNegativeTestJSON-1447477341 tempest-ServerRescueNegativeTestJSON-1447477341-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102992) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:34:31.057869 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-cafaf794-ac30-4751-805d-31f705e930e8 req-290815da-0c9e-4c79-b0d7-bade15ddd9b0 tempest-ServerRescueNegativeTestJSON-1447477341 tempest-ServerRescueNegativeTestJSON-1447477341-project] 10.222.0.62 "GET /v2.0/ports?device_id=90cb32bd-c375-400a-b79a-97fc61e2a3a3 HTTP/1.1" status: 200 len: 945 time: 0.0679557 Nov 23 19:34:31.108180 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-cafaf794-ac30-4751-805d-31f705e930e8 req-e2eb3327-a0c3-4b92-ba5f-bafd84a6504d tempest-ServerRescueNegativeTestJSON-1447477341 tempest-ServerRescueNegativeTestJSON-1447477341-project] 10.222.0.62 "GET /v2.0/security-groups?id=62a09434-acf0-424f-9001-2c3a78119364&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0469985 Nov 23 19:34:32.225588 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2f65caa0-de6c-48ff-9b31-24d066c1a3df req-c8ab8639-6cbe-4587-a3c5-5d0d01940671 tempest-ServerRescueNegativeTestJSON-1447477341 tempest-ServerRescueNegativeTestJSON-1447477341-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102992) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:34:32.227098 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-2f65caa0-de6c-48ff-9b31-24d066c1a3df req-c8ab8639-6cbe-4587-a3c5-5d0d01940671 tempest-ServerRescueNegativeTestJSON-1447477341 tempest-ServerRescueNegativeTestJSON-1447477341-project] 10.222.0.62 "GET /v2.0/ports?device_id=90cb32bd-c375-400a-b79a-97fc61e2a3a3 HTTP/1.1" status: 200 len: 945 time: 0.0526254 Nov 23 19:34:32.275360 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.wsgi [-] (102993) accepted ('10.222.0.62', 43130) {{(pid=102993) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 23 19:34:32.276114 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-2f65caa0-de6c-48ff-9b31-24d066c1a3df req-bc315d08-9647-4874-bdf0-a0f5e9aae731 tempest-ServerRescueNegativeTestJSON-1447477341 tempest-ServerRescueNegativeTestJSON-1447477341-project] 10.222.0.62 "GET /v2.0/security-groups?id=62a09434-acf0-424f-9001-2c3a78119364&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0425403 Nov 23 19:34:32.382521 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-730bbbea-70b3-4a08-a8c7-3c46fe8d62fe admin admin] Publish callbacks [] for security_group, before_create {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:34:32.455163 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-730bbbea-70b3-4a08-a8c7-3c46fe8d62fe admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:34:32.496105 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-730bbbea-70b3-4a08-a8c7-3c46fe8d62fe admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-623933'] for security_group, after_create {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:34:32.535698 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [None req-730bbbea-70b3-4a08-a8c7-3c46fe8d62fe admin admin] 10.222.0.62 "GET /v2.0/security-groups?tenant_id=58b51d4f1c344c87ba70a815b1450701&name=default HTTP/1.1" status: 200 len: 2996 time: 0.2592101 Nov 23 19:34:32.541267 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-730bbbea-70b3-4a08-a8c7-3c46fe8d62fe admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=f09559a7-8e97-4c3a-9f8e-7aba558c9211,revision_number=1']} {{(pid=102993) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 23 19:34:32.543425 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.wsgi [-] (102993) accepted ('10.222.0.62', 43136) {{(pid=102993) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 23 19:34:32.591524 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-a8f88c3c-7268-410c-b102-a06d8c3ace01 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:34:32.611501 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-a8f88c3c-7268-410c-b102-a06d8c3ace01 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:34:32.713771 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-a8f88c3c-7268-410c-b102-a06d8c3ace01 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-623933'] for security_group, after_delete {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:34:32.716619 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-a8f88c3c-7268-410c-b102-a06d8c3ace01 admin admin] Publish callbacks [] for security_group, before_response {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:34:32.717791 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [None req-a8f88c3c-7268-410c-b102-a06d8c3ace01 admin admin] 10.222.0.62 "DELETE /v2.0/security-groups/f09559a7-8e97-4c3a-9f8e-7aba558c9211 HTTP/1.1" status: 204 len: 168 time: 0.1734581 Nov 23 19:34:32.725843 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a8f88c3c-7268-410c-b102-a06d8c3ace01 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=f09559a7-8e97-4c3a-9f8e-7aba558c9211,revision_number=None']} {{(pid=102993) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 23 19:34:33.230876 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.wsgi [-] (102993) accepted ('10.222.0.62', 43150) {{(pid=102993) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 23 19:34:33.244234 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-3049e252-a9c0-4c81-811c-eabac6d55356 admin admin] Publish callbacks [] for security_group, before_create {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:34:33.318053 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-3049e252-a9c0-4c81-811c-eabac6d55356 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:34:33.390686 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-04385505-5bc3-45de-a7ea-590667ec8579 req-76dadacf-b175-41c5-95ea-6d078ff3f9e2 tempest-ServerRescueNegativeTestJSON-1447477341 tempest-ServerRescueNegativeTestJSON-1447477341-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102992) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:34:33.392335 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-04385505-5bc3-45de-a7ea-590667ec8579 req-76dadacf-b175-41c5-95ea-6d078ff3f9e2 tempest-ServerRescueNegativeTestJSON-1447477341 tempest-ServerRescueNegativeTestJSON-1447477341-project] 10.222.0.62 "GET /v2.0/ports?device_id=90cb32bd-c375-400a-b79a-97fc61e2a3a3 HTTP/1.1" status: 200 len: 945 time: 0.0494206 Nov 23 19:34:33.393774 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-3049e252-a9c0-4c81-811c-eabac6d55356 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-623933'] for security_group, after_create {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:34:33.431571 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3049e252-a9c0-4c81-811c-eabac6d55356 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=efd98a59-20d0-46df-8934-d53f7605d4dc,revision_number=1']} {{(pid=102993) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 23 19:34:33.435843 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [None req-3049e252-a9c0-4c81-811c-eabac6d55356 admin admin] 10.222.0.62 "GET /v2.0/security-groups?tenant_id=22d82e3212ff4217ac83f1d2c7c124e0&name=default HTTP/1.1" status: 200 len: 2996 time: 0.2039461 Nov 23 19:34:33.440629 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.wsgi [-] (102993) accepted ('10.222.0.62', 43154) {{(pid=102993) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 23 19:34:33.441627 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-04385505-5bc3-45de-a7ea-590667ec8579 req-6417ddb0-fd23-4026-ae84-924161e526c6 tempest-ServerRescueNegativeTestJSON-1447477341 tempest-ServerRescueNegativeTestJSON-1447477341-project] 10.222.0.62 "GET /v2.0/security-groups?id=62a09434-acf0-424f-9001-2c3a78119364&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0432129 Nov 23 19:34:33.493487 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-740664e2-23c6-4ee4-bc8d-2e28fa235432 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:34:33.514491 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-740664e2-23c6-4ee4-bc8d-2e28fa235432 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:34:33.617350 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-740664e2-23c6-4ee4-bc8d-2e28fa235432 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-623933'] for security_group, after_delete {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:34:33.620065 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-740664e2-23c6-4ee4-bc8d-2e28fa235432 admin admin] Publish callbacks [] for security_group, before_response {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:34:33.621262 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [None req-740664e2-23c6-4ee4-bc8d-2e28fa235432 admin admin] 10.222.0.62 "DELETE /v2.0/security-groups/efd98a59-20d0-46df-8934-d53f7605d4dc HTTP/1.1" status: 204 len: 168 time: 0.1796539 Nov 23 19:34:33.629029 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-740664e2-23c6-4ee4-bc8d-2e28fa235432 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=efd98a59-20d0-46df-8934-d53f7605d4dc,revision_number=None']} {{(pid=102993) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 23 19:34:34.299267 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.wsgi [-] (102993) accepted ('10.222.0.62', 43170) {{(pid=102993) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 23 19:34:34.312156 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-58d58ed7-dfac-4b15-8966-f9b16e1b8601 admin admin] Publish callbacks [] for security_group, before_create {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:34:34.382887 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-58d58ed7-dfac-4b15-8966-f9b16e1b8601 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:34:34.427718 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-58d58ed7-dfac-4b15-8966-f9b16e1b8601 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-623933'] for security_group, after_create {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:34:34.468289 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [None req-58d58ed7-dfac-4b15-8966-f9b16e1b8601 admin admin] 10.222.0.62 "GET /v2.0/security-groups?tenant_id=b8bda7b7e19a453d92dec7cb9cda930f&name=default HTTP/1.1" status: 200 len: 2996 time: 0.1678643 Nov 23 19:34:34.469010 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-58d58ed7-dfac-4b15-8966-f9b16e1b8601 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=79c74795-f3d4-4310-a665-4b4d51d69a86,revision_number=1']} {{(pid=102993) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 23 19:34:34.471923 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.wsgi [-] (102992) accepted ('10.222.0.62', 43174) {{(pid=102992) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 23 19:34:34.560250 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [None req-ee342f77-00ca-4f0d-8953-c8b7978c297a admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:34:34.589147 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ec009f27-1f87-4c52-afca-c33c2f2715ae req-db2c2da0-02a6-489f-a8d1-f71bf9e47669 tempest-ServerRescueNegativeTestJSON-1447477341 tempest-ServerRescueNegativeTestJSON-1447477341-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102992) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:34:34.590734 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-ec009f27-1f87-4c52-afca-c33c2f2715ae req-db2c2da0-02a6-489f-a8d1-f71bf9e47669 tempest-ServerRescueNegativeTestJSON-1447477341 tempest-ServerRescueNegativeTestJSON-1447477341-project] 10.222.0.62 "GET /v2.0/ports?device_id=90cb32bd-c375-400a-b79a-97fc61e2a3a3 HTTP/1.1" status: 200 len: 945 time: 0.0747068 Nov 23 19:34:34.595313 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [None req-ee342f77-00ca-4f0d-8953-c8b7978c297a admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:34:34.662541 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-ec009f27-1f87-4c52-afca-c33c2f2715ae req-985cebe3-0649-4588-b5c4-36b7084c16c0 tempest-ServerRescueNegativeTestJSON-1447477341 tempest-ServerRescueNegativeTestJSON-1447477341-project] 10.222.0.62 "GET /v2.0/security-groups?id=62a09434-acf0-424f-9001-2c3a78119364&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0652292 Nov 23 19:34:34.753547 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [None req-ee342f77-00ca-4f0d-8953-c8b7978c297a admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-623933'] for security_group, after_delete {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:34:34.757487 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [None req-ee342f77-00ca-4f0d-8953-c8b7978c297a admin admin] Publish callbacks [] for security_group, before_response {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:34:34.758624 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [None req-ee342f77-00ca-4f0d-8953-c8b7978c297a admin admin] 10.222.0.62 "DELETE /v2.0/security-groups/79c74795-f3d4-4310-a665-4b4d51d69a86 HTTP/1.1" status: 204 len: 168 time: 0.2853951 Nov 23 19:34:34.766558 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ee342f77-00ca-4f0d-8953-c8b7978c297a admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=79c74795-f3d4-4310-a665-4b4d51d69a86,revision_number=None']} {{(pid=102992) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 23 19:34:35.648069 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.wsgi [-] (102992) accepted ('10.222.0.62', 43228) {{(pid=102992) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 23 19:34:35.779103 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [None req-46f2d8e4-5bd9-4b15-8a8d-a71bad034024 admin admin] Publish callbacks [] for security_group, before_create {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:34:35.826574 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-af0ef6ea-cd4b-4cd7-a044-8dde90df90d0 req-b8b5858f-07f1-4233-8913-77cbeb18df18 tempest-ServerRescueNegativeTestJSON-1447477341 tempest-ServerRescueNegativeTestJSON-1447477341-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102992) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:34:35.828150 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-af0ef6ea-cd4b-4cd7-a044-8dde90df90d0 req-b8b5858f-07f1-4233-8913-77cbeb18df18 tempest-ServerRescueNegativeTestJSON-1447477341 tempest-ServerRescueNegativeTestJSON-1447477341-project] 10.222.0.62 "GET /v2.0/ports?device_id=90cb32bd-c375-400a-b79a-97fc61e2a3a3 HTTP/1.1" status: 200 len: 945 time: 0.0928118 Nov 23 19:34:35.902153 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-af0ef6ea-cd4b-4cd7-a044-8dde90df90d0 req-fd41e19e-6180-4fe0-bfec-f1377905d8e8 tempest-ServerRescueNegativeTestJSON-1447477341 tempest-ServerRescueNegativeTestJSON-1447477341-project] 10.222.0.62 "GET /v2.0/security-groups?id=62a09434-acf0-424f-9001-2c3a78119364&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0658400 Nov 23 19:34:35.931777 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [None req-46f2d8e4-5bd9-4b15-8a8d-a71bad034024 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:34:35.999767 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [None req-46f2d8e4-5bd9-4b15-8a8d-a71bad034024 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-623933'] for security_group, after_create {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:34:36.040693 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [None req-46f2d8e4-5bd9-4b15-8a8d-a71bad034024 admin admin] 10.222.0.62 "GET /v2.0/security-groups?tenant_id=c376d25cfd0645a1bd0d2dea2e61b14e&name=default HTTP/1.1" status: 200 len: 2996 time: 0.3915260 Nov 23 19:34:36.042766 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-46f2d8e4-5bd9-4b15-8a8d-a71bad034024 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=5180635e-0623-4fbc-948b-4556ec1a3510,revision_number=1']} {{(pid=102992) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 23 19:34:36.043459 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.wsgi [-] (102993) accepted ('10.222.0.62', 43250) {{(pid=102993) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 23 19:34:36.101323 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-5246ae12-7786-4548-ac7e-19d8d2ea6c41 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:34:36.123373 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-5246ae12-7786-4548-ac7e-19d8d2ea6c41 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:34:36.234085 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-5246ae12-7786-4548-ac7e-19d8d2ea6c41 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-623933'] for security_group, after_delete {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:34:36.236964 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-5246ae12-7786-4548-ac7e-19d8d2ea6c41 admin admin] Publish callbacks [] for security_group, before_response {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:34:36.238369 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [None req-5246ae12-7786-4548-ac7e-19d8d2ea6c41 admin admin] 10.222.0.62 "DELETE /v2.0/security-groups/5180635e-0623-4fbc-948b-4556ec1a3510 HTTP/1.1" status: 204 len: 168 time: 0.1938405 Nov 23 19:34:36.270151 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5246ae12-7786-4548-ac7e-19d8d2ea6c41 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=5180635e-0623-4fbc-948b-4556ec1a3510,revision_number=None']} {{(pid=102993) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 23 19:34:37.039843 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9714db02-7fd3-4c7f-bc0f-9e85f44352d3 req-3f80acce-95c7-4d1c-8271-d5005c83c628 tempest-ServerRescueNegativeTestJSON-1447477341 tempest-ServerRescueNegativeTestJSON-1447477341-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102992) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:34:37.047029 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-9714db02-7fd3-4c7f-bc0f-9e85f44352d3 req-3f80acce-95c7-4d1c-8271-d5005c83c628 tempest-ServerRescueNegativeTestJSON-1447477341 tempest-ServerRescueNegativeTestJSON-1447477341-project] 10.222.0.62 "GET /v2.0/ports?device_id=90cb32bd-c375-400a-b79a-97fc61e2a3a3 HTTP/1.1" status: 200 len: 945 time: 0.0590165 Nov 23 19:34:37.098947 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-9714db02-7fd3-4c7f-bc0f-9e85f44352d3 req-0326ca60-2e6c-4b0e-9ae9-f763b8bdc4d9 tempest-ServerRescueNegativeTestJSON-1447477341 tempest-ServerRescueNegativeTestJSON-1447477341-project] 10.222.0.62 "GET /v2.0/security-groups?id=62a09434-acf0-424f-9001-2c3a78119364&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0510435 Nov 23 19:34:37.562905 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.wsgi [-] (102993) accepted ('10.222.0.62', 43314) {{(pid=102993) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 23 19:34:37.869135 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-02069512-aae3-40c6-b75f-c8426de97c91 admin admin] Publish callbacks [] for security_group, before_create {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:34:37.947735 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-02069512-aae3-40c6-b75f-c8426de97c91 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:34:37.967247 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.wsgi [-] (102992) accepted ('10.222.0.62', 43322) {{(pid=102992) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 23 19:34:38.034279 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-02069512-aae3-40c6-b75f-c8426de97c91 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-623933'] for security_group, after_create {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:34:38.076814 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-02069512-aae3-40c6-b75f-c8426de97c91 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=6df6bd74-586d-4e3d-bb76-0fbfd422ebf0,revision_number=1']} {{(pid=102993) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 23 19:34:38.086551 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [None req-f3eb8a3f-51c9-4399-af7e-464955922c2f admin admin] Publish callbacks [] for security_group, before_create {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:34:38.093315 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [None req-02069512-aae3-40c6-b75f-c8426de97c91 admin admin] 10.222.0.62 "GET /v2.0/security-groups?tenant_id=b1b742d7d6cd4560b95273b99d07f2aa&name=default HTTP/1.1" status: 200 len: 2996 time: 0.5285599 Nov 23 19:34:38.095971 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.wsgi [-] (102993) accepted ('10.222.0.62', 43336) {{(pid=102993) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 23 19:34:38.152175 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-5e7cb0e7-74fb-448e-8e2d-6433054c53be admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:34:38.185688 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-5e7cb0e7-74fb-448e-8e2d-6433054c53be admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:34:38.197277 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [None req-f3eb8a3f-51c9-4399-af7e-464955922c2f admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:34:38.237972 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-019276cb-3566-4583-8fe1-d70778b717db req-0aba7053-e50c-4ef0-b41b-701368ae8475 tempest-ServerRescueNegativeTestJSON-1447477341 tempest-ServerRescueNegativeTestJSON-1447477341-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102992) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:34:38.239526 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-019276cb-3566-4583-8fe1-d70778b717db req-0aba7053-e50c-4ef0-b41b-701368ae8475 tempest-ServerRescueNegativeTestJSON-1447477341 tempest-ServerRescueNegativeTestJSON-1447477341-project] 10.222.0.62 "GET /v2.0/ports?device_id=90cb32bd-c375-400a-b79a-97fc61e2a3a3 HTTP/1.1" status: 200 len: 945 time: 0.0571992 Nov 23 19:34:38.273589 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [None req-f3eb8a3f-51c9-4399-af7e-464955922c2f admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-623933'] for security_group, after_create {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:34:38.319374 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-019276cb-3566-4583-8fe1-d70778b717db req-8eb5c11c-42a7-4c64-8db5-4b31de680d16 tempest-ServerRescueNegativeTestJSON-1447477341 tempest-ServerRescueNegativeTestJSON-1447477341-project] 10.222.0.62 "GET /v2.0/security-groups?id=62a09434-acf0-424f-9001-2c3a78119364&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0733039 Nov 23 19:34:38.327152 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [None req-f3eb8a3f-51c9-4399-af7e-464955922c2f admin admin] 10.222.0.62 "GET /v2.0/security-groups?tenant_id=f10ec19eeb9644d691133393f4700520&name=default HTTP/1.1" status: 200 len: 2996 time: 0.3626275 Nov 23 19:34:38.330035 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.wsgi [-] (102993) accepted ('10.222.0.62', 43344) {{(pid=102993) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 23 19:34:38.332328 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f3eb8a3f-51c9-4399-af7e-464955922c2f admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=6d25ed13-538a-49db-ad49-960278b065d2,revision_number=1']} {{(pid=102992) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 23 19:34:38.353970 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-5e7cb0e7-74fb-448e-8e2d-6433054c53be admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-623933'] for security_group, after_delete {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:34:38.356585 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-5e7cb0e7-74fb-448e-8e2d-6433054c53be admin admin] Publish callbacks [] for security_group, before_response {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:34:38.360177 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [None req-5e7cb0e7-74fb-448e-8e2d-6433054c53be admin admin] 10.222.0.62 "DELETE /v2.0/security-groups/6df6bd74-586d-4e3d-bb76-0fbfd422ebf0 HTTP/1.1" status: 204 len: 168 time: 0.2607956 Nov 23 19:34:38.392013 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5e7cb0e7-74fb-448e-8e2d-6433054c53be admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=6df6bd74-586d-4e3d-bb76-0fbfd422ebf0,revision_number=None']} {{(pid=102993) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 23 19:34:38.428057 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-f53ffe82-51e1-43e6-b2e4-a32c03694309 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:34:38.457696 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-f53ffe82-51e1-43e6-b2e4-a32c03694309 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:34:38.559722 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-f53ffe82-51e1-43e6-b2e4-a32c03694309 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-623933'] for security_group, after_delete {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:34:38.562734 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-f53ffe82-51e1-43e6-b2e4-a32c03694309 admin admin] Publish callbacks [] for security_group, before_response {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:34:38.564173 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [None req-f53ffe82-51e1-43e6-b2e4-a32c03694309 admin admin] 10.222.0.62 "DELETE /v2.0/security-groups/6d25ed13-538a-49db-ad49-960278b065d2 HTTP/1.1" status: 204 len: 168 time: 0.2324662 Nov 23 19:34:38.573876 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f53ffe82-51e1-43e6-b2e4-a32c03694309 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=6d25ed13-538a-49db-ad49-960278b065d2,revision_number=None']} {{(pid=102993) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 23 19:34:39.118508 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.wsgi [-] (102992) accepted ('10.222.0.62', 43378) {{(pid=102992) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 23 19:34:39.132748 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [None req-690a3e0a-b21f-4fcf-9bbd-7351aa256b32 admin admin] Publish callbacks [] for security_group, before_create {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:34:39.155896 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-738ad336-671f-49d1-9366-61dd00b648e5 req-8acc062e-bdfb-4060-9502-0508e89be7f6 tempest-DeleteServersTestJSON-453817978 tempest-DeleteServersTestJSON-453817978-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102993) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:34:39.157382 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-738ad336-671f-49d1-9366-61dd00b648e5 req-8acc062e-bdfb-4060-9502-0508e89be7f6 tempest-DeleteServersTestJSON-453817978 tempest-DeleteServersTestJSON-453817978-project] 10.222.0.62 "GET /v2.0/ports?device_id=5e3c1406-dc8c-414a-bcc5-55c7c963e1df HTTP/1.1" status: 200 len: 945 time: 0.0520895 Nov 23 19:34:39.223494 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-738ad336-671f-49d1-9366-61dd00b648e5 req-9820430f-e6c4-41d1-bbee-bdec420728a7 tempest-DeleteServersTestJSON-453817978 tempest-DeleteServersTestJSON-453817978-project] 10.222.0.62 "GET /v2.0/security-groups?id=5b5d5814-644d-45c2-ad35-f8920c3382b0&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0560393 Nov 23 19:34:39.223718 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [None req-690a3e0a-b21f-4fcf-9bbd-7351aa256b32 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:34:39.307934 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [None req-690a3e0a-b21f-4fcf-9bbd-7351aa256b32 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-623933'] for security_group, after_create {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:34:39.355442 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [None req-690a3e0a-b21f-4fcf-9bbd-7351aa256b32 admin admin] 10.222.0.62 "GET /v2.0/security-groups?tenant_id=1fa92d08844c446897deca64d27bca7e&name=default HTTP/1.1" status: 200 len: 2996 time: 0.2357185 Nov 23 19:34:39.356776 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-690a3e0a-b21f-4fcf-9bbd-7351aa256b32 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=a512f6da-1bd6-462a-9de4-6eec2bb532ce,revision_number=1']} {{(pid=102992) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 23 19:34:39.358086 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.wsgi [-] (102993) accepted ('10.222.0.62', 43388) {{(pid=102993) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 23 19:34:39.414493 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-c87c4943-9424-47d3-844d-36215a0d68ea admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:34:39.439180 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-c87c4943-9424-47d3-844d-36215a0d68ea admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:34:39.462991 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-23de7728-cb51-4005-a4c6-09fd35986247 req-bebd9f78-e1ea-4e4b-8eed-e029cf22e4f4 tempest-ServerRescueNegativeTestJSON-1447477341 tempest-ServerRescueNegativeTestJSON-1447477341-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102992) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:34:39.464970 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-23de7728-cb51-4005-a4c6-09fd35986247 req-bebd9f78-e1ea-4e4b-8eed-e029cf22e4f4 tempest-ServerRescueNegativeTestJSON-1447477341 tempest-ServerRescueNegativeTestJSON-1447477341-project] 10.222.0.62 "GET /v2.0/ports?device_id=90cb32bd-c375-400a-b79a-97fc61e2a3a3 HTTP/1.1" status: 200 len: 945 time: 0.0596225 Nov 23 19:34:39.517720 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-23de7728-cb51-4005-a4c6-09fd35986247 req-b964970a-297c-4813-b240-17d8b6b28e61 tempest-ServerRescueNegativeTestJSON-1447477341 tempest-ServerRescueNegativeTestJSON-1447477341-project] 10.222.0.62 "GET /v2.0/security-groups?id=62a09434-acf0-424f-9001-2c3a78119364&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0440435 Nov 23 19:34:39.593821 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-c87c4943-9424-47d3-844d-36215a0d68ea admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-623933'] for security_group, after_delete {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:34:39.596592 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-c87c4943-9424-47d3-844d-36215a0d68ea admin admin] Publish callbacks [] for security_group, before_response {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:34:39.597761 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [None req-c87c4943-9424-47d3-844d-36215a0d68ea admin admin] 10.222.0.62 "DELETE /v2.0/security-groups/a512f6da-1bd6-462a-9de4-6eec2bb532ce HTTP/1.1" status: 204 len: 168 time: 0.2384155 Nov 23 19:34:39.606842 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c87c4943-9424-47d3-844d-36215a0d68ea admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=a512f6da-1bd6-462a-9de4-6eec2bb532ce,revision_number=None']} {{(pid=102993) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 23 19:34:40.334272 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7f1df1be-4725-4423-8ca0-abbcf808979e req-9293e4c0-d8c6-49fb-b7bc-bef794f018f2 tempest-DeleteServersTestJSON-453817978 tempest-DeleteServersTestJSON-453817978-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102992) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:34:40.336297 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-7f1df1be-4725-4423-8ca0-abbcf808979e req-9293e4c0-d8c6-49fb-b7bc-bef794f018f2 tempest-DeleteServersTestJSON-453817978 tempest-DeleteServersTestJSON-453817978-project] 10.222.0.62 "GET /v2.0/ports?device_id=5e3c1406-dc8c-414a-bcc5-55c7c963e1df HTTP/1.1" status: 200 len: 945 time: 0.0488584 Nov 23 19:34:40.392247 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-7f1df1be-4725-4423-8ca0-abbcf808979e req-d1ab52d7-9705-40ef-9b8a-921e7f200432 tempest-DeleteServersTestJSON-453817978 tempest-DeleteServersTestJSON-453817978-project] 10.222.0.62 "GET /v2.0/security-groups?id=5b5d5814-644d-45c2-ad35-f8920c3382b0&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0495536 Nov 23 19:34:40.637847 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0886ca5f-bf27-4aba-ba4d-9e69925ec8f4 req-04269fa9-0a2f-4755-a8a3-8d76899a6eb6 tempest-ServerRescueNegativeTestJSON-1447477341 tempest-ServerRescueNegativeTestJSON-1447477341-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102992) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:34:40.639339 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-0886ca5f-bf27-4aba-ba4d-9e69925ec8f4 req-04269fa9-0a2f-4755-a8a3-8d76899a6eb6 tempest-ServerRescueNegativeTestJSON-1447477341 tempest-ServerRescueNegativeTestJSON-1447477341-project] 10.222.0.62 "GET /v2.0/ports?device_id=90cb32bd-c375-400a-b79a-97fc61e2a3a3 HTTP/1.1" status: 200 len: 945 time: 0.0529785 Nov 23 19:34:40.693966 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-0886ca5f-bf27-4aba-ba4d-9e69925ec8f4 req-9b53b2c9-b5bf-4636-b97b-293c522f27ec tempest-ServerRescueNegativeTestJSON-1447477341 tempest-ServerRescueNegativeTestJSON-1447477341-project] 10.222.0.62 "GET /v2.0/security-groups?id=62a09434-acf0-424f-9001-2c3a78119364&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0486293 Nov 23 19:34:41.506475 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dd6b8d37-31cf-4e56-afdc-162e7b5af440 req-b7abefe2-a315-482f-bdb3-32ff5c97b4a1 tempest-DeleteServersTestJSON-453817978 tempest-DeleteServersTestJSON-453817978-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102992) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:34:41.508201 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-dd6b8d37-31cf-4e56-afdc-162e7b5af440 req-b7abefe2-a315-482f-bdb3-32ff5c97b4a1 tempest-DeleteServersTestJSON-453817978 tempest-DeleteServersTestJSON-453817978-project] 10.222.0.62 "GET /v2.0/ports?device_id=5e3c1406-dc8c-414a-bcc5-55c7c963e1df HTTP/1.1" status: 200 len: 945 time: 0.0501969 Nov 23 19:34:41.555873 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-dd6b8d37-31cf-4e56-afdc-162e7b5af440 req-17dba6c8-0195-4116-a3a3-0d08338db58b tempest-DeleteServersTestJSON-453817978 tempest-DeleteServersTestJSON-453817978-project] 10.222.0.62 "GET /v2.0/security-groups?id=5b5d5814-644d-45c2-ad35-f8920c3382b0&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0417256 Nov 23 19:34:41.708819 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron_lib.callbacks.manager [None req-1b4f3f21-819a-4bbd-b617-05e69b04839f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8783631323329', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7978582'] for agent, after_update {{(pid=102994) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:34:41.805655 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e9012ccc-3b68-4f77-8889-37965a37aa69 req-70daf483-5a57-4d16-a3d7-cd82f08f871f tempest-ServerRescueNegativeTestJSON-1447477341 tempest-ServerRescueNegativeTestJSON-1447477341-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102992) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:34:41.807216 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-e9012ccc-3b68-4f77-8889-37965a37aa69 req-70daf483-5a57-4d16-a3d7-cd82f08f871f tempest-ServerRescueNegativeTestJSON-1447477341 tempest-ServerRescueNegativeTestJSON-1447477341-project] 10.222.0.62 "GET /v2.0/ports?device_id=90cb32bd-c375-400a-b79a-97fc61e2a3a3 HTTP/1.1" status: 200 len: 945 time: 0.0491514 Nov 23 19:34:41.858911 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-e9012ccc-3b68-4f77-8889-37965a37aa69 req-46309431-90ba-4f1e-b0c1-979759c3044e tempest-ServerRescueNegativeTestJSON-1447477341 tempest-ServerRescueNegativeTestJSON-1447477341-project] 10.222.0.62 "GET /v2.0/security-groups?id=62a09434-acf0-424f-9001-2c3a78119364&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0454173 Nov 23 19:34:42.668664 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cf19db80-2054-493d-9b84-5cbb5568ea2e req-9088af13-793b-40f5-95f1-abef50af09c7 tempest-DeleteServersTestJSON-453817978 tempest-DeleteServersTestJSON-453817978-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102992) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:34:42.670194 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-cf19db80-2054-493d-9b84-5cbb5568ea2e req-9088af13-793b-40f5-95f1-abef50af09c7 tempest-DeleteServersTestJSON-453817978 tempest-DeleteServersTestJSON-453817978-project] 10.222.0.62 "GET /v2.0/ports?device_id=5e3c1406-dc8c-414a-bcc5-55c7c963e1df HTTP/1.1" status: 200 len: 945 time: 0.0483146 Nov 23 19:34:42.718438 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-cf19db80-2054-493d-9b84-5cbb5568ea2e req-d26ae35a-e026-47c4-a1f6-1ed8e647d767 tempest-DeleteServersTestJSON-453817978 tempest-DeleteServersTestJSON-453817978-project] 10.222.0.62 "GET /v2.0/security-groups?id=5b5d5814-644d-45c2-ad35-f8920c3382b0&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0421176 Nov 23 19:34:42.979777 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d06e4f48-c05e-41c1-98ac-a5d7a5ce5013 req-0f417ec9-1c10-4841-839c-303f7ff68351 tempest-ServerRescueNegativeTestJSON-1447477341 tempest-ServerRescueNegativeTestJSON-1447477341-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102993) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:34:42.979777 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-d06e4f48-c05e-41c1-98ac-a5d7a5ce5013 req-0f417ec9-1c10-4841-839c-303f7ff68351 tempest-ServerRescueNegativeTestJSON-1447477341 tempest-ServerRescueNegativeTestJSON-1447477341-project] 10.222.0.62 "GET /v2.0/ports?device_id=90cb32bd-c375-400a-b79a-97fc61e2a3a3 HTTP/1.1" status: 200 len: 945 time: 0.0487247 Nov 23 19:34:43.026142 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-d06e4f48-c05e-41c1-98ac-a5d7a5ce5013 req-48e2f79c-9bd6-4231-b1c5-8bd0e71f03c3 tempest-ServerRescueNegativeTestJSON-1447477341 tempest-ServerRescueNegativeTestJSON-1447477341-project] 10.222.0.62 "GET /v2.0/security-groups?id=62a09434-acf0-424f-9001-2c3a78119364&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0410371 Nov 23 19:34:43.854460 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c7522d87-d679-4cff-b5ee-6c7f54cee7d6 req-2ee5ada2-3716-4ece-bb1f-5a1e56ec3630 tempest-DeleteServersTestJSON-453817978 tempest-DeleteServersTestJSON-453817978-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102993) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:34:43.856110 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-c7522d87-d679-4cff-b5ee-6c7f54cee7d6 req-2ee5ada2-3716-4ece-bb1f-5a1e56ec3630 tempest-DeleteServersTestJSON-453817978 tempest-DeleteServersTestJSON-453817978-project] 10.222.0.62 "GET /v2.0/ports?device_id=5e3c1406-dc8c-414a-bcc5-55c7c963e1df HTTP/1.1" status: 200 len: 945 time: 0.0694134 Nov 23 19:34:43.902589 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-c7522d87-d679-4cff-b5ee-6c7f54cee7d6 req-7f6e00f3-1cd4-4dc2-94e5-52552bb54a29 tempest-DeleteServersTestJSON-453817978 tempest-DeleteServersTestJSON-453817978-project] 10.222.0.62 "GET /v2.0/security-groups?id=5b5d5814-644d-45c2-ad35-f8920c3382b0&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0400870 Nov 23 19:34:44.152085 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b4c9c943-ff07-4442-b888-c92738e99484 req-c38ac684-0473-417e-a79c-d174989e74ee tempest-ServerRescueNegativeTestJSON-1447477341 tempest-ServerRescueNegativeTestJSON-1447477341-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102992) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:34:44.153627 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-b4c9c943-ff07-4442-b888-c92738e99484 req-c38ac684-0473-417e-a79c-d174989e74ee tempest-ServerRescueNegativeTestJSON-1447477341 tempest-ServerRescueNegativeTestJSON-1447477341-project] 10.222.0.62 "GET /v2.0/ports?device_id=90cb32bd-c375-400a-b79a-97fc61e2a3a3 HTTP/1.1" status: 200 len: 945 time: 0.0538599 Nov 23 19:34:44.212002 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-b4c9c943-ff07-4442-b888-c92738e99484 req-41fe4113-9ebe-4b17-b863-ef680ceb2d83 tempest-ServerRescueNegativeTestJSON-1447477341 tempest-ServerRescueNegativeTestJSON-1447477341-project] 10.222.0.62 "GET /v2.0/security-groups?id=62a09434-acf0-424f-9001-2c3a78119364&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0499303 Nov 23 19:34:44.245477 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron_lib.callbacks.manager [None req-306d7b48-1824-4624-adbe-fc5af3e6a0cb None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8783631323329', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7978582'] for agent, after_update {{(pid=102994) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:34:44.658861 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e5d47e56-6857-4863-90f8-114e8e2a5505 req-555d0c2a-73c7-49c5-b2e2-82e7c624fef4 tempest-DeleteServersTestJSON-453817978 tempest-DeleteServersTestJSON-453817978-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102993) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:34:44.660377 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-e5d47e56-6857-4863-90f8-114e8e2a5505 req-555d0c2a-73c7-49c5-b2e2-82e7c624fef4 tempest-DeleteServersTestJSON-453817978 tempest-DeleteServersTestJSON-453817978-project] 10.222.0.41 "GET /v2.0/ports?device_id=5e3c1406-dc8c-414a-bcc5-55c7c963e1df HTTP/1.1" status: 200 len: 945 time: 0.0506654 Nov 23 19:34:44.814592 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.plugins.ml2.plugin [req-e5d47e56-6857-4863-90f8-114e8e2a5505 req-0001f22e-b2c5-4fef-bf5e-e10daeccde08 tempest-DeleteServersTestJSON-453817978 tempest-DeleteServersTestJSON-453817978-project] Deleting port 8c70d83a-558d-4a92-a3e8-15396107e64d {{(pid=102993) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 23 19:34:44.814942 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [req-e5d47e56-6857-4863-90f8-114e8e2a5505 req-0001f22e-b2c5-4fef-bf5e-e10daeccde08 tempest-DeleteServersTestJSON-453817978 tempest-DeleteServersTestJSON-453817978-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8783631423070'] for port, before_delete {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:34:44.908316 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.plugins.ml2.db [req-e5d47e56-6857-4863-90f8-114e8e2a5505 req-0001f22e-b2c5-4fef-bf5e-e10daeccde08 tempest-DeleteServersTestJSON-453817978 tempest-DeleteServersTestJSON-453817978-project] For port 8c70d83a-558d-4a92-a3e8-15396107e64d, host hv-cinder-81901, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81901',level=0,port_id=8c70d83a-558d-4a92-a3e8-15396107e64d,segment=NetworkSegment(6f1d4a41-ab87-4da1-b83c-5e20faf1683c),segment_id=6f1d4a41-ab87-4da1-b83c-5e20faf1683c)] {{(pid=102993) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 23 19:34:44.908676 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [req-e5d47e56-6857-4863-90f8-114e8e2a5505 req-0001f22e-b2c5-4fef-bf5e-e10daeccde08 tempest-DeleteServersTestJSON-453817978 tempest-DeleteServersTestJSON-453817978-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-927332'] for port, precommit_delete {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:34:44.923608 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.plugins.ml2.plugin [req-e5d47e56-6857-4863-90f8-114e8e2a5505 req-0001f22e-b2c5-4fef-bf5e-e10daeccde08 tempest-DeleteServersTestJSON-453817978 tempest-DeleteServersTestJSON-453817978-project] Calling delete_port for 8c70d83a-558d-4a92-a3e8-15396107e64d owned by compute:nova {{(pid=102993) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 23 19:34:45.025454 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7b16c184-c610-4342-9504-94c6eb2611d4 req-e69e2aae-9e84-4959-acc1-77d2e18b3bce tempest-DeleteServersTestJSON-453817978 tempest-DeleteServersTestJSON-453817978-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102992) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:34:45.027025 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-7b16c184-c610-4342-9504-94c6eb2611d4 req-e69e2aae-9e84-4959-acc1-77d2e18b3bce tempest-DeleteServersTestJSON-453817978 tempest-DeleteServersTestJSON-453817978-project] 10.222.0.62 "GET /v2.0/ports?device_id=5e3c1406-dc8c-414a-bcc5-55c7c963e1df HTTP/1.1" status: 200 len: 945 time: 0.0570014 Nov 23 19:34:45.091424 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron_lib.callbacks.manager [None req-8346ef05-f685-4c3d-af3d-a159b683bec2 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8783631323329', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7978582'] for agent, after_update {{(pid=102994) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:34:45.095176 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-7b16c184-c610-4342-9504-94c6eb2611d4 req-cc4eb666-4743-4626-b078-13742de0c33b tempest-DeleteServersTestJSON-453817978 tempest-DeleteServersTestJSON-453817978-project] 10.222.0.62 "GET /v2.0/security-groups?id=5b5d5814-644d-45c2-ad35-f8920c3382b0&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0585916 Nov 23 19:34:45.177117 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [req-e5d47e56-6857-4863-90f8-114e8e2a5505 req-0001f22e-b2c5-4fef-bf5e-e10daeccde08 tempest-DeleteServersTestJSON-453817978 tempest-DeleteServersTestJSON-453817978-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7918660', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-15067', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560168', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8783631424624', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8783631008723'] for port, after_delete {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:34:45.201614 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.plugins.ml2.db [None req-4bf48ff4-ecfb-4168-8b63-249b8c6e9f04 None None] get_ports_and_sgs() called for port_ids ['8c70d83a-558d-4a92-a3e8-15396107e64d'] {{(pid=102994) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 23 19:34:45.207189 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0001f22e-b2c5-4fef-bf5e-e10daeccde08 tempest-DeleteServersTestJSON-453817978 tempest-DeleteServersTestJSON-453817978-project] Pushing event deleted for resources: {'Port': ['ID=8c70d83a-558d-4a92-a3e8-15396107e64d,revision_number=None']} {{(pid=102993) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 23 19:34:45.465951 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.db.l3_dvrscheduler_db [req-e5d47e56-6857-4863-90f8-114e8e2a5505 req-0001f22e-b2c5-4fef-bf5e-e10daeccde08 tempest-DeleteServersTestJSON-453817978 tempest-DeleteServersTestJSON-453817978-project] No DVR routers for this DVR port 8c70d83a-558d-4a92-a3e8-15396107e64d on host hv-cinder-81901 {{(pid=102993) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 23 19:34:45.476090 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [req-e5d47e56-6857-4863-90f8-114e8e2a5505 req-0001f22e-b2c5-4fef-bf5e-e10daeccde08 tempest-DeleteServersTestJSON-453817978 tempest-DeleteServersTestJSON-453817978-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-514902'] for port, before_response {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:34:45.479448 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-e5d47e56-6857-4863-90f8-114e8e2a5505 req-0001f22e-b2c5-4fef-bf5e-e10daeccde08 tempest-DeleteServersTestJSON-453817978 tempest-DeleteServersTestJSON-453817978-project] 10.222.0.41 "DELETE /v2.0/ports/8c70d83a-558d-4a92-a3e8-15396107e64d HTTP/1.1" status: 204 len: 173 time: 0.8104742 Nov 23 19:34:45.481103 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '5e3c1406-dc8c-414a-bcc5-55c7c963e1df', 'name': 'network-vif-deleted', 'tag': '8c70d83a-558d-4a92-a3e8-15396107e64d'}] {{(pid=102993) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 23 19:34:45.483480 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.62/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}9b10b92acbee16fb695be1efeed0b68f7c36a5b215ec004a8d9d707fa3d35b2c" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-ad39b585-06c8-4fba-817c-182241488d48" -d '{"events": [{"server_uuid": "5e3c1406-dc8c-414a-bcc5-55c7c963e1df", "name": "network-vif-deleted", "tag": "8c70d83a-558d-4a92-a3e8-15396107e64d"}]}' {{(pid=102993) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 23 19:34:45.521149 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1da765ef-29cd-4796-a75b-6900079b3a86 req-dc1326fc-b8f5-4302-8967-bd4ae4d9e076 tempest-ServerRescueNegativeTestJSON-1447477341 tempest-ServerRescueNegativeTestJSON-1447477341-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102993) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:34:45.522621 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-1da765ef-29cd-4796-a75b-6900079b3a86 req-dc1326fc-b8f5-4302-8967-bd4ae4d9e076 tempest-ServerRescueNegativeTestJSON-1447477341 tempest-ServerRescueNegativeTestJSON-1447477341-project] 10.222.0.62 "GET /v2.0/ports?device_id=90cb32bd-c375-400a-b79a-97fc61e2a3a3 HTTP/1.1" status: 200 len: 945 time: 0.0581486 Nov 23 19:34:45.536273 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 23 Nov 2021 19:34:45 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-d4d326c6-545d-4a53-8623-c8e7475189e0 x-openstack-request-id: req-d4d326c6-545d-4a53-8623-c8e7475189e0 {{(pid=102993) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 23 19:34:45.541743 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "5e3c1406-dc8c-414a-bcc5-55c7c963e1df", "name": "network-vif-deleted", "tag": "8c70d83a-558d-4a92-a3e8-15396107e64d", "status": "completed", "code": 200}]} {{(pid=102993) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 23 19:34:45.541743 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.62/compute/v2.1/os-server-external-events used request id req-d4d326c6-545d-4a53-8623-c8e7475189e0 {{(pid=102993) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 23 19:34:45.541743 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '5e3c1406-dc8c-414a-bcc5-55c7c963e1df', 'name': 'network-vif-deleted', 'tag': '8c70d83a-558d-4a92-a3e8-15396107e64d', 'status': 'completed', 'code': 200} Nov 23 19:34:45.577467 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-1da765ef-29cd-4796-a75b-6900079b3a86 req-fa5d17cb-7e7e-43b5-a71d-c8b5d4577b97 tempest-ServerRescueNegativeTestJSON-1447477341 tempest-ServerRescueNegativeTestJSON-1447477341-project] 10.222.0.62 "GET /v2.0/security-groups?id=62a09434-acf0-424f-9001-2c3a78119364&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0482051 Nov 23 19:34:46.201502 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-9178559f-b977-4074-b9c8-1ecf702f1d6f req-bae4a345-aea6-4023-b73d-82c763202acf tempest-DeleteServersTestJSON-453817978 tempest-DeleteServersTestJSON-453817978-project] 10.222.0.62 "GET /v2.0/ports?device_id=5e3c1406-dc8c-414a-bcc5-55c7c963e1df HTTP/1.1" status: 200 len: 210 time: 0.0292141 Nov 23 19:34:46.622104 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron_lib.callbacks.manager [None req-785c1d26-11ba-42d8-b5a6-51a8b3daeef0 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8783631323329', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7978582'] for agent, after_update {{(pid=102994) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:34:46.708042 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d7a4e46a-8841-43c1-a644-5196ed7b9b99 req-53a5914f-0ee8-4a75-a3be-e841afd443f7 tempest-ServerRescueNegativeTestJSON-1447477341 tempest-ServerRescueNegativeTestJSON-1447477341-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102992) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:34:46.714425 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-d7a4e46a-8841-43c1-a644-5196ed7b9b99 req-53a5914f-0ee8-4a75-a3be-e841afd443f7 tempest-ServerRescueNegativeTestJSON-1447477341 tempest-ServerRescueNegativeTestJSON-1447477341-project] 10.222.0.62 "GET /v2.0/ports?device_id=90cb32bd-c375-400a-b79a-97fc61e2a3a3 HTTP/1.1" status: 200 len: 945 time: 0.0505304 Nov 23 19:34:46.760826 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-d7a4e46a-8841-43c1-a644-5196ed7b9b99 req-c6ebcdfc-9cdf-43c1-abe6-6e285aa007be tempest-ServerRescueNegativeTestJSON-1447477341 tempest-ServerRescueNegativeTestJSON-1447477341-project] 10.222.0.62 "GET /v2.0/security-groups?id=62a09434-acf0-424f-9001-2c3a78119364&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0451386 Nov 23 19:34:47.337701 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron_lib.callbacks.manager [None req-eb87b2c3-3339-4249-8b85-e695b5b4e1f9 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8783631323329', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7978582'] for agent, after_update {{(pid=102994) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:34:47.667020 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.wsgi [-] (102992) accepted ('10.222.0.62', 43670) {{(pid=102992) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 23 19:34:47.797158 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [None req-e9ee946c-bcb2-4e72-870e-d84bef5f60d4 admin admin] Publish callbacks [] for security_group, before_create {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:34:47.912136 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-90df510e-010e-41c1-9db7-a4ed68827108 req-e9b882a2-22b7-4a40-a00f-f42939fbd4e2 tempest-ServerRescueNegativeTestJSON-1447477341 tempest-ServerRescueNegativeTestJSON-1447477341-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102992) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:34:47.913710 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-90df510e-010e-41c1-9db7-a4ed68827108 req-e9b882a2-22b7-4a40-a00f-f42939fbd4e2 tempest-ServerRescueNegativeTestJSON-1447477341 tempest-ServerRescueNegativeTestJSON-1447477341-project] 10.222.0.62 "GET /v2.0/ports?device_id=90cb32bd-c375-400a-b79a-97fc61e2a3a3 HTTP/1.1" status: 200 len: 945 time: 0.0726755 Nov 23 19:34:47.923827 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [None req-e9ee946c-bcb2-4e72-870e-d84bef5f60d4 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:34:47.965128 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-90df510e-010e-41c1-9db7-a4ed68827108 req-7c3a6ea4-7ceb-4606-bba7-d53ca3a0f6e0 tempest-ServerRescueNegativeTestJSON-1447477341 tempest-ServerRescueNegativeTestJSON-1447477341-project] 10.222.0.62 "GET /v2.0/security-groups?id=62a09434-acf0-424f-9001-2c3a78119364&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0434546 Nov 23 19:34:48.005122 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [None req-e9ee946c-bcb2-4e72-870e-d84bef5f60d4 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-623933'] for security_group, after_create {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:34:48.045201 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [None req-e9ee946c-bcb2-4e72-870e-d84bef5f60d4 admin admin] 10.222.0.62 "GET /v2.0/security-groups?tenant_id=2226f93483d94e5b9fb564e4e5fa9306&name=default HTTP/1.1" status: 200 len: 2996 time: 0.3770483 Nov 23 19:34:48.046077 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e9ee946c-bcb2-4e72-870e-d84bef5f60d4 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=37ee573d-b7dc-4383-9345-dad6e94ddb51,revision_number=1']} {{(pid=102992) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 23 19:34:48.048071 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.wsgi [-] (102993) accepted ('10.222.0.62', 43682) {{(pid=102993) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 23 19:34:48.097135 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-218f596a-d7f4-4fd1-b696-97276c36f7a3 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:34:48.118508 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-218f596a-d7f4-4fd1-b696-97276c36f7a3 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:34:48.251368 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-218f596a-d7f4-4fd1-b696-97276c36f7a3 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-623933'] for security_group, after_delete {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:34:48.254120 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-218f596a-d7f4-4fd1-b696-97276c36f7a3 admin admin] Publish callbacks [] for security_group, before_response {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:34:48.257590 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [None req-218f596a-d7f4-4fd1-b696-97276c36f7a3 admin admin] 10.222.0.62 "DELETE /v2.0/security-groups/37ee573d-b7dc-4383-9345-dad6e94ddb51 HTTP/1.1" status: 204 len: 168 time: 0.2061996 Nov 23 19:34:48.264229 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-218f596a-d7f4-4fd1-b696-97276c36f7a3 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=37ee573d-b7dc-4383-9345-dad6e94ddb51,revision_number=None']} {{(pid=102993) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 23 19:34:48.817341 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.plugins.ml2.rpc [None req-4bf48ff4-ecfb-4168-8b63-249b8c6e9f04 None None] Device 8c70d83a-558d-4a92-a3e8-15396107e64d no longer exists at agent hyperv_hv-cinder-81901 {{(pid=102994) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 23 19:34:48.841278 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.plugins.ml2.plugin [None req-4bf48ff4-ecfb-4168-8b63-249b8c6e9f04 None None] No Port match for: 8c70d83a-558d-4a92-a3e8-15396107e64d {{(pid=102994) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 23 19:34:48.841663 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.plugins.ml2.rpc [None req-4bf48ff4-ecfb-4168-8b63-249b8c6e9f04 None None] Device 8c70d83a-558d-4a92-a3e8-15396107e64d not bound to the agent host hv-cinder-81901 {{(pid=102994) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 23 19:34:48.877360 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.wsgi [-] (102993) accepted ('10.222.0.62', 43714) {{(pid=102993) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 23 19:34:48.925071 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.db.db_base_plugin_v2 [None req-aa81aabf-6a3d-4ef6-9053-91085ffc105b admin admin] Deleting subnet c1e8e6ce-3e67-4ef5-bbc3-db04880e7fab {{(pid=102993) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Nov 23 19:34:48.928146 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-aa81aabf-6a3d-4ef6-9053-91085ffc105b admin admin] Publish callbacks [] for subnet, before_delete {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:34:48.967842 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-aa81aabf-6a3d-4ef6-9053-91085ffc105b admin admin] Publish callbacks [] for subnet, precommit_delete_associations {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:34:48.990504 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-aa81aabf-6a3d-4ef6-9053-91085ffc105b admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-7975863'] for subnet, precommit_delete {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:34:49.109940 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ad8d3488-ac96-413c-8302-d76866eda48d req-95898775-638f-46b7-b4c6-34770c8ccf9d tempest-ServerRescueNegativeTestJSON-1447477341 tempest-ServerRescueNegativeTestJSON-1447477341-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102992) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:34:49.111513 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-ad8d3488-ac96-413c-8302-d76866eda48d req-95898775-638f-46b7-b4c6-34770c8ccf9d tempest-ServerRescueNegativeTestJSON-1447477341 tempest-ServerRescueNegativeTestJSON-1447477341-project] 10.222.0.62 "GET /v2.0/ports?device_id=90cb32bd-c375-400a-b79a-97fc61e2a3a3 HTTP/1.1" status: 200 len: 945 time: 0.0676763 Nov 23 19:34:49.143016 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-aa81aabf-6a3d-4ef6-9053-91085ffc105b admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-7982148', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-554858', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560168'] for subnet, after_delete {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:34:49.168680 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-ad8d3488-ac96-413c-8302-d76866eda48d req-abeea236-3fb9-40a1-a6e6-ad7513f4d509 tempest-ServerRescueNegativeTestJSON-1447477341 tempest-ServerRescueNegativeTestJSON-1447477341-project] 10.222.0.62 "GET /v2.0/security-groups?id=62a09434-acf0-424f-9001-2c3a78119364&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0511165 Nov 23 19:34:49.184366 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-aa81aabf-6a3d-4ef6-9053-91085ffc105b admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-560186'] for subnet, before_response {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:34:49.188425 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [None req-aa81aabf-6a3d-4ef6-9053-91085ffc105b admin admin] 10.222.0.62 "DELETE /v2.0/subnets/c1e8e6ce-3e67-4ef5-bbc3-db04880e7fab HTTP/1.1" status: 204 len: 168 time: 0.3092442 Nov 23 19:34:49.189629 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-aa81aabf-6a3d-4ef6-9053-91085ffc105b admin admin] Pushing event deleted for resources: {'Subnet': ['ID=c1e8e6ce-3e67-4ef5-bbc3-db04880e7fab,revision_number=None']} {{(pid=102993) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 23 19:34:49.191397 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.wsgi [-] (102992) accepted ('10.222.0.62', 43738) {{(pid=102992) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 23 19:34:49.269114 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [None req-b2db8ee2-f4ad-47bf-8723-328a1c812a47 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-8133038'] for network, before_delete {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:34:49.354149 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [None req-b2db8ee2-f4ad-47bf-8723-328a1c812a47 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-7977576', 'neutron.services.segments.db._delete_segments_for_network-8783631323320'] for network, precommit_delete {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:34:49.374746 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [None req-b2db8ee2-f4ad-47bf-8723-328a1c812a47 admin admin] Subscribe: > segment before_delete 55550000 {{(pid=102992) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 23 19:34:49.375123 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [None req-b2db8ee2-f4ad-47bf-8723-328a1c812a47 admin admin] Subscribe: > subnet precommit_delete_associations 55550000 {{(pid=102992) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 23 19:34:49.375886 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [None req-b2db8ee2-f4ad-47bf-8723-328a1c812a47 admin admin] Subscribe: > segment_host_mapping after_create 55550000 {{(pid=102992) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 23 19:34:49.376241 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [None req-b2db8ee2-f4ad-47bf-8723-328a1c812a47 admin admin] Subscribe: > port after_create 55550000 {{(pid=102992) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 23 19:34:49.376593 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [None req-b2db8ee2-f4ad-47bf-8723-328a1c812a47 admin admin] Subscribe: > port after_delete 55550000 {{(pid=102992) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 23 19:34:49.376927 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [None req-b2db8ee2-f4ad-47bf-8723-328a1c812a47 admin admin] Subscribe: > port after_update 55550000 {{(pid=102992) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 23 19:34:49.377551 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [None req-b2db8ee2-f4ad-47bf-8723-328a1c812a47 admin admin] Subscribe: > segment after_delete 55550000 {{(pid=102992) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 23 19:34:49.377899 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [None req-b2db8ee2-f4ad-47bf-8723-328a1c812a47 admin admin] Subscribe: > subnet after_create 55550000 {{(pid=102992) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 23 19:34:49.378228 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [None req-b2db8ee2-f4ad-47bf-8723-328a1c812a47 admin admin] Subscribe: > subnet after_delete 55550000 {{(pid=102992) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 23 19:34:49.378558 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [None req-b2db8ee2-f4ad-47bf-8723-328a1c812a47 admin admin] Subscribe: > subnet after_update 55550000 {{(pid=102992) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 23 19:34:49.573649 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [None req-b2db8ee2-f4ad-47bf-8723-328a1c812a47 admin admin] Subscribe: > subnet after_create 55550000 {{(pid=102992) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 23 19:34:49.574334 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [None req-b2db8ee2-f4ad-47bf-8723-328a1c812a47 admin admin] Subscribe: > subnet after_delete 55550000 {{(pid=102992) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 23 19:34:49.574937 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [None req-b2db8ee2-f4ad-47bf-8723-328a1c812a47 admin admin] Subscribe: > subnet before_create 55550000 {{(pid=102992) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 23 19:34:49.575496 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [None req-b2db8ee2-f4ad-47bf-8723-328a1c812a47 admin admin] Subscribe: > subnet before_update 55550000 {{(pid=102992) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 23 19:34:49.576472 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.services.segments.db [None req-b2db8ee2-f4ad-47bf-8723-328a1c812a47 admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['2cf6d774-4b5e-4f5e-bb22-8de22e43722d']}} {{(pid=102992) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 23 19:34:49.598757 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.services.segments.db [None req-b2db8ee2-f4ad-47bf-8723-328a1c812a47 admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '6f1d4a41-ab87-4da1-b83c-5e20faf1683c') {'for_net_delete': True} {{(pid=102992) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 23 19:34:49.602525 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.services.segments.db [None req-b2db8ee2-f4ad-47bf-8723-328a1c812a47 admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '6f1d4a41-ab87-4da1-b83c-5e20faf1683c') {} {{(pid=102992) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 23 19:34:49.620892 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [None req-b2db8ee2-f4ad-47bf-8723-328a1c812a47 admin admin] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8783631432524', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-25272530'] for segment, before_delete {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:34:49.647150 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [None req-b2db8ee2-f4ad-47bf-8723-328a1c812a47 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7982218'] for segment, precommit_delete {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:34:49.657886 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-b2db8ee2-f4ad-47bf-8723-328a1c812a47 admin admin] Releasing vlan 823 on physical network physnet1 to pool {{(pid=102992) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Nov 23 19:34:49.658469 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [None req-b2db8ee2-f4ad-47bf-8723-328a1c812a47 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7982218', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-25200492'] for segment, after_delete {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:34:49.670421 dv-cinder-819011-1-iscsi neutron-server[102992]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Nov 23 19:34:49.670421 dv-cinder-819011-1-iscsi neutron-server[102992]: from cryptography.utils import int_from_bytes Nov 23 19:34:49.670421 dv-cinder-819011-1-iscsi neutron-server[102992]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Nov 23 19:34:49.670421 dv-cinder-819011-1-iscsi neutron-server[102992]: from cryptography.utils import int_from_bytes Nov 23 19:34:49.670421 dv-cinder-819011-1-iscsi neutron-server[102992]: Traceback (most recent call last): Nov 23 19:34:49.670421 dv-cinder-819011-1-iscsi neutron-server[102992]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Nov 23 19:34:49.670421 dv-cinder-819011-1-iscsi neutron-server[102992]: timer() Nov 23 19:34:49.670421 dv-cinder-819011-1-iscsi neutron-server[102992]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 23 19:34:49.670421 dv-cinder-819011-1-iscsi neutron-server[102992]: cb(*args, **kw) Nov 23 19:34:49.670421 dv-cinder-819011-1-iscsi neutron-server[102992]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Nov 23 19:34:49.670421 dv-cinder-819011-1-iscsi neutron-server[102992]: return func(*args, **kwargs) Nov 23 19:34:49.670421 dv-cinder-819011-1-iscsi neutron-server[102992]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 23 19:34:49.670421 dv-cinder-819011-1-iscsi neutron-server[102992]: self._notify() Nov 23 19:34:49.670421 dv-cinder-819011-1-iscsi neutron-server[102992]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 23 19:34:49.670421 dv-cinder-819011-1-iscsi neutron-server[102992]: self.callback(batched_events) Nov 23 19:34:49.670421 dv-cinder-819011-1-iscsi neutron-server[102992]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 23 19:34:49.670421 dv-cinder-819011-1-iscsi neutron-server[102992]: event.method(event) Nov 23 19:34:49.670421 dv-cinder-819011-1-iscsi neutron-server[102992]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Nov 23 19:34:49.670421 dv-cinder-819011-1-iscsi neutron-server[102992]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 23 19:34:49.670421 dv-cinder-819011-1-iscsi neutron-server[102992]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Nov 23 19:34:49.670421 dv-cinder-819011-1-iscsi neutron-server[102992]: aggregate_uuid = self.p_client.list_aggregates( Nov 23 19:34:49.670421 dv-cinder-819011-1-iscsi neutron-server[102992]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Nov 23 19:34:49.670421 dv-cinder-819011-1-iscsi neutron-server[102992]: return f(self, *a, **k) Nov 23 19:34:49.670421 dv-cinder-819011-1-iscsi neutron-server[102992]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 23 19:34:49.670421 dv-cinder-819011-1-iscsi neutron-server[102992]: return self._get(url).json() Nov 23 19:34:49.670421 dv-cinder-819011-1-iscsi neutron-server[102992]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 23 19:34:49.670421 dv-cinder-819011-1-iscsi neutron-server[102992]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 23 19:34:49.670421 dv-cinder-819011-1-iscsi neutron-server[102992]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Nov 23 19:34:49.670421 dv-cinder-819011-1-iscsi neutron-server[102992]: return self.request(url, 'GET', **kwargs) Nov 23 19:34:49.670421 dv-cinder-819011-1-iscsi neutron-server[102992]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Nov 23 19:34:49.670421 dv-cinder-819011-1-iscsi neutron-server[102992]: base_url = self.get_endpoint(auth, allow=allow, Nov 23 19:34:49.670421 dv-cinder-819011-1-iscsi neutron-server[102992]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Nov 23 19:34:49.670421 dv-cinder-819011-1-iscsi neutron-server[102992]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 23 19:34:49.670421 dv-cinder-819011-1-iscsi neutron-server[102992]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Nov 23 19:34:49.670421 dv-cinder-819011-1-iscsi neutron-server[102992]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 23 19:34:49.670421 dv-cinder-819011-1-iscsi neutron-server[102992]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 23 19:34:49.748222 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.wsgi [-] (102992) accepted ('10.222.0.62', 43764) {{(pid=102992) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 23 19:34:49.806943 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [None req-b2db8ee2-f4ad-47bf-8723-328a1c812a47 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-7977567', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-554949', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560168', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-926557'] for network, after_delete {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:34:49.814375 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [None req-b2db8ee2-f4ad-47bf-8723-328a1c812a47 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-560186'] for network, before_response {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:34:49.830218 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [None req-b2db8ee2-f4ad-47bf-8723-328a1c812a47 admin admin] 10.222.0.62 "DELETE /v2.0/networks/2cf6d774-4b5e-4f5e-bb22-8de22e43722d HTTP/1.1" status: 204 len: 168 time: 0.6363811 Nov 23 19:34:49.850585 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b2db8ee2-f4ad-47bf-8723-328a1c812a47 admin admin] Pushing event deleted for resources: {'Network': ['ID=2cf6d774-4b5e-4f5e-bb22-8de22e43722d,revision_number=None']} {{(pid=102992) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 23 19:34:49.881497 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [None req-1e1b2132-af0e-48a3-8bf3-b2de9e5a2411 admin admin] Publish callbacks [] for security_group, before_create {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:34:49.970621 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [None req-1e1b2132-af0e-48a3-8bf3-b2de9e5a2411 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:34:50.091865 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [None req-1e1b2132-af0e-48a3-8bf3-b2de9e5a2411 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-623933'] for security_group, after_create {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:34:50.133055 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [None req-1e1b2132-af0e-48a3-8bf3-b2de9e5a2411 admin admin] 10.222.0.62 "GET /v2.0/security-groups?tenant_id=8a7d843406eb463d8a6371f625915599&name=default HTTP/1.1" status: 200 len: 2996 time: 0.3802204 Nov 23 19:34:50.134322 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.wsgi [-] (102993) accepted ('10.222.0.62', 43786) {{(pid=102993) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 23 19:34:50.145756 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1e1b2132-af0e-48a3-8bf3-b2de9e5a2411 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=f44b6d6d-db89-4b12-bf40-8c62b46b4853,revision_number=1']} {{(pid=102992) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 23 19:34:50.202207 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-bb423bb1-0ae4-400c-863c-e2e7b6520850 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:34:50.230044 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-bb423bb1-0ae4-400c-863c-e2e7b6520850 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:34:50.236277 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.wsgi [-] (102993) accepted ('10.222.0.62', 43794) {{(pid=102993) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 23 19:34:50.237539 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.wsgi [-] (102992) accepted ('10.222.0.62', 43796) {{(pid=102992) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 23 19:34:50.311623 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [None req-4bca33c8-075f-47b5-9006-8bdc484431bf admin admin] 10.222.0.62 "GET /v2.0/security-groups?tenant_id=69ab6d68b3f1442f9785568cd27eb367&name=default HTTP/1.1" status: 200 len: 2992 time: 0.0725582 Nov 23 19:34:50.314425 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.wsgi [-] (102993) accepted ('10.222.0.62', 43802) {{(pid=102993) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 23 19:34:50.350367 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f490a321-0c7c-4731-845b-7a80d5da3530 req-71aae4bc-4d59-4049-b345-1ed60caaa35a tempest-ServerRescueNegativeTestJSON-1447477341 tempest-ServerRescueNegativeTestJSON-1447477341-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102992) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:34:50.352442 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-f490a321-0c7c-4731-845b-7a80d5da3530 req-71aae4bc-4d59-4049-b345-1ed60caaa35a tempest-ServerRescueNegativeTestJSON-1447477341 tempest-ServerRescueNegativeTestJSON-1447477341-project] 10.222.0.62 "GET /v2.0/ports?device_id=90cb32bd-c375-400a-b79a-97fc61e2a3a3 HTTP/1.1" status: 200 len: 945 time: 0.0559886 Nov 23 19:34:50.370376 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-bb423bb1-0ae4-400c-863c-e2e7b6520850 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-623933'] for security_group, after_delete {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:34:50.373125 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-bb423bb1-0ae4-400c-863c-e2e7b6520850 admin admin] Publish callbacks [] for security_group, before_response {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:34:50.374362 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [None req-bb423bb1-0ae4-400c-863c-e2e7b6520850 admin admin] 10.222.0.62 "DELETE /v2.0/security-groups/f44b6d6d-db89-4b12-bf40-8c62b46b4853 HTTP/1.1" status: 204 len: 168 time: 0.2378983 Nov 23 19:34:50.385645 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bb423bb1-0ae4-400c-863c-e2e7b6520850 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=f44b6d6d-db89-4b12-bf40-8c62b46b4853,revision_number=None']} {{(pid=102993) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 23 19:34:50.387597 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-8862fe2a-c742-4a1c-986a-5af94a726ef8 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:34:50.436243 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-f490a321-0c7c-4731-845b-7a80d5da3530 req-6d8fc585-e2a9-4940-9846-1457bb9397a6 tempest-ServerRescueNegativeTestJSON-1447477341 tempest-ServerRescueNegativeTestJSON-1447477341-project] 10.222.0.62 "GET /v2.0/security-groups?id=62a09434-acf0-424f-9001-2c3a78119364&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0750360 Nov 23 19:34:50.441050 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-8862fe2a-c742-4a1c-986a-5af94a726ef8 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:34:50.547643 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-7ff42570-bbc8-4612-8c8b-653bfc442504 admin admin] Publish callbacks [] for security_group, before_create {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:34:50.596957 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-8862fe2a-c742-4a1c-986a-5af94a726ef8 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-623933'] for security_group, after_delete {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:34:50.599474 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-8862fe2a-c742-4a1c-986a-5af94a726ef8 admin admin] Publish callbacks [] for security_group, before_response {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:34:50.600606 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [None req-8862fe2a-c742-4a1c-986a-5af94a726ef8 admin admin] 10.222.0.62 "DELETE /v2.0/security-groups/5b5d5814-644d-45c2-ad35-f8920c3382b0 HTTP/1.1" status: 204 len: 168 time: 0.2852058 Nov 23 19:34:50.614489 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8862fe2a-c742-4a1c-986a-5af94a726ef8 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=5b5d5814-644d-45c2-ad35-f8920c3382b0,revision_number=None']} {{(pid=102993) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 23 19:34:50.642228 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-7ff42570-bbc8-4612-8c8b-653bfc442504 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:34:50.759998 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-7ff42570-bbc8-4612-8c8b-653bfc442504 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-623933'] for security_group, after_create {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:34:50.801038 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [None req-7ff42570-bbc8-4612-8c8b-653bfc442504 admin admin] 10.222.0.62 "GET /v2.0/security-groups?tenant_id=65117d1561be4d2b8f13c0e585cef28e&name=default HTTP/1.1" status: 200 len: 2996 time: 0.5634050 Nov 23 19:34:50.803129 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7ff42570-bbc8-4612-8c8b-653bfc442504 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=c68f129e-ea30-4216-baa4-a8ffbfba3e6a,revision_number=1']} {{(pid=102993) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 23 19:34:50.805689 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.wsgi [-] (102993) accepted ('10.222.0.62', 43816) {{(pid=102993) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 23 19:34:50.866978 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-cd404dbc-b30e-4904-a891-26cc452eb9f6 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:34:50.890588 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-cd404dbc-b30e-4904-a891-26cc452eb9f6 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:34:51.041628 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-cd404dbc-b30e-4904-a891-26cc452eb9f6 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-623933'] for security_group, after_delete {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:34:51.044519 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-cd404dbc-b30e-4904-a891-26cc452eb9f6 admin admin] Publish callbacks [] for security_group, before_response {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:34:51.045750 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [None req-cd404dbc-b30e-4904-a891-26cc452eb9f6 admin admin] 10.222.0.62 "DELETE /v2.0/security-groups/c68f129e-ea30-4216-baa4-a8ffbfba3e6a HTTP/1.1" status: 204 len: 168 time: 0.2390976 Nov 23 19:34:51.056163 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cd404dbc-b30e-4904-a891-26cc452eb9f6 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=c68f129e-ea30-4216-baa4-a8ffbfba3e6a,revision_number=None']} {{(pid=102993) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 23 19:34:51.246283 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.wsgi [-] (102993) accepted ('10.222.0.62', 43838) {{(pid=102993) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 23 19:34:51.260351 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-c8f15a20-7a79-456a-8fd9-a47fc6852b17 admin admin] Publish callbacks [] for security_group, before_create {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:34:51.351148 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-c8f15a20-7a79-456a-8fd9-a47fc6852b17 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:34:51.400808 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-c8f15a20-7a79-456a-8fd9-a47fc6852b17 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-623933'] for security_group, after_create {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:34:51.441666 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [None req-c8f15a20-7a79-456a-8fd9-a47fc6852b17 admin admin] 10.222.0.62 "GET /v2.0/security-groups?tenant_id=bbf21f5b29024f809c0b01d2912b2a93&name=default HTTP/1.1" status: 200 len: 2996 time: 0.1940563 Nov 23 19:34:51.442664 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c8f15a20-7a79-456a-8fd9-a47fc6852b17 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=6fa48e38-3f48-4c42-9bc3-42cfe3d3c46f,revision_number=1']} {{(pid=102993) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 23 19:34:51.445051 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.wsgi [-] (102992) accepted ('10.222.0.62', 43854) {{(pid=102992) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 23 19:34:51.499767 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [None req-1e8e55b6-90ce-41d5-8a53-e8c80121c820 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:34:51.544044 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [None req-1e8e55b6-90ce-41d5-8a53-e8c80121c820 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:34:51.595028 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-57c49fb0-04b0-40d7-8d46-c136c84f36e9 req-132ad045-7841-4751-97e8-0eeddd8774ac tempest-ServerRescueNegativeTestJSON-1447477341 tempest-ServerRescueNegativeTestJSON-1447477341-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102992) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:34:51.596500 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-57c49fb0-04b0-40d7-8d46-c136c84f36e9 req-132ad045-7841-4751-97e8-0eeddd8774ac tempest-ServerRescueNegativeTestJSON-1447477341 tempest-ServerRescueNegativeTestJSON-1447477341-project] 10.222.0.62 "GET /v2.0/ports?device_id=90cb32bd-c375-400a-b79a-97fc61e2a3a3 HTTP/1.1" status: 200 len: 945 time: 0.0852005 Nov 23 19:34:51.649079 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-57c49fb0-04b0-40d7-8d46-c136c84f36e9 req-e454eda4-b60f-421f-8994-e6dbf017c66b tempest-ServerRescueNegativeTestJSON-1447477341 tempest-ServerRescueNegativeTestJSON-1447477341-project] 10.222.0.62 "GET /v2.0/security-groups?id=62a09434-acf0-424f-9001-2c3a78119364&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0462108 Nov 23 19:34:51.702902 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [None req-1e8e55b6-90ce-41d5-8a53-e8c80121c820 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-623933'] for security_group, after_delete {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:34:51.705614 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [None req-1e8e55b6-90ce-41d5-8a53-e8c80121c820 admin admin] Publish callbacks [] for security_group, before_response {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:34:51.706758 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [None req-1e8e55b6-90ce-41d5-8a53-e8c80121c820 admin admin] 10.222.0.62 "DELETE /v2.0/security-groups/6fa48e38-3f48-4c42-9bc3-42cfe3d3c46f HTTP/1.1" status: 204 len: 168 time: 0.2587783 Nov 23 19:34:51.715725 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1e8e55b6-90ce-41d5-8a53-e8c80121c820 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=6fa48e38-3f48-4c42-9bc3-42cfe3d3c46f,revision_number=None']} {{(pid=102992) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 23 19:34:52.051454 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.wsgi [-] (102992) accepted ('10.222.0.62', 43870) {{(pid=102992) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 23 19:34:52.204333 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [None req-204058f5-2cc8-4dc8-b835-acb855bc0b29 admin admin] Publish callbacks [] for security_group, before_create {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:34:52.276462 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.wsgi [-] (102992) accepted ('10.222.0.62', 43898) {{(pid=102992) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 23 19:34:52.343609 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [None req-204058f5-2cc8-4dc8-b835-acb855bc0b29 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:34:52.346776 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.db.db_base_plugin_v2 [None req-27fd48fa-97e6-4302-bc0a-2efea4a08590 admin admin] Deleting subnet 0abb3a5c-c9ac-4da5-84df-f99818afe0a2 {{(pid=102992) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Nov 23 19:34:52.350186 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [None req-27fd48fa-97e6-4302-bc0a-2efea4a08590 admin admin] Publish callbacks [] for subnet, before_delete {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:34:52.406447 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [None req-27fd48fa-97e6-4302-bc0a-2efea4a08590 admin admin] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-25272549'] for subnet, precommit_delete_associations {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:34:52.428005 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [None req-204058f5-2cc8-4dc8-b835-acb855bc0b29 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-623933'] for security_group, after_create {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:34:52.488954 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [None req-204058f5-2cc8-4dc8-b835-acb855bc0b29 admin admin] 10.222.0.62 "GET /v2.0/security-groups?tenant_id=c7e49dae43774d24b2cdd1e71deb19f5&name=default HTTP/1.1" status: 200 len: 2996 time: 0.4334595 Nov 23 19:34:52.488954 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-204058f5-2cc8-4dc8-b835-acb855bc0b29 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=194f70c4-8513-43e3-b5a9-6c8e91736c86,revision_number=1']} {{(pid=102992) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 23 19:34:52.489798 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.wsgi [-] (102993) accepted ('10.222.0.62', 43908) {{(pid=102993) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 23 19:34:52.490157 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [None req-27fd48fa-97e6-4302-bc0a-2efea4a08590 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-7975863'] for subnet, precommit_delete {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:34:52.556560 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-78f0a4dc-ee63-4a38-8ac6-954034885957 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:34:52.580588 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-78f0a4dc-ee63-4a38-8ac6-954034885957 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:34:52.623280 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [None req-27fd48fa-97e6-4302-bc0a-2efea4a08590 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-7982148', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-554858', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560168', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-25199822', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-25999729'] for subnet, after_delete {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:34:52.655022 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-27fd48fa-97e6-4302-bc0a-2efea4a08590 admin admin] Pushing event deleted for resources: {'Subnet': ['ID=0abb3a5c-c9ac-4da5-84df-f99818afe0a2,revision_number=None']} {{(pid=102992) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 23 19:34:52.657004 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [None req-27fd48fa-97e6-4302-bc0a-2efea4a08590 admin admin] Publish callbacks [] for subnet, before_response {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:34:52.660407 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [None req-27fd48fa-97e6-4302-bc0a-2efea4a08590 admin admin] 10.222.0.62 "DELETE /v2.0/subnets/0abb3a5c-c9ac-4da5-84df-f99818afe0a2 HTTP/1.1" status: 204 len: 168 time: 0.3829701 Nov 23 19:34:52.663134 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.wsgi [-] (102993) accepted ('10.222.0.62', 43918) {{(pid=102993) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 23 19:34:52.729359 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-78f0a4dc-ee63-4a38-8ac6-954034885957 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-623933'] for security_group, after_delete {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:34:52.732114 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-78f0a4dc-ee63-4a38-8ac6-954034885957 admin admin] Publish callbacks [] for security_group, before_response {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:34:52.733567 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [None req-78f0a4dc-ee63-4a38-8ac6-954034885957 admin admin] 10.222.0.62 "DELETE /v2.0/security-groups/194f70c4-8513-43e3-b5a9-6c8e91736c86 HTTP/1.1" status: 204 len: 168 time: 0.2438035 Nov 23 19:34:52.757879 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-bfe2a12c-1769-4e18-82df-1a6a51c37fcf admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-8133038'] for network, before_delete {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:34:52.761337 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-78f0a4dc-ee63-4a38-8ac6-954034885957 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=194f70c4-8513-43e3-b5a9-6c8e91736c86,revision_number=None']} {{(pid=102993) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 23 19:34:52.797785 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7565f0e7-d674-4348-a16b-d302edaf760e req-74cfb688-70bf-4deb-8bba-484c38f077b8 tempest-ServerRescueNegativeTestJSON-1447477341 tempest-ServerRescueNegativeTestJSON-1447477341-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102992) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:34:52.799632 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-7565f0e7-d674-4348-a16b-d302edaf760e req-74cfb688-70bf-4deb-8bba-484c38f077b8 tempest-ServerRescueNegativeTestJSON-1447477341 tempest-ServerRescueNegativeTestJSON-1447477341-project] 10.222.0.62 "GET /v2.0/ports?device_id=90cb32bd-c375-400a-b79a-97fc61e2a3a3 HTTP/1.1" status: 200 len: 945 time: 0.0724511 Nov 23 19:34:52.874022 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-bfe2a12c-1769-4e18-82df-1a6a51c37fcf admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-7977576', 'neutron.services.segments.db._delete_segments_for_network-8783631323320'] for network, precommit_delete {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:34:52.880847 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-7565f0e7-d674-4348-a16b-d302edaf760e req-a1f71626-7b7e-4ef0-918b-fbfd993929fa tempest-ServerRescueNegativeTestJSON-1447477341 tempest-ServerRescueNegativeTestJSON-1447477341-project] 10.222.0.62 "GET /v2.0/security-groups?id=62a09434-acf0-424f-9001-2c3a78119364&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0709271 Nov 23 19:34:52.904943 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-bfe2a12c-1769-4e18-82df-1a6a51c37fcf admin admin] Subscribe: > segment before_delete 55550000 {{(pid=102993) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 23 19:34:52.905321 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-bfe2a12c-1769-4e18-82df-1a6a51c37fcf admin admin] Subscribe: > subnet precommit_delete_associations 55550000 {{(pid=102993) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 23 19:34:52.906102 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-bfe2a12c-1769-4e18-82df-1a6a51c37fcf admin admin] Subscribe: > segment_host_mapping after_create 55550000 {{(pid=102993) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 23 19:34:52.906445 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-bfe2a12c-1769-4e18-82df-1a6a51c37fcf admin admin] Subscribe: > port after_create 55550000 {{(pid=102993) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 23 19:34:52.906783 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-bfe2a12c-1769-4e18-82df-1a6a51c37fcf admin admin] Subscribe: > port after_delete 55550000 {{(pid=102993) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 23 19:34:52.907112 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-bfe2a12c-1769-4e18-82df-1a6a51c37fcf admin admin] Subscribe: > port after_update 55550000 {{(pid=102993) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 23 19:34:52.907431 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-bfe2a12c-1769-4e18-82df-1a6a51c37fcf admin admin] Subscribe: > segment after_delete 55550000 {{(pid=102993) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 23 19:34:52.907765 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-bfe2a12c-1769-4e18-82df-1a6a51c37fcf admin admin] Subscribe: > subnet after_create 55550000 {{(pid=102993) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 23 19:34:52.908075 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-bfe2a12c-1769-4e18-82df-1a6a51c37fcf admin admin] Subscribe: > subnet after_delete 55550000 {{(pid=102993) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 23 19:34:52.908393 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-bfe2a12c-1769-4e18-82df-1a6a51c37fcf admin admin] Subscribe: > subnet after_update 55550000 {{(pid=102993) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 23 19:34:52.975632 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-bfe2a12c-1769-4e18-82df-1a6a51c37fcf admin admin] Subscribe: > subnet after_create 55550000 {{(pid=102993) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 23 19:34:52.975840 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-bfe2a12c-1769-4e18-82df-1a6a51c37fcf admin admin] Subscribe: > subnet after_delete 55550000 {{(pid=102993) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 23 19:34:52.976209 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-bfe2a12c-1769-4e18-82df-1a6a51c37fcf admin admin] Subscribe: > subnet before_create 55550000 {{(pid=102993) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 23 19:34:52.976500 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-bfe2a12c-1769-4e18-82df-1a6a51c37fcf admin admin] Subscribe: > subnet before_update 55550000 {{(pid=102993) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 23 19:34:52.976900 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.services.segments.db [None req-bfe2a12c-1769-4e18-82df-1a6a51c37fcf admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['febefec9-9d20-4631-b16a-171834b4299f']}} {{(pid=102993) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 23 19:34:52.994593 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.services.segments.db [None req-bfe2a12c-1769-4e18-82df-1a6a51c37fcf admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, 'd31e81f7-47be-49ce-acc7-dd9bb979d4b9') {'for_net_delete': True} {{(pid=102993) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 23 19:34:52.994895 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.services.segments.db [None req-bfe2a12c-1769-4e18-82df-1a6a51c37fcf admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, 'd31e81f7-47be-49ce-acc7-dd9bb979d4b9') {} {{(pid=102993) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 23 19:34:53.014731 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-bfe2a12c-1769-4e18-82df-1a6a51c37fcf admin admin] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8783631432524', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-16914685'] for segment, before_delete {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:34:53.047707 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-bfe2a12c-1769-4e18-82df-1a6a51c37fcf admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7982218'] for segment, precommit_delete {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:34:53.057808 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-bfe2a12c-1769-4e18-82df-1a6a51c37fcf admin admin] Releasing vlan 824 on physical network physnet1 to pool {{(pid=102993) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Nov 23 19:34:53.058191 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-bfe2a12c-1769-4e18-82df-1a6a51c37fcf admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7982218', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-17258441'] for segment, after_delete {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:34:53.062228 dv-cinder-819011-1-iscsi neutron-server[102993]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Nov 23 19:34:53.062228 dv-cinder-819011-1-iscsi neutron-server[102993]: from cryptography.utils import int_from_bytes Nov 23 19:34:53.062228 dv-cinder-819011-1-iscsi neutron-server[102993]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Nov 23 19:34:53.062228 dv-cinder-819011-1-iscsi neutron-server[102993]: from cryptography.utils import int_from_bytes Nov 23 19:34:53.062228 dv-cinder-819011-1-iscsi neutron-server[102993]: Traceback (most recent call last): Nov 23 19:34:53.062228 dv-cinder-819011-1-iscsi neutron-server[102993]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Nov 23 19:34:53.062228 dv-cinder-819011-1-iscsi neutron-server[102993]: timer() Nov 23 19:34:53.062228 dv-cinder-819011-1-iscsi neutron-server[102993]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 23 19:34:53.062228 dv-cinder-819011-1-iscsi neutron-server[102993]: cb(*args, **kw) Nov 23 19:34:53.062228 dv-cinder-819011-1-iscsi neutron-server[102993]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Nov 23 19:34:53.062228 dv-cinder-819011-1-iscsi neutron-server[102993]: return func(*args, **kwargs) Nov 23 19:34:53.062228 dv-cinder-819011-1-iscsi neutron-server[102993]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 23 19:34:53.062228 dv-cinder-819011-1-iscsi neutron-server[102993]: self._notify() Nov 23 19:34:53.062228 dv-cinder-819011-1-iscsi neutron-server[102993]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 23 19:34:53.062228 dv-cinder-819011-1-iscsi neutron-server[102993]: self.callback(batched_events) Nov 23 19:34:53.062228 dv-cinder-819011-1-iscsi neutron-server[102993]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 23 19:34:53.062228 dv-cinder-819011-1-iscsi neutron-server[102993]: event.method(event) Nov 23 19:34:53.062228 dv-cinder-819011-1-iscsi neutron-server[102993]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Nov 23 19:34:53.062228 dv-cinder-819011-1-iscsi neutron-server[102993]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 23 19:34:53.062228 dv-cinder-819011-1-iscsi neutron-server[102993]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Nov 23 19:34:53.062228 dv-cinder-819011-1-iscsi neutron-server[102993]: aggregate_uuid = self.p_client.list_aggregates( Nov 23 19:34:53.062228 dv-cinder-819011-1-iscsi neutron-server[102993]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Nov 23 19:34:53.062228 dv-cinder-819011-1-iscsi neutron-server[102993]: return f(self, *a, **k) Nov 23 19:34:53.062228 dv-cinder-819011-1-iscsi neutron-server[102993]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 23 19:34:53.062228 dv-cinder-819011-1-iscsi neutron-server[102993]: return self._get(url).json() Nov 23 19:34:53.062228 dv-cinder-819011-1-iscsi neutron-server[102993]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 23 19:34:53.062228 dv-cinder-819011-1-iscsi neutron-server[102993]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 23 19:34:53.062228 dv-cinder-819011-1-iscsi neutron-server[102993]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Nov 23 19:34:53.062228 dv-cinder-819011-1-iscsi neutron-server[102993]: return self.request(url, 'GET', **kwargs) Nov 23 19:34:53.062228 dv-cinder-819011-1-iscsi neutron-server[102993]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Nov 23 19:34:53.062228 dv-cinder-819011-1-iscsi neutron-server[102993]: base_url = self.get_endpoint(auth, allow=allow, Nov 23 19:34:53.062228 dv-cinder-819011-1-iscsi neutron-server[102993]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Nov 23 19:34:53.062228 dv-cinder-819011-1-iscsi neutron-server[102993]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 23 19:34:53.062228 dv-cinder-819011-1-iscsi neutron-server[102993]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Nov 23 19:34:53.062228 dv-cinder-819011-1-iscsi neutron-server[102993]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 23 19:34:53.062228 dv-cinder-819011-1-iscsi neutron-server[102993]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 23 19:34:53.203116 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-bfe2a12c-1769-4e18-82df-1a6a51c37fcf admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-7977567', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-554949', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560168', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-926557'] for network, after_delete {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:34:53.221784 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-bfe2a12c-1769-4e18-82df-1a6a51c37fcf admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-560186'] for network, before_response {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:34:53.229772 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [None req-bfe2a12c-1769-4e18-82df-1a6a51c37fcf admin admin] 10.222.0.62 "DELETE /v2.0/networks/febefec9-9d20-4631-b16a-171834b4299f HTTP/1.1" status: 204 len: 168 time: 0.5652726 Nov 23 19:34:53.232431 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.wsgi [-] (102992) accepted ('10.222.0.62', 43940) {{(pid=102992) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 23 19:34:53.253263 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bfe2a12c-1769-4e18-82df-1a6a51c37fcf admin admin] Pushing event deleted for resources: {'Network': ['ID=febefec9-9d20-4631-b16a-171834b4299f,revision_number=None']} {{(pid=102993) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 23 19:34:53.289106 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.db.db_base_plugin_v2 [None req-ffb52db8-55a5-4886-9d8c-aabbb81ff144 admin admin] Deleting subnet bd077d39-49d5-4e6b-a1da-3b01cf2fcba1 {{(pid=102992) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Nov 23 19:34:53.293000 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [None req-ffb52db8-55a5-4886-9d8c-aabbb81ff144 admin admin] Publish callbacks [] for subnet, before_delete {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:34:53.338108 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [None req-ffb52db8-55a5-4886-9d8c-aabbb81ff144 admin admin] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-25272549'] for subnet, precommit_delete_associations {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:34:53.384701 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [None req-ffb52db8-55a5-4886-9d8c-aabbb81ff144 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-7975863'] for subnet, precommit_delete {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:34:53.417780 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.wsgi [-] (102992) accepted ('10.222.0.62', 43946) {{(pid=102992) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 23 19:34:53.520829 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [None req-ffb52db8-55a5-4886-9d8c-aabbb81ff144 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-7982148', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-554858', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560168', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-25199822', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-25999729'] for subnet, after_delete {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:34:53.549724 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ffb52db8-55a5-4886-9d8c-aabbb81ff144 admin admin] Pushing event deleted for resources: {'Subnet': ['ID=bd077d39-49d5-4e6b-a1da-3b01cf2fcba1,revision_number=None']} {{(pid=102992) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 23 19:34:53.551495 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [None req-ffb52db8-55a5-4886-9d8c-aabbb81ff144 admin admin] Publish callbacks [] for subnet, before_response {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:34:53.557682 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [None req-ffb52db8-55a5-4886-9d8c-aabbb81ff144 admin admin] 10.222.0.62 "DELETE /v2.0/subnets/bd077d39-49d5-4e6b-a1da-3b01cf2fcba1 HTTP/1.1" status: 204 len: 168 time: 0.3231282 Nov 23 19:34:53.561803 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.wsgi [-] (102993) accepted ('10.222.0.62', 43954) {{(pid=102993) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 23 19:34:53.635144 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [None req-23ea10dd-3fce-4eeb-9df1-0c78915c3755 admin admin] Publish callbacks [] for security_group, before_create {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:34:53.636757 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-5c17b022-25a3-4fce-b8b1-a240a40c8134 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-8133038'] for network, before_delete {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:34:53.720506 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-5c17b022-25a3-4fce-b8b1-a240a40c8134 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-7977576', 'neutron.services.segments.db._delete_segments_for_network-8783631323320'] for network, precommit_delete {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:34:53.729653 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [None req-23ea10dd-3fce-4eeb-9df1-0c78915c3755 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:34:53.743555 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.services.segments.db [None req-5c17b022-25a3-4fce-b8b1-a240a40c8134 admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['f7e55161-fa06-4ef2-9321-13f9e46bf524']}} {{(pid=102993) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 23 19:34:53.752676 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.services.segments.db [None req-5c17b022-25a3-4fce-b8b1-a240a40c8134 admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '89181dee-3c67-43a1-8d3e-f96fd0fb7142') {'for_net_delete': True} {{(pid=102993) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 23 19:34:53.752954 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.services.segments.db [None req-5c17b022-25a3-4fce-b8b1-a240a40c8134 admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '89181dee-3c67-43a1-8d3e-f96fd0fb7142') {} {{(pid=102993) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 23 19:34:53.764757 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-5c17b022-25a3-4fce-b8b1-a240a40c8134 admin admin] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8783631432524', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-16914685'] for segment, before_delete {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:34:53.776323 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-5c17b022-25a3-4fce-b8b1-a240a40c8134 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7982218'] for segment, precommit_delete {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:34:53.782493 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-5c17b022-25a3-4fce-b8b1-a240a40c8134 admin admin] Releasing vlan 840 on physical network physnet1 to pool {{(pid=102993) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Nov 23 19:34:53.782956 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-5c17b022-25a3-4fce-b8b1-a240a40c8134 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7982218', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-17258441'] for segment, after_delete {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:34:53.789033 dv-cinder-819011-1-iscsi neutron-server[102993]: Traceback (most recent call last): Nov 23 19:34:53.789033 dv-cinder-819011-1-iscsi neutron-server[102993]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Nov 23 19:34:53.789033 dv-cinder-819011-1-iscsi neutron-server[102993]: timer() Nov 23 19:34:53.789033 dv-cinder-819011-1-iscsi neutron-server[102993]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 23 19:34:53.789033 dv-cinder-819011-1-iscsi neutron-server[102993]: cb(*args, **kw) Nov 23 19:34:53.789033 dv-cinder-819011-1-iscsi neutron-server[102993]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Nov 23 19:34:53.789033 dv-cinder-819011-1-iscsi neutron-server[102993]: return func(*args, **kwargs) Nov 23 19:34:53.789033 dv-cinder-819011-1-iscsi neutron-server[102993]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 23 19:34:53.789033 dv-cinder-819011-1-iscsi neutron-server[102993]: self._notify() Nov 23 19:34:53.789033 dv-cinder-819011-1-iscsi neutron-server[102993]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 23 19:34:53.789033 dv-cinder-819011-1-iscsi neutron-server[102993]: self.callback(batched_events) Nov 23 19:34:53.789033 dv-cinder-819011-1-iscsi neutron-server[102993]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 23 19:34:53.789033 dv-cinder-819011-1-iscsi neutron-server[102993]: event.method(event) Nov 23 19:34:53.789033 dv-cinder-819011-1-iscsi neutron-server[102993]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Nov 23 19:34:53.789033 dv-cinder-819011-1-iscsi neutron-server[102993]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 23 19:34:53.789033 dv-cinder-819011-1-iscsi neutron-server[102993]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Nov 23 19:34:53.789033 dv-cinder-819011-1-iscsi neutron-server[102993]: aggregate_uuid = self.p_client.list_aggregates( Nov 23 19:34:53.789033 dv-cinder-819011-1-iscsi neutron-server[102993]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Nov 23 19:34:53.789033 dv-cinder-819011-1-iscsi neutron-server[102993]: return f(self, *a, **k) Nov 23 19:34:53.789033 dv-cinder-819011-1-iscsi neutron-server[102993]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 23 19:34:53.789033 dv-cinder-819011-1-iscsi neutron-server[102993]: return self._get(url).json() Nov 23 19:34:53.789033 dv-cinder-819011-1-iscsi neutron-server[102993]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 23 19:34:53.789033 dv-cinder-819011-1-iscsi neutron-server[102993]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 23 19:34:53.789033 dv-cinder-819011-1-iscsi neutron-server[102993]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Nov 23 19:34:53.789033 dv-cinder-819011-1-iscsi neutron-server[102993]: return self.request(url, 'GET', **kwargs) Nov 23 19:34:53.789033 dv-cinder-819011-1-iscsi neutron-server[102993]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Nov 23 19:34:53.789033 dv-cinder-819011-1-iscsi neutron-server[102993]: base_url = self.get_endpoint(auth, allow=allow, Nov 23 19:34:53.789033 dv-cinder-819011-1-iscsi neutron-server[102993]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Nov 23 19:34:53.789033 dv-cinder-819011-1-iscsi neutron-server[102993]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 23 19:34:53.789033 dv-cinder-819011-1-iscsi neutron-server[102993]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Nov 23 19:34:53.789033 dv-cinder-819011-1-iscsi neutron-server[102993]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 23 19:34:53.789033 dv-cinder-819011-1-iscsi neutron-server[102993]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 23 19:34:53.837664 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.wsgi [-] (102992) accepted ('10.222.0.62', 43960) {{(pid=102992) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 23 19:34:53.847292 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [None req-23ea10dd-3fce-4eeb-9df1-0c78915c3755 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-623933'] for security_group, after_create {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:34:53.867121 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [None req-d6851c93-37bc-4460-a892-88f193655463 admin admin] Publish callbacks [] for security_group, before_create {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:34:53.897198 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [None req-23ea10dd-3fce-4eeb-9df1-0c78915c3755 admin admin] 10.222.0.62 "GET /v2.0/security-groups?tenant_id=8d7c3ef13ab246688276dd494e86352e&name=default HTTP/1.1" status: 200 len: 2996 time: 0.4780672 Nov 23 19:34:53.899985 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.wsgi [-] (102993) accepted ('10.222.0.62', 43962) {{(pid=102993) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 23 19:34:53.906837 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-23ea10dd-3fce-4eeb-9df1-0c78915c3755 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=93cb6f82-ecd9-4c9c-a472-efa599475e45,revision_number=1']} {{(pid=102992) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 23 19:34:53.931605 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-5c17b022-25a3-4fce-b8b1-a240a40c8134 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-7977567', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-554949', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560168', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-926557'] for network, after_delete {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:34:53.940272 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-5c17b022-25a3-4fce-b8b1-a240a40c8134 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-560186'] for network, before_response {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:34:53.948605 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [None req-5c17b022-25a3-4fce-b8b1-a240a40c8134 admin admin] 10.222.0.62 "DELETE /v2.0/networks/f7e55161-fa06-4ef2-9321-13f9e46bf524 HTTP/1.1" status: 204 len: 168 time: 0.3830454 Nov 23 19:34:53.965073 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5c17b022-25a3-4fce-b8b1-a240a40c8134 admin admin] Pushing event deleted for resources: {'Network': ['ID=f7e55161-fa06-4ef2-9321-13f9e46bf524,revision_number=None']} {{(pid=102993) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 23 19:34:53.989549 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-0d66d7ad-88b6-4c94-838d-8b0631fe94f3 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:34:54.013790 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-0d66d7ad-88b6-4c94-838d-8b0631fe94f3 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:34:54.126149 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-0d66d7ad-88b6-4c94-838d-8b0631fe94f3 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-623933'] for security_group, after_delete {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:34:54.128910 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-0d66d7ad-88b6-4c94-838d-8b0631fe94f3 admin admin] Publish callbacks [] for security_group, before_response {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:34:54.130147 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [None req-0d66d7ad-88b6-4c94-838d-8b0631fe94f3 admin admin] 10.222.0.62 "DELETE /v2.0/security-groups/93cb6f82-ecd9-4c9c-a472-efa599475e45 HTTP/1.1" status: 204 len: 168 time: 0.2291539 Nov 23 19:34:54.140049 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0d66d7ad-88b6-4c94-838d-8b0631fe94f3 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=93cb6f82-ecd9-4c9c-a472-efa599475e45,revision_number=None']} {{(pid=102993) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 23 19:34:54.236874 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [None req-d6851c93-37bc-4460-a892-88f193655463 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:34:54.247859 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-056f9afe-f642-421b-bef9-dfd712696957 req-1c5449dd-9522-46ce-ac99-b2b2a69eadd5 tempest-ServerRescueNegativeTestJSON-1447477341 tempest-ServerRescueNegativeTestJSON-1447477341-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102992) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:34:54.249346 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-056f9afe-f642-421b-bef9-dfd712696957 req-1c5449dd-9522-46ce-ac99-b2b2a69eadd5 tempest-ServerRescueNegativeTestJSON-1447477341 tempest-ServerRescueNegativeTestJSON-1447477341-project] 10.222.0.62 "GET /v2.0/ports?device_id=90cb32bd-c375-400a-b79a-97fc61e2a3a3 HTTP/1.1" status: 200 len: 945 time: 0.2733905 Nov 23 19:34:54.297198 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-056f9afe-f642-421b-bef9-dfd712696957 req-d549bebb-337d-4b1f-a0b2-e890f5fe0688 tempest-ServerRescueNegativeTestJSON-1447477341 tempest-ServerRescueNegativeTestJSON-1447477341-project] 10.222.0.62 "GET /v2.0/security-groups?id=62a09434-acf0-424f-9001-2c3a78119364&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0416536 Nov 23 19:34:54.320069 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [None req-d6851c93-37bc-4460-a892-88f193655463 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-623933'] for security_group, after_create {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:34:54.353612 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.wsgi [-] (102993) accepted ('10.222.0.62', 43978) {{(pid=102993) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 23 19:34:54.374755 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [None req-d6851c93-37bc-4460-a892-88f193655463 admin admin] 10.222.0.62 "GET /v2.0/security-groups?tenant_id=63d1266a3862465781548aa97182656a&name=default HTTP/1.1" status: 200 len: 2996 time: 0.5353460 Nov 23 19:34:54.375893 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d6851c93-37bc-4460-a892-88f193655463 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=ef535bea-6e2a-43c6-92fc-b6cd3398c34d,revision_number=1']} {{(pid=102992) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 23 19:34:54.379901 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.wsgi [-] (102993) accepted ('10.222.0.62', 43982) {{(pid=102993) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 23 19:34:54.435905 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [None req-e86e7267-717a-4620-84f6-80014678d244 admin admin] 10.222.0.62 "GET /v2.0/security-groups?tenant_id=11b44d27020442f1a83627c7c46cce22&name=default HTTP/1.1" status: 200 len: 2996 time: 0.0788379 Nov 23 19:34:54.436609 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.wsgi [-] (102992) accepted ('10.222.0.62', 43986) {{(pid=102992) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 23 19:34:54.474607 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-d6d313db-98cf-4b5e-bf6b-0ce6ce37b7b3 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:34:54.501634 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [None req-9fffadcc-1e12-45e5-85dd-2d1cdf2cd332 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:34:54.502160 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-d6d313db-98cf-4b5e-bf6b-0ce6ce37b7b3 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:34:54.526536 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [None req-9fffadcc-1e12-45e5-85dd-2d1cdf2cd332 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:34:54.618719 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-d6d313db-98cf-4b5e-bf6b-0ce6ce37b7b3 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-623933'] for security_group, after_delete {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:34:54.629026 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-d6d313db-98cf-4b5e-bf6b-0ce6ce37b7b3 admin admin] Publish callbacks [] for security_group, before_response {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:34:54.629026 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [None req-d6d313db-98cf-4b5e-bf6b-0ce6ce37b7b3 admin admin] 10.222.0.62 "DELETE /v2.0/security-groups/ef535bea-6e2a-43c6-92fc-b6cd3398c34d HTTP/1.1" status: 204 len: 168 time: 0.2207954 Nov 23 19:34:54.633738 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d6d313db-98cf-4b5e-bf6b-0ce6ce37b7b3 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=ef535bea-6e2a-43c6-92fc-b6cd3398c34d,revision_number=None']} {{(pid=102993) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 23 19:34:54.668683 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [None req-9fffadcc-1e12-45e5-85dd-2d1cdf2cd332 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-623933'] for security_group, after_delete {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:34:54.672178 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [None req-9fffadcc-1e12-45e5-85dd-2d1cdf2cd332 admin admin] Publish callbacks [] for security_group, before_response {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:34:54.673863 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [None req-9fffadcc-1e12-45e5-85dd-2d1cdf2cd332 admin admin] 10.222.0.62 "DELETE /v2.0/security-groups/2ddcad07-c0ca-429d-8be8-fb4205ff6766 HTTP/1.1" status: 204 len: 168 time: 0.2362311 Nov 23 19:34:54.684819 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9fffadcc-1e12-45e5-85dd-2d1cdf2cd332 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=2ddcad07-c0ca-429d-8be8-fb4205ff6766,revision_number=None']} {{(pid=102992) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 23 19:34:55.403467 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.wsgi [-] (102992) accepted ('10.222.0.62', 44036) {{(pid=102992) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 23 19:34:55.442059 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [None req-ffffeb54-ed7c-4c09-ac03-fcc9bfdc9fc9 admin admin] Publish callbacks [] for security_group, before_create {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:34:55.506850 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b1fcb10a-3735-4e85-9cab-798d74e49308 req-b1b00cec-7590-4757-9a83-20c116af9f15 tempest-ServerRescueNegativeTestJSON-1447477341 tempest-ServerRescueNegativeTestJSON-1447477341-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102993) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:34:55.515411 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-b1fcb10a-3735-4e85-9cab-798d74e49308 req-b1b00cec-7590-4757-9a83-20c116af9f15 tempest-ServerRescueNegativeTestJSON-1447477341 tempest-ServerRescueNegativeTestJSON-1447477341-project] 10.222.0.62 "GET /v2.0/ports?device_id=90cb32bd-c375-400a-b79a-97fc61e2a3a3 HTTP/1.1" status: 200 len: 945 time: 0.1274393 Nov 23 19:34:55.606354 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [None req-ffffeb54-ed7c-4c09-ac03-fcc9bfdc9fc9 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:34:55.614841 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-29f5b98b-8416-491c-ae1b-7e35bd122c41 req-a8f19966-99e8-45d8-bccb-0decb305858f service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102993) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:34:55.616383 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-29f5b98b-8416-491c-ae1b-7e35bd122c41 req-a8f19966-99e8-45d8-bccb-0decb305858f service neutron] 10.222.0.41 "GET /v2.0/ports?device_id=90cb32bd-c375-400a-b79a-97fc61e2a3a3 HTTP/1.1" status: 200 len: 1098 time: 0.0893474 Nov 23 19:34:55.624857 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-b1fcb10a-3735-4e85-9cab-798d74e49308 req-4c88200e-5493-4b96-a016-f922e3a0c72b tempest-ServerRescueNegativeTestJSON-1447477341 tempest-ServerRescueNegativeTestJSON-1447477341-project] 10.222.0.62 "GET /v2.0/security-groups?id=62a09434-acf0-424f-9001-2c3a78119364&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1023793 Nov 23 19:34:55.673297 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.wsgi [-] (102992) accepted ('10.222.0.62', 44058) {{(pid=102992) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 23 19:34:55.686708 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-29f5b98b-8416-491c-ae1b-7e35bd122c41 req-1d221e2b-f6a8-4492-ad69-fab0f9717644 service neutron] 10.222.0.41 "GET /v2.0/security-groups?id=62a09434-acf0-424f-9001-2c3a78119364&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0598905 Nov 23 19:34:55.700638 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [None req-ffffeb54-ed7c-4c09-ac03-fcc9bfdc9fc9 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-623933'] for security_group, after_create {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:34:55.741673 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [None req-39b8b205-404e-4764-b3f2-d0902f958019 admin admin] 10.222.0.62 "GET /v2.0/security-groups?tenant_id=0f471fb0d1ee46ceac1bf2ea7ca3ab29&name=default HTTP/1.1" status: 200 len: 2996 time: 0.0669940 Nov 23 19:34:55.744524 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.wsgi [-] (102993) accepted ('10.222.0.62', 44060) {{(pid=102993) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 23 19:34:55.752043 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [None req-ffffeb54-ed7c-4c09-ac03-fcc9bfdc9fc9 admin admin] 10.222.0.62 "GET /v2.0/security-groups?tenant_id=6cd52637ae14420fb9c8b02404e32924&name=default HTTP/1.1" status: 200 len: 2996 time: 0.3468297 Nov 23 19:34:55.754041 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ffffeb54-ed7c-4c09-ac03-fcc9bfdc9fc9 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=4e4f045f-837a-4220-bc08-2e6a9b6a9b45,revision_number=1']} {{(pid=102992) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 23 19:34:55.756487 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.wsgi [-] (102992) accepted ('10.222.0.62', 44062) {{(pid=102992) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 23 19:34:55.816479 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [None req-f624de57-8e0e-43ac-9df4-20620d18bd91 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:34:55.831485 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-35de1d33-0a9b-4cd8-a556-549dd68480dc admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:34:55.842980 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [None req-f624de57-8e0e-43ac-9df4-20620d18bd91 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:34:55.855817 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-35de1d33-0a9b-4cd8-a556-549dd68480dc admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:34:56.011771 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-35de1d33-0a9b-4cd8-a556-549dd68480dc admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-623933'] for security_group, after_delete {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:34:56.011951 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [None req-f624de57-8e0e-43ac-9df4-20620d18bd91 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-623933'] for security_group, after_delete {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:34:56.014662 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-35de1d33-0a9b-4cd8-a556-549dd68480dc admin admin] Publish callbacks [] for security_group, before_response {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:34:56.014781 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [None req-f624de57-8e0e-43ac-9df4-20620d18bd91 admin admin] Publish callbacks [] for security_group, before_response {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:34:56.018307 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [None req-f624de57-8e0e-43ac-9df4-20620d18bd91 admin admin] 10.222.0.62 "DELETE /v2.0/security-groups/4e4f045f-837a-4220-bc08-2e6a9b6a9b45 HTTP/1.1" status: 204 len: 168 time: 0.2584229 Nov 23 19:34:56.023226 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [None req-35de1d33-0a9b-4cd8-a556-549dd68480dc admin admin] 10.222.0.62 "DELETE /v2.0/security-groups/60afb6b3-875f-408b-8716-084f2e71ea81 HTTP/1.1" status: 204 len: 168 time: 0.2701886 Nov 23 19:34:56.024531 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-35de1d33-0a9b-4cd8-a556-549dd68480dc admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=60afb6b3-875f-408b-8716-084f2e71ea81,revision_number=None']} {{(pid=102993) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 23 19:34:56.025172 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f624de57-8e0e-43ac-9df4-20620d18bd91 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=4e4f045f-837a-4220-bc08-2e6a9b6a9b45,revision_number=None']} {{(pid=102992) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 23 19:34:56.648659 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.wsgi [-] (102993) accepted ('10.222.0.62', 44102) {{(pid=102993) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 23 19:34:56.766059 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-297da306-f80d-4100-9c7a-23f162c47e75 req-a8e09ffe-a47d-4a6a-8e97-92a6b3a4f76d tempest-ServerRescueNegativeTestJSON-1447477341 tempest-ServerRescueNegativeTestJSON-1447477341-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102992) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:34:56.768544 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-297da306-f80d-4100-9c7a-23f162c47e75 req-a8e09ffe-a47d-4a6a-8e97-92a6b3a4f76d tempest-ServerRescueNegativeTestJSON-1447477341 tempest-ServerRescueNegativeTestJSON-1447477341-project] 10.222.0.62 "GET /v2.0/ports?device_id=90cb32bd-c375-400a-b79a-97fc61e2a3a3 HTTP/1.1" status: 200 len: 945 time: 0.0560749 Nov 23 19:34:56.860108 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-297da306-f80d-4100-9c7a-23f162c47e75 req-df22a519-7e53-46f1-84a9-b8278593bfc9 tempest-ServerRescueNegativeTestJSON-1447477341 tempest-ServerRescueNegativeTestJSON-1447477341-project] 10.222.0.62 "GET /v2.0/security-groups?id=62a09434-acf0-424f-9001-2c3a78119364&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0817375 Nov 23 19:34:56.882713 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-016bb525-a7f4-4308-94cf-13772dfca2ae admin admin] Publish callbacks [] for security_group, before_create {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:34:56.993886 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-016bb525-a7f4-4308-94cf-13772dfca2ae admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:34:57.057695 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-016bb525-a7f4-4308-94cf-13772dfca2ae admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-623933'] for security_group, after_create {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:34:57.111503 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [None req-016bb525-a7f4-4308-94cf-13772dfca2ae admin admin] 10.222.0.62 "GET /v2.0/security-groups?tenant_id=a5d817817e0943fcbb18809eefa13704&name=default HTTP/1.1" status: 200 len: 2996 time: 0.4604363 Nov 23 19:34:57.112269 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-016bb525-a7f4-4308-94cf-13772dfca2ae admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=8f48cb89-4804-4980-88f6-fd0e799ce32d,revision_number=1']} {{(pid=102993) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 23 19:34:57.115175 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.wsgi [-] (102992) accepted ('10.222.0.62', 44130) {{(pid=102992) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 23 19:34:57.177285 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [None req-556a5d51-3a39-4410-8b92-0a34551d1401 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:34:57.201647 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [None req-556a5d51-3a39-4410-8b92-0a34551d1401 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:34:57.377796 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [None req-556a5d51-3a39-4410-8b92-0a34551d1401 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-623933'] for security_group, after_delete {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:34:57.387833 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [None req-556a5d51-3a39-4410-8b92-0a34551d1401 admin admin] Publish callbacks [] for security_group, before_response {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:34:57.387833 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [None req-556a5d51-3a39-4410-8b92-0a34551d1401 admin admin] 10.222.0.62 "DELETE /v2.0/security-groups/8f48cb89-4804-4980-88f6-fd0e799ce32d HTTP/1.1" status: 204 len: 168 time: 0.2710726 Nov 23 19:34:57.400327 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-556a5d51-3a39-4410-8b92-0a34551d1401 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=8f48cb89-4804-4980-88f6-fd0e799ce32d,revision_number=None']} {{(pid=102992) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 23 19:34:57.977525 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ce512a85-fa3e-45b1-befa-1bce89fe6c3a req-b400d4a8-efad-4a21-aac3-a124f1553ec7 tempest-ServerRescueNegativeTestJSON-1447477341 tempest-ServerRescueNegativeTestJSON-1447477341-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102992) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:34:57.979027 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-ce512a85-fa3e-45b1-befa-1bce89fe6c3a req-b400d4a8-efad-4a21-aac3-a124f1553ec7 tempest-ServerRescueNegativeTestJSON-1447477341 tempest-ServerRescueNegativeTestJSON-1447477341-project] 10.222.0.62 "GET /v2.0/ports?device_id=90cb32bd-c375-400a-b79a-97fc61e2a3a3 HTTP/1.1" status: 200 len: 945 time: 0.0525773 Nov 23 19:34:58.029034 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-ce512a85-fa3e-45b1-befa-1bce89fe6c3a req-2d60e517-2849-4b69-806c-40f570969ccb tempest-ServerRescueNegativeTestJSON-1447477341 tempest-ServerRescueNegativeTestJSON-1447477341-project] 10.222.0.62 "GET /v2.0/security-groups?id=62a09434-acf0-424f-9001-2c3a78119364&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0439253 Nov 23 19:34:58.151735 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a65e366f-37b7-418c-81d9-acf2da66ce4c req-bb644c76-e2b5-4380-bb78-52ed2469a1f5 tempest-ServerRescueNegativeTestJSON-1447477341 tempest-ServerRescueNegativeTestJSON-1447477341-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102993) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:34:58.154137 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-a65e366f-37b7-418c-81d9-acf2da66ce4c req-bb644c76-e2b5-4380-bb78-52ed2469a1f5 tempest-ServerRescueNegativeTestJSON-1447477341 tempest-ServerRescueNegativeTestJSON-1447477341-project] 10.222.0.62 "GET /v2.0/ports?device_id=671f1d44-7752-4a9d-835d-4d76164c900f HTTP/1.1" status: 200 len: 945 time: 0.0544932 Nov 23 19:34:58.186180 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.wsgi [-] (102992) accepted ('10.222.0.62', 44176) {{(pid=102992) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 23 19:34:58.225106 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [None req-b6e9611a-eba6-4d02-87ff-75b73b9cb3fa admin admin] Publish callbacks [] for security_group, before_create {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:34:58.264928 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-a65e366f-37b7-418c-81d9-acf2da66ce4c req-eff8999f-fb09-4a01-8002-8cdf215c47d9 tempest-ServerRescueNegativeTestJSON-1447477341 tempest-ServerRescueNegativeTestJSON-1447477341-project] 10.222.0.62 "GET /v2.0/security-groups?id=62a09434-acf0-424f-9001-2c3a78119364&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1004837 Nov 23 19:34:58.352033 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [None req-b6e9611a-eba6-4d02-87ff-75b73b9cb3fa admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:34:58.465680 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [None req-b6e9611a-eba6-4d02-87ff-75b73b9cb3fa admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-623933'] for security_group, after_create {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:34:58.509523 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b6e9611a-eba6-4d02-87ff-75b73b9cb3fa admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=731adb87-3792-42a8-923f-05f00a673f92,revision_number=1']} {{(pid=102992) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 23 19:34:58.521333 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [None req-b6e9611a-eba6-4d02-87ff-75b73b9cb3fa admin admin] 10.222.0.62 "GET /v2.0/security-groups?tenant_id=e7541e4fe56d4df78e88963e79a690e3&name=default HTTP/1.1" status: 200 len: 2996 time: 0.3337686 Nov 23 19:34:58.525303 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.wsgi [-] (102993) accepted ('10.222.0.62', 44202) {{(pid=102993) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 23 19:34:58.585056 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-5f04b94a-d821-485d-a796-78d740c936c0 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:34:58.608768 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-5f04b94a-d821-485d-a796-78d740c936c0 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:34:58.754785 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-5f04b94a-d821-485d-a796-78d740c936c0 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-623933'] for security_group, after_delete {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:34:58.757538 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-5f04b94a-d821-485d-a796-78d740c936c0 admin admin] Publish callbacks [] for security_group, before_response {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:34:58.758962 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [None req-5f04b94a-d821-485d-a796-78d740c936c0 admin admin] 10.222.0.62 "DELETE /v2.0/security-groups/731adb87-3792-42a8-923f-05f00a673f92 HTTP/1.1" status: 204 len: 168 time: 0.2329068 Nov 23 19:34:58.767739 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5f04b94a-d821-485d-a796-78d740c936c0 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=731adb87-3792-42a8-923f-05f00a673f92,revision_number=None']} {{(pid=102993) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 23 19:34:59.051620 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron_lib.callbacks.manager [None req-4bf48ff4-ecfb-4168-8b63-249b8c6e9f04 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8783631323329', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7978582'] for agent, after_update {{(pid=102994) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:35:00.645759 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.wsgi [-] (102993) accepted ('10.222.0.62', 44356) {{(pid=102993) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 23 19:35:00.699905 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3cb5659e-7765-4043-95f6-c90a08c76fcc req-4f2cc008-6608-4c94-94d5-4fe0afdb2395 tempest-ServerRescueNegativeTestJSON-1447477341 tempest-ServerRescueNegativeTestJSON-1447477341-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102992) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:35:00.702746 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-3cb5659e-7765-4043-95f6-c90a08c76fcc req-4f2cc008-6608-4c94-94d5-4fe0afdb2395 tempest-ServerRescueNegativeTestJSON-1447477341 tempest-ServerRescueNegativeTestJSON-1447477341-project] 10.222.0.62 "GET /v2.0/ports?device_id=671f1d44-7752-4a9d-835d-4d76164c900f HTTP/1.1" status: 200 len: 945 time: 0.0641885 Nov 23 19:35:00.778220 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-fdb3eca2-11ba-4d79-8785-0874ab38df23 admin admin] Publish callbacks [] for security_group, before_create {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:35:00.778324 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-3cb5659e-7765-4043-95f6-c90a08c76fcc req-8424da4d-1308-4ecb-8775-4d2769561a73 tempest-ServerRescueNegativeTestJSON-1447477341 tempest-ServerRescueNegativeTestJSON-1447477341-project] 10.222.0.62 "GET /v2.0/security-groups?id=62a09434-acf0-424f-9001-2c3a78119364&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0647876 Nov 23 19:35:00.806443 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-66c5fbb2-e4a0-4da3-95e6-2294bb946589 req-d083fa91-c064-4c34-9e14-59267b20afeb service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102993) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:35:00.808068 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-66c5fbb2-e4a0-4da3-95e6-2294bb946589 req-d083fa91-c064-4c34-9e14-59267b20afeb service neutron] 10.222.0.41 "GET /v2.0/ports?tenant_id=c15ab51e579448cfb7a4b3e4f8049687&device_id=671f1d44-7752-4a9d-835d-4d76164c900f HTTP/1.1" status: 200 len: 1098 time: 0.0910189 Nov 23 19:35:00.958458 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-66c5fbb2-e4a0-4da3-95e6-2294bb946589 req-83faca6e-55c0-4f45-8b22-982cc4e26c8d service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102993) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:35:00.960058 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-66c5fbb2-e4a0-4da3-95e6-2294bb946589 req-83faca6e-55c0-4f45-8b22-982cc4e26c8d service neutron] 10.222.0.41 "GET /v2.0/networks?id=07eeb44e-4cdb-4c58-a83d-1dd8ab1ccb8a HTTP/1.1" status: 200 len: 920 time: 0.1412361 Nov 23 19:35:00.965245 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-fdb3eca2-11ba-4d79-8785-0874ab38df23 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:35:01.006879 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-66c5fbb2-e4a0-4da3-95e6-2294bb946589 req-5e1d414c-db60-4019-a8fe-4d801ff23788 service neutron] 10.222.0.41 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.3&port_id=50e9d93b-ad23-4b6b-bdd0-ae5afe6f80ea HTTP/1.1" status: 200 len: 217 time: 0.0359104 Nov 23 19:35:01.040834 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-fdb3eca2-11ba-4d79-8785-0874ab38df23 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-623933'] for security_group, after_create {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:35:01.095885 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [None req-fdb3eca2-11ba-4d79-8785-0874ab38df23 admin admin] 10.222.0.62 "GET /v2.0/security-groups?tenant_id=2b1ac19abf834056a4a2b515a3cdc916&name=default HTTP/1.1" status: 200 len: 2996 time: 0.4464138 Nov 23 19:35:01.096324 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.wsgi [-] (102992) accepted ('10.222.0.62', 44376) {{(pid=102992) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 23 19:35:01.099848 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-66c5fbb2-e4a0-4da3-95e6-2294bb946589 req-bc6e3363-2457-43e0-b5a5-70fdc9aa51da service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102993) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:35:01.101346 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-66c5fbb2-e4a0-4da3-95e6-2294bb946589 req-bc6e3363-2457-43e0-b5a5-70fdc9aa51da service neutron] 10.222.0.41 "GET /v2.0/subnets?id=e4fda56f-85ff-422d-adad-ec00db6378af HTTP/1.1" status: 200 len: 859 time: 0.0875227 Nov 23 19:35:01.102531 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fdb3eca2-11ba-4d79-8785-0874ab38df23 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=34ae4008-47ee-41a4-818c-50b8ec84ca24,revision_number=1']} {{(pid=102993) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 23 19:35:01.153497 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-66c5fbb2-e4a0-4da3-95e6-2294bb946589 req-b4b1b6a5-441e-4efb-ac63-bfe9ce5f2dab service neutron] 10.222.0.41 "GET /v2.0/ports?network_id=07eeb44e-4cdb-4c58-a83d-1dd8ab1ccb8a&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0329332 Nov 23 19:35:01.179809 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [None req-64fbdd9e-a1df-4ba0-9ec4-ad3a1e7dc6f6 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:35:01.197144 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [None req-64fbdd9e-a1df-4ba0-9ec4-ad3a1e7dc6f6 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:35:01.257504 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-66c5fbb2-e4a0-4da3-95e6-2294bb946589 req-732c7d56-e4f2-43a7-be0a-340e2d0a8665 service neutron] 10.222.0.41 "GET /v2.0/networks/07eeb44e-4cdb-4c58-a83d-1dd8ab1ccb8a?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0949333 Nov 23 19:35:01.325852 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [None req-64fbdd9e-a1df-4ba0-9ec4-ad3a1e7dc6f6 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-623933'] for security_group, after_delete {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:35:01.328884 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [None req-64fbdd9e-a1df-4ba0-9ec4-ad3a1e7dc6f6 admin admin] Publish callbacks [] for security_group, before_response {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:35:01.330061 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [None req-64fbdd9e-a1df-4ba0-9ec4-ad3a1e7dc6f6 admin admin] 10.222.0.62 "DELETE /v2.0/security-groups/34ae4008-47ee-41a4-818c-50b8ec84ca24 HTTP/1.1" status: 204 len: 168 time: 0.2327931 Nov 23 19:35:01.339401 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-64fbdd9e-a1df-4ba0-9ec4-ad3a1e7dc6f6 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=34ae4008-47ee-41a4-818c-50b8ec84ca24,revision_number=None']} {{(pid=102992) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 23 19:35:01.357382 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-66c5fbb2-e4a0-4da3-95e6-2294bb946589 req-a4816712-4c81-4731-bf44-ce30ac225514 service neutron] 10.222.0.41 "GET /v2.0/networks/07eeb44e-4cdb-4c58-a83d-1dd8ab1ccb8a?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0907063 Nov 23 19:35:01.916897 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9bbb80a4-8fd0-499e-8b2e-c523a54c1cc1 req-f32bdece-0b97-4012-b4a2-5b5e6e91d592 tempest-ServerRescueNegativeTestJSON-1447477341 tempest-ServerRescueNegativeTestJSON-1447477341-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102992) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:35:01.918471 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-9bbb80a4-8fd0-499e-8b2e-c523a54c1cc1 req-f32bdece-0b97-4012-b4a2-5b5e6e91d592 tempest-ServerRescueNegativeTestJSON-1447477341 tempest-ServerRescueNegativeTestJSON-1447477341-project] 10.222.0.62 "GET /v2.0/ports?device_id=671f1d44-7752-4a9d-835d-4d76164c900f HTTP/1.1" status: 200 len: 945 time: 0.0570450 Nov 23 19:35:01.966904 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-9bbb80a4-8fd0-499e-8b2e-c523a54c1cc1 req-7a225cea-0b61-489a-99dc-294557e6f3ea tempest-ServerRescueNegativeTestJSON-1447477341 tempest-ServerRescueNegativeTestJSON-1447477341-project] 10.222.0.62 "GET /v2.0/security-groups?id=62a09434-acf0-424f-9001-2c3a78119364&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0419312 Nov 23 19:35:03.099110 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-eb67d6dc-b0f3-4e74-b9e9-cbb8bbdef8f4 req-170269eb-f9c5-496b-a9a9-7e21b55849c2 tempest-ServerRescueNegativeTestJSON-1447477341 tempest-ServerRescueNegativeTestJSON-1447477341-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102992) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:35:03.100646 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-eb67d6dc-b0f3-4e74-b9e9-cbb8bbdef8f4 req-170269eb-f9c5-496b-a9a9-7e21b55849c2 tempest-ServerRescueNegativeTestJSON-1447477341 tempest-ServerRescueNegativeTestJSON-1447477341-project] 10.222.0.62 "GET /v2.0/ports?device_id=671f1d44-7752-4a9d-835d-4d76164c900f HTTP/1.1" status: 200 len: 945 time: 0.0587852 Nov 23 19:35:03.173986 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-eb67d6dc-b0f3-4e74-b9e9-cbb8bbdef8f4 req-b5f224f5-fe5d-44ef-af38-a065a47396c3 tempest-ServerRescueNegativeTestJSON-1447477341 tempest-ServerRescueNegativeTestJSON-1447477341-project] 10.222.0.62 "GET /v2.0/security-groups?id=62a09434-acf0-424f-9001-2c3a78119364&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0646422 Nov 23 19:35:04.301757 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.wsgi [-] (102993) accepted ('10.222.0.62', 44504) {{(pid=102993) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 23 19:35:04.358733 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2577405f-2704-4ac2-9fcd-cbace873f848 req-5fe82bfa-cc47-4c67-b9ca-cdc360da3723 tempest-ServerRescueNegativeTestJSON-1447477341 tempest-ServerRescueNegativeTestJSON-1447477341-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102992) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:35:04.361394 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-2577405f-2704-4ac2-9fcd-cbace873f848 req-5fe82bfa-cc47-4c67-b9ca-cdc360da3723 tempest-ServerRescueNegativeTestJSON-1447477341 tempest-ServerRescueNegativeTestJSON-1447477341-project] 10.222.0.62 "GET /v2.0/ports?device_id=671f1d44-7752-4a9d-835d-4d76164c900f HTTP/1.1" status: 200 len: 945 time: 0.0690515 Nov 23 19:35:04.422644 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-2577405f-2704-4ac2-9fcd-cbace873f848 req-c0f838ed-cf6e-4bbd-a341-a4a2673a1a34 tempest-ServerRescueNegativeTestJSON-1447477341 tempest-ServerRescueNegativeTestJSON-1447477341-project] 10.222.0.62 "GET /v2.0/security-groups?id=62a09434-acf0-424f-9001-2c3a78119364&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0539036 Nov 23 19:35:04.479321 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-f67851c4-f18b-40b0-a765-1c880368a0cc admin admin] Publish callbacks [] for security_group, before_create {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:35:04.556507 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-f67851c4-f18b-40b0-a765-1c880368a0cc admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:35:04.600552 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-f67851c4-f18b-40b0-a765-1c880368a0cc admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-623933'] for security_group, after_create {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:35:04.643662 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f67851c4-f18b-40b0-a765-1c880368a0cc admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=ba62efb3-91ea-4bd6-a359-449aba345c90,revision_number=1']} {{(pid=102993) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 23 19:35:04.651899 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.wsgi [-] (102992) accepted ('10.222.0.62', 44520) {{(pid=102992) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 23 19:35:04.659872 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [None req-f67851c4-f18b-40b0-a765-1c880368a0cc admin admin] 10.222.0.62 "GET /v2.0/security-groups?tenant_id=d88cb76f80dc40eab09248e90b44d38d&name=default HTTP/1.1" status: 200 len: 2996 time: 0.3558700 Nov 23 19:35:04.720370 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [None req-48aadfe1-ecb4-455f-aa4b-445451b8ae77 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:35:04.744134 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [None req-48aadfe1-ecb4-455f-aa4b-445451b8ae77 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:35:04.868975 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [None req-48aadfe1-ecb4-455f-aa4b-445451b8ae77 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-623933'] for security_group, after_delete {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:35:04.872325 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [None req-48aadfe1-ecb4-455f-aa4b-445451b8ae77 admin admin] Publish callbacks [] for security_group, before_response {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:35:04.877658 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [None req-48aadfe1-ecb4-455f-aa4b-445451b8ae77 admin admin] 10.222.0.62 "DELETE /v2.0/security-groups/ba62efb3-91ea-4bd6-a359-449aba345c90 HTTP/1.1" status: 204 len: 168 time: 0.2206869 Nov 23 19:35:04.882459 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-48aadfe1-ecb4-455f-aa4b-445451b8ae77 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=ba62efb3-91ea-4bd6-a359-449aba345c90,revision_number=None']} {{(pid=102992) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 23 19:35:05.004214 dv-cinder-819011-1-iscsi neutron-server[102995]: DEBUG neutron.db.agents_db [None req-84bdc9b2-57ea-4bdb-a245-07c78d37cea8 None None] Agent healthcheck: found 6 active agents {{(pid=102995) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 23 19:35:05.589516 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bd6b947e-6d92-4cde-a265-02cac642a7c5 req-57010f5f-b646-4290-bef2-6d212c89d8f1 tempest-ServerRescueNegativeTestJSON-1447477341 tempest-ServerRescueNegativeTestJSON-1447477341-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102992) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:35:05.591367 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-bd6b947e-6d92-4cde-a265-02cac642a7c5 req-57010f5f-b646-4290-bef2-6d212c89d8f1 tempest-ServerRescueNegativeTestJSON-1447477341 tempest-ServerRescueNegativeTestJSON-1447477341-project] 10.222.0.62 "GET /v2.0/ports?device_id=671f1d44-7752-4a9d-835d-4d76164c900f HTTP/1.1" status: 200 len: 945 time: 0.0790031 Nov 23 19:35:05.651049 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-bd6b947e-6d92-4cde-a265-02cac642a7c5 req-05e38b5c-94b7-4147-8dfa-d9ae1abb460a tempest-ServerRescueNegativeTestJSON-1447477341 tempest-ServerRescueNegativeTestJSON-1447477341-project] 10.222.0.62 "GET /v2.0/security-groups?id=62a09434-acf0-424f-9001-2c3a78119364&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0529940 Nov 23 19:35:06.778928 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-405256f0-0209-4975-87ca-a49752552f92 req-3d85fe08-6364-4093-833a-9ce5795ddd69 tempest-ServerRescueNegativeTestJSON-1447477341 tempest-ServerRescueNegativeTestJSON-1447477341-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102992) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:35:06.780510 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-405256f0-0209-4975-87ca-a49752552f92 req-3d85fe08-6364-4093-833a-9ce5795ddd69 tempest-ServerRescueNegativeTestJSON-1447477341 tempest-ServerRescueNegativeTestJSON-1447477341-project] 10.222.0.62 "GET /v2.0/ports?device_id=671f1d44-7752-4a9d-835d-4d76164c900f HTTP/1.1" status: 200 len: 945 time: 0.0497098 Nov 23 19:35:06.840899 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-405256f0-0209-4975-87ca-a49752552f92 req-16654959-80b1-49d4-a86c-27ad80bbe1b5 tempest-ServerRescueNegativeTestJSON-1447477341 tempest-ServerRescueNegativeTestJSON-1447477341-project] 10.222.0.62 "GET /v2.0/security-groups?id=62a09434-acf0-424f-9001-2c3a78119364&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0479681 Nov 23 19:35:06.971244 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.wsgi [-] (102992) accepted ('10.222.0.62', 44634) {{(pid=102992) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 23 19:35:07.080908 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [None req-fb3c0c92-6fe7-49c4-87f3-1b304cdfc06b admin admin] Publish callbacks [] for security_group, before_create {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:35:07.174449 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [None req-fb3c0c92-6fe7-49c4-87f3-1b304cdfc06b admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:35:07.245741 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [None req-fb3c0c92-6fe7-49c4-87f3-1b304cdfc06b admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-623933'] for security_group, after_create {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:35:07.289852 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [None req-fb3c0c92-6fe7-49c4-87f3-1b304cdfc06b admin admin] 10.222.0.62 "GET /v2.0/security-groups?tenant_id=5f0a1660e1fa40bb8b2575afb749ffbc&name=default HTTP/1.1" status: 200 len: 2996 time: 0.3174200 Nov 23 19:35:07.292872 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fb3c0c92-6fe7-49c4-87f3-1b304cdfc06b admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=69df6f1c-93f0-4de5-8f37-2ebf078cb641,revision_number=1']} {{(pid=102992) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 23 19:35:07.293125 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.wsgi [-] (102993) accepted ('10.222.0.62', 44646) {{(pid=102993) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 23 19:35:07.342288 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-f79a6e86-3314-4ef7-ace8-0e9497d6ce6d admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:35:07.367351 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-f79a6e86-3314-4ef7-ace8-0e9497d6ce6d admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:35:07.531741 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-f79a6e86-3314-4ef7-ace8-0e9497d6ce6d admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-623933'] for security_group, after_delete {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:35:07.535022 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-f79a6e86-3314-4ef7-ace8-0e9497d6ce6d admin admin] Publish callbacks [] for security_group, before_response {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:35:07.538679 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [None req-f79a6e86-3314-4ef7-ace8-0e9497d6ce6d admin admin] 10.222.0.62 "DELETE /v2.0/security-groups/69df6f1c-93f0-4de5-8f37-2ebf078cb641 HTTP/1.1" status: 204 len: 168 time: 0.2422824 Nov 23 19:35:07.547203 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f79a6e86-3314-4ef7-ace8-0e9497d6ce6d admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=69df6f1c-93f0-4de5-8f37-2ebf078cb641,revision_number=None']} {{(pid=102993) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 23 19:35:07.958816 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-50551f4d-07ab-426b-98fa-d03787c218c8 req-bfc7fafb-5e62-473d-8159-5fb62880c53f tempest-ServerRescueNegativeTestJSON-1447477341 tempest-ServerRescueNegativeTestJSON-1447477341-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102992) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:35:07.960291 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-50551f4d-07ab-426b-98fa-d03787c218c8 req-bfc7fafb-5e62-473d-8159-5fb62880c53f tempest-ServerRescueNegativeTestJSON-1447477341 tempest-ServerRescueNegativeTestJSON-1447477341-project] 10.222.0.62 "GET /v2.0/ports?device_id=671f1d44-7752-4a9d-835d-4d76164c900f HTTP/1.1" status: 200 len: 945 time: 0.0512159 Nov 23 19:35:08.010042 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-50551f4d-07ab-426b-98fa-d03787c218c8 req-2c545a2a-03f9-4ec9-9517-6fdae24619ce tempest-ServerRescueNegativeTestJSON-1447477341 tempest-ServerRescueNegativeTestJSON-1447477341-project] 10.222.0.62 "GET /v2.0/security-groups?id=62a09434-acf0-424f-9001-2c3a78119364&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0435698 Nov 23 19:35:08.180754 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.wsgi [-] (102993) accepted ('10.222.0.62', 44676) {{(pid=102993) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 23 19:35:08.194504 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-2d000638-65f1-40b9-b116-ef42f39c0b47 admin admin] Publish callbacks [] for security_group, before_create {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:35:08.270736 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-2d000638-65f1-40b9-b116-ef42f39c0b47 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:35:08.343238 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-2d000638-65f1-40b9-b116-ef42f39c0b47 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-623933'] for security_group, after_create {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:35:08.385940 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2d000638-65f1-40b9-b116-ef42f39c0b47 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=adef077a-d71f-4866-9426-a95eb418f674,revision_number=1']} {{(pid=102993) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 23 19:35:08.391211 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [None req-2d000638-65f1-40b9-b116-ef42f39c0b47 admin admin] 10.222.0.62 "GET /v2.0/security-groups?tenant_id=631c868425ac4873afb1e1c6aae74875&name=default HTTP/1.1" status: 200 len: 2996 time: 0.2087145 Nov 23 19:35:08.393891 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.wsgi [-] (102993) accepted ('10.222.0.62', 44680) {{(pid=102993) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 23 19:35:08.441626 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-5a30110b-4df4-4e96-aa9c-77c8801eb2ba admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:35:08.463404 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-5a30110b-4df4-4e96-aa9c-77c8801eb2ba admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:35:08.657716 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-5a30110b-4df4-4e96-aa9c-77c8801eb2ba admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-623933'] for security_group, after_delete {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:35:08.660471 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-5a30110b-4df4-4e96-aa9c-77c8801eb2ba admin admin] Publish callbacks [] for security_group, before_response {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:35:08.666845 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [None req-5a30110b-4df4-4e96-aa9c-77c8801eb2ba admin admin] 10.222.0.62 "DELETE /v2.0/security-groups/adef077a-d71f-4866-9426-a95eb418f674 HTTP/1.1" status: 204 len: 168 time: 0.2668209 Nov 23 19:35:08.672425 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5a30110b-4df4-4e96-aa9c-77c8801eb2ba admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=adef077a-d71f-4866-9426-a95eb418f674,revision_number=None']} {{(pid=102993) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 23 19:35:09.139389 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fee445e2-3f48-46da-9994-dcaefa277ba1 req-8e6b58cc-4bed-412c-a77b-8512839cc711 tempest-ServerRescueNegativeTestJSON-1447477341 tempest-ServerRescueNegativeTestJSON-1447477341-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102992) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:35:09.141086 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-fee445e2-3f48-46da-9994-dcaefa277ba1 req-8e6b58cc-4bed-412c-a77b-8512839cc711 tempest-ServerRescueNegativeTestJSON-1447477341 tempest-ServerRescueNegativeTestJSON-1447477341-project] 10.222.0.62 "GET /v2.0/ports?device_id=671f1d44-7752-4a9d-835d-4d76164c900f HTTP/1.1" status: 200 len: 945 time: 0.0616543 Nov 23 19:35:09.210051 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-fee445e2-3f48-46da-9994-dcaefa277ba1 req-3e3686d9-0aa5-4d82-bfc4-8975cba365ea tempest-ServerRescueNegativeTestJSON-1447477341 tempest-ServerRescueNegativeTestJSON-1447477341-project] 10.222.0.62 "GET /v2.0/security-groups?id=62a09434-acf0-424f-9001-2c3a78119364&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0590546 Nov 23 19:35:09.749059 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.wsgi [-] (102993) accepted ('10.222.0.62', 44736) {{(pid=102993) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 23 19:35:09.769112 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.wsgi [-] (102993) accepted ('10.222.0.62', 44742) {{(pid=102993) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 23 19:35:09.866537 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-0d45a2eb-e9d4-4855-bd9e-8b60e0fdb2e7 admin admin] Publish callbacks [] for security_group, before_create {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:35:09.899109 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.api.v2.base [None req-58d7e112-bc26-4bc4-8cde-ac12364bae78 admin admin] Request body: {'network': {'name': 'tempest-VolumesSnapshotTestJSON-523768498-network', 'tenant_id': '766c6a829b9945cfb36bad289566c0ad'}} {{(pid=102993) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 23 19:35:09.967803 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-0d45a2eb-e9d4-4855-bd9e-8b60e0fdb2e7 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:35:10.005994 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-58d7e112-bc26-4bc4-8cde-ac12364bae78 admin admin] Made reservation on behalf of 766c6a829b9945cfb36bad289566c0ad for: {'network': 1} {{(pid=102993) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 23 19:35:10.008509 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-58d7e112-bc26-4bc4-8cde-ac12364bae78 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7921281'] for network, before_create {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:35:10.021164 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-58d7e112-bc26-4bc4-8cde-ac12364bae78 admin admin] Publish callbacks [] for security_group, before_create {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:35:10.032950 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-0d45a2eb-e9d4-4855-bd9e-8b60e0fdb2e7 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-623933'] for security_group, after_create {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:35:10.088397 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [None req-0d45a2eb-e9d4-4855-bd9e-8b60e0fdb2e7 admin admin] 10.222.0.62 "GET /v2.0/security-groups?tenant_id=3defe0f00d114d658520b90a888c2b27&name=default HTTP/1.1" status: 200 len: 2996 time: 0.3352895 Nov 23 19:35:10.088493 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.wsgi [-] (102992) accepted ('10.222.0.62', 44752) {{(pid=102992) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 23 19:35:10.091265 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0d45a2eb-e9d4-4855-bd9e-8b60e0fdb2e7 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=edcb9158-da5e-444a-a873-c4f8e534c613,revision_number=1']} {{(pid=102993) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 23 19:35:10.146634 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [None req-ea82b9e1-cef1-48b3-a222-4bac5ec38e70 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:35:10.151249 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-58d7e112-bc26-4bc4-8cde-ac12364bae78 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:35:10.173365 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [None req-ea82b9e1-cef1-48b3-a222-4bac5ec38e70 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:35:10.185541 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.wsgi [-] (102993) accepted ('10.222.0.62', 44754) {{(pid=102993) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 23 19:35:10.199748 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-58d7e112-bc26-4bc4-8cde-ac12364bae78 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-623933'] for security_group, after_create {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:35:10.221778 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-58d7e112-bc26-4bc4-8cde-ac12364bae78 admin admin] vlan segment allocate from pool success with {'vlan_id': 815, 'physical_network': 'physnet1'} {{(pid=102993) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 23 19:35:10.236732 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-58d7e112-bc26-4bc4-8cde-ac12364bae78 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=2fd4bf42-f1cd-4ab5-94a3-e2347f7bb016,revision_number=1']} {{(pid=102993) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 23 19:35:10.286181 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [None req-ea82b9e1-cef1-48b3-a222-4bac5ec38e70 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-623933'] for security_group, after_delete {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:35:10.289702 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [None req-ea82b9e1-cef1-48b3-a222-4bac5ec38e70 admin admin] Publish callbacks [] for security_group, before_response {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:35:10.300340 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-58d7e112-bc26-4bc4-8cde-ac12364bae78 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7982218'] for segment, precommit_create {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:35:10.300813 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [None req-ea82b9e1-cef1-48b3-a222-4bac5ec38e70 admin admin] 10.222.0.62 "DELETE /v2.0/security-groups/edcb9158-da5e-444a-a873-c4f8e534c613 HTTP/1.1" status: 204 len: 168 time: 0.2069724 Nov 23 19:35:10.301894 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.db.segments_db [None req-58d7e112-bc26-4bc4-8cde-ac12364bae78 admin admin] Added segment b67642b4-1845-4b49-9392-51fd2c9bc8b8 of type vlan for network 6a5d33a0-25a4-4580-ae9f-e7aa9d768182 Nov 23 19:35:10.313738 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ea82b9e1-cef1-48b3-a222-4bac5ec38e70 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=edcb9158-da5e-444a-a873-c4f8e534c613,revision_number=None']} {{(pid=102992) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 23 19:35:10.336709 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-503a1ed6-3cc8-465f-8075-c411575e110f admin admin] Publish callbacks [] for security_group, before_create {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:35:10.388657 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-58d7e112-bc26-4bc4-8cde-ac12364bae78 admin admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8783630993713'] for network, precommit_create {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:35:10.401572 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3504fabd-1bff-4a30-a534-37d1db7c48a6 req-723369b0-cdfb-45a8-b6fe-e6e3de4be088 tempest-ServerRescueNegativeTestJSON-1447477341 tempest-ServerRescueNegativeTestJSON-1447477341-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102992) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:35:10.403051 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-3504fabd-1bff-4a30-a534-37d1db7c48a6 req-723369b0-cdfb-45a8-b6fe-e6e3de4be088 tempest-ServerRescueNegativeTestJSON-1447477341 tempest-ServerRescueNegativeTestJSON-1447477341-project] 10.222.0.62 "GET /v2.0/ports?device_id=671f1d44-7752-4a9d-835d-4d76164c900f HTTP/1.1" status: 200 len: 945 time: 0.0777338 Nov 23 19:35:10.455552 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-3504fabd-1bff-4a30-a534-37d1db7c48a6 req-6219d80d-323e-4f43-bb90-55e84bd65f43 tempest-ServerRescueNegativeTestJSON-1447477341 tempest-ServerRescueNegativeTestJSON-1447477341-project] 10.222.0.62 "GET /v2.0/security-groups?id=62a09434-acf0-424f-9001-2c3a78119364&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0463972 Nov 23 19:35:10.471905 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-503a1ed6-3cc8-465f-8075-c411575e110f admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:35:10.565909 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-58d7e112-bc26-4bc4-8cde-ac12364bae78 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-554949', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560168'] for network, after_create {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:35:10.566926 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-58d7e112-bc26-4bc4-8cde-ac12364bae78 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102993) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:35:10.567507 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-58d7e112-bc26-4bc4-8cde-ac12364bae78 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-560186'] for network, before_response {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:35:10.596187 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-503a1ed6-3cc8-465f-8075-c411575e110f admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-623933'] for security_group, after_create {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:35:10.643335 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-58d7e112-bc26-4bc4-8cde-ac12364bae78 admin admin] Pushing event updated for resources: {'Network': ['ID=6a5d33a0-25a4-4580-ae9f-e7aa9d768182,revision_number=1']} {{(pid=102993) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 23 19:35:10.661486 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.plugins.ml2.rpc [None req-eb87b2c3-3339-4249-8b85-e695b5b4e1f9 None None] Network 6a5d33a0-25a4-4580-ae9f-e7aa9d768182 details requested by agent ovs-agent-dv-cinder-819011-1-iscsi with host dv-cinder-819011-1-iscsi {{(pid=102994) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Nov 23 19:35:10.672197 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [None req-503a1ed6-3cc8-465f-8075-c411575e110f admin admin] 10.222.0.62 "GET /v2.0/security-groups?tenant_id=40b590d43a4a4aaebf06487cd89b84ba&name=default HTTP/1.1" status: 200 len: 2996 time: 0.4854474 Nov 23 19:35:10.672590 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.wsgi [-] (102992) accepted ('10.222.0.62', 44772) {{(pid=102992) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 23 19:35:10.673049 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-503a1ed6-3cc8-465f-8075-c411575e110f admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=23989b9d-7cf2-48b0-b656-53bc1829d068,revision_number=1']} {{(pid=102993) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 23 19:35:10.728295 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [None req-999219b5-2d53-474a-b2c2-82a7e3f0936c admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:35:10.752253 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [None req-58d7e112-bc26-4bc4-8cde-ac12364bae78 admin admin] 10.222.0.62 "POST /v2.0/networks HTTP/1.1" status: 201 len: 886 time: 0.9817033 Nov 23 19:35:10.757179 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [None req-999219b5-2d53-474a-b2c2-82a7e3f0936c admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:35:10.757591 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.wsgi [-] (102993) accepted ('10.222.0.62', 44774) {{(pid=102993) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 23 19:35:10.762144 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.api.v2.base [None req-d30b8b58-4783-44c5-9d07-a99108fc51f9 admin admin] Request body: {'subnet': {'network_id': '6a5d33a0-25a4-4580-ae9f-e7aa9d768182', 'cidr': '172.20.0.0/28', 'name': 'tempest-VolumesSnapshotTestJSON-523768498-subnet', 'tenant_id': '766c6a829b9945cfb36bad289566c0ad', 'enable_dhcp': False, 'ip_version': 4}} {{(pid=102993) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 23 19:35:10.845951 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-d30b8b58-4783-44c5-9d07-a99108fc51f9 admin admin] Made reservation on behalf of 766c6a829b9945cfb36bad289566c0ad for: {'subnet': 1} {{(pid=102993) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 23 19:35:10.848361 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-d30b8b58-4783-44c5-9d07-a99108fc51f9 admin admin] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-17772934'] for subnet, before_create {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:35:10.869728 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [None req-999219b5-2d53-474a-b2c2-82a7e3f0936c admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-623933'] for security_group, after_delete {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:35:10.875025 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [None req-999219b5-2d53-474a-b2c2-82a7e3f0936c admin admin] Publish callbacks [] for security_group, before_response {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:35:10.879356 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [None req-999219b5-2d53-474a-b2c2-82a7e3f0936c admin admin] 10.222.0.62 "DELETE /v2.0/security-groups/23989b9d-7cf2-48b0-b656-53bc1829d068 HTTP/1.1" status: 204 len: 168 time: 0.2018754 Nov 23 19:35:10.892302 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-999219b5-2d53-474a-b2c2-82a7e3f0936c admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=23989b9d-7cf2-48b0-b656-53bc1829d068,revision_number=None']} {{(pid=102992) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 23 19:35:11.028130 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.wsgi [-] (102993) accepted ('10.222.0.62', 44780) {{(pid=102993) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 23 19:35:11.041833 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-9f2615b3-2d1a-4534-a624-692ae56b29c2 admin admin] Publish callbacks [] for security_group, before_create {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:35:11.095831 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-d30b8b58-4783-44c5-9d07-a99108fc51f9 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-554858', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560168', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-17257652', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-17772948'] for subnet, after_create {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:35:11.166388 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-9f2615b3-2d1a-4534-a624-692ae56b29c2 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:35:11.185123 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d30b8b58-4783-44c5-9d07-a99108fc51f9 admin admin] Pushing event updated for resources: {'Subnet': ['ID=cf93b200-5fcb-4538-8ce7-95612047c22a,revision_number=0']} {{(pid=102993) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 23 19:35:11.199202 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-d30b8b58-4783-44c5-9d07-a99108fc51f9 admin admin] Checking segment: {'id': 'b67642b4-1845-4b49-9392-51fd2c9bc8b8', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 815, 'network_id': '6a5d33a0-25a4-4580-ae9f-e7aa9d768182'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102993) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 23 19:35:11.199707 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-d30b8b58-4783-44c5-9d07-a99108fc51f9 admin admin] Network hostable DHCP agents. Network: 6a5d33a0-25a4-4580-ae9f-e7aa9d768182, hostable agents: ['e51c95c7-6a36-4263-ba47-1839054f3e7a'], hosted agents: [] {{(pid=102993) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 23 19:35:11.207644 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-9f2615b3-2d1a-4534-a624-692ae56b29c2 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-623933'] for security_group, after_create {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:35:11.257341 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [None req-9f2615b3-2d1a-4534-a624-692ae56b29c2 admin admin] 10.222.0.62 "GET /v2.0/security-groups?tenant_id=28227a7aed324ef4ae79d1186a550112&name=default HTTP/1.1" status: 200 len: 2996 time: 0.2281590 Nov 23 19:35:11.260858 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.wsgi [-] (102992) accepted ('10.222.0.62', 44784) {{(pid=102992) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 23 19:35:11.261939 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9f2615b3-2d1a-4534-a624-692ae56b29c2 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=8252f1af-399f-4143-8d6b-12faf359f78b,revision_number=1']} {{(pid=102993) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 23 19:35:11.298489 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-d30b8b58-4783-44c5-9d07-a99108fc51f9 admin admin] Network 6a5d33a0-25a4-4580-ae9f-e7aa9d768182 is scheduled to be hosted by DHCP agent e51c95c7-6a36-4263-ba47-1839054f3e7a with binding_index 1 {{(pid=102993) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 23 19:35:11.321048 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [None req-d546d39f-4d3c-4e67-bdd4-8681b8113caf admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:35:11.343840 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [None req-d546d39f-4d3c-4e67-bdd4-8681b8113caf admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:35:11.377178 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.scheduler.base_scheduler [None req-d30b8b58-4783-44c5-9d07-a99108fc51f9 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-819011-1-iscsi, 6a5d33a0-25a4-4580-ae9f-e7aa9d768182) {{(pid=102993) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 23 19:35:11.381864 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-d30b8b58-4783-44c5-9d07-a99108fc51f9 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=102993) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:35:11.382918 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-d30b8b58-4783-44c5-9d07-a99108fc51f9 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-560186'] for subnet, before_response {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:35:11.386452 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-7f77a092-b5ad-4ada-be28-856abfb4256b None None] Network 6a5d33a0-25a4-4580-ae9f-e7aa9d768182 requested from dv-cinder-819011-1-iscsi {{(pid=102994) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 23 19:35:11.495872 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [None req-d546d39f-4d3c-4e67-bdd4-8681b8113caf admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-623933'] for security_group, after_delete {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:35:11.495872 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [None req-d546d39f-4d3c-4e67-bdd4-8681b8113caf admin admin] Publish callbacks [] for security_group, before_response {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:35:11.496606 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [None req-d546d39f-4d3c-4e67-bdd4-8681b8113caf admin admin] 10.222.0.62 "DELETE /v2.0/security-groups/8252f1af-399f-4143-8d6b-12faf359f78b HTTP/1.1" status: 204 len: 168 time: 0.2343814 Nov 23 19:35:11.514640 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d546d39f-4d3c-4e67-bdd4-8681b8113caf admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=8252f1af-399f-4143-8d6b-12faf359f78b,revision_number=None']} {{(pid=102992) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 23 19:35:11.520522 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [None req-d30b8b58-4783-44c5-9d07-a99108fc51f9 admin admin] 10.222.0.62 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 850 time: 0.7612453 Nov 23 19:35:11.524162 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-90ab1c02-71e1-4aa9-a3b7-40e124177ccf None None] Network 6a5d33a0-25a4-4580-ae9f-e7aa9d768182 requested from dv-cinder-819011-1-iscsi {{(pid=102994) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 23 19:35:11.627733 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b30a1958-3101-44d6-b321-938a0af7c358 req-8c20788a-c29f-442b-9471-4d837d12159a tempest-ServerRescueNegativeTestJSON-1447477341 tempest-ServerRescueNegativeTestJSON-1447477341-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102992) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:35:11.629333 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-b30a1958-3101-44d6-b321-938a0af7c358 req-8c20788a-c29f-442b-9471-4d837d12159a tempest-ServerRescueNegativeTestJSON-1447477341 tempest-ServerRescueNegativeTestJSON-1447477341-project] 10.222.0.62 "GET /v2.0/ports?device_id=671f1d44-7752-4a9d-835d-4d76164c900f HTTP/1.1" status: 200 len: 945 time: 0.0712109 Nov 23 19:35:11.691627 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-b30a1958-3101-44d6-b321-938a0af7c358 req-14e78245-a831-4495-a304-719f1019f760 tempest-ServerRescueNegativeTestJSON-1447477341 tempest-ServerRescueNegativeTestJSON-1447477341-project] 10.222.0.62 "GET /v2.0/security-groups?id=62a09434-acf0-424f-9001-2c3a78119364&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0535247 Nov 23 19:35:11.743034 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron_lib.callbacks.manager [None req-7465b741-0ceb-44a8-b942-d0c003f38aa1 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8783631323329', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7978582'] for agent, after_update {{(pid=102994) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:35:12.311186 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.wsgi [-] (102993) accepted ('10.222.0.62', 44804) {{(pid=102993) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 23 19:35:12.325654 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-bb5452af-4c45-4ea3-af65-5b247472888c admin admin] Publish callbacks [] for security_group, before_create {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:35:12.402319 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-bb5452af-4c45-4ea3-af65-5b247472888c admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:35:12.475083 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-bb5452af-4c45-4ea3-af65-5b247472888c admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-623933'] for security_group, after_create {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:35:12.518258 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [None req-bb5452af-4c45-4ea3-af65-5b247472888c admin admin] 10.222.0.62 "GET /v2.0/security-groups?tenant_id=15726b0ea4064a2fbc497b7f3518ea76&name=default HTTP/1.1" status: 200 len: 2996 time: 0.2051897 Nov 23 19:35:12.519319 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bb5452af-4c45-4ea3-af65-5b247472888c admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=8e6ce350-7f22-4ee4-a640-ab95ab7d38e2,revision_number=1']} {{(pid=102993) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 23 19:35:12.520611 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.wsgi [-] (102992) accepted ('10.222.0.62', 44812) {{(pid=102992) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 23 19:35:12.572936 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [None req-773f5394-6216-4734-ba87-fda2e455e1de admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:35:12.594153 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [None req-773f5394-6216-4734-ba87-fda2e455e1de admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:35:12.674788 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [None req-773f5394-6216-4734-ba87-fda2e455e1de admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-623933'] for security_group, after_delete {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:35:12.677592 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [None req-773f5394-6216-4734-ba87-fda2e455e1de admin admin] Publish callbacks [] for security_group, before_response {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:35:12.678789 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [None req-773f5394-6216-4734-ba87-fda2e455e1de admin admin] 10.222.0.62 "DELETE /v2.0/security-groups/8e6ce350-7f22-4ee4-a640-ab95ab7d38e2 HTTP/1.1" status: 204 len: 168 time: 0.1566427 Nov 23 19:35:12.687082 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-773f5394-6216-4734-ba87-fda2e455e1de admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=8e6ce350-7f22-4ee4-a640-ab95ab7d38e2,revision_number=None']} {{(pid=102992) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 23 19:35:12.807703 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0c10c96d-f79a-4905-949b-69c7627bf348 req-cc4c2dfb-a5da-4ae9-af25-721ccd419848 tempest-ServerRescueNegativeTestJSON-1447477341 tempest-ServerRescueNegativeTestJSON-1447477341-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102992) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:35:12.809317 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-0c10c96d-f79a-4905-949b-69c7627bf348 req-cc4c2dfb-a5da-4ae9-af25-721ccd419848 tempest-ServerRescueNegativeTestJSON-1447477341 tempest-ServerRescueNegativeTestJSON-1447477341-project] 10.222.0.62 "GET /v2.0/ports?device_id=671f1d44-7752-4a9d-835d-4d76164c900f HTTP/1.1" status: 200 len: 945 time: 0.0496223 Nov 23 19:35:12.861177 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-0c10c96d-f79a-4905-949b-69c7627bf348 req-c9b2acbd-8fc0-40b0-9b4b-4c6e72c27eb3 tempest-ServerRescueNegativeTestJSON-1447477341 tempest-ServerRescueNegativeTestJSON-1447477341-project] 10.222.0.62 "GET /v2.0/security-groups?id=62a09434-acf0-424f-9001-2c3a78119364&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0457220 Nov 23 19:35:13.683884 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.wsgi [-] (102992) accepted ('10.222.0.62', 44842) {{(pid=102992) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 23 19:35:13.777720 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.api.v2.base [None req-35855ebe-d313-4f97-a25d-766f28c56529 admin admin] Request body: {'network': {'name': 'tempest-VolumesActionsTest-1528575891-network', 'tenant_id': '893242e83e2b490a98fcd7fafca0a833'}} {{(pid=102992) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 23 19:35:13.857087 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-35855ebe-d313-4f97-a25d-766f28c56529 admin admin] Made reservation on behalf of 893242e83e2b490a98fcd7fafca0a833 for: {'network': 1} {{(pid=102992) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 23 19:35:13.859442 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [None req-35855ebe-d313-4f97-a25d-766f28c56529 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7921281'] for network, before_create {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:35:13.868056 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [None req-35855ebe-d313-4f97-a25d-766f28c56529 admin admin] Publish callbacks [] for security_group, before_create {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:35:13.962986 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [None req-35855ebe-d313-4f97-a25d-766f28c56529 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:35:13.986042 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b50003d3-ab06-4a34-b2d7-4c6f8ad85477 req-cead329f-7d12-4c1c-9f30-bac08cd79943 tempest-ServerRescueNegativeTestJSON-1447477341 tempest-ServerRescueNegativeTestJSON-1447477341-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102992) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:35:13.987516 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-b50003d3-ab06-4a34-b2d7-4c6f8ad85477 req-cead329f-7d12-4c1c-9f30-bac08cd79943 tempest-ServerRescueNegativeTestJSON-1447477341 tempest-ServerRescueNegativeTestJSON-1447477341-project] 10.222.0.62 "GET /v2.0/ports?device_id=671f1d44-7752-4a9d-835d-4d76164c900f HTTP/1.1" status: 200 len: 945 time: 0.0582249 Nov 23 19:35:14.000813 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [None req-35855ebe-d313-4f97-a25d-766f28c56529 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-623933'] for security_group, after_create {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:35:14.036721 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-35855ebe-d313-4f97-a25d-766f28c56529 admin admin] vlan segment allocate from pool success with {'vlan_id': 839, 'physical_network': 'physnet1'} {{(pid=102992) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 23 19:35:14.062078 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [None req-35855ebe-d313-4f97-a25d-766f28c56529 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7982218'] for segment, precommit_create {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:35:14.062413 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.db.segments_db [None req-35855ebe-d313-4f97-a25d-766f28c56529 admin admin] Added segment 2ab14203-895d-412f-8616-df9c89e896c9 of type vlan for network 4b2c41c3-6250-433d-837a-85d02cae1bde Nov 23 19:35:14.064674 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-35855ebe-d313-4f97-a25d-766f28c56529 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=47acb13d-cf9a-4dd6-a614-503b94072f69,revision_number=1']} {{(pid=102992) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 23 19:35:14.080573 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-b50003d3-ab06-4a34-b2d7-4c6f8ad85477 req-063a1a02-47f4-4612-883e-80c122bf4bd4 tempest-ServerRescueNegativeTestJSON-1447477341 tempest-ServerRescueNegativeTestJSON-1447477341-project] 10.222.0.62 "GET /v2.0/security-groups?id=62a09434-acf0-424f-9001-2c3a78119364&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0870898 Nov 23 19:35:14.114381 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [None req-35855ebe-d313-4f97-a25d-766f28c56529 admin admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8783630993713'] for network, precommit_create {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:35:14.188586 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron_lib.callbacks.manager [None req-f0034731-eb4e-4440-b3d3-296f4ee78cc2 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8783631323329', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7978582'] for agent, after_update {{(pid=102994) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:35:14.211426 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [None req-35855ebe-d313-4f97-a25d-766f28c56529 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-554949', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560168'] for network, after_create {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:35:14.212488 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-35855ebe-d313-4f97-a25d-766f28c56529 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102992) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:35:14.213868 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [None req-35855ebe-d313-4f97-a25d-766f28c56529 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-560186'] for network, before_response {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:35:14.271756 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-35855ebe-d313-4f97-a25d-766f28c56529 admin admin] Pushing event updated for resources: {'Network': ['ID=4b2c41c3-6250-433d-837a-85d02cae1bde,revision_number=1']} {{(pid=102992) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 23 19:35:14.281064 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.plugins.ml2.rpc [None req-eb87b2c3-3339-4249-8b85-e695b5b4e1f9 None None] Network 4b2c41c3-6250-433d-837a-85d02cae1bde details requested by agent ovs-agent-dv-cinder-819011-1-iscsi with host dv-cinder-819011-1-iscsi {{(pid=102994) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Nov 23 19:35:14.305823 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [None req-35855ebe-d313-4f97-a25d-766f28c56529 admin admin] 10.222.0.62 "POST /v2.0/networks HTTP/1.1" status: 201 len: 882 time: 0.6208196 Nov 23 19:35:14.309255 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.wsgi [-] (102992) accepted ('10.222.0.62', 44850) {{(pid=102992) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 23 19:35:14.314579 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.api.v2.base [None req-16997cfb-19ff-40b3-8440-b3a2fc8eee94 admin admin] Request body: {'subnet': {'network_id': '4b2c41c3-6250-433d-837a-85d02cae1bde', 'cidr': '172.20.0.0/28', 'name': 'tempest-VolumesActionsTest-1528575891-subnet', 'tenant_id': '893242e83e2b490a98fcd7fafca0a833', 'enable_dhcp': False, 'ip_version': 4}} {{(pid=102992) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 23 19:35:14.405913 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-16997cfb-19ff-40b3-8440-b3a2fc8eee94 admin admin] Made reservation on behalf of 893242e83e2b490a98fcd7fafca0a833 for: {'subnet': 1} {{(pid=102992) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 23 19:35:14.408292 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [None req-16997cfb-19ff-40b3-8440-b3a2fc8eee94 admin admin] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-25999706'] for subnet, before_create {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:35:14.640619 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [None req-16997cfb-19ff-40b3-8440-b3a2fc8eee94 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-554858', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560168', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-25199633', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-25999688'] for subnet, after_create {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:35:14.702401 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-16997cfb-19ff-40b3-8440-b3a2fc8eee94 admin admin] Pushing event updated for resources: {'Subnet': ['ID=168da168-ed46-4168-8b11-4b0ac0e6fbd8,revision_number=0']} {{(pid=102992) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 23 19:35:14.712401 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-16997cfb-19ff-40b3-8440-b3a2fc8eee94 admin admin] Checking segment: {'id': '2ab14203-895d-412f-8616-df9c89e896c9', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 839, 'network_id': '4b2c41c3-6250-433d-837a-85d02cae1bde'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102992) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 23 19:35:14.712831 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-16997cfb-19ff-40b3-8440-b3a2fc8eee94 admin admin] Network hostable DHCP agents. Network: 4b2c41c3-6250-433d-837a-85d02cae1bde, hostable agents: ['e51c95c7-6a36-4263-ba47-1839054f3e7a'], hosted agents: [] {{(pid=102992) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 23 19:35:14.788978 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-16997cfb-19ff-40b3-8440-b3a2fc8eee94 admin admin] Network 4b2c41c3-6250-433d-837a-85d02cae1bde is scheduled to be hosted by DHCP agent e51c95c7-6a36-4263-ba47-1839054f3e7a with binding_index 1 {{(pid=102992) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 23 19:35:14.868905 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.scheduler.base_scheduler [None req-16997cfb-19ff-40b3-8440-b3a2fc8eee94 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-819011-1-iscsi, 4b2c41c3-6250-433d-837a-85d02cae1bde) {{(pid=102992) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 23 19:35:14.873906 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-16997cfb-19ff-40b3-8440-b3a2fc8eee94 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=102992) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:35:14.874648 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [None req-16997cfb-19ff-40b3-8440-b3a2fc8eee94 admin admin] Publish callbacks [] for subnet, before_response {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:35:14.879641 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-e25dd3e2-d28b-4cb4-a7f0-1f743684bfaa None None] Network 4b2c41c3-6250-433d-837a-85d02cae1bde requested from dv-cinder-819011-1-iscsi {{(pid=102994) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 23 19:35:14.974716 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [None req-16997cfb-19ff-40b3-8440-b3a2fc8eee94 admin admin] 10.222.0.62 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 846 time: 0.6644011 Nov 23 19:35:15.012858 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-3b12c1fb-8a34-44df-a66d-c7e46e17ec89 None None] Network 4b2c41c3-6250-433d-837a-85d02cae1bde requested from dv-cinder-819011-1-iscsi {{(pid=102994) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 23 19:35:15.098917 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron_lib.callbacks.manager [None req-8346ef05-f685-4c3d-af3d-a159b683bec2 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8783631323329', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7978582'] for agent, after_update {{(pid=102994) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:35:15.207771 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e75365fa-e845-44dd-88a4-d703d8d5be28 req-c151490a-e32f-4f79-bc98-35f622e3236f tempest-ServerRescueNegativeTestJSON-1447477341 tempest-ServerRescueNegativeTestJSON-1447477341-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102992) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:35:15.209358 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-e75365fa-e845-44dd-88a4-d703d8d5be28 req-c151490a-e32f-4f79-bc98-35f622e3236f tempest-ServerRescueNegativeTestJSON-1447477341 tempest-ServerRescueNegativeTestJSON-1447477341-project] 10.222.0.62 "GET /v2.0/ports?device_id=671f1d44-7752-4a9d-835d-4d76164c900f HTTP/1.1" status: 200 len: 945 time: 0.0545008 Nov 23 19:35:15.270451 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-e75365fa-e845-44dd-88a4-d703d8d5be28 req-ee1fc2a6-a99a-419c-9dd6-a065e5f04f89 tempest-ServerRescueNegativeTestJSON-1447477341 tempest-ServerRescueNegativeTestJSON-1447477341-project] 10.222.0.62 "GET /v2.0/security-groups?id=62a09434-acf0-424f-9001-2c3a78119364&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0533285 Nov 23 19:35:16.065200 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-73fe7243-5536-4f32-95e0-1f9e43288040 req-9089db0a-2920-4d01-bc75-1e934a29229c tempest-VolumesSnapshotTestJSON-97879810 tempest-VolumesSnapshotTestJSON-97879810-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=102992) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:35:16.066717 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-73fe7243-5536-4f32-95e0-1f9e43288040 req-9089db0a-2920-4d01-bc75-1e934a29229c tempest-VolumesSnapshotTestJSON-97879810 tempest-VolumesSnapshotTestJSON-97879810-project] 10.222.0.62 "GET /v2.0/networks?id=6a5d33a0-25a4-4580-ae9f-e7aa9d768182 HTTP/1.1" status: 200 len: 813 time: 0.1142640 Nov 23 19:35:16.083909 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-73fe7243-5536-4f32-95e0-1f9e43288040 req-30262865-a357-4cf2-83eb-f76883c40679 tempest-VolumesSnapshotTestJSON-97879810 tempest-VolumesSnapshotTestJSON-97879810-project] 10.222.0.62 "GET /v2.0/quotas/766c6a829b9945cfb36bad289566c0ad HTTP/1.1" status: 200 len: 375 time: 0.0107327 Nov 23 19:35:16.136298 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-73fe7243-5536-4f32-95e0-1f9e43288040 req-aee04cb3-423f-4824-b48a-b602ceec7621 tempest-VolumesSnapshotTestJSON-97879810 tempest-VolumesSnapshotTestJSON-97879810-project] 10.222.0.62 "GET /v2.0/ports?tenant_id=766c6a829b9945cfb36bad289566c0ad&fields=id HTTP/1.1" status: 200 len: 210 time: 0.0461116 Nov 23 19:35:16.238129 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.wsgi [req-73fe7243-5536-4f32-95e0-1f9e43288040 req-bbdb85f5-7f2b-4b81-8a00-1f99291c1da1 service neutron] http://10.222.0.62:9696/v2.0/extensions returned with HTTP 200 {{(pid=102992) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Nov 23 19:35:16.239156 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-73fe7243-5536-4f32-95e0-1f9e43288040 req-bbdb85f5-7f2b-4b81-8a00-1f99291c1da1 service neutron] 10.222.0.62 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 14082 time: 0.0509934 Nov 23 19:35:16.334409 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-73fe7243-5536-4f32-95e0-1f9e43288040 req-992ebfaf-7aa9-4753-81e3-dc1a864c9bf7 service neutron] 10.222.0.62 "GET /v2.0/networks/6a5d33a0-25a4-4580-ae9f-e7aa9d768182?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0889173 Nov 23 19:35:16.394397 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5070b242-a471-49c6-a397-6f1c52eb24af req-9a463e0d-a7b4-4453-b73b-d2ff3953b6b2 tempest-ServerRescueNegativeTestJSON-1447477341 tempest-ServerRescueNegativeTestJSON-1447477341-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102993) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:35:16.395829 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-5070b242-a471-49c6-a397-6f1c52eb24af req-9a463e0d-a7b4-4453-b73b-d2ff3953b6b2 tempest-ServerRescueNegativeTestJSON-1447477341 tempest-ServerRescueNegativeTestJSON-1447477341-project] 10.222.0.62 "GET /v2.0/ports?device_id=671f1d44-7752-4a9d-835d-4d76164c900f HTTP/1.1" status: 200 len: 945 time: 0.0521610 Nov 23 19:35:16.425003 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-73fe7243-5536-4f32-95e0-1f9e43288040 req-5d83e326-52db-409e-bf2f-ba7aa043ab43 service neutron] 10.222.0.62 "GET /v2.0/networks/6a5d33a0-25a4-4580-ae9f-e7aa9d768182?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0836427 Nov 23 19:35:16.447467 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-5070b242-a471-49c6-a397-6f1c52eb24af req-f0c29189-efbd-4979-9ea0-4d4728426e99 tempest-ServerRescueNegativeTestJSON-1447477341 tempest-ServerRescueNegativeTestJSON-1447477341-project] 10.222.0.62 "GET /v2.0/security-groups?id=62a09434-acf0-424f-9001-2c3a78119364&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0445061 Nov 23 19:35:16.577790 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron_lib.callbacks.manager [None req-785c1d26-11ba-42d8-b5a6-51a8b3daeef0 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8783631323329', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7978582'] for agent, after_update {{(pid=102994) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:35:16.692223 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-64a58a19-8135-4f48-acec-18aedf94b3f0 req-1f58923b-e1fb-4cce-85f7-1992916b2be0 tempest-VolumesSnapshotTestJSON-97879810 tempest-VolumesSnapshotTestJSON-97879810-project] 10.222.0.62 "GET /v2.0/ports?device_id=d8c269ba-e8f8-4705-a5a5-fbfbb498151f HTTP/1.1" status: 200 len: 210 time: 0.0267570 Nov 23 19:35:17.079442 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-82ea341b-5c7c-44b0-aa2c-109799d8e518 req-4ddcd425-df74-44d5-9ec7-65591b62f185 tempest-VolumesActionsTest-802949502 tempest-VolumesActionsTest-802949502-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=102992) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:35:17.081044 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-82ea341b-5c7c-44b0-aa2c-109799d8e518 req-4ddcd425-df74-44d5-9ec7-65591b62f185 tempest-VolumesActionsTest-802949502 tempest-VolumesActionsTest-802949502-project] 10.222.0.62 "GET /v2.0/networks?id=4b2c41c3-6250-433d-837a-85d02cae1bde HTTP/1.1" status: 200 len: 809 time: 0.1050355 Nov 23 19:35:17.096747 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-82ea341b-5c7c-44b0-aa2c-109799d8e518 req-8aa9ae72-bb29-4700-a211-cf22a248be45 tempest-VolumesActionsTest-802949502 tempest-VolumesActionsTest-802949502-project] 10.222.0.62 "GET /v2.0/quotas/893242e83e2b490a98fcd7fafca0a833 HTTP/1.1" status: 200 len: 375 time: 0.0098724 Nov 23 19:35:17.128601 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-82ea341b-5c7c-44b0-aa2c-109799d8e518 req-9ebb245e-bba0-4e10-a0f1-b5705ce3b536 tempest-VolumesActionsTest-802949502 tempest-VolumesActionsTest-802949502-project] 10.222.0.62 "GET /v2.0/ports?tenant_id=893242e83e2b490a98fcd7fafca0a833&fields=id HTTP/1.1" status: 200 len: 210 time: 0.0262063 Nov 23 19:35:17.227587 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-82ea341b-5c7c-44b0-aa2c-109799d8e518 req-bebd637f-8b90-4a06-b300-d264c2ecaf6a service neutron] 10.222.0.62 "GET /v2.0/networks/4b2c41c3-6250-433d-837a-85d02cae1bde?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0922852 Nov 23 19:35:17.326227 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron_lib.callbacks.manager [None req-eb87b2c3-3339-4249-8b85-e695b5b4e1f9 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8783631323329', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7978582'] for agent, after_update {{(pid=102994) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:35:17.335497 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-82ea341b-5c7c-44b0-aa2c-109799d8e518 req-f5027299-5910-458b-bb4e-44e46de19559 service neutron] 10.222.0.62 "GET /v2.0/networks/4b2c41c3-6250-433d-837a-85d02cae1bde?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0898187 Nov 23 19:35:17.546997 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-0c81098f-224f-4022-b9e2-310780531306 req-c437f5d0-caee-4531-9879-51074d93441e tempest-VolumesActionsTest-802949502 tempest-VolumesActionsTest-802949502-project] 10.222.0.62 "GET /v2.0/ports?device_id=fa2c753c-e8ba-46c8-8c59-7a35f6357117 HTTP/1.1" status: 200 len: 210 time: 0.0301263 Nov 23 19:35:17.580074 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9b55da69-526d-4578-9573-8562ab635780 req-62d844b3-29cc-48b8-8ce5-dc49a0b34be8 tempest-ServerRescueNegativeTestJSON-1447477341 tempest-ServerRescueNegativeTestJSON-1447477341-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102993) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:35:17.581898 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-9b55da69-526d-4578-9573-8562ab635780 req-62d844b3-29cc-48b8-8ce5-dc49a0b34be8 tempest-ServerRescueNegativeTestJSON-1447477341 tempest-ServerRescueNegativeTestJSON-1447477341-project] 10.222.0.62 "GET /v2.0/ports?device_id=671f1d44-7752-4a9d-835d-4d76164c900f HTTP/1.1" status: 200 len: 945 time: 0.0526757 Nov 23 19:35:17.653956 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-9b55da69-526d-4578-9573-8562ab635780 req-f7ea53dd-c211-4555-b368-5b66fc2cd193 tempest-ServerRescueNegativeTestJSON-1447477341 tempest-ServerRescueNegativeTestJSON-1447477341-project] 10.222.0.62 "GET /v2.0/security-groups?id=62a09434-acf0-424f-9001-2c3a78119364&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0659649 Nov 23 19:35:17.788312 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-796d011c-bd73-43ec-9c83-340d3502a779 req-933a84d9-9361-4cfd-83ba-bc7397857f6c tempest-VolumesSnapshotTestJSON-97879810 tempest-VolumesSnapshotTestJSON-97879810-project] 10.222.0.62 "GET /v2.0/ports?device_id=d8c269ba-e8f8-4705-a5a5-fbfbb498151f HTTP/1.1" status: 200 len: 210 time: 0.0296712 Nov 23 19:35:18.629920 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-930d40b5-cc2b-43bf-b57c-6486423fe124 req-8e745e31-e380-4a2a-a7dd-20c1b063b8f9 tempest-VolumesActionsTest-802949502 tempest-VolumesActionsTest-802949502-project] 10.222.0.62 "GET /v2.0/ports?device_id=fa2c753c-e8ba-46c8-8c59-7a35f6357117 HTTP/1.1" status: 200 len: 210 time: 0.0268178 Nov 23 19:35:18.731317 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-73fe7243-5536-4f32-95e0-1f9e43288040 req-044efc69-7013-49bb-953a-6d93b91f6a87 tempest-VolumesSnapshotTestJSON-97879810 tempest-VolumesSnapshotTestJSON-97879810-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=102993) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:35:18.743397 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-73fe7243-5536-4f32-95e0-1f9e43288040 req-044efc69-7013-49bb-953a-6d93b91f6a87 tempest-VolumesSnapshotTestJSON-97879810 tempest-VolumesSnapshotTestJSON-97879810-project] 10.222.0.41 "GET /v2.0/networks?id=6a5d33a0-25a4-4580-ae9f-e7aa9d768182 HTTP/1.1" status: 200 len: 813 time: 0.1217260 Nov 23 19:35:18.755485 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.api.v2.base [req-73fe7243-5536-4f32-95e0-1f9e43288040 req-e2734bee-a7c0-42df-ac5a-5fdfc02d8ca9 tempest-VolumesSnapshotTestJSON-97879810 tempest-VolumesSnapshotTestJSON-97879810-project] Request body: {'port': {'device_id': 'd8c269ba-e8f8-4705-a5a5-fbfbb498151f', 'network_id': '6a5d33a0-25a4-4580-ae9f-e7aa9d768182', 'admin_state_up': True, 'tenant_id': '766c6a829b9945cfb36bad289566c0ad'}} {{(pid=102993) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 23 19:35:18.876564 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-998f3048-8c1a-472e-9a98-c3c769e35d3c req-8024d026-1862-4db4-8148-6889f6bd674b tempest-ServerRescueNegativeTestJSON-1447477341 tempest-ServerRescueNegativeTestJSON-1447477341-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102993) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:35:18.878087 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-998f3048-8c1a-472e-9a98-c3c769e35d3c req-8024d026-1862-4db4-8148-6889f6bd674b tempest-ServerRescueNegativeTestJSON-1447477341 tempest-ServerRescueNegativeTestJSON-1447477341-project] 10.222.0.62 "GET /v2.0/ports?device_id=671f1d44-7752-4a9d-835d-4d76164c900f HTTP/1.1" status: 200 len: 945 time: 0.1171825 Nov 23 19:35:18.922356 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-7a5ef147-3c3c-4b41-b77c-beb191b7d671 req-9ed957cd-c564-47d4-a910-359837080285 tempest-VolumesSnapshotTestJSON-97879810 tempest-VolumesSnapshotTestJSON-97879810-project] 10.222.0.62 "GET /v2.0/ports?device_id=d8c269ba-e8f8-4705-a5a5-fbfbb498151f HTTP/1.1" status: 200 len: 210 time: 0.0387166 Nov 23 19:35:18.959527 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-998f3048-8c1a-472e-9a98-c3c769e35d3c req-af6575f3-38b0-4be7-9576-74c45447dcab tempest-ServerRescueNegativeTestJSON-1447477341 tempest-ServerRescueNegativeTestJSON-1447477341-project] 10.222.0.62 "GET /v2.0/security-groups?id=62a09434-acf0-424f-9001-2c3a78119364&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0628815 Nov 23 19:35:19.000663 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-73fe7243-5536-4f32-95e0-1f9e43288040 req-e2734bee-a7c0-42df-ac5a-5fdfc02d8ca9 tempest-VolumesSnapshotTestJSON-97879810 tempest-VolumesSnapshotTestJSON-97879810-project] Made reservation on behalf of 766c6a829b9945cfb36bad289566c0ad for: {'port': 1} {{(pid=102993) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 23 19:35:19.005732 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [req-73fe7243-5536-4f32-95e0-1f9e43288040 req-e2734bee-a7c0-42df-ac5a-5fdfc02d8ca9 tempest-VolumesSnapshotTestJSON-97879810 tempest-VolumesSnapshotTestJSON-97879810-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7921281'] for port, before_create {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:35:19.177204 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.db.db_base_plugin_common [req-73fe7243-5536-4f32-95e0-1f9e43288040 req-e2734bee-a7c0-42df-ac5a-5fdfc02d8ca9 tempest-VolumesSnapshotTestJSON-97879810 tempest-VolumesSnapshotTestJSON-97879810-project] Allocated IP 172.20.0.8 (6a5d33a0-25a4-4580-ae9f-e7aa9d768182/cf93b200-5fcb-4538-8ce7-95612047c22a/f82fc68a-422f-4577-b6c3-98bd45727b03) {{(pid=102993) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 23 19:35:19.324681 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [req-73fe7243-5536-4f32-95e0-1f9e43288040 req-e2734bee-a7c0-42df-ac5a-5fdfc02d8ca9 tempest-VolumesSnapshotTestJSON-97879810 tempest-VolumesSnapshotTestJSON-97879810-project] Publish callbacks [] for port, precommit_create {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:35:19.424159 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [req-73fe7243-5536-4f32-95e0-1f9e43288040 req-e2734bee-a7c0-42df-ac5a-5fdfc02d8ca9 tempest-VolumesSnapshotTestJSON-97879810 tempest-VolumesSnapshotTestJSON-97879810-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7918660', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-15067', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560168', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8783631008714', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-17257496'] for port, after_create {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:35:19.466028 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-73fe7243-5536-4f32-95e0-1f9e43288040 req-e2734bee-a7c0-42df-ac5a-5fdfc02d8ca9 tempest-VolumesSnapshotTestJSON-97879810 tempest-VolumesSnapshotTestJSON-97879810-project] Network 6a5d33a0-25a4-4580-ae9f-e7aa9d768182 is already hosted by enough agents. {{(pid=102993) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 23 19:35:19.469345 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.scheduler.base_scheduler [req-73fe7243-5536-4f32-95e0-1f9e43288040 req-e2734bee-a7c0-42df-ac5a-5fdfc02d8ca9 tempest-VolumesSnapshotTestJSON-97879810 tempest-VolumesSnapshotTestJSON-97879810-project] Resources bound (agent type, host, resource id): {{(pid=102993) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 23 19:35:19.475308 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.db.l3_dvrscheduler_db [req-73fe7243-5536-4f32-95e0-1f9e43288040 req-e2734bee-a7c0-42df-ac5a-5fdfc02d8ca9 tempest-VolumesSnapshotTestJSON-97879810 tempest-VolumesSnapshotTestJSON-97879810-project] Received port after_create {{(pid=102993) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 23 19:35:19.507982 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e2734bee-a7c0-42df-ac5a-5fdfc02d8ca9 tempest-VolumesSnapshotTestJSON-97879810 tempest-VolumesSnapshotTestJSON-97879810-project] Pushing event updated for resources: {'Port': ['ID=f82fc68a-422f-4577-b6c3-98bd45727b03,revision_number=1']} {{(pid=102993) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 23 19:35:19.519926 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e2734bee-a7c0-42df-ac5a-5fdfc02d8ca9 tempest-VolumesSnapshotTestJSON-97879810 tempest-VolumesSnapshotTestJSON-97879810-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-819011-1-iscsi {{(pid=102993) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 23 19:35:19.520284 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e2734bee-a7c0-42df-ac5a-5fdfc02d8ca9 tempest-VolumesSnapshotTestJSON-97879810 tempest-VolumesSnapshotTestJSON-97879810-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-819011-1-iscsi {{(pid=102993) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 23 19:35:19.520632 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e2734bee-a7c0-42df-ac5a-5fdfc02d8ca9 tempest-VolumesSnapshotTestJSON-97879810 tempest-VolumesSnapshotTestJSON-97879810-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-819011-1-iscsi {{(pid=102993) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 23 19:35:19.520975 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e2734bee-a7c0-42df-ac5a-5fdfc02d8ca9 tempest-VolumesSnapshotTestJSON-97879810 tempest-VolumesSnapshotTestJSON-97879810-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-819011-1-iscsi {{(pid=102993) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 23 19:35:19.521319 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e2734bee-a7c0-42df-ac5a-5fdfc02d8ca9 tempest-VolumesSnapshotTestJSON-97879810 tempest-VolumesSnapshotTestJSON-97879810-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-819011-1-iscsi {{(pid=102993) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 23 19:35:19.521682 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e2734bee-a7c0-42df-ac5a-5fdfc02d8ca9 tempest-VolumesSnapshotTestJSON-97879810 tempest-VolumesSnapshotTestJSON-97879810-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-819011-1-iscsi {{(pid=102993) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 23 19:35:19.522018 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e2734bee-a7c0-42df-ac5a-5fdfc02d8ca9 tempest-VolumesSnapshotTestJSON-97879810 tempest-VolumesSnapshotTestJSON-97879810-project] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-819011-1-iscsi {{(pid=102993) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 23 19:35:19.522355 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e2734bee-a7c0-42df-ac5a-5fdfc02d8ca9 tempest-VolumesSnapshotTestJSON-97879810 tempest-VolumesSnapshotTestJSON-97879810-project] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-819011-1-iscsi {{(pid=102993) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 23 19:35:19.522686 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e2734bee-a7c0-42df-ac5a-5fdfc02d8ca9 tempest-VolumesSnapshotTestJSON-97879810 tempest-VolumesSnapshotTestJSON-97879810-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-819011-1-iscsi {{(pid=102993) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 23 19:35:19.523018 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e2734bee-a7c0-42df-ac5a-5fdfc02d8ca9 tempest-VolumesSnapshotTestJSON-97879810 tempest-VolumesSnapshotTestJSON-97879810-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-819011-1-iscsi {{(pid=102993) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 23 19:35:19.523349 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e2734bee-a7c0-42df-ac5a-5fdfc02d8ca9 tempest-VolumesSnapshotTestJSON-97879810 tempest-VolumesSnapshotTestJSON-97879810-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-819011-1-iscsi {{(pid=102993) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 23 19:35:19.523675 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e2734bee-a7c0-42df-ac5a-5fdfc02d8ca9 tempest-VolumesSnapshotTestJSON-97879810 tempest-VolumesSnapshotTestJSON-97879810-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-819011-1-iscsi {{(pid=102993) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 23 19:35:19.538668 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-73fe7243-5536-4f32-95e0-1f9e43288040 req-e2734bee-a7c0-42df-ac5a-5fdfc02d8ca9 tempest-VolumesSnapshotTestJSON-97879810 tempest-VolumesSnapshotTestJSON-97879810-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=102993) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:35:19.541836 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [req-73fe7243-5536-4f32-95e0-1f9e43288040 req-e2734bee-a7c0-42df-ac5a-5fdfc02d8ca9 tempest-VolumesSnapshotTestJSON-97879810 tempest-VolumesSnapshotTestJSON-97879810-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-514902'] for port, before_response {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:35:19.614439 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-73fe7243-5536-4f32-95e0-1f9e43288040 req-e2734bee-a7c0-42df-ac5a-5fdfc02d8ca9 tempest-VolumesSnapshotTestJSON-97879810 tempest-VolumesSnapshotTestJSON-97879810-project] 10.222.0.41 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 0.8632324 Nov 23 19:35:19.629256 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.api.v2.base [req-73fe7243-5536-4f32-95e0-1f9e43288040 req-b8fcc7e6-15da-422d-b093-0ed1629eb499 service neutron] Request body: {'port': {'device_id': 'd8c269ba-e8f8-4705-a5a5-fbfbb498151f', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-81901'}} {{(pid=102993) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 23 19:35:19.691170 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [req-73fe7243-5536-4f32-95e0-1f9e43288040 req-b8fcc7e6-15da-422d-b093-0ed1629eb499 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7921281'] for port, before_update {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:35:19.743439 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-63d06cd8-bb0c-4ff7-81a0-75c4ead8ac12 req-b562fc3f-5aeb-499f-ada3-bca27d5dc7b6 tempest-VolumesActionsTest-802949502 tempest-VolumesActionsTest-802949502-project] 10.222.0.62 "GET /v2.0/ports?device_id=fa2c753c-e8ba-46c8-8c59-7a35f6357117 HTTP/1.1" status: 200 len: 210 time: 0.0353866 Nov 23 19:35:19.970623 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.notifiers.nova [req-73fe7243-5536-4f32-95e0-1f9e43288040 req-b8fcc7e6-15da-422d-b093-0ed1629eb499 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id f82fc68a-422f-4577-b6c3-98bd45727b03 {{(pid=102993) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 23 19:35:19.977111 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [req-73fe7243-5536-4f32-95e0-1f9e43288040 req-b8fcc7e6-15da-422d-b093-0ed1629eb499 service neutron] Publish callbacks [] for port, precommit_update {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:35:19.990695 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.db.provisioning_blocks [req-73fe7243-5536-4f32-95e0-1f9e43288040 req-b8fcc7e6-15da-422d-b093-0ed1629eb499 service neutron] Transition to ACTIVE for port object f82fc68a-422f-4577-b6c3-98bd45727b03 will not be triggered until provisioned by entity L2. {{(pid=102993) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 23 19:35:20.053315 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-06459f5d-b191-44f0-b1c1-db0662587b0b req-0fd34425-5a3e-42ec-8456-8289144661fe tempest-VolumesSnapshotTestJSON-97879810 tempest-VolumesSnapshotTestJSON-97879810-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102993) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:35:20.053782 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-06459f5d-b191-44f0-b1c1-db0662587b0b req-0fd34425-5a3e-42ec-8456-8289144661fe tempest-VolumesSnapshotTestJSON-97879810 tempest-VolumesSnapshotTestJSON-97879810-project] 10.222.0.62 "GET /v2.0/ports?device_id=d8c269ba-e8f8-4705-a5a5-fbfbb498151f HTTP/1.1" status: 200 len: 931 time: 0.0507216 Nov 23 19:35:20.076147 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [req-73fe7243-5536-4f32-95e0-1f9e43288040 req-b8fcc7e6-15da-422d-b093-0ed1629eb499 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7918660', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-15067', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560168', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8783631423946', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8783631008732', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8783631008750', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-17257505'] for port, after_update {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:35:20.086343 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-82ea341b-5c7c-44b0-aa2c-109799d8e518 req-b5e9e50b-949e-4e6f-8960-5751681cc33e tempest-VolumesActionsTest-802949502 tempest-VolumesActionsTest-802949502-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=102992) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:35:20.087800 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-82ea341b-5c7c-44b0-aa2c-109799d8e518 req-b5e9e50b-949e-4e6f-8960-5751681cc33e tempest-VolumesActionsTest-802949502 tempest-VolumesActionsTest-802949502-project] 10.222.0.41 "GET /v2.0/networks?id=4b2c41c3-6250-433d-837a-85d02cae1bde HTTP/1.1" status: 200 len: 809 time: 0.1546290 Nov 23 19:35:20.106698 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.api.v2.base [req-82ea341b-5c7c-44b0-aa2c-109799d8e518 req-46513e1e-2fe0-4d48-b676-592425edd8f2 tempest-VolumesActionsTest-802949502 tempest-VolumesActionsTest-802949502-project] Request body: {'port': {'device_id': 'fa2c753c-e8ba-46c8-8c59-7a35f6357117', 'network_id': '4b2c41c3-6250-433d-837a-85d02cae1bde', 'admin_state_up': True, 'tenant_id': '893242e83e2b490a98fcd7fafca0a833'}} {{(pid=102992) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 23 19:35:20.119167 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b9fa1809-6205-414b-ab1e-7cb9c50f48e4 req-50a4af42-3cdd-42b3-aa23-59078805e1b4 tempest-ServerRescueNegativeTestJSON-1447477341 tempest-ServerRescueNegativeTestJSON-1447477341-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102992) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:35:20.120974 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-b9fa1809-6205-414b-ab1e-7cb9c50f48e4 req-50a4af42-3cdd-42b3-aa23-59078805e1b4 tempest-ServerRescueNegativeTestJSON-1447477341 tempest-ServerRescueNegativeTestJSON-1447477341-project] 10.222.0.62 "GET /v2.0/ports?device_id=671f1d44-7752-4a9d-835d-4d76164c900f HTTP/1.1" status: 200 len: 945 time: 0.0843542 Nov 23 19:35:20.152644 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-06459f5d-b191-44f0-b1c1-db0662587b0b req-f33b29ba-f3fd-4645-a2db-7ab6a5c23674 tempest-VolumesSnapshotTestJSON-97879810 tempest-VolumesSnapshotTestJSON-97879810-project] 10.222.0.62 "GET /v2.0/security-groups?id=2fd4bf42-f1cd-4ab5-94a3-e2347f7bb016&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0927947 Nov 23 19:35:20.153245 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b8fcc7e6-15da-422d-b093-0ed1629eb499 service neutron] Pushing event updated for resources: {'Port': ['ID=f82fc68a-422f-4577-b6c3-98bd45727b03,revision_number=2']} {{(pid=102993) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 23 19:35:20.240912 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.plugins.ml2.managers [req-73fe7243-5536-4f32-95e0-1f9e43288040 req-b8fcc7e6-15da-422d-b093-0ed1629eb499 service neutron] Attempting to bind port f82fc68a-422f-4577-b6c3-98bd45727b03 on host hv-cinder-81901 for vnic_type normal with profile {{(pid=102993) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 23 19:35:20.241267 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.plugins.ml2.managers [req-73fe7243-5536-4f32-95e0-1f9e43288040 req-b8fcc7e6-15da-422d-b093-0ed1629eb499 service neutron] Attempting to bind port f82fc68a-422f-4577-b6c3-98bd45727b03 by drivers openvswitch,hyperv on host hv-cinder-81901 at level 0 using segments [{'id': 'b67642b4-1845-4b49-9392-51fd2c9bc8b8', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 815, 'network_id': '6a5d33a0-25a4-4580-ae9f-e7aa9d768182'}] {{(pid=102993) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 23 19:35:20.241648 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-73fe7243-5536-4f32-95e0-1f9e43288040 req-b8fcc7e6-15da-422d-b093-0ed1629eb499 service neutron] Attempting to bind port f82fc68a-422f-4577-b6c3-98bd45727b03 on network 6a5d33a0-25a4-4580-ae9f-e7aa9d768182 {{(pid=102993) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 23 19:35:20.249675 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-73fe7243-5536-4f32-95e0-1f9e43288040 req-b8fcc7e6-15da-422d-b093-0ed1629eb499 service neutron] Port f82fc68a-422f-4577-b6c3-98bd45727b03 on network 6a5d33a0-25a4-4580-ae9f-e7aa9d768182 not bound, no agent of type Open vSwitch agent registered on host hv-cinder-81901 {{(pid=102993) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Nov 23 19:35:20.253551 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-73fe7243-5536-4f32-95e0-1f9e43288040 req-b8fcc7e6-15da-422d-b093-0ed1629eb499 service neutron] Attempting to bind port f82fc68a-422f-4577-b6c3-98bd45727b03 on network 6a5d33a0-25a4-4580-ae9f-e7aa9d768182 {{(pid=102993) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 23 19:35:20.254000 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-b9fa1809-6205-414b-ab1e-7cb9c50f48e4 req-493e773c-b5bc-429a-b577-a6d46540a2fd tempest-ServerRescueNegativeTestJSON-1447477341 tempest-ServerRescueNegativeTestJSON-1447477341-project] 10.222.0.62 "GET /v2.0/security-groups?id=62a09434-acf0-424f-9001-2c3a78119364&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1206822 Nov 23 19:35:20.255816 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-73fe7243-5536-4f32-95e0-1f9e43288040 req-b8fcc7e6-15da-422d-b093-0ed1629eb499 service neutron] Checking agent: {'id': '14e5d049-431d-466a-8d1c-264e5129d376', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-81901', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 23, 19, 31, 29), 'started_at': datetime.datetime(2021, 11, 23, 19, 31, 29), 'heartbeat_timestamp': datetime.datetime(2021, 11, 23, 19, 34, 59), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=102993) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 23 19:35:20.256154 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-73fe7243-5536-4f32-95e0-1f9e43288040 req-b8fcc7e6-15da-422d-b093-0ed1629eb499 service neutron] Checking segment: {'id': 'b67642b4-1845-4b49-9392-51fd2c9bc8b8', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 815, 'network_id': '6a5d33a0-25a4-4580-ae9f-e7aa9d768182'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102993) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 23 19:35:20.256847 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-73fe7243-5536-4f32-95e0-1f9e43288040 req-b8fcc7e6-15da-422d-b093-0ed1629eb499 service neutron] Bound using segment: {'id': 'b67642b4-1845-4b49-9392-51fd2c9bc8b8', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 815, 'network_id': '6a5d33a0-25a4-4580-ae9f-e7aa9d768182'} {{(pid=102993) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 23 19:35:20.257124 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.plugins.ml2.managers [req-73fe7243-5536-4f32-95e0-1f9e43288040 req-b8fcc7e6-15da-422d-b093-0ed1629eb499 service neutron] Bound port: f82fc68a-422f-4577-b6c3-98bd45727b03, host: hv-cinder-81901, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': 'b67642b4-1845-4b49-9392-51fd2c9bc8b8', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 815, 'network_id': '6a5d33a0-25a4-4580-ae9f-e7aa9d768182'}}] {{(pid=102993) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 23 19:35:20.257512 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [req-73fe7243-5536-4f32-95e0-1f9e43288040 req-b8fcc7e6-15da-422d-b093-0ed1629eb499 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7921281'] for port, before_update {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:35:20.324062 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.plugins.ml2.db [req-73fe7243-5536-4f32-95e0-1f9e43288040 req-b8fcc7e6-15da-422d-b093-0ed1629eb499 service neutron] For port f82fc68a-422f-4577-b6c3-98bd45727b03, host hv-cinder-81901, cleared binding levels {{(pid=102993) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 23 19:35:20.327912 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.plugins.ml2.db [req-73fe7243-5536-4f32-95e0-1f9e43288040 req-b8fcc7e6-15da-422d-b093-0ed1629eb499 service neutron] For port f82fc68a-422f-4577-b6c3-98bd45727b03, host hv-cinder-81901, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81901',level=0,port_id=f82fc68a-422f-4577-b6c3-98bd45727b03,segment=NetworkSegment(b67642b4-1845-4b49-9392-51fd2c9bc8b8),segment_id=b67642b4-1845-4b49-9392-51fd2c9bc8b8)] {{(pid=102993) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 23 19:35:20.349437 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-82ea341b-5c7c-44b0-aa2c-109799d8e518 req-46513e1e-2fe0-4d48-b676-592425edd8f2 tempest-VolumesActionsTest-802949502 tempest-VolumesActionsTest-802949502-project] Made reservation on behalf of 893242e83e2b490a98fcd7fafca0a833 for: {'port': 1} {{(pid=102992) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 23 19:35:20.353477 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [req-82ea341b-5c7c-44b0-aa2c-109799d8e518 req-46513e1e-2fe0-4d48-b676-592425edd8f2 tempest-VolumesActionsTest-802949502 tempest-VolumesActionsTest-802949502-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7921281'] for port, before_create {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:35:20.395271 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [req-73fe7243-5536-4f32-95e0-1f9e43288040 req-b8fcc7e6-15da-422d-b093-0ed1629eb499 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7918660', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-15067', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560168', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8783631423946', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8783631008732', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8783631008750', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-17257505'] for port, after_update {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:35:20.433274 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-73fe7243-5536-4f32-95e0-1f9e43288040 req-b8fcc7e6-15da-422d-b093-0ed1629eb499 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102993) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:35:20.433919 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [req-73fe7243-5536-4f32-95e0-1f9e43288040 req-b8fcc7e6-15da-422d-b093-0ed1629eb499 service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-514902'] for port, before_response {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:35:20.435291 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-73fe7243-5536-4f32-95e0-1f9e43288040 req-b8fcc7e6-15da-422d-b093-0ed1629eb499 service neutron] 10.222.0.41 "PUT /v2.0/ports/f82fc68a-422f-4577-b6c3-98bd45727b03 HTTP/1.1" status: 200 len: 1093 time: 0.8100579 Nov 23 19:35:20.435732 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'd8c269ba-e8f8-4705-a5a5-fbfbb498151f', 'tag': 'f82fc68a-422f-4577-b6c3-98bd45727b03'}] {{(pid=102993) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 23 19:35:20.438143 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.62/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}9b10b92acbee16fb695be1efeed0b68f7c36a5b215ec004a8d9d707fa3d35b2c" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-35133cc4-0b6e-462e-b4aa-0618a1899518" -d '{"events": [{"name": "network-changed", "server_uuid": "d8c269ba-e8f8-4705-a5a5-fbfbb498151f", "tag": "f82fc68a-422f-4577-b6c3-98bd45727b03"}]}' {{(pid=102993) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 23 19:35:20.462963 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b8fcc7e6-15da-422d-b093-0ed1629eb499 service neutron] Pushing event updated for resources: {'Port': ['ID=f82fc68a-422f-4577-b6c3-98bd45727b03,revision_number=3']} {{(pid=102993) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 23 19:35:20.490688 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Tue, 23 Nov 2021 19:35:20 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-46adfd50-1a13-47db-a748-f8e91e1ab145 x-openstack-request-id: req-46adfd50-1a13-47db-a748-f8e91e1ab145 {{(pid=102993) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 23 19:35:20.491266 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "d8c269ba-e8f8-4705-a5a5-fbfbb498151f", "tag": "f82fc68a-422f-4577-b6c3-98bd45727b03", "status": "completed", "code": 200}]} {{(pid=102993) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 23 19:35:20.491803 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.62/compute/v2.1/os-server-external-events used request id req-46adfd50-1a13-47db-a748-f8e91e1ab145 {{(pid=102993) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 23 19:35:20.495250 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'd8c269ba-e8f8-4705-a5a5-fbfbb498151f', 'tag': 'f82fc68a-422f-4577-b6c3-98bd45727b03', 'status': 'completed', 'code': 200} Nov 23 19:35:20.515485 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.db.db_base_plugin_common [req-82ea341b-5c7c-44b0-aa2c-109799d8e518 req-46513e1e-2fe0-4d48-b676-592425edd8f2 tempest-VolumesActionsTest-802949502 tempest-VolumesActionsTest-802949502-project] Allocated IP 172.20.0.2 (4b2c41c3-6250-433d-837a-85d02cae1bde/168da168-ed46-4168-8b11-4b0ac0e6fbd8/8a6b6382-0b2a-4cc0-9d38-21f83a9faa3b) {{(pid=102992) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 23 19:35:20.562395 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-35133cc4-0b6e-462e-b4aa-0618a1899518 req-84df61f6-024e-4634-8576-8fb89214bb47 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102993) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:35:20.564000 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-35133cc4-0b6e-462e-b4aa-0618a1899518 req-84df61f6-024e-4634-8576-8fb89214bb47 service neutron] 10.222.0.41 "GET /v2.0/ports?tenant_id=766c6a829b9945cfb36bad289566c0ad&device_id=d8c269ba-e8f8-4705-a5a5-fbfbb498151f HTTP/1.1" status: 200 len: 1096 time: 0.0439155 Nov 23 19:35:20.669910 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-49b63e6e-2b70-41f2-b156-80fb360e2256 req-0e5b2745-db5d-4f92-beeb-bb27c9ff6b55 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102992) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:35:20.671516 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-49b63e6e-2b70-41f2-b156-80fb360e2256 req-0e5b2745-db5d-4f92-beeb-bb27c9ff6b55 service neutron] 10.222.0.41 "GET /v2.0/ports?device_id=671f1d44-7752-4a9d-835d-4d76164c900f HTTP/1.1" status: 200 len: 1098 time: 0.1176422 Nov 23 19:35:20.707984 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-35133cc4-0b6e-462e-b4aa-0618a1899518 req-c5f9502b-2726-4d5f-8dcc-c17e27736f6f service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102993) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:35:20.709662 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-35133cc4-0b6e-462e-b4aa-0618a1899518 req-c5f9502b-2726-4d5f-8dcc-c17e27736f6f service neutron] 10.222.0.41 "GET /v2.0/networks?tenant_id=766c6a829b9945cfb36bad289566c0ad&shared=False HTTP/1.1" status: 200 len: 914 time: 0.1368511 Nov 23 19:35:20.744803 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [req-82ea341b-5c7c-44b0-aa2c-109799d8e518 req-46513e1e-2fe0-4d48-b676-592425edd8f2 tempest-VolumesActionsTest-802949502 tempest-VolumesActionsTest-802949502-project] Publish callbacks [] for port, precommit_create {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:35:20.747945 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-49b63e6e-2b70-41f2-b156-80fb360e2256 req-4300fe71-6d5b-4f19-a9dc-8798c1d2e102 service neutron] 10.222.0.41 "GET /v2.0/security-groups?id=62a09434-acf0-424f-9001-2c3a78119364&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0667336 Nov 23 19:35:20.817744 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-35133cc4-0b6e-462e-b4aa-0618a1899518 req-226271c2-3c57-4d3d-b49d-c8aec1784693 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102993) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:35:20.819191 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-35133cc4-0b6e-462e-b4aa-0618a1899518 req-226271c2-3c57-4d3d-b49d-c8aec1784693 service neutron] 10.222.0.41 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 870 time: 0.0967793 Nov 23 19:35:20.842674 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-83752aac-e8a8-4909-a783-275200aac87c req-7ae9fca5-29e8-4b5a-8996-da33259aff0d tempest-VolumesActionsTest-802949502 tempest-VolumesActionsTest-802949502-project] 10.222.0.62 "GET /v2.0/ports?device_id=fa2c753c-e8ba-46c8-8c59-7a35f6357117 HTTP/1.1" status: 200 len: 210 time: 0.0297034 Nov 23 19:35:20.845887 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [req-82ea341b-5c7c-44b0-aa2c-109799d8e518 req-46513e1e-2fe0-4d48-b676-592425edd8f2 tempest-VolumesActionsTest-802949502 tempest-VolumesActionsTest-802949502-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7918660', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-15067', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560168', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8783631008714', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-25199805'] for port, after_create {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:35:20.885970 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-82ea341b-5c7c-44b0-aa2c-109799d8e518 req-46513e1e-2fe0-4d48-b676-592425edd8f2 tempest-VolumesActionsTest-802949502 tempest-VolumesActionsTest-802949502-project] Network 4b2c41c3-6250-433d-837a-85d02cae1bde is already hosted by enough agents. {{(pid=102992) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 23 19:35:20.891594 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.scheduler.base_scheduler [req-82ea341b-5c7c-44b0-aa2c-109799d8e518 req-46513e1e-2fe0-4d48-b676-592425edd8f2 tempest-VolumesActionsTest-802949502 tempest-VolumesActionsTest-802949502-project] Resources bound (agent type, host, resource id): {{(pid=102992) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 23 19:35:20.895112 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.db.l3_dvrscheduler_db [req-82ea341b-5c7c-44b0-aa2c-109799d8e518 req-46513e1e-2fe0-4d48-b676-592425edd8f2 tempest-VolumesActionsTest-802949502 tempest-VolumesActionsTest-802949502-project] Received port after_create {{(pid=102992) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 23 19:35:20.919314 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-46513e1e-2fe0-4d48-b676-592425edd8f2 tempest-VolumesActionsTest-802949502 tempest-VolumesActionsTest-802949502-project] Pushing event updated for resources: {'Port': ['ID=8a6b6382-0b2a-4cc0-9d38-21f83a9faa3b,revision_number=1']} {{(pid=102992) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 23 19:35:20.933781 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-46513e1e-2fe0-4d48-b676-592425edd8f2 tempest-VolumesActionsTest-802949502 tempest-VolumesActionsTest-802949502-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-819011-1-iscsi {{(pid=102992) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 23 19:35:20.934135 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-46513e1e-2fe0-4d48-b676-592425edd8f2 tempest-VolumesActionsTest-802949502 tempest-VolumesActionsTest-802949502-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-819011-1-iscsi {{(pid=102992) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 23 19:35:20.934482 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-46513e1e-2fe0-4d48-b676-592425edd8f2 tempest-VolumesActionsTest-802949502 tempest-VolumesActionsTest-802949502-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-819011-1-iscsi {{(pid=102992) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 23 19:35:20.934825 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-46513e1e-2fe0-4d48-b676-592425edd8f2 tempest-VolumesActionsTest-802949502 tempest-VolumesActionsTest-802949502-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-819011-1-iscsi {{(pid=102992) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 23 19:35:20.935163 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-46513e1e-2fe0-4d48-b676-592425edd8f2 tempest-VolumesActionsTest-802949502 tempest-VolumesActionsTest-802949502-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-819011-1-iscsi {{(pid=102992) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 23 19:35:20.935503 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-46513e1e-2fe0-4d48-b676-592425edd8f2 tempest-VolumesActionsTest-802949502 tempest-VolumesActionsTest-802949502-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-819011-1-iscsi {{(pid=102992) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 23 19:35:20.935859 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-46513e1e-2fe0-4d48-b676-592425edd8f2 tempest-VolumesActionsTest-802949502 tempest-VolumesActionsTest-802949502-project] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-819011-1-iscsi {{(pid=102992) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 23 19:35:20.936838 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-46513e1e-2fe0-4d48-b676-592425edd8f2 tempest-VolumesActionsTest-802949502 tempest-VolumesActionsTest-802949502-project] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-819011-1-iscsi {{(pid=102992) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 23 19:35:20.937175 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-46513e1e-2fe0-4d48-b676-592425edd8f2 tempest-VolumesActionsTest-802949502 tempest-VolumesActionsTest-802949502-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-819011-1-iscsi {{(pid=102992) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 23 19:35:20.937539 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-46513e1e-2fe0-4d48-b676-592425edd8f2 tempest-VolumesActionsTest-802949502 tempest-VolumesActionsTest-802949502-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-819011-1-iscsi {{(pid=102992) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 23 19:35:20.941075 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-46513e1e-2fe0-4d48-b676-592425edd8f2 tempest-VolumesActionsTest-802949502 tempest-VolumesActionsTest-802949502-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-819011-1-iscsi {{(pid=102992) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 23 19:35:20.941075 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-46513e1e-2fe0-4d48-b676-592425edd8f2 tempest-VolumesActionsTest-802949502 tempest-VolumesActionsTest-802949502-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-819011-1-iscsi {{(pid=102992) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 23 19:35:20.957601 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-82ea341b-5c7c-44b0-aa2c-109799d8e518 req-46513e1e-2fe0-4d48-b676-592425edd8f2 tempest-VolumesActionsTest-802949502 tempest-VolumesActionsTest-802949502-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=102992) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:35:20.958266 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [req-82ea341b-5c7c-44b0-aa2c-109799d8e518 req-46513e1e-2fe0-4d48-b676-592425edd8f2 tempest-VolumesActionsTest-802949502 tempest-VolumesActionsTest-802949502-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-514902', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-560186'] for port, before_response {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:35:21.038241 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-73fe7243-5536-4f32-95e0-1f9e43288040 req-c9d427c4-476a-43df-b455-7f1b64e04b06 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102993) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:35:21.039798 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-73fe7243-5536-4f32-95e0-1f9e43288040 req-c9d427c4-476a-43df-b455-7f1b64e04b06 service neutron] 10.222.0.41 "GET /v2.0/ports?tenant_id=766c6a829b9945cfb36bad289566c0ad&device_id=d8c269ba-e8f8-4705-a5a5-fbfbb498151f HTTP/1.1" status: 200 len: 1096 time: 0.0398505 Nov 23 19:35:21.043125 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-82ea341b-5c7c-44b0-aa2c-109799d8e518 req-46513e1e-2fe0-4d48-b676-592425edd8f2 tempest-VolumesActionsTest-802949502 tempest-VolumesActionsTest-802949502-project] 10.222.0.41 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 0.9408064 Nov 23 19:35:21.067502 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.api.v2.base [req-82ea341b-5c7c-44b0-aa2c-109799d8e518 req-32ea38f1-1c11-4239-bcef-495a6f256662 service neutron] Request body: {'port': {'device_id': 'fa2c753c-e8ba-46c8-8c59-7a35f6357117', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-81901'}} {{(pid=102992) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 23 19:35:21.100788 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-73fe7243-5536-4f32-95e0-1f9e43288040 req-c9813480-2e6e-4db9-98d7-4e05e534c615 service neutron] 10.222.0.41 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.8&port_id=f82fc68a-422f-4577-b6c3-98bd45727b03 HTTP/1.1" status: 200 len: 217 time: 0.0384126 Nov 23 19:35:21.122916 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [req-82ea341b-5c7c-44b0-aa2c-109799d8e518 req-32ea38f1-1c11-4239-bcef-495a6f256662 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7921281'] for port, before_update {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:35:21.158437 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-73fe7243-5536-4f32-95e0-1f9e43288040 req-1c7d4cd6-a0b0-4fb8-9195-4895ee3ffb17 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102993) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:35:21.159869 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-73fe7243-5536-4f32-95e0-1f9e43288040 req-1c7d4cd6-a0b0-4fb8-9195-4895ee3ffb17 service neutron] 10.222.0.41 "GET /v2.0/subnets?id=cf93b200-5fcb-4538-8ce7-95612047c22a HTTP/1.1" status: 200 len: 853 time: 0.0453637 Nov 23 19:35:21.214012 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-73fe7243-5536-4f32-95e0-1f9e43288040 req-0de76102-0337-401b-8201-eb3f666dec46 service neutron] 10.222.0.41 "GET /v2.0/ports?network_id=6a5d33a0-25a4-4580-ae9f-e7aa9d768182&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0264039 Nov 23 19:35:21.433501 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-19e36469-8cae-4742-95bc-8b87fc240ef9 req-7acd644f-a3f6-4b15-be57-f6cd2c36b889 tempest-ServerRescueNegativeTestJSON-1447477341 tempest-ServerRescueNegativeTestJSON-1447477341-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102992) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:35:21.435076 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-19e36469-8cae-4742-95bc-8b87fc240ef9 req-7acd644f-a3f6-4b15-be57-f6cd2c36b889 tempest-ServerRescueNegativeTestJSON-1447477341 tempest-ServerRescueNegativeTestJSON-1447477341-project] 10.222.0.62 "GET /v2.0/ports?device_id=671f1d44-7752-4a9d-835d-4d76164c900f HTTP/1.1" status: 200 len: 945 time: 0.0990305 Nov 23 19:35:21.443483 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.notifiers.nova [req-82ea341b-5c7c-44b0-aa2c-109799d8e518 req-32ea38f1-1c11-4239-bcef-495a6f256662 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 8a6b6382-0b2a-4cc0-9d38-21f83a9faa3b {{(pid=102992) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 23 19:35:21.454656 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [req-82ea341b-5c7c-44b0-aa2c-109799d8e518 req-32ea38f1-1c11-4239-bcef-495a6f256662 service neutron] Publish callbacks [] for port, precommit_update {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:35:21.489104 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.db.provisioning_blocks [req-82ea341b-5c7c-44b0-aa2c-109799d8e518 req-32ea38f1-1c11-4239-bcef-495a6f256662 service neutron] Transition to ACTIVE for port object 8a6b6382-0b2a-4cc0-9d38-21f83a9faa3b will not be triggered until provisioned by entity L2. {{(pid=102992) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 23 19:35:21.513207 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-19e36469-8cae-4742-95bc-8b87fc240ef9 req-826bf85a-34f8-474f-8b4f-15b61a57af13 tempest-ServerRescueNegativeTestJSON-1447477341 tempest-ServerRescueNegativeTestJSON-1447477341-project] 10.222.0.62 "GET /v2.0/security-groups?id=62a09434-acf0-424f-9001-2c3a78119364&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0643020 Nov 23 19:35:21.549795 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-11be5065-a293-4531-8629-316597501faa req-5ef22573-9624-434e-a877-9568a0024b46 tempest-VolumesSnapshotTestJSON-97879810 tempest-VolumesSnapshotTestJSON-97879810-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102993) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:35:21.551230 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-11be5065-a293-4531-8629-316597501faa req-5ef22573-9624-434e-a877-9568a0024b46 tempest-VolumesSnapshotTestJSON-97879810 tempest-VolumesSnapshotTestJSON-97879810-project] 10.222.0.62 "GET /v2.0/ports?device_id=d8c269ba-e8f8-4705-a5a5-fbfbb498151f HTTP/1.1" status: 200 len: 943 time: 0.3081629 Nov 23 19:35:21.554942 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-73fe7243-5536-4f32-95e0-1f9e43288040 req-13000ea1-2016-4c83-a9ab-53c65514d70e service neutron] 10.222.0.41 "GET /v2.0/networks/6a5d33a0-25a4-4580-ae9f-e7aa9d768182?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.3303990 Nov 23 19:35:21.566333 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [req-82ea341b-5c7c-44b0-aa2c-109799d8e518 req-32ea38f1-1c11-4239-bcef-495a6f256662 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7918660', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-15067', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560168', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8783631423946', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8783631008732', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8783631008750', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-25199748'] for port, after_update {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:35:21.624978 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-32ea38f1-1c11-4239-bcef-495a6f256662 service neutron] Pushing event updated for resources: {'Port': ['ID=8a6b6382-0b2a-4cc0-9d38-21f83a9faa3b,revision_number=2']} {{(pid=102992) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 23 19:35:21.650915 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-11be5065-a293-4531-8629-316597501faa req-f005105a-0610-4deb-a999-c5acaa8b9eab tempest-VolumesSnapshotTestJSON-97879810 tempest-VolumesSnapshotTestJSON-97879810-project] 10.222.0.62 "GET /v2.0/security-groups?id=2fd4bf42-f1cd-4ab5-94a3-e2347f7bb016&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0932190 Nov 23 19:35:21.683756 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-73fe7243-5536-4f32-95e0-1f9e43288040 req-69b8f908-f762-424b-9d99-6ca27cf8ec3d service neutron] 10.222.0.41 "GET /v2.0/networks/6a5d33a0-25a4-4580-ae9f-e7aa9d768182?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1122777 Nov 23 19:35:21.691021 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.plugins.ml2.managers [req-82ea341b-5c7c-44b0-aa2c-109799d8e518 req-32ea38f1-1c11-4239-bcef-495a6f256662 service neutron] Attempting to bind port 8a6b6382-0b2a-4cc0-9d38-21f83a9faa3b on host hv-cinder-81901 for vnic_type normal with profile {{(pid=102992) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 23 19:35:21.691358 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.plugins.ml2.managers [req-82ea341b-5c7c-44b0-aa2c-109799d8e518 req-32ea38f1-1c11-4239-bcef-495a6f256662 service neutron] Attempting to bind port 8a6b6382-0b2a-4cc0-9d38-21f83a9faa3b by drivers openvswitch,hyperv on host hv-cinder-81901 at level 0 using segments [{'id': '2ab14203-895d-412f-8616-df9c89e896c9', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 839, 'network_id': '4b2c41c3-6250-433d-837a-85d02cae1bde'}] {{(pid=102992) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 23 19:35:21.691690 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-82ea341b-5c7c-44b0-aa2c-109799d8e518 req-32ea38f1-1c11-4239-bcef-495a6f256662 service neutron] Attempting to bind port 8a6b6382-0b2a-4cc0-9d38-21f83a9faa3b on network 4b2c41c3-6250-433d-837a-85d02cae1bde {{(pid=102992) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 23 19:35:21.696027 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-82ea341b-5c7c-44b0-aa2c-109799d8e518 req-32ea38f1-1c11-4239-bcef-495a6f256662 service neutron] Port 8a6b6382-0b2a-4cc0-9d38-21f83a9faa3b on network 4b2c41c3-6250-433d-837a-85d02cae1bde not bound, no agent of type Open vSwitch agent registered on host hv-cinder-81901 {{(pid=102992) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Nov 23 19:35:21.696349 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-82ea341b-5c7c-44b0-aa2c-109799d8e518 req-32ea38f1-1c11-4239-bcef-495a6f256662 service neutron] Attempting to bind port 8a6b6382-0b2a-4cc0-9d38-21f83a9faa3b on network 4b2c41c3-6250-433d-837a-85d02cae1bde {{(pid=102992) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 23 19:35:21.701174 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-82ea341b-5c7c-44b0-aa2c-109799d8e518 req-32ea38f1-1c11-4239-bcef-495a6f256662 service neutron] Checking agent: {'id': '14e5d049-431d-466a-8d1c-264e5129d376', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-81901', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 23, 19, 31, 29), 'started_at': datetime.datetime(2021, 11, 23, 19, 31, 29), 'heartbeat_timestamp': datetime.datetime(2021, 11, 23, 19, 34, 59), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=102992) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 23 19:35:21.701590 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-82ea341b-5c7c-44b0-aa2c-109799d8e518 req-32ea38f1-1c11-4239-bcef-495a6f256662 service neutron] Checking segment: {'id': '2ab14203-895d-412f-8616-df9c89e896c9', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 839, 'network_id': '4b2c41c3-6250-433d-837a-85d02cae1bde'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102992) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 23 19:35:21.702796 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-82ea341b-5c7c-44b0-aa2c-109799d8e518 req-32ea38f1-1c11-4239-bcef-495a6f256662 service neutron] Bound using segment: {'id': '2ab14203-895d-412f-8616-df9c89e896c9', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 839, 'network_id': '4b2c41c3-6250-433d-837a-85d02cae1bde'} {{(pid=102992) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 23 19:35:21.703225 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.plugins.ml2.managers [req-82ea341b-5c7c-44b0-aa2c-109799d8e518 req-32ea38f1-1c11-4239-bcef-495a6f256662 service neutron] Bound port: 8a6b6382-0b2a-4cc0-9d38-21f83a9faa3b, host: hv-cinder-81901, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '2ab14203-895d-412f-8616-df9c89e896c9', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 839, 'network_id': '4b2c41c3-6250-433d-837a-85d02cae1bde'}}] {{(pid=102992) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 23 19:35:21.703585 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [req-82ea341b-5c7c-44b0-aa2c-109799d8e518 req-32ea38f1-1c11-4239-bcef-495a6f256662 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7921281'] for port, before_update {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:35:21.773894 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.plugins.ml2.db [req-82ea341b-5c7c-44b0-aa2c-109799d8e518 req-32ea38f1-1c11-4239-bcef-495a6f256662 service neutron] For port 8a6b6382-0b2a-4cc0-9d38-21f83a9faa3b, host hv-cinder-81901, cleared binding levels {{(pid=102992) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 23 19:35:21.776842 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.plugins.ml2.db [req-82ea341b-5c7c-44b0-aa2c-109799d8e518 req-32ea38f1-1c11-4239-bcef-495a6f256662 service neutron] For port 8a6b6382-0b2a-4cc0-9d38-21f83a9faa3b, host hv-cinder-81901, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81901',level=0,port_id=8a6b6382-0b2a-4cc0-9d38-21f83a9faa3b,segment=NetworkSegment(2ab14203-895d-412f-8616-df9c89e896c9),segment_id=2ab14203-895d-412f-8616-df9c89e896c9)] {{(pid=102992) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 23 19:35:21.940573 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [req-82ea341b-5c7c-44b0-aa2c-109799d8e518 req-32ea38f1-1c11-4239-bcef-495a6f256662 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7918660', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-15067', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560168', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8783631423946', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8783631008732', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8783631008750', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-25199748'] for port, after_update {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:35:21.983256 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-82ea341b-5c7c-44b0-aa2c-109799d8e518 req-32ea38f1-1c11-4239-bcef-495a6f256662 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102992) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:35:21.983873 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [req-82ea341b-5c7c-44b0-aa2c-109799d8e518 req-32ea38f1-1c11-4239-bcef-495a6f256662 service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-514902', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-560186'] for port, before_response {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:35:21.986104 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-82ea341b-5c7c-44b0-aa2c-109799d8e518 req-32ea38f1-1c11-4239-bcef-495a6f256662 service neutron] 10.222.0.41 "PUT /v2.0/ports/8a6b6382-0b2a-4cc0-9d38-21f83a9faa3b HTTP/1.1" status: 200 len: 1093 time: 0.9225786 Nov 23 19:35:21.988579 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'fa2c753c-e8ba-46c8-8c59-7a35f6357117', 'tag': '8a6b6382-0b2a-4cc0-9d38-21f83a9faa3b'}] {{(pid=102992) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 23 19:35:22.000358 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.62/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}f86c332b591ae691ababa4b64e0601cbf242a448242f95367ce03daabfb7e1ce" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-1d1843c9-7bca-463e-a62c-96fbb73e2255" -d '{"events": [{"name": "network-changed", "server_uuid": "fa2c753c-e8ba-46c8-8c59-7a35f6357117", "tag": "8a6b6382-0b2a-4cc0-9d38-21f83a9faa3b"}]}' {{(pid=102992) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 23 19:35:22.040420 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-33df57c3-e2bc-4684-801a-f022ede01910 req-c55f5735-ce7d-4507-a241-f2aec5acac34 tempest-VolumesActionsTest-802949502 tempest-VolumesActionsTest-802949502-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102992) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:35:22.040420 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-33df57c3-e2bc-4684-801a-f022ede01910 req-c55f5735-ce7d-4507-a241-f2aec5acac34 tempest-VolumesActionsTest-802949502 tempest-VolumesActionsTest-802949502-project] 10.222.0.62 "GET /v2.0/ports?device_id=fa2c753c-e8ba-46c8-8c59-7a35f6357117 HTTP/1.1" status: 200 len: 943 time: 0.1190298 Nov 23 19:35:22.040420 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Tue, 23 Nov 2021 19:35:21 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-f2cd1856-a407-46b5-b595-e8284805604c x-openstack-request-id: req-f2cd1856-a407-46b5-b595-e8284805604c {{(pid=102992) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 23 19:35:22.040420 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "fa2c753c-e8ba-46c8-8c59-7a35f6357117", "tag": "8a6b6382-0b2a-4cc0-9d38-21f83a9faa3b", "status": "completed", "code": 200}]} {{(pid=102992) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 23 19:35:22.040420 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.62/compute/v2.1/os-server-external-events used request id req-f2cd1856-a407-46b5-b595-e8284805604c {{(pid=102992) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 23 19:35:22.040420 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'fa2c753c-e8ba-46c8-8c59-7a35f6357117', 'tag': '8a6b6382-0b2a-4cc0-9d38-21f83a9faa3b', 'status': 'completed', 'code': 200} Nov 23 19:35:22.040420 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-32ea38f1-1c11-4239-bcef-495a6f256662 service neutron] Pushing event updated for resources: {'Port': ['ID=8a6b6382-0b2a-4cc0-9d38-21f83a9faa3b,revision_number=3']} {{(pid=102992) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 23 19:35:22.321134 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-33df57c3-e2bc-4684-801a-f022ede01910 req-73049c3b-278a-43d0-97a5-8824d87f39b1 tempest-VolumesActionsTest-802949502 tempest-VolumesActionsTest-802949502-project] 10.222.0.62 "GET /v2.0/security-groups?id=47acb13d-cf9a-4dd6-a614-503b94072f69&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2819984 Nov 23 19:35:22.336569 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1d1843c9-7bca-463e-a62c-96fbb73e2255 req-6266b8d8-bbf4-40a9-99a1-37e436ab1b6a service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102992) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:35:22.338163 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-1d1843c9-7bca-463e-a62c-96fbb73e2255 req-6266b8d8-bbf4-40a9-99a1-37e436ab1b6a service neutron] 10.222.0.41 "GET /v2.0/ports?tenant_id=893242e83e2b490a98fcd7fafca0a833&device_id=fa2c753c-e8ba-46c8-8c59-7a35f6357117 HTTP/1.1" status: 200 len: 1096 time: 0.2673059 Nov 23 19:35:22.446980 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1d1843c9-7bca-463e-a62c-96fbb73e2255 req-2a9c72dc-21de-49bb-a52e-d998e0242071 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102992) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:35:22.448452 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-1d1843c9-7bca-463e-a62c-96fbb73e2255 req-2a9c72dc-21de-49bb-a52e-d998e0242071 service neutron] 10.222.0.41 "GET /v2.0/networks?tenant_id=893242e83e2b490a98fcd7fafca0a833&shared=False HTTP/1.1" status: 200 len: 910 time: 0.0968654 Nov 23 19:35:22.569673 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1d1843c9-7bca-463e-a62c-96fbb73e2255 req-be7f56ca-a8ce-4738-9d82-5ef9cce3279c service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102992) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:35:22.571152 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-1d1843c9-7bca-463e-a62c-96fbb73e2255 req-be7f56ca-a8ce-4738-9d82-5ef9cce3279c service neutron] 10.222.0.41 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 870 time: 0.1027150 Nov 23 19:35:22.642405 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3766a937-1b8c-4ec2-b83f-c548aeccd349 req-667083db-398e-48b8-80fb-e811beb0aa54 tempest-ServerRescueNegativeTestJSON-1447477341 tempest-ServerRescueNegativeTestJSON-1447477341-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102992) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:35:22.643872 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-3766a937-1b8c-4ec2-b83f-c548aeccd349 req-667083db-398e-48b8-80fb-e811beb0aa54 tempest-ServerRescueNegativeTestJSON-1447477341 tempest-ServerRescueNegativeTestJSON-1447477341-project] 10.222.0.62 "GET /v2.0/ports?device_id=671f1d44-7752-4a9d-835d-4d76164c900f HTTP/1.1" status: 200 len: 945 time: 0.0524230 Nov 23 19:35:22.714208 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-3766a937-1b8c-4ec2-b83f-c548aeccd349 req-12a9ddbd-2961-47c7-ade8-7dfa66b26534 tempest-ServerRescueNegativeTestJSON-1447477341 tempest-ServerRescueNegativeTestJSON-1447477341-project] 10.222.0.62 "GET /v2.0/security-groups?id=62a09434-acf0-424f-9001-2c3a78119364&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0619977 Nov 23 19:35:22.716991 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-82ea341b-5c7c-44b0-aa2c-109799d8e518 req-2d0c657b-42ef-4e46-8446-8da15371373b service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102992) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:35:22.718452 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-82ea341b-5c7c-44b0-aa2c-109799d8e518 req-2d0c657b-42ef-4e46-8446-8da15371373b service neutron] 10.222.0.41 "GET /v2.0/ports?tenant_id=893242e83e2b490a98fcd7fafca0a833&device_id=fa2c753c-e8ba-46c8-8c59-7a35f6357117 HTTP/1.1" status: 200 len: 1096 time: 0.0737536 Nov 23 19:35:22.792172 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-82ea341b-5c7c-44b0-aa2c-109799d8e518 req-3a59d804-0615-4fc8-bd31-2818e78ddaa5 service neutron] 10.222.0.41 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.2&port_id=8a6b6382-0b2a-4cc0-9d38-21f83a9faa3b HTTP/1.1" status: 200 len: 217 time: 0.0446084 Nov 23 19:35:22.830206 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bd729696-535b-4300-aa81-48acf3779fcb req-cdfae5e4-b236-46e1-a8f2-9cf49d7aaf48 tempest-VolumesSnapshotTestJSON-97879810 tempest-VolumesSnapshotTestJSON-97879810-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102993) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:35:22.831687 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-bd729696-535b-4300-aa81-48acf3779fcb req-cdfae5e4-b236-46e1-a8f2-9cf49d7aaf48 tempest-VolumesSnapshotTestJSON-97879810 tempest-VolumesSnapshotTestJSON-97879810-project] 10.222.0.62 "GET /v2.0/ports?device_id=d8c269ba-e8f8-4705-a5a5-fbfbb498151f HTTP/1.1" status: 200 len: 943 time: 0.0587325 Nov 23 19:35:22.875089 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7598c367-42f5-44ee-9881-2243efaccdcc req-b89689e4-f4d0-41db-9ba4-a7653871164e tempest-AttachVolumeShelveTestJSON-1172915835 tempest-AttachVolumeShelveTestJSON-1172915835-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102992) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:35:22.876596 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-7598c367-42f5-44ee-9881-2243efaccdcc req-b89689e4-f4d0-41db-9ba4-a7653871164e tempest-AttachVolumeShelveTestJSON-1172915835 tempest-AttachVolumeShelveTestJSON-1172915835-project] 10.222.0.62 "GET /v2.0/ports?device_id=85ea3d72-6c17-4ea2-82b7-90cce01633bd HTTP/1.1" status: 200 len: 945 time: 0.0885022 Nov 23 19:35:22.880467 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-bd729696-535b-4300-aa81-48acf3779fcb req-02210ec0-8c87-465c-b499-b3077f2e52db tempest-VolumesSnapshotTestJSON-97879810 tempest-VolumesSnapshotTestJSON-97879810-project] 10.222.0.62 "GET /v2.0/security-groups?id=2fd4bf42-f1cd-4ab5-94a3-e2347f7bb016&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0426748 Nov 23 19:35:22.883844 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-82ea341b-5c7c-44b0-aa2c-109799d8e518 req-e3695cb8-1b68-45f1-aff0-c219c1bbbd6f service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102992) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:35:22.885255 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-82ea341b-5c7c-44b0-aa2c-109799d8e518 req-e3695cb8-1b68-45f1-aff0-c219c1bbbd6f service neutron] 10.222.0.41 "GET /v2.0/subnets?id=168da168-ed46-4168-8b11-4b0ac0e6fbd8 HTTP/1.1" status: 200 len: 849 time: 0.0591063 Nov 23 19:35:22.928696 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-82ea341b-5c7c-44b0-aa2c-109799d8e518 req-7b2d7d2c-f7de-480f-8272-3375c1e927e4 service neutron] 10.222.0.41 "GET /v2.0/ports?network_id=4b2c41c3-6250-433d-837a-85d02cae1bde&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0293610 Nov 23 19:35:22.972886 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-7598c367-42f5-44ee-9881-2243efaccdcc req-10f1ce4b-2516-455b-9be0-cfb7fb5e3733 tempest-AttachVolumeShelveTestJSON-1172915835 tempest-AttachVolumeShelveTestJSON-1172915835-project] 10.222.0.62 "GET /v2.0/security-groups?id=f1ca24d9-0a31-470d-a1d5-fa7059df0141&fields=id&fields=name HTTP/1.1" status: 200 len: 311 time: 0.0866628 Nov 23 19:35:23.037385 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-82ea341b-5c7c-44b0-aa2c-109799d8e518 req-c6aed405-7367-4994-a31d-b6292356dbd7 service neutron] 10.222.0.41 "GET /v2.0/networks/4b2c41c3-6250-433d-837a-85d02cae1bde?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0966496 Nov 23 19:35:23.139373 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-82ea341b-5c7c-44b0-aa2c-109799d8e518 req-dc8abf9c-bdf7-4abe-a4e5-f094e6393f6d service neutron] 10.222.0.41 "GET /v2.0/networks/4b2c41c3-6250-433d-837a-85d02cae1bde?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0882578 Nov 23 19:35:23.258620 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ca5e1707-d95c-4d41-ab5d-ec69d5d5bf05 req-6887940b-6cc3-42db-a1be-81e0ea1e370d tempest-ServerRescueNegativeTestJSON-1447477341 tempest-ServerRescueNegativeTestJSON-1447477341-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102992) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:35:23.260126 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-ca5e1707-d95c-4d41-ab5d-ec69d5d5bf05 req-6887940b-6cc3-42db-a1be-81e0ea1e370d tempest-ServerRescueNegativeTestJSON-1447477341 tempest-ServerRescueNegativeTestJSON-1447477341-project] 10.222.0.62 "GET /v2.0/ports?device_id=671f1d44-7752-4a9d-835d-4d76164c900f HTTP/1.1" status: 200 len: 945 time: 0.0506227 Nov 23 19:35:23.338259 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-ca5e1707-d95c-4d41-ab5d-ec69d5d5bf05 req-be09bdca-9e6d-4bc0-a6dc-8a8abdab68b7 tempest-ServerRescueNegativeTestJSON-1447477341 tempest-ServerRescueNegativeTestJSON-1447477341-project] 10.222.0.62 "GET /v2.0/security-groups?id=62a09434-acf0-424f-9001-2c3a78119364&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0714340 Nov 23 19:35:23.343075 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ca7770f4-b499-43c6-af35-3c32aeeb8007 req-e3e5d21b-b4e1-4249-8a21-8c6519623a90 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102992) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:35:23.345922 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-ca7770f4-b499-43c6-af35-3c32aeeb8007 req-e3e5d21b-b4e1-4249-8a21-8c6519623a90 service neutron] 10.222.0.41 "GET /v2.0/ports?tenant_id=c15ab51e579448cfb7a4b3e4f8049687&device_id=671f1d44-7752-4a9d-835d-4d76164c900f HTTP/1.1" status: 200 len: 1098 time: 0.0723968 Nov 23 19:35:23.437861 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ca7770f4-b499-43c6-af35-3c32aeeb8007 req-513806aa-831a-4186-9f39-2c5be08a9b15 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102992) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:35:23.438408 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ba7392e1-0fee-4e28-97fc-2f44cc5b1924 req-0d027c9a-c7ff-4025-b412-cd0b50d21288 tempest-VolumesActionsTest-802949502 tempest-VolumesActionsTest-802949502-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102993) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:35:23.439373 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-ca7770f4-b499-43c6-af35-3c32aeeb8007 req-513806aa-831a-4186-9f39-2c5be08a9b15 service neutron] 10.222.0.41 "GET /v2.0/networks?id=07eeb44e-4cdb-4c58-a83d-1dd8ab1ccb8a HTTP/1.1" status: 200 len: 920 time: 0.0849326 Nov 23 19:35:23.439935 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-ba7392e1-0fee-4e28-97fc-2f44cc5b1924 req-0d027c9a-c7ff-4025-b412-cd0b50d21288 tempest-VolumesActionsTest-802949502 tempest-VolumesActionsTest-802949502-project] 10.222.0.62 "GET /v2.0/ports?device_id=fa2c753c-e8ba-46c8-8c59-7a35f6357117 HTTP/1.1" status: 200 len: 943 time: 0.0477641 Nov 23 19:35:23.487863 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-ca7770f4-b499-43c6-af35-3c32aeeb8007 req-60a56d31-eb10-4182-b987-6c90ca016fc4 service neutron] 10.222.0.41 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.3&port_id=50e9d93b-ad23-4b6b-bdd0-ae5afe6f80ea HTTP/1.1" status: 200 len: 217 time: 0.0390761 Nov 23 19:35:23.494877 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-ba7392e1-0fee-4e28-97fc-2f44cc5b1924 req-dc529bb5-41b3-4748-a7fd-fd6da6f72537 tempest-VolumesActionsTest-802949502 tempest-VolumesActionsTest-802949502-project] 10.222.0.62 "GET /v2.0/security-groups?id=47acb13d-cf9a-4dd6-a614-503b94072f69&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0488582 Nov 23 19:35:23.542009 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ca7770f4-b499-43c6-af35-3c32aeeb8007 req-71bb8c9b-6636-4e8a-8fd4-bcc33141daf2 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102992) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:35:23.542009 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-ca7770f4-b499-43c6-af35-3c32aeeb8007 req-71bb8c9b-6636-4e8a-8fd4-bcc33141daf2 service neutron] 10.222.0.41 "GET /v2.0/subnets?id=e4fda56f-85ff-422d-adad-ec00db6378af HTTP/1.1" status: 200 len: 859 time: 0.0448964 Nov 23 19:35:23.575810 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-ca7770f4-b499-43c6-af35-3c32aeeb8007 req-9dc64d2f-6594-4817-a743-756b3077b45b service neutron] 10.222.0.41 "GET /v2.0/ports?network_id=07eeb44e-4cdb-4c58-a83d-1dd8ab1ccb8a&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0238867 Nov 23 19:35:23.701214 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-ca7770f4-b499-43c6-af35-3c32aeeb8007 req-218c2a0d-f752-4335-aa2a-e32394514cf7 service neutron] 10.222.0.41 "GET /v2.0/networks/07eeb44e-4cdb-4c58-a83d-1dd8ab1ccb8a?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1160443 Nov 23 19:35:23.798204 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-ca7770f4-b499-43c6-af35-3c32aeeb8007 req-a03c112d-3487-47ee-9f11-0afce03f2b63 service neutron] 10.222.0.41 "GET /v2.0/networks/07eeb44e-4cdb-4c58-a83d-1dd8ab1ccb8a?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0848410 Nov 23 19:35:23.995304 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-164b6933-bc02-4dff-92d2-1408cdb5f1ab req-632593d6-c83d-4425-9d01-ca0d321e086d tempest-VolumesSnapshotTestJSON-97879810 tempest-VolumesSnapshotTestJSON-97879810-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102992) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:35:23.996750 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-164b6933-bc02-4dff-92d2-1408cdb5f1ab req-632593d6-c83d-4425-9d01-ca0d321e086d tempest-VolumesSnapshotTestJSON-97879810 tempest-VolumesSnapshotTestJSON-97879810-project] 10.222.0.62 "GET /v2.0/ports?device_id=d8c269ba-e8f8-4705-a5a5-fbfbb498151f HTTP/1.1" status: 200 len: 943 time: 0.0499794 Nov 23 19:35:24.050075 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-164b6933-bc02-4dff-92d2-1408cdb5f1ab req-9c674215-c73e-44f0-94a0-cbc120f4a44c tempest-VolumesSnapshotTestJSON-97879810 tempest-VolumesSnapshotTestJSON-97879810-project] 10.222.0.62 "GET /v2.0/security-groups?id=2fd4bf42-f1cd-4ab5-94a3-e2347f7bb016&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0471716 Nov 23 19:35:24.105317 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4f57c263-4933-44b2-b38b-7b6c0b23f806 req-3e10abb1-4f8e-4e0f-acd6-34418d19afb4 tempest-AttachVolumeShelveTestJSON-1172915835 tempest-AttachVolumeShelveTestJSON-1172915835-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102993) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:35:24.114558 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-4f57c263-4933-44b2-b38b-7b6c0b23f806 req-3e10abb1-4f8e-4e0f-acd6-34418d19afb4 tempest-AttachVolumeShelveTestJSON-1172915835 tempest-AttachVolumeShelveTestJSON-1172915835-project] 10.222.0.62 "GET /v2.0/ports?device_id=85ea3d72-6c17-4ea2-82b7-90cce01633bd HTTP/1.1" status: 200 len: 945 time: 0.0600617 Nov 23 19:35:24.164531 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-4f57c263-4933-44b2-b38b-7b6c0b23f806 req-dba74d2f-8f73-4409-aea3-9ade5dfa5374 tempest-AttachVolumeShelveTestJSON-1172915835 tempest-AttachVolumeShelveTestJSON-1172915835-project] 10.222.0.62 "GET /v2.0/security-groups?id=f1ca24d9-0a31-470d-a1d5-fa7059df0141&fields=id&fields=name HTTP/1.1" status: 200 len: 311 time: 0.0488925 Nov 23 19:35:24.270086 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-976480cd-3755-45a4-9b82-aa4a7bc669b7 req-7205c8b3-6aee-417d-b7f5-83c936d7bba1 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102992) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:35:24.271621 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-976480cd-3755-45a4-9b82-aa4a7bc669b7 req-7205c8b3-6aee-417d-b7f5-83c936d7bba1 service neutron] 10.222.0.41 "GET /v2.0/ports?tenant_id=c15ab51e579448cfb7a4b3e4f8049687&device_id=671f1d44-7752-4a9d-835d-4d76164c900f HTTP/1.1" status: 200 len: 1098 time: 0.0450253 Nov 23 19:35:24.386026 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-976480cd-3755-45a4-9b82-aa4a7bc669b7 req-2223b5b7-eb19-4fea-9a80-864602866440 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102992) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:35:24.388522 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-976480cd-3755-45a4-9b82-aa4a7bc669b7 req-2223b5b7-eb19-4fea-9a80-864602866440 service neutron] 10.222.0.41 "GET /v2.0/networks?id=07eeb44e-4cdb-4c58-a83d-1dd8ab1ccb8a HTTP/1.1" status: 200 len: 920 time: 0.0915852 Nov 23 19:35:24.451369 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-976480cd-3755-45a4-9b82-aa4a7bc669b7 req-5006adbf-1c84-4af2-b06d-896ffe6cc97d service neutron] 10.222.0.41 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.3&port_id=50e9d93b-ad23-4b6b-bdd0-ae5afe6f80ea HTTP/1.1" status: 200 len: 217 time: 0.0491033 Nov 23 19:35:24.525723 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-863826eb-126d-4914-af0b-127ff326fe39 req-c825b563-a64c-4b4b-969e-a80e356e4f84 tempest-ServerRescueNegativeTestJSON-1447477341 tempest-ServerRescueNegativeTestJSON-1447477341-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102992) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:35:24.527232 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-863826eb-126d-4914-af0b-127ff326fe39 req-c825b563-a64c-4b4b-969e-a80e356e4f84 tempest-ServerRescueNegativeTestJSON-1447477341 tempest-ServerRescueNegativeTestJSON-1447477341-project] 10.222.0.62 "GET /v2.0/ports?device_id=671f1d44-7752-4a9d-835d-4d76164c900f HTTP/1.1" status: 200 len: 945 time: 0.1170082 Nov 23 19:35:24.528864 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-976480cd-3755-45a4-9b82-aa4a7bc669b7 req-5e5263c3-dc5b-42e0-856a-137e7154befa service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102992) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:35:24.530332 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-976480cd-3755-45a4-9b82-aa4a7bc669b7 req-5e5263c3-dc5b-42e0-856a-137e7154befa service neutron] 10.222.0.41 "GET /v2.0/subnets?id=e4fda56f-85ff-422d-adad-ec00db6378af HTTP/1.1" status: 200 len: 859 time: 0.0645905 Nov 23 19:35:24.576866 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-976480cd-3755-45a4-9b82-aa4a7bc669b7 req-471332af-eccd-4608-8d0f-f4c3f248cc7c service neutron] 10.222.0.41 "GET /v2.0/ports?network_id=07eeb44e-4cdb-4c58-a83d-1dd8ab1ccb8a&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0363073 Nov 23 19:35:24.631691 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-863826eb-126d-4914-af0b-127ff326fe39 req-1f5e2551-8089-41b9-97ce-6a316e829928 tempest-ServerRescueNegativeTestJSON-1447477341 tempest-ServerRescueNegativeTestJSON-1447477341-project] 10.222.0.62 "GET /v2.0/security-groups?id=62a09434-acf0-424f-9001-2c3a78119364&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0982552 Nov 23 19:35:24.634769 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-89bcf7df-fcec-4f31-96aa-9885d3da9168 req-3158c7ea-5ff0-4d9b-9b87-c3b1b249368e tempest-VolumesActionsTest-802949502 tempest-VolumesActionsTest-802949502-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102993) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:35:24.643771 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-89bcf7df-fcec-4f31-96aa-9885d3da9168 req-3158c7ea-5ff0-4d9b-9b87-c3b1b249368e tempest-VolumesActionsTest-802949502 tempest-VolumesActionsTest-802949502-project] 10.222.0.62 "GET /v2.0/ports?device_id=fa2c753c-e8ba-46c8-8c59-7a35f6357117 HTTP/1.1" status: 200 len: 943 time: 0.0604255 Nov 23 19:35:24.683426 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-89bcf7df-fcec-4f31-96aa-9885d3da9168 req-bf8a81d7-decb-4295-b511-8a9fe878015a tempest-VolumesActionsTest-802949502 tempest-VolumesActionsTest-802949502-project] 10.222.0.62 "GET /v2.0/security-groups?id=47acb13d-cf9a-4dd6-a614-503b94072f69&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0409117 Nov 23 19:35:24.728333 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-976480cd-3755-45a4-9b82-aa4a7bc669b7 req-cc4b6ac8-aed6-4383-8352-ead87cb243c7 service neutron] 10.222.0.41 "GET /v2.0/networks/07eeb44e-4cdb-4c58-a83d-1dd8ab1ccb8a?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1403573 Nov 23 19:35:24.827702 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-976480cd-3755-45a4-9b82-aa4a7bc669b7 req-009a0902-d9e4-47bf-b66a-964399d6d165 service neutron] 10.222.0.41 "GET /v2.0/networks/07eeb44e-4cdb-4c58-a83d-1dd8ab1ccb8a?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0916889 Nov 23 19:35:25.047497 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.plugins.ml2.rpc [None req-4bf48ff4-ecfb-4168-8b63-249b8c6e9f04 None None] Device f82fc68a-422f-4577-b6c3-98bd45727b03 details requested by agent hyperv_hv-cinder-81901 with host hv-cinder-81901 {{(pid=102994) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Nov 23 19:35:25.147340 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.plugins.ml2.db [None req-4bf48ff4-ecfb-4168-8b63-249b8c6e9f04 None None] For port f82fc68a-422f-4577-b6c3-98bd45727b03, host hv-cinder-81901, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81901',level=0,port_id=f82fc68a-422f-4577-b6c3-98bd45727b03,segment=NetworkSegment(b67642b4-1845-4b49-9392-51fd2c9bc8b8),segment_id=b67642b4-1845-4b49-9392-51fd2c9bc8b8)] {{(pid=102994) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 23 19:35:25.159934 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.plugins.ml2.rpc [None req-4bf48ff4-ecfb-4168-8b63-249b8c6e9f04 None None] Returning: {'device': 'f82fc68a-422f-4577-b6c3-98bd45727b03', 'network_id': '6a5d33a0-25a4-4580-ae9f-e7aa9d768182', 'port_id': 'f82fc68a-422f-4577-b6c3-98bd45727b03', 'mac_address': 'fa:16:3e:40:ca:39', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 815, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'cf93b200-5fcb-4538-8ce7-95612047c22a', 'ip_address': '172.20.0.8'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=102994) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Nov 23 19:35:25.167711 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8369c569-8c04-4d10-8f66-093780fb87f7 req-92b100a7-84f8-4a62-bc08-e48d7d524f0d tempest-VolumesSnapshotTestJSON-97879810 tempest-VolumesSnapshotTestJSON-97879810-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102992) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:35:25.169198 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-8369c569-8c04-4d10-8f66-093780fb87f7 req-92b100a7-84f8-4a62-bc08-e48d7d524f0d tempest-VolumesSnapshotTestJSON-97879810 tempest-VolumesSnapshotTestJSON-97879810-project] 10.222.0.62 "GET /v2.0/ports?device_id=d8c269ba-e8f8-4705-a5a5-fbfbb498151f HTTP/1.1" status: 200 len: 943 time: 0.0516307 Nov 23 19:35:25.202538 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron_lib.callbacks.manager [None req-4bf48ff4-ecfb-4168-8b63-249b8c6e9f04 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7921281'] for port, before_update {{(pid=102994) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:35:25.217074 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.notifiers.nova [None req-4bf48ff4-ecfb-4168-8b63-249b8c6e9f04 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id f82fc68a-422f-4577-b6c3-98bd45727b03 {{(pid=102994) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 23 19:35:25.220438 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-8369c569-8c04-4d10-8f66-093780fb87f7 req-ddca93b1-1f27-48d7-947d-a00375f517e7 tempest-VolumesSnapshotTestJSON-97879810 tempest-VolumesSnapshotTestJSON-97879810-project] 10.222.0.62 "GET /v2.0/security-groups?id=2fd4bf42-f1cd-4ab5-94a3-e2347f7bb016&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0443354 Nov 23 19:35:25.240174 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.plugins.ml2.db [None req-4bf48ff4-ecfb-4168-8b63-249b8c6e9f04 None None] For port f82fc68a-422f-4577-b6c3-98bd45727b03, host hv-cinder-81901, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81901',level=0,port_id=f82fc68a-422f-4577-b6c3-98bd45727b03,segment=NetworkSegment(b67642b4-1845-4b49-9392-51fd2c9bc8b8),segment_id=b67642b4-1845-4b49-9392-51fd2c9bc8b8)] {{(pid=102994) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 23 19:35:25.314980 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8e5fb884-91b7-4363-b500-c2162c17097d req-e781a659-fc7b-4054-97ca-2c8411066e13 tempest-AttachVolumeShelveTestJSON-1172915835 tempest-AttachVolumeShelveTestJSON-1172915835-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102993) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:35:25.316464 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-8e5fb884-91b7-4363-b500-c2162c17097d req-e781a659-fc7b-4054-97ca-2c8411066e13 tempest-AttachVolumeShelveTestJSON-1172915835 tempest-AttachVolumeShelveTestJSON-1172915835-project] 10.222.0.62 "GET /v2.0/ports?device_id=85ea3d72-6c17-4ea2-82b7-90cce01633bd HTTP/1.1" status: 200 len: 945 time: 0.0524955 Nov 23 19:35:25.322768 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron_lib.callbacks.manager [None req-4bf48ff4-ecfb-4168-8b63-249b8c6e9f04 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7918660', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-15067', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560168', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8783631423946', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8783631008732', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8783631008750'] for port, after_update {{(pid=102994) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:35:25.370159 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-8e5fb884-91b7-4363-b500-c2162c17097d req-a0e94e13-fc67-4cdd-8725-68f452c13856 tempest-AttachVolumeShelveTestJSON-1172915835 tempest-AttachVolumeShelveTestJSON-1172915835-project] 10.222.0.62 "GET /v2.0/security-groups?id=f1ca24d9-0a31-470d-a1d5-fa7059df0141&fields=id&fields=name HTTP/1.1" status: 200 len: 311 time: 0.0473781 Nov 23 19:35:25.376889 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4bf48ff4-ecfb-4168-8b63-249b8c6e9f04 None None] Pushing event updated for resources: {'Port': ['ID=f82fc68a-422f-4577-b6c3-98bd45727b03,revision_number=4']} {{(pid=102994) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 23 19:35:25.384586 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4bf48ff4-ecfb-4168-8b63-249b8c6e9f04 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-819011-1-iscsi {{(pid=102994) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 23 19:35:25.385029 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4bf48ff4-ecfb-4168-8b63-249b8c6e9f04 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-819011-1-iscsi {{(pid=102994) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 23 19:35:25.385485 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4bf48ff4-ecfb-4168-8b63-249b8c6e9f04 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-819011-1-iscsi {{(pid=102994) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 23 19:35:25.385962 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4bf48ff4-ecfb-4168-8b63-249b8c6e9f04 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-819011-1-iscsi {{(pid=102994) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 23 19:35:25.389444 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4bf48ff4-ecfb-4168-8b63-249b8c6e9f04 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-819011-1-iscsi {{(pid=102994) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 23 19:35:25.389444 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4bf48ff4-ecfb-4168-8b63-249b8c6e9f04 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-819011-1-iscsi {{(pid=102994) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 23 19:35:25.389444 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4bf48ff4-ecfb-4168-8b63-249b8c6e9f04 None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-819011-1-iscsi {{(pid=102994) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 23 19:35:25.389444 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4bf48ff4-ecfb-4168-8b63-249b8c6e9f04 None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-819011-1-iscsi {{(pid=102994) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 23 19:35:25.389444 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4bf48ff4-ecfb-4168-8b63-249b8c6e9f04 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-819011-1-iscsi {{(pid=102994) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 23 19:35:25.389444 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4bf48ff4-ecfb-4168-8b63-249b8c6e9f04 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-819011-1-iscsi {{(pid=102994) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 23 19:35:25.389444 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4bf48ff4-ecfb-4168-8b63-249b8c6e9f04 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-819011-1-iscsi {{(pid=102994) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 23 19:35:25.389444 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4bf48ff4-ecfb-4168-8b63-249b8c6e9f04 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-819011-1-iscsi {{(pid=102994) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 23 19:35:25.650494 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.plugins.ml2.db [None req-4bf48ff4-ecfb-4168-8b63-249b8c6e9f04 None None] get_ports_and_sgs() called for port_ids ['f82fc68a-422f-4577-b6c3-98bd45727b03'] {{(pid=102994) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 23 19:35:25.752667 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e6606322-8a6b-4a61-b512-441c27541abe req-f4f04179-73d7-4b19-a4ac-40d0e71ef712 tempest-ServerRescueNegativeTestJSON-1447477341 tempest-ServerRescueNegativeTestJSON-1447477341-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102992) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:35:25.760383 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-e6606322-8a6b-4a61-b512-441c27541abe req-f4f04179-73d7-4b19-a4ac-40d0e71ef712 tempest-ServerRescueNegativeTestJSON-1447477341 tempest-ServerRescueNegativeTestJSON-1447477341-project] 10.222.0.62 "GET /v2.0/ports?device_id=671f1d44-7752-4a9d-835d-4d76164c900f HTTP/1.1" status: 200 len: 945 time: 0.0615458 Nov 23 19:35:25.817072 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-368bacb0-c71d-4ced-aa27-9a2018839731 req-b50697a0-afd8-4548-aeb0-d35d8788829f tempest-VolumesActionsTest-802949502 tempest-VolumesActionsTest-802949502-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102993) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:35:25.818768 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-368bacb0-c71d-4ced-aa27-9a2018839731 req-b50697a0-afd8-4548-aeb0-d35d8788829f tempest-VolumesActionsTest-802949502 tempest-VolumesActionsTest-802949502-project] 10.222.0.62 "GET /v2.0/ports?device_id=fa2c753c-e8ba-46c8-8c59-7a35f6357117 HTTP/1.1" status: 200 len: 943 time: 0.0610785 Nov 23 19:35:25.825758 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-e6606322-8a6b-4a61-b512-441c27541abe req-23388b49-188b-498f-b104-861ff44f74d8 tempest-ServerRescueNegativeTestJSON-1447477341 tempest-ServerRescueNegativeTestJSON-1447477341-project] 10.222.0.62 "GET /v2.0/security-groups?id=62a09434-acf0-424f-9001-2c3a78119364&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0643930 Nov 23 19:35:25.883024 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-368bacb0-c71d-4ced-aa27-9a2018839731 req-4ba4514d-0d8a-409a-9441-b48628ad92c3 tempest-VolumesActionsTest-802949502 tempest-VolumesActionsTest-802949502-project] 10.222.0.62 "GET /v2.0/security-groups?id=47acb13d-cf9a-4dd6-a614-503b94072f69&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0524695 Nov 23 19:35:26.265438 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.wsgi [-] (102992) accepted ('10.222.0.62', 45186) {{(pid=102992) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 23 19:35:26.339517 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8087e36c-4fb6-4653-84c7-c13d5c44bb4e req-27744188-f46f-43c7-98d4-5516d4480a92 tempest-VolumesSnapshotTestJSON-97879810 tempest-VolumesSnapshotTestJSON-97879810-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102992) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:35:26.340973 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-8087e36c-4fb6-4653-84c7-c13d5c44bb4e req-27744188-f46f-43c7-98d4-5516d4480a92 tempest-VolumesSnapshotTestJSON-97879810 tempest-VolumesSnapshotTestJSON-97879810-project] 10.222.0.62 "GET /v2.0/ports?device_id=d8c269ba-e8f8-4705-a5a5-fbfbb498151f HTTP/1.1" status: 200 len: 944 time: 0.0489440 Nov 23 19:35:26.379591 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [None req-56dec0fb-dd30-47dd-8a86-ee8f0b06eb25 admin admin] Publish callbacks [] for security_group, before_create {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:35:26.416362 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-8087e36c-4fb6-4653-84c7-c13d5c44bb4e req-002c2663-cc93-4cc1-a5c9-2498c2ff579e tempest-VolumesSnapshotTestJSON-97879810 tempest-VolumesSnapshotTestJSON-97879810-project] 10.222.0.62 "GET /v2.0/security-groups?id=2fd4bf42-f1cd-4ab5-94a3-e2347f7bb016&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0682337 Nov 23 19:35:26.478513 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [None req-56dec0fb-dd30-47dd-8a86-ee8f0b06eb25 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:35:26.494591 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bd3dcf3b-7c5d-4593-b1ec-2b518233ebe9 req-3dbd86e4-cf36-45e4-92c5-ded310cce6ab tempest-AttachVolumeShelveTestJSON-1172915835 tempest-AttachVolumeShelveTestJSON-1172915835-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102993) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:35:26.496090 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-bd3dcf3b-7c5d-4593-b1ec-2b518233ebe9 req-3dbd86e4-cf36-45e4-92c5-ded310cce6ab tempest-AttachVolumeShelveTestJSON-1172915835 tempest-AttachVolumeShelveTestJSON-1172915835-project] 10.222.0.62 "GET /v2.0/ports?device_id=85ea3d72-6c17-4ea2-82b7-90cce01633bd HTTP/1.1" status: 200 len: 945 time: 0.0507743 Nov 23 19:35:26.547345 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-bd3dcf3b-7c5d-4593-b1ec-2b518233ebe9 req-1da4e13a-b3c9-401d-94f6-665b6554dda6 tempest-AttachVolumeShelveTestJSON-1172915835 tempest-AttachVolumeShelveTestJSON-1172915835-project] 10.222.0.62 "GET /v2.0/security-groups?id=f1ca24d9-0a31-470d-a1d5-fa7059df0141&fields=id&fields=name HTTP/1.1" status: 200 len: 311 time: 0.0452185 Nov 23 19:35:26.552368 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [None req-56dec0fb-dd30-47dd-8a86-ee8f0b06eb25 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-623933'] for security_group, after_create {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:35:26.591995 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [None req-56dec0fb-dd30-47dd-8a86-ee8f0b06eb25 admin admin] 10.222.0.62 "GET /v2.0/security-groups?tenant_id=0c047bad97094523a07eed09ac4a7175&name=default HTTP/1.1" status: 200 len: 2996 time: 0.3253253 Nov 23 19:35:26.593158 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-56dec0fb-dd30-47dd-8a86-ee8f0b06eb25 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=02236c07-2543-49be-a085-59daaf192f1d,revision_number=1']} {{(pid=102992) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 23 19:35:26.594599 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.wsgi [-] (102993) accepted ('10.222.0.62', 45192) {{(pid=102993) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 23 19:35:26.647368 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-51e6a9ee-a08f-4edb-9107-f54e10885485 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:35:26.667837 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-51e6a9ee-a08f-4edb-9107-f54e10885485 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:35:26.760470 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-51e6a9ee-a08f-4edb-9107-f54e10885485 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-623933'] for security_group, after_delete {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:35:26.763311 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-51e6a9ee-a08f-4edb-9107-f54e10885485 admin admin] Publish callbacks [] for security_group, before_response {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:35:26.764438 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [None req-51e6a9ee-a08f-4edb-9107-f54e10885485 admin admin] 10.222.0.62 "DELETE /v2.0/security-groups/02236c07-2543-49be-a085-59daaf192f1d HTTP/1.1" status: 204 len: 168 time: 0.1688149 Nov 23 19:35:26.772087 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-51e6a9ee-a08f-4edb-9107-f54e10885485 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=02236c07-2543-49be-a085-59daaf192f1d,revision_number=None']} {{(pid=102993) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 23 19:35:26.973264 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-660082bb-d428-4b8b-ba0a-03cf6506cf19 req-b6cd5424-93ec-4d9b-9ebb-4b42a09d7a96 tempest-ServerRescueNegativeTestJSON-1447477341 tempest-ServerRescueNegativeTestJSON-1447477341-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102992) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:35:26.974833 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-660082bb-d428-4b8b-ba0a-03cf6506cf19 req-b6cd5424-93ec-4d9b-9ebb-4b42a09d7a96 tempest-ServerRescueNegativeTestJSON-1447477341 tempest-ServerRescueNegativeTestJSON-1447477341-project] 10.222.0.62 "GET /v2.0/ports?device_id=671f1d44-7752-4a9d-835d-4d76164c900f HTTP/1.1" status: 200 len: 945 time: 0.0566649 Nov 23 19:35:27.011060 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-85989a4c-90ac-4ead-90c4-ef86024f98dd req-a93142b0-e151-4425-adce-22d5e70d39b5 tempest-VolumesActionsTest-802949502 tempest-VolumesActionsTest-802949502-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102993) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:35:27.014110 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-85989a4c-90ac-4ead-90c4-ef86024f98dd req-a93142b0-e151-4425-adce-22d5e70d39b5 tempest-VolumesActionsTest-802949502 tempest-VolumesActionsTest-802949502-project] 10.222.0.62 "GET /v2.0/ports?device_id=fa2c753c-e8ba-46c8-8c59-7a35f6357117 HTTP/1.1" status: 200 len: 943 time: 0.0517390 Nov 23 19:35:27.056309 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-660082bb-d428-4b8b-ba0a-03cf6506cf19 req-a77767d9-ff3d-48db-ba7d-8d1fb0e39754 tempest-ServerRescueNegativeTestJSON-1447477341 tempest-ServerRescueNegativeTestJSON-1447477341-project] 10.222.0.62 "GET /v2.0/security-groups?id=62a09434-acf0-424f-9001-2c3a78119364&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0755670 Nov 23 19:35:27.073351 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-85989a4c-90ac-4ead-90c4-ef86024f98dd req-7af349f4-5eb1-4a44-a73d-4f981eb53d4c tempest-VolumesActionsTest-802949502 tempest-VolumesActionsTest-802949502-project] 10.222.0.62 "GET /v2.0/security-groups?id=47acb13d-cf9a-4dd6-a614-503b94072f69&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0502222 Nov 23 19:35:27.074449 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.plugins.ml2.rpc [None req-4bf48ff4-ecfb-4168-8b63-249b8c6e9f04 None None] Device 8a6b6382-0b2a-4cc0-9d38-21f83a9faa3b details requested by agent hyperv_hv-cinder-81901 with host hv-cinder-81901 {{(pid=102994) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Nov 23 19:35:27.078793 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.plugins.ml2.rpc [None req-4bf48ff4-ecfb-4168-8b63-249b8c6e9f04 None None] Device f82fc68a-422f-4577-b6c3-98bd45727b03 up at agent hyperv_hv-cinder-81901 {{(pid=102994) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 23 19:35:27.243529 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.plugins.ml2.db [None req-4bf48ff4-ecfb-4168-8b63-249b8c6e9f04 None None] For port 8a6b6382-0b2a-4cc0-9d38-21f83a9faa3b, host hv-cinder-81901, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81901',level=0,port_id=8a6b6382-0b2a-4cc0-9d38-21f83a9faa3b,segment=NetworkSegment(2ab14203-895d-412f-8616-df9c89e896c9),segment_id=2ab14203-895d-412f-8616-df9c89e896c9)] {{(pid=102994) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 23 19:35:27.254892 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.plugins.ml2.rpc [None req-4bf48ff4-ecfb-4168-8b63-249b8c6e9f04 None None] Returning: {'device': '8a6b6382-0b2a-4cc0-9d38-21f83a9faa3b', 'network_id': '4b2c41c3-6250-433d-837a-85d02cae1bde', 'port_id': '8a6b6382-0b2a-4cc0-9d38-21f83a9faa3b', 'mac_address': 'fa:16:3e:2d:91:27', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 839, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '168da168-ed46-4168-8b11-4b0ac0e6fbd8', 'ip_address': '172.20.0.2'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=102994) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Nov 23 19:35:27.290557 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.db.provisioning_blocks [None req-4bf48ff4-ecfb-4168-8b63-249b8c6e9f04 None None] Provisioning for port f82fc68a-422f-4577-b6c3-98bd45727b03 completed by entity L2. {{(pid=102994) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 23 19:35:27.296703 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.db.provisioning_blocks [None req-4bf48ff4-ecfb-4168-8b63-249b8c6e9f04 None None] Provisioning complete for port f82fc68a-422f-4577-b6c3-98bd45727b03 triggered by entity L2. {{(pid=102994) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 23 19:35:27.297078 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron_lib.callbacks.manager [None req-4bf48ff4-ecfb-4168-8b63-249b8c6e9f04 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-8355713'] for port, provisioning_complete {{(pid=102994) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:35:27.299859 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron_lib.callbacks.manager [None req-4bf48ff4-ecfb-4168-8b63-249b8c6e9f04 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7921281'] for port, before_update {{(pid=102994) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:35:27.336179 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.notifiers.nova [None req-4bf48ff4-ecfb-4168-8b63-249b8c6e9f04 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 8a6b6382-0b2a-4cc0-9d38-21f83a9faa3b {{(pid=102994) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 23 19:35:27.361242 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.plugins.ml2.db [None req-4bf48ff4-ecfb-4168-8b63-249b8c6e9f04 None None] For port 8a6b6382-0b2a-4cc0-9d38-21f83a9faa3b, host hv-cinder-81901, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81901',level=0,port_id=8a6b6382-0b2a-4cc0-9d38-21f83a9faa3b,segment=NetworkSegment(2ab14203-895d-412f-8616-df9c89e896c9),segment_id=2ab14203-895d-412f-8616-df9c89e896c9)] {{(pid=102994) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 23 19:35:27.407684 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron_lib.callbacks.manager [None req-4bf48ff4-ecfb-4168-8b63-249b8c6e9f04 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7921281'] for port, before_update {{(pid=102994) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:35:27.434784 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'd8c269ba-e8f8-4705-a5a5-fbfbb498151f', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'f82fc68a-422f-4577-b6c3-98bd45727b03'}] {{(pid=102994) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 23 19:35:27.437349 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.62/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}09a7511da0d2ba1d728b27e36a8467ec5289399952f0059588048a7cb66d3a43" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-89a7757f-7c02-4509-ad8a-e8cb38018d0e" -d '{"events": [{"server_uuid": "d8c269ba-e8f8-4705-a5a5-fbfbb498151f", "name": "network-vif-plugged", "status": "completed", "tag": "f82fc68a-422f-4577-b6c3-98bd45727b03"}]}' {{(pid=102994) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 23 19:35:27.464044 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.plugins.ml2.db [None req-4bf48ff4-ecfb-4168-8b63-249b8c6e9f04 None None] For port f82fc68a-422f-4577-b6c3-98bd45727b03, host hv-cinder-81901, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81901',level=0,port_id=f82fc68a-422f-4577-b6c3-98bd45727b03,segment=NetworkSegment(b67642b4-1845-4b49-9392-51fd2c9bc8b8),segment_id=b67642b4-1845-4b49-9392-51fd2c9bc8b8)] {{(pid=102994) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 23 19:35:27.478345 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 23 Nov 2021 19:35:27 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-fd7adce6-81ec-4ab2-96ab-72f52778252a x-openstack-request-id: req-fd7adce6-81ec-4ab2-96ab-72f52778252a {{(pid=102994) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 23 19:35:27.478683 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "d8c269ba-e8f8-4705-a5a5-fbfbb498151f", "name": "network-vif-plugged", "status": "completed", "tag": "f82fc68a-422f-4577-b6c3-98bd45727b03", "code": 200}]} {{(pid=102994) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 23 19:35:27.478985 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.62/compute/v2.1/os-server-external-events used request id req-fd7adce6-81ec-4ab2-96ab-72f52778252a {{(pid=102994) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 23 19:35:27.479438 dv-cinder-819011-1-iscsi neutron-server[102994]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'd8c269ba-e8f8-4705-a5a5-fbfbb498151f', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'f82fc68a-422f-4577-b6c3-98bd45727b03', 'code': 200} Nov 23 19:35:27.488504 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron_lib.callbacks.manager [None req-4bf48ff4-ecfb-4168-8b63-249b8c6e9f04 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7918660', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-15067', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560168', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8783631423946', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8783631008732', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8783631008750'] for port, after_update {{(pid=102994) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:35:27.541206 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron_lib.callbacks.manager [None req-4bf48ff4-ecfb-4168-8b63-249b8c6e9f04 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7918660', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-15067', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560168', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8783631423946', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8783631008732', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8783631008750'] for port, after_update {{(pid=102994) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:35:27.543784 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4bf48ff4-ecfb-4168-8b63-249b8c6e9f04 None None] Pushing event updated for resources: {'Port': ['ID=8a6b6382-0b2a-4cc0-9d38-21f83a9faa3b,revision_number=4']} {{(pid=102994) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 23 19:35:27.612289 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-90901db7-1ed6-45d4-ba2d-5d533b103a64 req-75137924-93c9-4eba-bce4-d5b62a3f111b tempest-VolumesSnapshotTestJSON-97879810 tempest-VolumesSnapshotTestJSON-97879810-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102992) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:35:27.613884 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-90901db7-1ed6-45d4-ba2d-5d533b103a64 req-75137924-93c9-4eba-bce4-d5b62a3f111b tempest-VolumesSnapshotTestJSON-97879810 tempest-VolumesSnapshotTestJSON-97879810-project] 10.222.0.62 "GET /v2.0/ports?device_id=d8c269ba-e8f8-4705-a5a5-fbfbb498151f HTTP/1.1" status: 200 len: 945 time: 0.0666935 Nov 23 19:35:27.656134 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4bf48ff4-ecfb-4168-8b63-249b8c6e9f04 None None] Pushing event updated for resources: {'Port': ['ID=f82fc68a-422f-4577-b6c3-98bd45727b03,revision_number=5']} {{(pid=102994) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 23 19:35:27.710205 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-90901db7-1ed6-45d4-ba2d-5d533b103a64 req-19c9c337-d468-47ca-9cb6-55fe501a308e tempest-VolumesSnapshotTestJSON-97879810 tempest-VolumesSnapshotTestJSON-97879810-project] 10.222.0.62 "GET /v2.0/security-groups?id=2fd4bf42-f1cd-4ab5-94a3-e2347f7bb016&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0886219 Nov 23 19:35:27.806051 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-983dc178-ed30-4bce-b940-45b394488998 req-910e5690-f4d8-4020-acdd-67e086610f38 tempest-AttachVolumeShelveTestJSON-1172915835 tempest-AttachVolumeShelveTestJSON-1172915835-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102993) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:35:27.807599 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-983dc178-ed30-4bce-b940-45b394488998 req-910e5690-f4d8-4020-acdd-67e086610f38 tempest-AttachVolumeShelveTestJSON-1172915835 tempest-AttachVolumeShelveTestJSON-1172915835-project] 10.222.0.62 "GET /v2.0/ports?device_id=85ea3d72-6c17-4ea2-82b7-90cce01633bd HTTP/1.1" status: 200 len: 945 time: 0.0828881 Nov 23 19:35:27.817826 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.plugins.ml2.db [None req-4bf48ff4-ecfb-4168-8b63-249b8c6e9f04 None None] get_ports_and_sgs() called for port_ids ['8a6b6382-0b2a-4cc0-9d38-21f83a9faa3b'] {{(pid=102994) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 23 19:35:27.869897 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7d785413-a39e-4501-8e27-94bfc4294d7e req-898bbc09-968b-4b90-9983-82ec33c95400 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102992) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:35:27.872988 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-983dc178-ed30-4bce-b940-45b394488998 req-8be3dce7-f452-4ae8-b198-27d5d9f4c63b tempest-AttachVolumeShelveTestJSON-1172915835 tempest-AttachVolumeShelveTestJSON-1172915835-project] 10.222.0.62 "GET /v2.0/security-groups?id=f1ca24d9-0a31-470d-a1d5-fa7059df0141&fields=id&fields=name HTTP/1.1" status: 200 len: 311 time: 0.0580742 Nov 23 19:35:27.874998 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-7d785413-a39e-4501-8e27-94bfc4294d7e req-898bbc09-968b-4b90-9983-82ec33c95400 service neutron] 10.222.0.41 "GET /v2.0/ports?device_id=d8c269ba-e8f8-4705-a5a5-fbfbb498151f HTTP/1.1" status: 200 len: 1098 time: 0.0511878 Nov 23 19:35:27.958184 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-7d785413-a39e-4501-8e27-94bfc4294d7e req-d048056c-9ba4-4757-b755-6832e35f1cb4 service neutron] 10.222.0.41 "GET /v2.0/security-groups?id=2fd4bf42-f1cd-4ab5-94a3-e2347f7bb016&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0655043 Nov 23 19:35:28.042338 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.wsgi [-] (102993) accepted ('10.222.0.62', 45238) {{(pid=102993) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 23 19:35:28.137578 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.api.v2.base [None req-176d27e3-2adc-46bd-a8f6-a2ecff8cdc91 admin admin] Request body: {'network': {'name': 'tempest-TestVolumeBootPattern-84632531-network', 'tenant_id': '257b0b2e531441b4bb745e99cfd799f3'}} {{(pid=102993) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 23 19:35:28.206886 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2e178726-b82f-4cc9-bcad-257a0bd8f50d req-5eb150b5-d779-4658-be78-dfea4eafe672 tempest-VolumesActionsTest-802949502 tempest-VolumesActionsTest-802949502-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102992) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:35:28.208428 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-2e178726-b82f-4cc9-bcad-257a0bd8f50d req-5eb150b5-d779-4658-be78-dfea4eafe672 tempest-VolumesActionsTest-802949502 tempest-VolumesActionsTest-802949502-project] 10.222.0.62 "GET /v2.0/ports?device_id=fa2c753c-e8ba-46c8-8c59-7a35f6357117 HTTP/1.1" status: 200 len: 944 time: 0.0518167 Nov 23 19:35:28.223431 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-176d27e3-2adc-46bd-a8f6-a2ecff8cdc91 admin admin] Made reservation on behalf of 257b0b2e531441b4bb745e99cfd799f3 for: {'network': 1} {{(pid=102993) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 23 19:35:28.225819 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-176d27e3-2adc-46bd-a8f6-a2ecff8cdc91 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7921281'] for network, before_create {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:35:28.235855 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-176d27e3-2adc-46bd-a8f6-a2ecff8cdc91 admin admin] Publish callbacks [] for security_group, before_create {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:35:28.259322 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-2e178726-b82f-4cc9-bcad-257a0bd8f50d req-4b904837-ab34-48e3-9d4d-a9b32c4b9454 tempest-VolumesActionsTest-802949502 tempest-VolumesActionsTest-802949502-project] 10.222.0.62 "GET /v2.0/security-groups?id=47acb13d-cf9a-4dd6-a614-503b94072f69&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0446637 Nov 23 19:35:28.316352 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-176d27e3-2adc-46bd-a8f6-a2ecff8cdc91 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:35:28.400279 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-176d27e3-2adc-46bd-a8f6-a2ecff8cdc91 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-623933'] for security_group, after_create {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:35:28.425680 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-176d27e3-2adc-46bd-a8f6-a2ecff8cdc91 admin admin] vlan segment allocate from pool success with {'vlan_id': 800, 'physical_network': 'physnet1'} {{(pid=102993) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 23 19:35:28.434235 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-176d27e3-2adc-46bd-a8f6-a2ecff8cdc91 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=1837229a-e26a-4243-bdd7-8391c7eafa8b,revision_number=1']} {{(pid=102993) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 23 19:35:28.440042 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-176d27e3-2adc-46bd-a8f6-a2ecff8cdc91 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7982218'] for segment, precommit_create {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:35:28.440457 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.db.segments_db [None req-176d27e3-2adc-46bd-a8f6-a2ecff8cdc91 admin admin] Added segment 56316385-5b81-43f5-84db-b708b46f04eb of type vlan for network 226a519f-5f3e-4d80-bb8a-0e9fc4f64828 Nov 23 19:35:28.480496 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-176d27e3-2adc-46bd-a8f6-a2ecff8cdc91 admin admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8783630993713'] for network, precommit_create {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:35:28.623665 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-176d27e3-2adc-46bd-a8f6-a2ecff8cdc91 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-554949', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560168'] for network, after_create {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:35:28.624789 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-176d27e3-2adc-46bd-a8f6-a2ecff8cdc91 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102993) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:35:28.625378 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-176d27e3-2adc-46bd-a8f6-a2ecff8cdc91 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-560186'] for network, before_response {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:35:28.690359 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-176d27e3-2adc-46bd-a8f6-a2ecff8cdc91 admin admin] Pushing event updated for resources: {'Network': ['ID=226a519f-5f3e-4d80-bb8a-0e9fc4f64828,revision_number=1']} {{(pid=102993) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 23 19:35:28.699746 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.plugins.ml2.rpc [None req-eb87b2c3-3339-4249-8b85-e695b5b4e1f9 None None] Network 226a519f-5f3e-4d80-bb8a-0e9fc4f64828 details requested by agent ovs-agent-dv-cinder-819011-1-iscsi with host dv-cinder-819011-1-iscsi {{(pid=102994) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Nov 23 19:35:28.729313 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [None req-176d27e3-2adc-46bd-a8f6-a2ecff8cdc91 admin admin] 10.222.0.62 "POST /v2.0/networks HTTP/1.1" status: 201 len: 883 time: 0.6858468 Nov 23 19:35:28.732346 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.wsgi [-] (102992) accepted ('10.222.0.62', 45250) {{(pid=102992) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 23 19:35:28.738266 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.api.v2.base [None req-0dd2099d-660f-4965-ac80-0eb31424d834 admin admin] Request body: {'subnet': {'network_id': '226a519f-5f3e-4d80-bb8a-0e9fc4f64828', 'cidr': '172.20.0.0/28', 'name': 'tempest-TestVolumeBootPattern-84632531-subnet', 'tenant_id': '257b0b2e531441b4bb745e99cfd799f3', 'ip_version': 4}} {{(pid=102992) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 23 19:35:28.801460 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-0dd2099d-660f-4965-ac80-0eb31424d834 admin admin] Made reservation on behalf of 257b0b2e531441b4bb745e99cfd799f3 for: {'subnet': 1} {{(pid=102992) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 23 19:35:28.803847 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [None req-0dd2099d-660f-4965-ac80-0eb31424d834 admin admin] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-25999706'] for subnet, before_create {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:35:28.843664 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-939a7044-535c-4f0b-bdd1-b028aa2367fb req-61292568-1a1a-48a4-aebd-bcf396a2186b tempest-VolumesSnapshotTestJSON-97879810 tempest-VolumesSnapshotTestJSON-97879810-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102993) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:35:28.845175 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-939a7044-535c-4f0b-bdd1-b028aa2367fb req-61292568-1a1a-48a4-aebd-bcf396a2186b tempest-VolumesSnapshotTestJSON-97879810 tempest-VolumesSnapshotTestJSON-97879810-project] 10.222.0.62 "GET /v2.0/ports?device_id=d8c269ba-e8f8-4705-a5a5-fbfbb498151f HTTP/1.1" status: 200 len: 945 time: 0.0526712 Nov 23 19:35:28.894322 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-939a7044-535c-4f0b-bdd1-b028aa2367fb req-c938303d-8616-4aaf-aa41-2bf3ace48caf tempest-VolumesSnapshotTestJSON-97879810 tempest-VolumesSnapshotTestJSON-97879810-project] 10.222.0.62 "GET /v2.0/security-groups?id=2fd4bf42-f1cd-4ab5-94a3-e2347f7bb016&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0426922 Nov 23 19:35:29.012327 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron_lib.callbacks.manager [None req-4bf48ff4-ecfb-4168-8b63-249b8c6e9f04 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8783631323329', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7978582'] for agent, after_update {{(pid=102994) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:35:29.025652 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e9c6c042-7f57-4701-b9bb-852f354ca7d2 req-ea6241d8-1cca-40a6-a442-6c92fcd7cbc5 tempest-AttachVolumeShelveTestJSON-1172915835 tempest-AttachVolumeShelveTestJSON-1172915835-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102992) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:35:29.027141 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-e9c6c042-7f57-4701-b9bb-852f354ca7d2 req-ea6241d8-1cca-40a6-a442-6c92fcd7cbc5 tempest-AttachVolumeShelveTestJSON-1172915835 tempest-AttachVolumeShelveTestJSON-1172915835-project] 10.222.0.62 "GET /v2.0/ports?device_id=85ea3d72-6c17-4ea2-82b7-90cce01633bd HTTP/1.1" status: 200 len: 945 time: 0.0607355 Nov 23 19:35:29.050244 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4ee680e5-c73e-471f-b4ed-9beff86970d4 req-2fa47e0c-d91d-4abb-9bed-fef06f50595c tempest-ServerRescueNegativeTestJSON-1447477341 tempest-ServerRescueNegativeTestJSON-1447477341-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102993) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:35:29.051857 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-4ee680e5-c73e-471f-b4ed-9beff86970d4 req-2fa47e0c-d91d-4abb-9bed-fef06f50595c tempest-ServerRescueNegativeTestJSON-1447477341 tempest-ServerRescueNegativeTestJSON-1447477341-project] 10.222.0.62 "GET /v2.0/ports?device_id=671f1d44-7752-4a9d-835d-4d76164c900f HTTP/1.1" status: 200 len: 945 time: 0.0542350 Nov 23 19:35:29.058863 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [None req-0dd2099d-660f-4965-ac80-0eb31424d834 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-554858', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560168', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-25199633', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-25999688'] for subnet, after_create {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:35:29.075642 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.plugins.ml2.rpc [None req-4bf48ff4-ecfb-4168-8b63-249b8c6e9f04 None None] Device 8a6b6382-0b2a-4cc0-9d38-21f83a9faa3b up at agent hyperv_hv-cinder-81901 {{(pid=102994) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 23 19:35:29.107514 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-4ee680e5-c73e-471f-b4ed-9beff86970d4 req-b4b0c9f5-10b9-4ef4-9b37-6725c02d9292 tempest-ServerRescueNegativeTestJSON-1447477341 tempest-ServerRescueNegativeTestJSON-1447477341-project] 10.222.0.62 "GET /v2.0/security-groups?id=62a09434-acf0-424f-9001-2c3a78119364&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0490420 Nov 23 19:35:29.108751 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-e9c6c042-7f57-4701-b9bb-852f354ca7d2 req-bddf25ef-5562-4da8-9d01-8cf6babe67d5 tempest-AttachVolumeShelveTestJSON-1172915835 tempest-AttachVolumeShelveTestJSON-1172915835-project] 10.222.0.62 "GET /v2.0/security-groups?id=f1ca24d9-0a31-470d-a1d5-fa7059df0141&fields=id&fields=name HTTP/1.1" status: 200 len: 311 time: 0.0752940 Nov 23 19:35:29.149980 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0dd2099d-660f-4965-ac80-0eb31424d834 admin admin] Pushing event updated for resources: {'Subnet': ['ID=88de785d-c540-4651-af1e-26f27ccaee3c,revision_number=0']} {{(pid=102992) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 23 19:35:29.159813 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-0dd2099d-660f-4965-ac80-0eb31424d834 admin admin] Checking segment: {'id': '56316385-5b81-43f5-84db-b708b46f04eb', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 800, 'network_id': '226a519f-5f3e-4d80-bb8a-0e9fc4f64828'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102992) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 23 19:35:29.160168 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-0dd2099d-660f-4965-ac80-0eb31424d834 admin admin] Network hostable DHCP agents. Network: 226a519f-5f3e-4d80-bb8a-0e9fc4f64828, hostable agents: ['e51c95c7-6a36-4263-ba47-1839054f3e7a'], hosted agents: [] {{(pid=102992) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 23 19:35:29.195044 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.db.provisioning_blocks [None req-4bf48ff4-ecfb-4168-8b63-249b8c6e9f04 None None] Provisioning for port 8a6b6382-0b2a-4cc0-9d38-21f83a9faa3b completed by entity L2. {{(pid=102994) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 23 19:35:29.201263 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.db.provisioning_blocks [None req-4bf48ff4-ecfb-4168-8b63-249b8c6e9f04 None None] Provisioning complete for port 8a6b6382-0b2a-4cc0-9d38-21f83a9faa3b triggered by entity L2. {{(pid=102994) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 23 19:35:29.202518 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron_lib.callbacks.manager [None req-4bf48ff4-ecfb-4168-8b63-249b8c6e9f04 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-8355713'] for port, provisioning_complete {{(pid=102994) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:35:29.252600 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-0dd2099d-660f-4965-ac80-0eb31424d834 admin admin] Network 226a519f-5f3e-4d80-bb8a-0e9fc4f64828 is scheduled to be hosted by DHCP agent e51c95c7-6a36-4263-ba47-1839054f3e7a with binding_index 1 {{(pid=102992) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 23 19:35:29.283548 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron_lib.callbacks.manager [None req-4bf48ff4-ecfb-4168-8b63-249b8c6e9f04 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7921281'] for port, before_update {{(pid=102994) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:35:29.316958 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.plugins.ml2.db [None req-4bf48ff4-ecfb-4168-8b63-249b8c6e9f04 None None] For port 8a6b6382-0b2a-4cc0-9d38-21f83a9faa3b, host hv-cinder-81901, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81901',level=0,port_id=8a6b6382-0b2a-4cc0-9d38-21f83a9faa3b,segment=NetworkSegment(2ab14203-895d-412f-8616-df9c89e896c9),segment_id=2ab14203-895d-412f-8616-df9c89e896c9)] {{(pid=102994) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 23 19:35:29.360561 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.scheduler.base_scheduler [None req-0dd2099d-660f-4965-ac80-0eb31424d834 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-819011-1-iscsi, 226a519f-5f3e-4d80-bb8a-0e9fc4f64828) {{(pid=102992) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 23 19:35:29.370783 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-fd634a8e-edd9-43a4-b34d-9a1ed6cda47b None None] Network 226a519f-5f3e-4d80-bb8a-0e9fc4f64828 requested from dv-cinder-819011-1-iscsi {{(pid=102994) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 23 19:35:29.384158 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-764b04dc-c788-4855-a665-a0100817ff65 req-b56bcbcf-121f-4552-a471-a78d026aea98 tempest-VolumesActionsTest-802949502 tempest-VolumesActionsTest-802949502-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102993) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:35:29.385762 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-0dd2099d-660f-4965-ac80-0eb31424d834 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=102992) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:35:29.386356 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [None req-0dd2099d-660f-4965-ac80-0eb31424d834 admin admin] Publish callbacks [] for subnet, before_response {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:35:29.386741 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-764b04dc-c788-4855-a665-a0100817ff65 req-b56bcbcf-121f-4552-a471-a78d026aea98 tempest-VolumesActionsTest-802949502 tempest-VolumesActionsTest-802949502-project] 10.222.0.62 "GET /v2.0/ports?device_id=fa2c753c-e8ba-46c8-8c59-7a35f6357117 HTTP/1.1" status: 200 len: 944 time: 0.0570140 Nov 23 19:35:29.427138 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron_lib.callbacks.manager [None req-4bf48ff4-ecfb-4168-8b63-249b8c6e9f04 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7918660', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-15067', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560168', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8783631423946', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8783631008732', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8783631008750'] for port, after_update {{(pid=102994) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:35:29.439893 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-764b04dc-c788-4855-a665-a0100817ff65 req-d5078ac9-6f09-4284-b3e0-4b9e6556ec83 tempest-VolumesActionsTest-802949502 tempest-VolumesActionsTest-802949502-project] 10.222.0.62 "GET /v2.0/security-groups?id=47acb13d-cf9a-4dd6-a614-503b94072f69&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0458164 Nov 23 19:35:29.481679 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'fa2c753c-e8ba-46c8-8c59-7a35f6357117', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '8a6b6382-0b2a-4cc0-9d38-21f83a9faa3b'}] {{(pid=102994) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 23 19:35:29.483898 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.62/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}09a7511da0d2ba1d728b27e36a8467ec5289399952f0059588048a7cb66d3a43" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-62aac5c3-0bad-45f2-83fd-962caf366975" -d '{"events": [{"server_uuid": "fa2c753c-e8ba-46c8-8c59-7a35f6357117", "name": "network-vif-plugged", "status": "completed", "tag": "8a6b6382-0b2a-4cc0-9d38-21f83a9faa3b"}]}' {{(pid=102994) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 23 19:35:29.503578 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4bf48ff4-ecfb-4168-8b63-249b8c6e9f04 None None] Pushing event updated for resources: {'Port': ['ID=8a6b6382-0b2a-4cc0-9d38-21f83a9faa3b,revision_number=5']} {{(pid=102994) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 23 19:35:29.513646 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [None req-0dd2099d-660f-4965-ac80-0eb31424d834 admin admin] 10.222.0.62 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 846 time: 0.7784770 Nov 23 19:35:29.514868 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.wsgi [-] (102992) accepted ('10.222.0.62', 45276) {{(pid=102992) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 23 19:35:29.520250 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.api.v2.base [None req-e0f6e71e-d699-4723-bcc3-c38e661cac2f admin admin] Request body: {'router': {'name': 'tempest-TestVolumeBootPattern-84632531-router', 'tenant_id': '257b0b2e531441b4bb745e99cfd799f3', 'external_gateway_info': {'network_id': 'a93e254e-aac9-4233-9e4d-4290fd0458e4'}}} {{(pid=102992) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 23 19:35:29.635401 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [None req-e0f6e71e-d699-4723-bcc3-c38e661cac2f admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-933550', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-13503'] for router, before_create {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:35:29.636622 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [None req-e0f6e71e-d699-4723-bcc3-c38e661cac2f admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-933038', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-927700', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-622769', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-13448'] for router, precommit_create {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:35:29.666432 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 23 Nov 2021 19:35:29 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-18fd93dd-95d7-4850-a274-e468f9f66122 x-openstack-request-id: req-18fd93dd-95d7-4850-a274-e468f9f66122 {{(pid=102994) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 23 19:35:29.666758 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "fa2c753c-e8ba-46c8-8c59-7a35f6357117", "name": "network-vif-plugged", "status": "completed", "tag": "8a6b6382-0b2a-4cc0-9d38-21f83a9faa3b", "code": 200}]} {{(pid=102994) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 23 19:35:29.667012 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.62/compute/v2.1/os-server-external-events used request id req-18fd93dd-95d7-4850-a274-e468f9f66122 {{(pid=102994) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 23 19:35:29.667503 dv-cinder-819011-1-iscsi neutron-server[102994]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'fa2c753c-e8ba-46c8-8c59-7a35f6357117', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '8a6b6382-0b2a-4cc0-9d38-21f83a9faa3b', 'code': 200} Nov 23 19:35:29.688229 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [None req-e0f6e71e-d699-4723-bcc3-c38e661cac2f admin admin] Publish callbacks [] for router_controller, precommit_add_association {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:35:29.714216 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-36054576-150b-45f4-ba72-3fec1074ecad None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp8353ff9b-e01d-5e31-ab2d-60a764783255-226a519f-5f3e-4d80-bb8a-0e9fc4f64828', 'network_id': '226a519f-5f3e-4d80-bb8a-0e9fc4f64828', 'tenant_id': '257b0b2e531441b4bb745e99cfd799f3', 'fixed_ips': [{'subnet_id': '88de785d-c540-4651-af1e-26f27ccaee3c'}]}} from dv-cinder-819011-1-iscsi. {{(pid=102994) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:285}} Nov 23 19:35:29.715097 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron_lib.callbacks.manager [None req-36054576-150b-45f4-ba72-3fec1074ecad None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7921281'] for port, before_create {{(pid=102994) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:35:29.862889 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.db.db_base_plugin_common [None req-36054576-150b-45f4-ba72-3fec1074ecad None None] Allocated IP 172.20.0.2 (226a519f-5f3e-4d80-bb8a-0e9fc4f64828/88de785d-c540-4651-af1e-26f27ccaee3c/1e712a26-63c0-453b-8510-11be3fce9e06) {{(pid=102994) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 23 19:35:29.949178 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [None req-e0f6e71e-d699-4723-bcc3-c38e661cac2f admin admin] Publish callbacks [] for router_gateway, precommit_update {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:35:29.964804 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c634f847-98a9-45a1-a8af-1775ec9fca13 req-ba364ddc-473c-4fcc-a1ea-06d3929c6129 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102992) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:35:29.966714 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-c634f847-98a9-45a1-a8af-1775ec9fca13 req-ba364ddc-473c-4fcc-a1ea-06d3929c6129 service neutron] 10.222.0.41 "GET /v2.0/ports?device_id=fa2c753c-e8ba-46c8-8c59-7a35f6357117 HTTP/1.1" status: 200 len: 1098 time: 0.0724113 Nov 23 19:35:30.018869 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-121ebc22-addf-477d-99ea-5d2a8ae67eb3 req-bc7d4c13-1b9e-4a17-a0bb-ca667fb45b7b tempest-VolumesSnapshotTestJSON-97879810 tempest-VolumesSnapshotTestJSON-97879810-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102993) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:35:30.019473 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-c634f847-98a9-45a1-a8af-1775ec9fca13 req-88bc7cf3-1b43-44e4-83c3-16fd9be1a1d8 service neutron] 10.222.0.41 "GET /v2.0/security-groups?id=47acb13d-cf9a-4dd6-a614-503b94072f69&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0432253 Nov 23 19:35:30.020527 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron_lib.callbacks.manager [None req-36054576-150b-45f4-ba72-3fec1074ecad None None] Publish callbacks [] for port, precommit_create {{(pid=102994) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:35:30.020890 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-121ebc22-addf-477d-99ea-5d2a8ae67eb3 req-bc7d4c13-1b9e-4a17-a0bb-ca667fb45b7b tempest-VolumesSnapshotTestJSON-97879810 tempest-VolumesSnapshotTestJSON-97879810-project] 10.222.0.62 "GET /v2.0/ports?device_id=d8c269ba-e8f8-4705-a5a5-fbfbb498151f HTTP/1.1" status: 200 len: 945 time: 0.0534599 Nov 23 19:35:30.076235 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-121ebc22-addf-477d-99ea-5d2a8ae67eb3 req-56ca798f-dea6-4cfa-9a8e-d976e0886aae tempest-VolumesSnapshotTestJSON-97879810 tempest-VolumesSnapshotTestJSON-97879810-project] 10.222.0.62 "GET /v2.0/security-groups?id=2fd4bf42-f1cd-4ab5-94a3-e2347f7bb016&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0480237 Nov 23 19:35:30.115638 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron_lib.callbacks.manager [None req-36054576-150b-45f4-ba72-3fec1074ecad None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7918660', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-15067', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560168', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8783631008714'] for port, after_create {{(pid=102994) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:35:30.163598 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-36054576-150b-45f4-ba72-3fec1074ecad None None] Network 226a519f-5f3e-4d80-bb8a-0e9fc4f64828 is already hosted by enough agents. {{(pid=102994) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 23 19:35:30.168285 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.scheduler.base_scheduler [None req-36054576-150b-45f4-ba72-3fec1074ecad None None] Resources bound (agent type, host, resource id): {{(pid=102994) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 23 19:35:30.173128 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.db.l3_dvrscheduler_db [None req-36054576-150b-45f4-ba72-3fec1074ecad None None] Received port after_create {{(pid=102994) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 23 19:35:30.175510 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-36054576-150b-45f4-ba72-3fec1074ecad None None] Pushing event updated for resources: {'Port': ['ID=1e712a26-63c0-453b-8510-11be3fce9e06,revision_number=1']} {{(pid=102994) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 23 19:35:30.232483 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.plugins.ml2.managers [None req-36054576-150b-45f4-ba72-3fec1074ecad None None] Attempting to bind port 1e712a26-63c0-453b-8510-11be3fce9e06 on host dv-cinder-819011-1-iscsi for vnic_type normal with profile {{(pid=102994) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 23 19:35:30.232948 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.plugins.ml2.managers [None req-36054576-150b-45f4-ba72-3fec1074ecad None None] Attempting to bind port 1e712a26-63c0-453b-8510-11be3fce9e06 by drivers openvswitch,hyperv on host dv-cinder-819011-1-iscsi at level 0 using segments [{'id': '56316385-5b81-43f5-84db-b708b46f04eb', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 800, 'network_id': '226a519f-5f3e-4d80-bb8a-0e9fc4f64828'}] {{(pid=102994) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 23 19:35:30.233852 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-36054576-150b-45f4-ba72-3fec1074ecad None None] Attempting to bind port 1e712a26-63c0-453b-8510-11be3fce9e06 on network 226a519f-5f3e-4d80-bb8a-0e9fc4f64828 {{(pid=102994) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 23 19:35:30.241128 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-36054576-150b-45f4-ba72-3fec1074ecad None None] Checking agent: {'id': '668c8953-047c-499e-8c0d-db838fac1668', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-819011-1-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 23, 19, 25, 17), 'started_at': datetime.datetime(2021, 11, 23, 19, 25, 47), 'heartbeat_timestamp': datetime.datetime(2021, 11, 23, 19, 35, 17), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-819011-1-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=102994) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 23 19:35:30.241436 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-36054576-150b-45f4-ba72-3fec1074ecad None None] Checking segment: {'id': '56316385-5b81-43f5-84db-b708b46f04eb', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 800, 'network_id': '226a519f-5f3e-4d80-bb8a-0e9fc4f64828'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102994) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 23 19:35:30.242029 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron_lib.callbacks.manager [None req-36054576-150b-45f4-ba72-3fec1074ecad None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=102994) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:35:30.242437 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-36054576-150b-45f4-ba72-3fec1074ecad None None] Bound using segment: {'id': '56316385-5b81-43f5-84db-b708b46f04eb', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 800, 'network_id': '226a519f-5f3e-4d80-bb8a-0e9fc4f64828'} {{(pid=102994) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 23 19:35:30.242988 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.plugins.ml2.managers [None req-36054576-150b-45f4-ba72-3fec1074ecad None None] Bound port: 1e712a26-63c0-453b-8510-11be3fce9e06, host: dv-cinder-819011-1-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '56316385-5b81-43f5-84db-b708b46f04eb', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 800, 'network_id': '226a519f-5f3e-4d80-bb8a-0e9fc4f64828'}}] {{(pid=102994) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 23 19:35:30.243540 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron_lib.callbacks.manager [None req-36054576-150b-45f4-ba72-3fec1074ecad None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7921281'] for port, before_update {{(pid=102994) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:35:30.321204 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.plugins.ml2.db [None req-36054576-150b-45f4-ba72-3fec1074ecad None None] For port 1e712a26-63c0-453b-8510-11be3fce9e06, host dv-cinder-819011-1-iscsi, cleared binding levels {{(pid=102994) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 23 19:35:30.324964 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.plugins.ml2.db [None req-36054576-150b-45f4-ba72-3fec1074ecad None None] For port 1e712a26-63c0-453b-8510-11be3fce9e06, host dv-cinder-819011-1-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-819011-1-iscsi',level=0,port_id=1e712a26-63c0-453b-8510-11be3fce9e06,segment=NetworkSegment(56316385-5b81-43f5-84db-b708b46f04eb),segment_id=56316385-5b81-43f5-84db-b708b46f04eb)] {{(pid=102994) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 23 19:35:30.329925 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8a368092-39bc-4532-8c6c-c57dc27490f0 req-645fa3b5-09b3-47bd-8235-0c3fd199d892 tempest-AttachVolumeShelveTestJSON-1172915835 tempest-AttachVolumeShelveTestJSON-1172915835-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102992) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:35:30.335816 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-8a368092-39bc-4532-8c6c-c57dc27490f0 req-645fa3b5-09b3-47bd-8235-0c3fd199d892 tempest-AttachVolumeShelveTestJSON-1172915835 tempest-AttachVolumeShelveTestJSON-1172915835-project] 10.222.0.62 "GET /v2.0/ports?device_id=85ea3d72-6c17-4ea2-82b7-90cce01633bd HTTP/1.1" status: 200 len: 945 time: 0.0939054 Nov 23 19:35:30.335816 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [None req-e0f6e71e-d699-4723-bcc3-c38e661cac2f admin admin] Publish callbacks [] for router_gateway, before_create {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:35:30.355585 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [None req-e0f6e71e-d699-4723-bcc3-c38e661cac2f admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7921281'] for port, before_create {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:35:30.424912 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron_lib.callbacks.manager [None req-36054576-150b-45f4-ba72-3fec1074ecad None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7918660', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-15067', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560168', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8783631423946', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8783631008732', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8783631008750'] for port, after_update {{(pid=102994) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:35:30.444580 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-8a368092-39bc-4532-8c6c-c57dc27490f0 req-eb6db9f2-6e6e-4994-898e-d135af6083e8 tempest-AttachVolumeShelveTestJSON-1172915835 tempest-AttachVolumeShelveTestJSON-1172915835-project] 10.222.0.62 "GET /v2.0/security-groups?id=f1ca24d9-0a31-470d-a1d5-fa7059df0141&fields=id&fields=name HTTP/1.1" status: 200 len: 311 time: 0.0905099 Nov 23 19:35:30.496368 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-36054576-150b-45f4-ba72-3fec1074ecad None None] Pushing event updated for resources: {'Port': ['ID=1e712a26-63c0-453b-8510-11be3fce9e06,revision_number=2']} {{(pid=102994) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 23 19:35:30.510180 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.db.db_base_plugin_common [None req-e0f6e71e-d699-4723-bcc3-c38e661cac2f admin admin] Allocated IP 172.27.1.154 (a93e254e-aac9-4233-9e4d-4290fd0458e4/e0b32f3d-83d6-439a-bbed-01df7cf01051/c7996293-6188-4690-b614-395448e4dc25) {{(pid=102992) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 23 19:35:30.576731 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3ba369eb-6e40-4936-bd89-d69d6f95ef37 req-37fd28f5-1bdf-4526-972b-4cb52072e09a tempest-VolumesActionsTest-802949502 tempest-VolumesActionsTest-802949502-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102993) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:35:30.578496 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-3ba369eb-6e40-4936-bd89-d69d6f95ef37 req-37fd28f5-1bdf-4526-972b-4cb52072e09a tempest-VolumesActionsTest-802949502 tempest-VolumesActionsTest-802949502-project] 10.222.0.62 "GET /v2.0/ports?device_id=fa2c753c-e8ba-46c8-8c59-7a35f6357117 HTTP/1.1" status: 200 len: 945 time: 0.0612583 Nov 23 19:35:30.631722 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [None req-e0f6e71e-d699-4723-bcc3-c38e661cac2f admin admin] Publish callbacks [] for port, precommit_create {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:35:30.638385 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-3ba369eb-6e40-4936-bd89-d69d6f95ef37 req-c7e87f72-e30d-433f-bdde-5a8f36e3b084 tempest-VolumesActionsTest-802949502 tempest-VolumesActionsTest-802949502-project] 10.222.0.62 "GET /v2.0/security-groups?id=47acb13d-cf9a-4dd6-a614-503b94072f69&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0470674 Nov 23 19:35:30.755852 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [None req-e0f6e71e-d699-4723-bcc3-c38e661cac2f admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7918660', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-15067', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560168', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8783631008714', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-25199805'] for port, after_create {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:35:30.812166 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-e0f6e71e-d699-4723-bcc3-c38e661cac2f admin admin] Network a93e254e-aac9-4233-9e4d-4290fd0458e4 is already hosted by enough agents. {{(pid=102992) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 23 19:35:30.815744 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.scheduler.base_scheduler [None req-e0f6e71e-d699-4723-bcc3-c38e661cac2f admin admin] Resources bound (agent type, host, resource id): {{(pid=102992) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 23 19:35:30.820479 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.db.l3_dvrscheduler_db [None req-e0f6e71e-d699-4723-bcc3-c38e661cac2f admin admin] Received port after_create {{(pid=102992) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 23 19:35:30.825613 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e0f6e71e-d699-4723-bcc3-c38e661cac2f admin admin] Pushing event updated for resources: {'Port': ['ID=c7996293-6188-4690-b614-395448e4dc25,revision_number=1']} {{(pid=102992) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 23 19:35:31.387548 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [None req-e0f6e71e-d699-4723-bcc3-c38e661cac2f admin admin] Publish callbacks [] for router_gateway, after_create {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:35:31.476490 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-b1f15733-1402-4b46-a783-50c913ff6a1e None None] Network 226a519f-5f3e-4d80-bb8a-0e9fc4f64828 requested from dv-cinder-819011-1-iscsi {{(pid=102994) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 23 19:35:31.585171 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.db.provisioning_blocks [None req-039c4227-a1b9-41fb-aa1c-27a6fbbab76c None None] Provisioning complete for port 1e712a26-63c0-453b-8510-11be3fce9e06 triggered by entity DHCP. {{(pid=102994) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 23 19:35:31.585640 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron_lib.callbacks.manager [None req-039c4227-a1b9-41fb-aa1c-27a6fbbab76c None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-8355713'] for port, provisioning_complete {{(pid=102994) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:35:31.644525 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ee50dcc7-61ff-40bc-b0e8-ecb62fd14691 req-560d7ba8-d08f-477a-a9f0-1c64264e212a tempest-AttachVolumeShelveTestJSON-1172915835 tempest-AttachVolumeShelveTestJSON-1172915835-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102992) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:35:31.645970 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-ee50dcc7-61ff-40bc-b0e8-ecb62fd14691 req-560d7ba8-d08f-477a-a9f0-1c64264e212a tempest-AttachVolumeShelveTestJSON-1172915835 tempest-AttachVolumeShelveTestJSON-1172915835-project] 10.222.0.62 "GET /v2.0/ports?device_id=85ea3d72-6c17-4ea2-82b7-90cce01633bd HTTP/1.1" status: 200 len: 945 time: 0.1035776 Nov 23 19:35:31.685960 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [None req-e0f6e71e-d699-4723-bcc3-c38e661cac2f admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-932875', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-926501'] for router, after_create {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:35:31.719791 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron_lib.callbacks.manager [None req-039c4227-a1b9-41fb-aa1c-27a6fbbab76c None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7921281'] for port, before_update {{(pid=102994) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:35:31.751167 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-ee50dcc7-61ff-40bc-b0e8-ecb62fd14691 req-760fb286-a39c-42a0-8b08-86c45e06917d tempest-AttachVolumeShelveTestJSON-1172915835 tempest-AttachVolumeShelveTestJSON-1172915835-project] 10.222.0.62 "GET /v2.0/security-groups?id=f1ca24d9-0a31-470d-a1d5-fa7059df0141&fields=id&fields=name HTTP/1.1" status: 200 len: 311 time: 0.0968082 Nov 23 19:35:31.776589 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.plugins.ml2.db [None req-039c4227-a1b9-41fb-aa1c-27a6fbbab76c None None] For port 1e712a26-63c0-453b-8510-11be3fce9e06, host dv-cinder-819011-1-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-819011-1-iscsi',level=0,port_id=1e712a26-63c0-453b-8510-11be3fce9e06,segment=NetworkSegment(56316385-5b81-43f5-84db-b708b46f04eb),segment_id=56316385-5b81-43f5-84db-b708b46f04eb)] {{(pid=102994) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 23 19:35:31.794682 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8d3d1c88-27fd-4601-bb9b-8f05cd152a67 req-1e6f06f0-a913-47ea-8096-e0520a752141 tempest-VolumesActionsTest-802949502 tempest-VolumesActionsTest-802949502-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102993) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:35:31.797001 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-8d3d1c88-27fd-4601-bb9b-8f05cd152a67 req-1e6f06f0-a913-47ea-8096-e0520a752141 tempest-VolumesActionsTest-802949502 tempest-VolumesActionsTest-802949502-project] 10.222.0.62 "GET /v2.0/ports?device_id=fa2c753c-e8ba-46c8-8c59-7a35f6357117 HTTP/1.1" status: 200 len: 945 time: 0.0681648 Nov 23 19:35:31.835501 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron_lib.callbacks.manager [None req-039c4227-a1b9-41fb-aa1c-27a6fbbab76c None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7918660', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-15067', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560168', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8783631423946', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8783631008732', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8783631008750'] for port, after_update {{(pid=102994) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:35:31.888775 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-8d3d1c88-27fd-4601-bb9b-8f05cd152a67 req-bf8b6e1e-012a-4dc4-b4e2-0b0152840c54 tempest-VolumesActionsTest-802949502 tempest-VolumesActionsTest-802949502-project] 10.222.0.62 "GET /v2.0/security-groups?id=47acb13d-cf9a-4dd6-a614-503b94072f69&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0850427 Nov 23 19:35:31.952702 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-039c4227-a1b9-41fb-aa1c-27a6fbbab76c None None] Pushing event updated for resources: {'Port': ['ID=1e712a26-63c0-453b-8510-11be3fce9e06,revision_number=3']} {{(pid=102994) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 23 19:35:31.961009 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-e0f6e71e-d699-4723-bcc3-c38e661cac2f admin admin] Router 0534bcc4-1e12-4026-90ce-1406543c7662 is scheduled to L3 agent 1b20f2c4-70b6-43c3-b9bd-0062cc9e57ac with binding_index 1 {{(pid=102992) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Nov 23 19:35:31.994478 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.plugins.ml2.rpc [None req-eb87b2c3-3339-4249-8b85-e695b5b4e1f9 None None] Device 1e712a26-63c0-453b-8510-11be3fce9e06 up at agent ovs-agent-dv-cinder-819011-1-iscsi {{(pid=102994) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 23 19:35:32.066463 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.db.provisioning_blocks [None req-61c4c138-e6b5-4e48-8144-1fc3f463af5e None None] Provisioning complete for port 1e712a26-63c0-453b-8510-11be3fce9e06 triggered by entity DHCP. {{(pid=102994) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 23 19:35:32.066846 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron_lib.callbacks.manager [None req-61c4c138-e6b5-4e48-8144-1fc3f463af5e None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-8355713'] for port, provisioning_complete {{(pid=102994) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:35:32.072512 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.db.provisioning_blocks [None req-eb87b2c3-3339-4249-8b85-e695b5b4e1f9 None None] Provisioning complete for port 1e712a26-63c0-453b-8510-11be3fce9e06 triggered by entity L2. {{(pid=102994) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 23 19:35:32.072877 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron_lib.callbacks.manager [None req-eb87b2c3-3339-4249-8b85-e695b5b4e1f9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-8355713'] for port, provisioning_complete {{(pid=102994) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:35:32.089598 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-e0f6e71e-d699-4723-bcc3-c38e661cac2f admin admin] Notify agent at l3_agent.dv-cinder-819011-1-iscsi the message routers_updated {{(pid=102992) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 23 19:35:32.098925 dv-cinder-819011-1-iscsi neutron-server[102995]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-7295d65a-e598-4d9a-99a2-1ff43d879727 None None] Sync routers for ids ['0534bcc4-1e12-4026-90ce-1406543c7662'] in dv-cinder-819011-1-iscsi {{(pid=102995) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 23 19:35:32.109165 dv-cinder-819011-1-iscsi neutron-server[102995]: DEBUG neutron.db.l3_dvrscheduler_db [None req-7295d65a-e598-4d9a-99a2-1ff43d879727 None None] Routers {'0534bcc4-1e12-4026-90ce-1406543c7662'} bound to L3 agent in host dv-cinder-819011-1-iscsi {{(pid=102995) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 23 19:35:32.109766 dv-cinder-819011-1-iscsi neutron-server[102995]: DEBUG neutron.db.l3_hamode_db [None req-7295d65a-e598-4d9a-99a2-1ff43d879727 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-819011-1-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-23T19:25:14Z,description=,heartbeat_timestamp=2021-11-23T19:35:14Z,host='dv-cinder-819011-1-iscsi',id=1b20f2c4-70b6-43c3-b9bd-0062cc9e57ac,load=0,resource_versions=,resources_synced=,started_at=2021-11-23T19:25:15Z,topic='l3_agent')) {'router_ids': ['0534bcc4-1e12-4026-90ce-1406543c7662'], 'active': True} {{(pid=102995) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 23 19:35:32.179768 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [None req-e0f6e71e-d699-4723-bcc3-c38e661cac2f admin admin] Publish callbacks [] for router, before_response {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:35:32.181298 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [None req-e0f6e71e-d699-4723-bcc3-c38e661cac2f admin admin] 10.222.0.62 "POST /v2.0/routers HTTP/1.1" status: 201 len: 922 time: 2.6653428 Nov 23 19:35:32.184150 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.wsgi [-] (102992) accepted ('10.222.0.62', 45366) {{(pid=102992) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 23 19:35:32.233851 dv-cinder-819011-1-iscsi neutron-server[102995]: DEBUG neutron.db.l3_dvr_db [None req-7295d65a-e598-4d9a-99a2-1ff43d879727 None None] Set router 0534bcc4-1e12-4026-90ce-1406543c7662 gateway port host: dv-cinder-819011-1-iscsi {{(pid=102995) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 23 19:35:32.435816 dv-cinder-819011-1-iscsi neutron-server[102995]: DEBUG neutron.db.l3_hamode_db [None req-7295d65a-e598-4d9a-99a2-1ff43d879727 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '0534bcc4-1e12-4026-90ce-1406543c7662', 'name': 'tempest-TestVolumeBootPattern-84632531-router', 'tenant_id': '257b0b2e531441b4bb745e99cfd799f3', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'a93e254e-aac9-4233-9e4d-4290fd0458e4', 'external_fixed_ips': [{'subnet_id': 'e0b32f3d-83d6-439a-bbed-01df7cf01051', 'ip_address': '172.27.1.154'}], 'enable_snat': True}, 'gw_port_id': 'c7996293-6188-4690-b614-395448e4dc25', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-23T19:35:29Z', 'updated_at': '2021-11-23T19:35:30Z', 'revision_number': 3, 'project_id': '257b0b2e531441b4bb745e99cfd799f3', 'gw_port': {'id': 'c7996293-6188-4690-b614-395448e4dc25', 'name': '', 'network_id': 'a93e254e-aac9-4233-9e4d-4290fd0458e4', 'tenant_id': '', 'mac_address': 'fa:16:3e:52:67:5e', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '0534bcc4-1e12-4026-90ce-1406543c7662', 'device_owner': 'network:router_gateway', 'standard_attr_id': 392, 'fixed_ips': [{'subnet_id': 'e0b32f3d-83d6-439a-bbed-01df7cf01051', 'ip_address': '172.27.1.154', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-23T19:35:30Z', 'updated_at': '2021-11-23T19:35:30Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': 'e0b32f3d-83d6-439a-bbed-01df7cf01051', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-819011-1-iscsi'}], 'dv-cinder-819011-1-iscsi', False) {} {{(pid=102995) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 23 19:35:32.464484 dv-cinder-819011-1-iscsi neutron-server[102995]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-7295d65a-e598-4d9a-99a2-1ff43d879727 None None] Checking router: 0534bcc4-1e12-4026-90ce-1406543c7662 for host: dv-cinder-819011-1-iscsi {{(pid=102995) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 23 19:35:32.468689 dv-cinder-819011-1-iscsi neutron-server[102995]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-7295d65a-e598-4d9a-99a2-1ff43d879727 None None] Updating router 0534bcc4-1e12-4026-90ce-1406543c7662 port c7996293-6188-4690-b614-395448e4dc25 binding host dv-cinder-819011-1-iscsi {{(pid=102995) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Nov 23 19:35:32.507908 dv-cinder-819011-1-iscsi neutron-server[102995]: DEBUG neutron_lib.callbacks.manager [None req-7295d65a-e598-4d9a-99a2-1ff43d879727 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7921281'] for port, before_update {{(pid=102995) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:35:32.668523 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [None req-8fb19c2f-c4d1-4b35-aafc-c624362c0101 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7921281'] for port, before_create {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:35:32.802005 dv-cinder-819011-1-iscsi neutron-server[102995]: DEBUG neutron_lib.callbacks.manager [None req-7295d65a-e598-4d9a-99a2-1ff43d879727 None None] Publish callbacks [] for port, precommit_update {{(pid=102995) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:35:32.840089 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.db.db_base_plugin_common [None req-8fb19c2f-c4d1-4b35-aafc-c624362c0101 admin admin] Allocated IP 172.20.0.1 (226a519f-5f3e-4d80-bb8a-0e9fc4f64828/88de785d-c540-4651-af1e-26f27ccaee3c/854821af-61e0-47e7-a603-95f500a49030) {{(pid=102992) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 23 19:35:32.870005 dv-cinder-819011-1-iscsi neutron-server[102995]: DEBUG neutron_lib.callbacks.manager [None req-7295d65a-e598-4d9a-99a2-1ff43d879727 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7918660', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-15067', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560168', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8783631423946', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8783631008732', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8783631008750'] for port, after_update {{(pid=102995) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:35:32.913205 dv-cinder-819011-1-iscsi neutron-server[102995]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ea1a9867-7e40-4ddc-99bf-75e5332dabfc None None] Pushing event updated for resources: {'Port': ['ID=c7996293-6188-4690-b614-395448e4dc25,revision_number=2']} {{(pid=102995) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 23 19:35:32.921752 dv-cinder-819011-1-iscsi neutron-server[102995]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ea1a9867-7e40-4ddc-99bf-75e5332dabfc None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-819011-1-iscsi {{(pid=102995) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 23 19:35:32.922960 dv-cinder-819011-1-iscsi neutron-server[102995]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ea1a9867-7e40-4ddc-99bf-75e5332dabfc None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-819011-1-iscsi {{(pid=102995) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 23 19:35:32.922960 dv-cinder-819011-1-iscsi neutron-server[102995]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ea1a9867-7e40-4ddc-99bf-75e5332dabfc None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-819011-1-iscsi {{(pid=102995) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 23 19:35:32.922960 dv-cinder-819011-1-iscsi neutron-server[102995]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ea1a9867-7e40-4ddc-99bf-75e5332dabfc None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-819011-1-iscsi {{(pid=102995) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 23 19:35:32.923248 dv-cinder-819011-1-iscsi neutron-server[102995]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ea1a9867-7e40-4ddc-99bf-75e5332dabfc None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-819011-1-iscsi {{(pid=102995) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 23 19:35:32.923811 dv-cinder-819011-1-iscsi neutron-server[102995]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ea1a9867-7e40-4ddc-99bf-75e5332dabfc None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-819011-1-iscsi {{(pid=102995) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 23 19:35:32.923811 dv-cinder-819011-1-iscsi neutron-server[102995]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ea1a9867-7e40-4ddc-99bf-75e5332dabfc None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-819011-1-iscsi {{(pid=102995) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 23 19:35:32.924789 dv-cinder-819011-1-iscsi neutron-server[102995]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ea1a9867-7e40-4ddc-99bf-75e5332dabfc None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-819011-1-iscsi {{(pid=102995) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 23 19:35:32.925165 dv-cinder-819011-1-iscsi neutron-server[102995]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ea1a9867-7e40-4ddc-99bf-75e5332dabfc None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-819011-1-iscsi {{(pid=102995) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 23 19:35:32.926253 dv-cinder-819011-1-iscsi neutron-server[102995]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ea1a9867-7e40-4ddc-99bf-75e5332dabfc None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-819011-1-iscsi {{(pid=102995) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 23 19:35:32.926253 dv-cinder-819011-1-iscsi neutron-server[102995]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ea1a9867-7e40-4ddc-99bf-75e5332dabfc None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-819011-1-iscsi {{(pid=102995) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 23 19:35:32.926253 dv-cinder-819011-1-iscsi neutron-server[102995]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ea1a9867-7e40-4ddc-99bf-75e5332dabfc None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-819011-1-iscsi {{(pid=102995) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 23 19:35:32.961342 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-354078f0-020d-4fb1-abf5-4ecaf89bcd91 req-5bdaa9ab-5525-44d8-b5c6-e6d2aeefc826 tempest-AttachVolumeShelveTestJSON-1172915835 tempest-AttachVolumeShelveTestJSON-1172915835-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102992) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:35:32.963088 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-354078f0-020d-4fb1-abf5-4ecaf89bcd91 req-5bdaa9ab-5525-44d8-b5c6-e6d2aeefc826 tempest-AttachVolumeShelveTestJSON-1172915835 tempest-AttachVolumeShelveTestJSON-1172915835-project] 10.222.0.62 "GET /v2.0/ports?device_id=85ea3d72-6c17-4ea2-82b7-90cce01633bd HTTP/1.1" status: 200 len: 945 time: 0.1127794 Nov 23 19:35:32.991140 dv-cinder-819011-1-iscsi neutron-server[102995]: DEBUG neutron.plugins.ml2.managers [None req-7295d65a-e598-4d9a-99a2-1ff43d879727 None None] Attempting to bind port c7996293-6188-4690-b614-395448e4dc25 on host dv-cinder-819011-1-iscsi for vnic_type normal with profile {{(pid=102995) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 23 19:35:32.991527 dv-cinder-819011-1-iscsi neutron-server[102995]: DEBUG neutron.plugins.ml2.managers [None req-7295d65a-e598-4d9a-99a2-1ff43d879727 None None] Attempting to bind port c7996293-6188-4690-b614-395448e4dc25 by drivers openvswitch,hyperv on host dv-cinder-819011-1-iscsi at level 0 using segments [{'id': '3cb5e60b-103a-47d0-a28b-d68e3159d032', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'a93e254e-aac9-4233-9e4d-4290fd0458e4'}] {{(pid=102995) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 23 19:35:32.991901 dv-cinder-819011-1-iscsi neutron-server[102995]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-7295d65a-e598-4d9a-99a2-1ff43d879727 None None] Attempting to bind port c7996293-6188-4690-b614-395448e4dc25 on network a93e254e-aac9-4233-9e4d-4290fd0458e4 {{(pid=102995) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 23 19:35:32.999509 dv-cinder-819011-1-iscsi neutron-server[102995]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-7295d65a-e598-4d9a-99a2-1ff43d879727 None None] Checking agent: {'id': '668c8953-047c-499e-8c0d-db838fac1668', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-819011-1-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 23, 19, 25, 17), 'started_at': datetime.datetime(2021, 11, 23, 19, 25, 47), 'heartbeat_timestamp': datetime.datetime(2021, 11, 23, 19, 35, 17), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-819011-1-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=102995) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 23 19:35:32.999509 dv-cinder-819011-1-iscsi neutron-server[102995]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-7295d65a-e598-4d9a-99a2-1ff43d879727 None None] Checking segment: {'id': '3cb5e60b-103a-47d0-a28b-d68e3159d032', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'a93e254e-aac9-4233-9e4d-4290fd0458e4'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102995) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 23 19:35:32.999509 dv-cinder-819011-1-iscsi neutron-server[102995]: DEBUG neutron_lib.callbacks.manager [None req-7295d65a-e598-4d9a-99a2-1ff43d879727 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=102995) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:35:32.999509 dv-cinder-819011-1-iscsi neutron-server[102995]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-7295d65a-e598-4d9a-99a2-1ff43d879727 None None] Bound using segment: {'id': '3cb5e60b-103a-47d0-a28b-d68e3159d032', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'a93e254e-aac9-4233-9e4d-4290fd0458e4'} {{(pid=102995) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 23 19:35:32.999976 dv-cinder-819011-1-iscsi neutron-server[102995]: DEBUG neutron.plugins.ml2.managers [None req-7295d65a-e598-4d9a-99a2-1ff43d879727 None None] Bound port: c7996293-6188-4690-b614-395448e4dc25, host: dv-cinder-819011-1-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '3cb5e60b-103a-47d0-a28b-d68e3159d032', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'a93e254e-aac9-4233-9e4d-4290fd0458e4'}}] {{(pid=102995) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 23 19:35:33.000081 dv-cinder-819011-1-iscsi neutron-server[102995]: DEBUG neutron_lib.callbacks.manager [None req-7295d65a-e598-4d9a-99a2-1ff43d879727 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7921281'] for port, before_update {{(pid=102995) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:35:33.031828 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-354078f0-020d-4fb1-abf5-4ecaf89bcd91 req-13e63f72-20d7-4935-83ce-d3afb6a7ccd3 tempest-AttachVolumeShelveTestJSON-1172915835 tempest-AttachVolumeShelveTestJSON-1172915835-project] 10.222.0.62 "GET /v2.0/security-groups?id=f1ca24d9-0a31-470d-a1d5-fa7059df0141&fields=id&fields=name HTTP/1.1" status: 200 len: 311 time: 0.0614424 Nov 23 19:35:33.048087 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [None req-8fb19c2f-c4d1-4b35-aafc-c624362c0101 admin admin] Publish callbacks [] for port, precommit_create {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:35:33.057775 dv-cinder-819011-1-iscsi neutron-server[102995]: DEBUG neutron.plugins.ml2.db [None req-7295d65a-e598-4d9a-99a2-1ff43d879727 None None] For port c7996293-6188-4690-b614-395448e4dc25, host dv-cinder-819011-1-iscsi, cleared binding levels {{(pid=102995) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 23 19:35:33.061080 dv-cinder-819011-1-iscsi neutron-server[102995]: DEBUG neutron.plugins.ml2.db [None req-7295d65a-e598-4d9a-99a2-1ff43d879727 None None] For port c7996293-6188-4690-b614-395448e4dc25, host dv-cinder-819011-1-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-819011-1-iscsi',level=0,port_id=c7996293-6188-4690-b614-395448e4dc25,segment=NetworkSegment(3cb5e60b-103a-47d0-a28b-d68e3159d032),segment_id=3cb5e60b-103a-47d0-a28b-d68e3159d032)] {{(pid=102995) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 23 19:35:33.132920 dv-cinder-819011-1-iscsi neutron-server[102995]: DEBUG neutron_lib.callbacks.manager [None req-7295d65a-e598-4d9a-99a2-1ff43d879727 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7918660', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-15067', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560168', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8783631423946', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8783631008732', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8783631008750'] for port, after_update {{(pid=102995) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:35:33.155824 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [None req-8fb19c2f-c4d1-4b35-aafc-c624362c0101 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7918660', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-15067', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560168', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8783631008714', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-25199805'] for port, after_create {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:35:33.185581 dv-cinder-819011-1-iscsi neutron-server[102995]: DEBUG neutron.db.l3_dvrscheduler_db [None req-7295d65a-e598-4d9a-99a2-1ff43d879727 None None] Routers {'0534bcc4-1e12-4026-90ce-1406543c7662'} bound to L3 agent in host dv-cinder-819011-1-iscsi {{(pid=102995) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 23 19:35:33.186209 dv-cinder-819011-1-iscsi neutron-server[102995]: DEBUG neutron.db.l3_hamode_db [None req-7295d65a-e598-4d9a-99a2-1ff43d879727 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-819011-1-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-23T19:25:14Z,description=,heartbeat_timestamp=2021-11-23T19:35:14Z,host='dv-cinder-819011-1-iscsi',id=1b20f2c4-70b6-43c3-b9bd-0062cc9e57ac,load=0,resource_versions=,resources_synced=,started_at=2021-11-23T19:25:15Z,topic='l3_agent')) {'router_ids': ['0534bcc4-1e12-4026-90ce-1406543c7662'], 'active': True} {{(pid=102995) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 23 19:35:33.201771 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-8fb19c2f-c4d1-4b35-aafc-c624362c0101 admin admin] Network 226a519f-5f3e-4d80-bb8a-0e9fc4f64828 is already hosted by enough agents. {{(pid=102992) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 23 19:35:33.204949 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.scheduler.base_scheduler [None req-8fb19c2f-c4d1-4b35-aafc-c624362c0101 admin admin] Resources bound (agent type, host, resource id): {{(pid=102992) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 23 19:35:33.210902 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.db.l3_dvrscheduler_db [None req-8fb19c2f-c4d1-4b35-aafc-c624362c0101 admin admin] Received port after_create {{(pid=102992) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 23 19:35:33.240089 dv-cinder-819011-1-iscsi neutron-server[102995]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ea1a9867-7e40-4ddc-99bf-75e5332dabfc None None] Pushing event updated for resources: {'Port': ['ID=c7996293-6188-4690-b614-395448e4dc25,revision_number=3']} {{(pid=102995) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 23 19:35:33.241895 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8fb19c2f-c4d1-4b35-aafc-c624362c0101 admin admin] Pushing event updated for resources: {'Port': ['ID=854821af-61e0-47e7-a603-95f500a49030,revision_number=1']} {{(pid=102992) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 23 19:35:33.264305 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [None req-8fb19c2f-c4d1-4b35-aafc-c624362c0101 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-926676'] for router_interface, before_create {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:35:33.346620 dv-cinder-819011-1-iscsi neutron-server[102995]: DEBUG neutron.db.l3_dvr_db [None req-7295d65a-e598-4d9a-99a2-1ff43d879727 None None] Set router 0534bcc4-1e12-4026-90ce-1406543c7662 gateway port host: dv-cinder-819011-1-iscsi {{(pid=102995) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 23 19:35:33.431874 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-80012091-6f5e-45f6-8dd3-571aac880c11 req-9faf3d6d-4ee0-4d7c-a4d8-8715c042877c tempest-VolumesActionsTest-802949502 tempest-VolumesActionsTest-802949502-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102992) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:35:33.433310 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-80012091-6f5e-45f6-8dd3-571aac880c11 req-9faf3d6d-4ee0-4d7c-a4d8-8715c042877c tempest-VolumesActionsTest-802949502 tempest-VolumesActionsTest-802949502-project] 10.222.0.62 "GET /v2.0/ports?device_id=fa2c753c-e8ba-46c8-8c59-7a35f6357117 HTTP/1.1" status: 200 len: 945 time: 0.0944386 Nov 23 19:35:33.463711 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.db.provisioning_blocks [None req-0fe67c80-35ad-4800-9c7d-2aab548db42b None None] Provisioning complete for port 854821af-61e0-47e7-a603-95f500a49030 triggered by entity DHCP. {{(pid=102994) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 23 19:35:33.464295 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron_lib.callbacks.manager [None req-0fe67c80-35ad-4800-9c7d-2aab548db42b None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-8355713'] for port, provisioning_complete {{(pid=102994) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:35:33.500084 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-80012091-6f5e-45f6-8dd3-571aac880c11 req-b98820f8-9d4e-48e2-b6c7-f0ce0b8f2650 tempest-VolumesActionsTest-802949502 tempest-VolumesActionsTest-802949502-project] 10.222.0.62 "GET /v2.0/security-groups?id=47acb13d-cf9a-4dd6-a614-503b94072f69&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0600417 Nov 23 19:35:33.517219 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.plugins.ml2.plugin [None req-0fe67c80-35ad-4800-9c7d-2aab548db42b None None] Port 854821af-61e0-47e7-a603-95f500a49030 cannot update to ACTIVE because it is not bound. {{(pid=102994) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 23 19:35:33.526297 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [None req-8fb19c2f-c4d1-4b35-aafc-c624362c0101 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7921281'] for port, before_update {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:35:33.568577 dv-cinder-819011-1-iscsi neutron-server[102995]: DEBUG neutron.db.l3_hamode_db [None req-7295d65a-e598-4d9a-99a2-1ff43d879727 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '0534bcc4-1e12-4026-90ce-1406543c7662', 'name': 'tempest-TestVolumeBootPattern-84632531-router', 'tenant_id': '257b0b2e531441b4bb745e99cfd799f3', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'a93e254e-aac9-4233-9e4d-4290fd0458e4', 'external_fixed_ips': [{'subnet_id': 'e0b32f3d-83d6-439a-bbed-01df7cf01051', 'ip_address': '172.27.1.154'}], 'enable_snat': True}, 'gw_port_id': 'c7996293-6188-4690-b614-395448e4dc25', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-23T19:35:29Z', 'updated_at': '2021-11-23T19:35:30Z', 'revision_number': 3, 'project_id': '257b0b2e531441b4bb745e99cfd799f3', 'gw_port': {'id': 'c7996293-6188-4690-b614-395448e4dc25', 'name': '', 'network_id': 'a93e254e-aac9-4233-9e4d-4290fd0458e4', 'tenant_id': '', 'mac_address': 'fa:16:3e:52:67:5e', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '0534bcc4-1e12-4026-90ce-1406543c7662', 'device_owner': 'network:router_gateway', 'standard_attr_id': 392, 'fixed_ips': [{'subnet_id': 'e0b32f3d-83d6-439a-bbed-01df7cf01051', 'ip_address': '172.27.1.154', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-819011-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-23T19:35:30Z', 'updated_at': '2021-11-23T19:35:33Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'e0b32f3d-83d6-439a-bbed-01df7cf01051', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-819011-1-iscsi'}], 'dv-cinder-819011-1-iscsi', False) {} {{(pid=102995) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 23 19:35:33.597441 dv-cinder-819011-1-iscsi neutron-server[102995]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-7295d65a-e598-4d9a-99a2-1ff43d879727 None None] The sync data for ids ['0534bcc4-1e12-4026-90ce-1406543c7662'] in dv-cinder-819011-1-iscsi is: [{'id': '0534bcc4-1e12-4026-90ce-1406543c7662', 'name': 'tempest-TestVolumeBootPattern-84632531-router', 'tenant_id': '257b0b2e531441b4bb745e99cfd799f3', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'a93e254e-aac9-4233-9e4d-4290fd0458e4', 'external_fixed_ips': [{'subnet_id': 'e0b32f3d-83d6-439a-bbed-01df7cf01051', 'ip_address': '172.27.1.154'}], 'enable_snat': True}, 'gw_port_id': 'c7996293-6188-4690-b614-395448e4dc25', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-23T19:35:29Z', 'updated_at': '2021-11-23T19:35:30Z', 'revision_number': 3, 'project_id': '257b0b2e531441b4bb745e99cfd799f3', 'gw_port': {'id': 'c7996293-6188-4690-b614-395448e4dc25', 'name': '', 'network_id': 'a93e254e-aac9-4233-9e4d-4290fd0458e4', 'tenant_id': '', 'mac_address': 'fa:16:3e:52:67:5e', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '0534bcc4-1e12-4026-90ce-1406543c7662', 'device_owner': 'network:router_gateway', 'standard_attr_id': 392, 'fixed_ips': [{'subnet_id': 'e0b32f3d-83d6-439a-bbed-01df7cf01051', 'ip_address': '172.27.1.154', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-819011-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-23T19:35:30Z', 'updated_at': '2021-11-23T19:35:33Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'e0b32f3d-83d6-439a-bbed-01df7cf01051', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-819011-1-iscsi'}] {{(pid=102995) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 23 19:35:33.708398 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [None req-8fb19c2f-c4d1-4b35-aafc-c624362c0101 admin admin] Publish callbacks [] for port, precommit_update {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:35:33.777927 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [None req-8fb19c2f-c4d1-4b35-aafc-c624362c0101 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7918660', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-15067', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560168', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8783631423946', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8783631008732', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8783631008750', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-25199748'] for port, after_update {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:35:33.862661 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [None req-8fb19c2f-c4d1-4b35-aafc-c624362c0101 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-553426', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-932964'] for router_interface, after_create {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:35:33.864424 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8fb19c2f-c4d1-4b35-aafc-c624362c0101 admin admin] Pushing event updated for resources: {'Port': ['ID=854821af-61e0-47e7-a603-95f500a49030,revision_number=2']} {{(pid=102992) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 23 19:35:33.972738 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-8fb19c2f-c4d1-4b35-aafc-c624362c0101 admin admin] Network 226a519f-5f3e-4d80-bb8a-0e9fc4f64828 is already hosted by enough agents. {{(pid=102992) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 23 19:35:33.974469 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.scheduler.base_scheduler [None req-8fb19c2f-c4d1-4b35-aafc-c624362c0101 admin admin] Resources bound (agent type, host, resource id): {{(pid=102992) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 23 19:35:34.085763 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.plugins.ml2.rpc [None req-eb87b2c3-3339-4249-8b85-e695b5b4e1f9 None None] Device 1e712a26-63c0-453b-8510-11be3fce9e06 up at agent ovs-agent-dv-cinder-819011-1-iscsi {{(pid=102994) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 23 19:35:34.146615 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-8fb19c2f-c4d1-4b35-aafc-c624362c0101 admin admin] Router 0534bcc4-1e12-4026-90ce-1406543c7662 has already been hosted by L3 agent 1b20f2c4-70b6-43c3-b9bd-0062cc9e57ac {{(pid=102992) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 23 19:35:34.159702 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.db.provisioning_blocks [None req-eb87b2c3-3339-4249-8b85-e695b5b4e1f9 None None] Provisioning complete for port 1e712a26-63c0-453b-8510-11be3fce9e06 triggered by entity L2. {{(pid=102994) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 23 19:35:34.160302 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron_lib.callbacks.manager [None req-eb87b2c3-3339-4249-8b85-e695b5b4e1f9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-8355713'] for port, provisioning_complete {{(pid=102994) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:35:34.238361 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9881313f-608d-4397-abc8-7ecd2c9143eb req-ee411af4-b229-4edb-81e0-23b598ad7679 tempest-AttachVolumeShelveTestJSON-1172915835 tempest-AttachVolumeShelveTestJSON-1172915835-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102993) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:35:34.240542 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-9881313f-608d-4397-abc8-7ecd2c9143eb req-ee411af4-b229-4edb-81e0-23b598ad7679 tempest-AttachVolumeShelveTestJSON-1172915835 tempest-AttachVolumeShelveTestJSON-1172915835-project] 10.222.0.62 "GET /v2.0/ports?device_id=85ea3d72-6c17-4ea2-82b7-90cce01633bd HTTP/1.1" status: 200 len: 945 time: 0.0849133 Nov 23 19:35:34.265465 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.plugins.ml2.rpc [None req-eb87b2c3-3339-4249-8b85-e695b5b4e1f9 None None] Device c7996293-6188-4690-b614-395448e4dc25 up at agent ovs-agent-dv-cinder-819011-1-iscsi {{(pid=102994) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 23 19:35:34.288027 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-8fb19c2f-c4d1-4b35-aafc-c624362c0101 admin admin] Notify agent at l3_agent.dv-cinder-819011-1-iscsi the message routers_updated {{(pid=102992) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 23 19:35:34.305793 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [None req-8fb19c2f-c4d1-4b35-aafc-c624362c0101 admin admin] 10.222.0.62 "PUT /v2.0/routers/0534bcc4-1e12-4026-90ce-1406543c7662/add_router_interface HTTP/1.1" status: 200 len: 503 time: 2.1123126 Nov 23 19:35:34.309527 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-9881313f-608d-4397-abc8-7ecd2c9143eb req-18495672-7b28-49c7-b1fc-272d7c373838 tempest-AttachVolumeShelveTestJSON-1172915835 tempest-AttachVolumeShelveTestJSON-1172915835-project] 10.222.0.62 "GET /v2.0/security-groups?id=f1ca24d9-0a31-470d-a1d5-fa7059df0141&fields=id&fields=name HTTP/1.1" status: 200 len: 311 time: 0.0596161 Nov 23 19:35:34.363472 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.db.provisioning_blocks [None req-45de95b0-a45e-4d94-99a6-89d0a9aeb5e6 None None] Provisioning complete for port 854821af-61e0-47e7-a603-95f500a49030 triggered by entity DHCP. {{(pid=102994) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 23 19:35:34.363861 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron_lib.callbacks.manager [None req-45de95b0-a45e-4d94-99a6-89d0a9aeb5e6 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-8355713'] for port, provisioning_complete {{(pid=102994) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:35:34.370322 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.db.provisioning_blocks [None req-eb87b2c3-3339-4249-8b85-e695b5b4e1f9 None None] Provisioning complete for port c7996293-6188-4690-b614-395448e4dc25 triggered by entity L2. {{(pid=102994) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 23 19:35:34.370946 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron_lib.callbacks.manager [None req-eb87b2c3-3339-4249-8b85-e695b5b4e1f9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-8355713'] for port, provisioning_complete {{(pid=102994) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:35:34.434046 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.plugins.ml2.plugin [None req-45de95b0-a45e-4d94-99a6-89d0a9aeb5e6 None None] Port 854821af-61e0-47e7-a603-95f500a49030 cannot update to ACTIVE because it is not bound. {{(pid=102994) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 23 19:35:34.489847 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron_lib.callbacks.manager [None req-eb87b2c3-3339-4249-8b85-e695b5b4e1f9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7921281'] for port, before_update {{(pid=102994) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:35:34.515946 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.plugins.ml2.db [None req-eb87b2c3-3339-4249-8b85-e695b5b4e1f9 None None] For port c7996293-6188-4690-b614-395448e4dc25, host dv-cinder-819011-1-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-819011-1-iscsi',level=0,port_id=c7996293-6188-4690-b614-395448e4dc25,segment=NetworkSegment(3cb5e60b-103a-47d0-a28b-d68e3159d032),segment_id=3cb5e60b-103a-47d0-a28b-d68e3159d032)] {{(pid=102994) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 23 19:35:34.606872 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron_lib.callbacks.manager [None req-eb87b2c3-3339-4249-8b85-e695b5b4e1f9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7918660', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-15067', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560168', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8783631423946', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8783631008732', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8783631008750'] for port, after_update {{(pid=102994) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:35:34.624392 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-21eb8326-9e16-4338-a588-bd80afb14080 req-610d43cf-d4a8-4c2a-b7ca-62be69793ddb tempest-VolumesActionsTest-802949502 tempest-VolumesActionsTest-802949502-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102992) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:35:34.626340 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-21eb8326-9e16-4338-a588-bd80afb14080 req-610d43cf-d4a8-4c2a-b7ca-62be69793ddb tempest-VolumesActionsTest-802949502 tempest-VolumesActionsTest-802949502-project] 10.222.0.62 "GET /v2.0/ports?device_id=fa2c753c-e8ba-46c8-8c59-7a35f6357117 HTTP/1.1" status: 200 len: 945 time: 0.0574007 Nov 23 19:35:34.661990 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-eb87b2c3-3339-4249-8b85-e695b5b4e1f9 None None] Pushing event updated for resources: {'Port': ['ID=c7996293-6188-4690-b614-395448e4dc25,revision_number=4']} {{(pid=102994) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 23 19:35:34.681266 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-21eb8326-9e16-4338-a588-bd80afb14080 req-d03fbd71-bffd-4d9d-ae0e-87c692487b40 tempest-VolumesActionsTest-802949502 tempest-VolumesActionsTest-802949502-project] 10.222.0.62 "GET /v2.0/security-groups?id=47acb13d-cf9a-4dd6-a614-503b94072f69&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0451391 Nov 23 19:35:35.068636 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.wsgi [-] (102992) accepted ('10.222.0.62', 45420) {{(pid=102992) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 23 19:35:35.073555 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.api.v2.base [None req-eeb79ecf-e4b3-440e-b5c8-f4fccae6848f admin admin] Request body: {'network': {'name': 'tempest-TestVolumeBootPattern-1496802758-network', 'tenant_id': '1e70ae5f657c4aebb6c283d99f5ccde0'}} {{(pid=102992) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 23 19:35:35.155120 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-eeb79ecf-e4b3-440e-b5c8-f4fccae6848f admin admin] Made reservation on behalf of 1e70ae5f657c4aebb6c283d99f5ccde0 for: {'network': 1} {{(pid=102992) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 23 19:35:35.157680 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [None req-eeb79ecf-e4b3-440e-b5c8-f4fccae6848f admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7921281'] for network, before_create {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:35:35.167184 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [None req-eeb79ecf-e4b3-440e-b5c8-f4fccae6848f admin admin] Publish callbacks [] for security_group, before_create {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:35:35.251889 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [None req-eeb79ecf-e4b3-440e-b5c8-f4fccae6848f admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:35:35.332350 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [None req-eeb79ecf-e4b3-440e-b5c8-f4fccae6848f admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-623933'] for security_group, after_create {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:35:35.361340 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-eeb79ecf-e4b3-440e-b5c8-f4fccae6848f admin admin] vlan segment allocate from pool success with {'vlan_id': 837, 'physical_network': 'physnet1'} {{(pid=102992) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 23 19:35:35.367847 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-eeb79ecf-e4b3-440e-b5c8-f4fccae6848f admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=e6172580-cd29-420e-9dc0-33b702f5b55e,revision_number=1']} {{(pid=102992) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 23 19:35:35.378477 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [None req-eeb79ecf-e4b3-440e-b5c8-f4fccae6848f admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7982218'] for segment, precommit_create {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:35:35.378477 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.db.segments_db [None req-eeb79ecf-e4b3-440e-b5c8-f4fccae6848f admin admin] Added segment 89776fd7-6ee8-49b6-aa38-04444322cfc6 of type vlan for network a79fa83e-69fd-41d9-9001-545f7467c26a Nov 23 19:35:35.396949 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-b95ea5d5-6f49-476a-b921-4d764afd92db None None] Sync routers for ids ['0534bcc4-1e12-4026-90ce-1406543c7662'] in dv-cinder-819011-1-iscsi {{(pid=102994) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 23 19:35:35.412201 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.db.l3_dvrscheduler_db [None req-b95ea5d5-6f49-476a-b921-4d764afd92db None None] Routers {'0534bcc4-1e12-4026-90ce-1406543c7662'} bound to L3 agent in host dv-cinder-819011-1-iscsi {{(pid=102994) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 23 19:35:35.413751 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.db.l3_hamode_db [None req-b95ea5d5-6f49-476a-b921-4d764afd92db None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-819011-1-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-23T19:25:14Z,description=,heartbeat_timestamp=2021-11-23T19:35:14Z,host='dv-cinder-819011-1-iscsi',id=1b20f2c4-70b6-43c3-b9bd-0062cc9e57ac,load=0,resource_versions=,resources_synced=,started_at=2021-11-23T19:25:15Z,topic='l3_agent')) {'router_ids': ['0534bcc4-1e12-4026-90ce-1406543c7662'], 'active': True} {{(pid=102994) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 23 19:35:35.435313 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [None req-eeb79ecf-e4b3-440e-b5c8-f4fccae6848f admin admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8783630993713'] for network, precommit_create {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:35:35.474585 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e52028e1-ab04-4268-a7d1-b31b83bd206e req-2da03f4b-e4da-4d88-8e3e-29696c57fbc3 tempest-AttachVolumeShelveTestJSON-1172915835 tempest-AttachVolumeShelveTestJSON-1172915835-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102993) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:35:35.476061 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-e52028e1-ab04-4268-a7d1-b31b83bd206e req-2da03f4b-e4da-4d88-8e3e-29696c57fbc3 tempest-AttachVolumeShelveTestJSON-1172915835 tempest-AttachVolumeShelveTestJSON-1172915835-project] 10.222.0.62 "GET /v2.0/ports?device_id=85ea3d72-6c17-4ea2-82b7-90cce01633bd HTTP/1.1" status: 200 len: 945 time: 0.0559700 Nov 23 19:35:35.521028 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [None req-eeb79ecf-e4b3-440e-b5c8-f4fccae6848f admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-554949', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560168'] for network, after_create {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:35:35.522057 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-eeb79ecf-e4b3-440e-b5c8-f4fccae6848f admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102992) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:35:35.522651 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [None req-eeb79ecf-e4b3-440e-b5c8-f4fccae6848f admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-560186'] for network, before_response {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:35:35.523480 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-e52028e1-ab04-4268-a7d1-b31b83bd206e req-93c9d6a6-63ab-4599-af97-daa63dd4fc4f tempest-AttachVolumeShelveTestJSON-1172915835 tempest-AttachVolumeShelveTestJSON-1172915835-project] 10.222.0.62 "GET /v2.0/security-groups?id=f1ca24d9-0a31-470d-a1d5-fa7059df0141&fields=id&fields=name HTTP/1.1" status: 200 len: 311 time: 0.0413177 Nov 23 19:35:35.537814 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.db.l3_dvr_db [None req-b95ea5d5-6f49-476a-b921-4d764afd92db None None] Set router 0534bcc4-1e12-4026-90ce-1406543c7662 gateway port host: dv-cinder-819011-1-iscsi {{(pid=102994) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 23 19:35:35.588106 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-eeb79ecf-e4b3-440e-b5c8-f4fccae6848f admin admin] Pushing event updated for resources: {'Network': ['ID=a79fa83e-69fd-41d9-9001-545f7467c26a,revision_number=1']} {{(pid=102992) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 23 19:35:35.614347 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.plugins.ml2.rpc [None req-eb87b2c3-3339-4249-8b85-e695b5b4e1f9 None None] Network a79fa83e-69fd-41d9-9001-545f7467c26a details requested by agent ovs-agent-dv-cinder-819011-1-iscsi with host dv-cinder-819011-1-iscsi {{(pid=102994) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Nov 23 19:35:35.632479 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [None req-eeb79ecf-e4b3-440e-b5c8-f4fccae6848f admin admin] 10.222.0.62 "POST /v2.0/networks HTTP/1.1" status: 201 len: 885 time: 0.5627153 Nov 23 19:35:35.635037 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.wsgi [-] (102992) accepted ('10.222.0.62', 45428) {{(pid=102992) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 23 19:35:35.639963 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.api.v2.base [None req-f1e23483-9176-40f9-9424-a5f85f1dc645 admin admin] Request body: {'subnet': {'network_id': 'a79fa83e-69fd-41d9-9001-545f7467c26a', 'cidr': '172.20.0.0/28', 'name': 'tempest-TestVolumeBootPattern-1496802758-subnet', 'tenant_id': '1e70ae5f657c4aebb6c283d99f5ccde0', 'ip_version': 4}} {{(pid=102992) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 23 19:35:35.732498 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-f1e23483-9176-40f9-9424-a5f85f1dc645 admin admin] Made reservation on behalf of 1e70ae5f657c4aebb6c283d99f5ccde0 for: {'subnet': 1} {{(pid=102992) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 23 19:35:35.735089 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [None req-f1e23483-9176-40f9-9424-a5f85f1dc645 admin admin] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-25999706'] for subnet, before_create {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:35:35.815884 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.db.l3_hamode_db [None req-b95ea5d5-6f49-476a-b921-4d764afd92db None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '0534bcc4-1e12-4026-90ce-1406543c7662', 'name': 'tempest-TestVolumeBootPattern-84632531-router', 'tenant_id': '257b0b2e531441b4bb745e99cfd799f3', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'a93e254e-aac9-4233-9e4d-4290fd0458e4', 'external_fixed_ips': [{'subnet_id': 'e0b32f3d-83d6-439a-bbed-01df7cf01051', 'ip_address': '172.27.1.154'}], 'enable_snat': True}, 'gw_port_id': 'c7996293-6188-4690-b614-395448e4dc25', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-23T19:35:29Z', 'updated_at': '2021-11-23T19:35:33Z', 'revision_number': 4, 'project_id': '257b0b2e531441b4bb745e99cfd799f3', 'gw_port': {'id': 'c7996293-6188-4690-b614-395448e4dc25', 'name': '', 'network_id': 'a93e254e-aac9-4233-9e4d-4290fd0458e4', 'tenant_id': '', 'mac_address': 'fa:16:3e:52:67:5e', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '0534bcc4-1e12-4026-90ce-1406543c7662', 'device_owner': 'network:router_gateway', 'standard_attr_id': 392, 'fixed_ips': [{'subnet_id': 'e0b32f3d-83d6-439a-bbed-01df7cf01051', 'ip_address': '172.27.1.154', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-819011-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-23T19:35:30Z', 'updated_at': '2021-11-23T19:35:34Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'e0b32f3d-83d6-439a-bbed-01df7cf01051', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-819011-1-iscsi', '_interfaces': [{'id': '854821af-61e0-47e7-a603-95f500a49030', 'name': '', 'network_id': '226a519f-5f3e-4d80-bb8a-0e9fc4f64828', 'tenant_id': '257b0b2e531441b4bb745e99cfd799f3', 'mac_address': 'fa:16:3e:90:11:65', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '0534bcc4-1e12-4026-90ce-1406543c7662', 'device_owner': 'network:router_interface', 'standard_attr_id': 393, 'fixed_ips': [{'subnet_id': '88de785d-c540-4651-af1e-26f27ccaee3c', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-23T19:35:32Z', 'updated_at': '2021-11-23T19:35:33Z', 'revision_number': 2, 'project_id': '257b0b2e531441b4bb745e99cfd799f3', 'subnets': [{'id': '88de785d-c540-4651-af1e-26f27ccaee3c', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-819011-1-iscsi', False) {} {{(pid=102994) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 23 19:35:35.843275 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-b95ea5d5-6f49-476a-b921-4d764afd92db None None] Checking router: 0534bcc4-1e12-4026-90ce-1406543c7662 for host: dv-cinder-819011-1-iscsi {{(pid=102994) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 23 19:35:35.843636 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-b95ea5d5-6f49-476a-b921-4d764afd92db None None] Updating router 0534bcc4-1e12-4026-90ce-1406543c7662 port 854821af-61e0-47e7-a603-95f500a49030 binding host dv-cinder-819011-1-iscsi {{(pid=102994) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Nov 23 19:35:35.854005 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ae8e4683-3481-4900-8ed6-60628b70f0c6 req-621d8fe1-2914-4b3d-bdab-ec212117fd12 tempest-VolumesActionsTest-802949502 tempest-VolumesActionsTest-802949502-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102992) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:35:35.854005 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-ae8e4683-3481-4900-8ed6-60628b70f0c6 req-621d8fe1-2914-4b3d-bdab-ec212117fd12 tempest-VolumesActionsTest-802949502 tempest-VolumesActionsTest-802949502-project] 10.222.0.62 "GET /v2.0/ports?device_id=fa2c753c-e8ba-46c8-8c59-7a35f6357117 HTTP/1.1" status: 200 len: 945 time: 0.0925596 Nov 23 19:35:35.870164 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron_lib.callbacks.manager [None req-b95ea5d5-6f49-476a-b921-4d764afd92db None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7921281'] for port, before_update {{(pid=102994) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:35:35.970519 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.plugins.ml2.rpc [None req-eb87b2c3-3339-4249-8b85-e695b5b4e1f9 None None] Device c7996293-6188-4690-b614-395448e4dc25 up at agent ovs-agent-dv-cinder-819011-1-iscsi {{(pid=102994) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 23 19:35:36.097704 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.db.provisioning_blocks [None req-eb87b2c3-3339-4249-8b85-e695b5b4e1f9 None None] Provisioning complete for port c7996293-6188-4690-b614-395448e4dc25 triggered by entity L2. {{(pid=102994) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 23 19:35:36.098220 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron_lib.callbacks.manager [None req-eb87b2c3-3339-4249-8b85-e695b5b4e1f9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-8355713'] for port, provisioning_complete {{(pid=102994) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:35:36.170250 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-ae8e4683-3481-4900-8ed6-60628b70f0c6 req-c914b615-04e5-41cd-abf6-f28227779999 tempest-VolumesActionsTest-802949502 tempest-VolumesActionsTest-802949502-project] 10.222.0.62 "GET /v2.0/security-groups?id=47acb13d-cf9a-4dd6-a614-503b94072f69&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2977107 Nov 23 19:35:36.252929 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron_lib.callbacks.manager [None req-b95ea5d5-6f49-476a-b921-4d764afd92db None None] Publish callbacks [] for port, precommit_update {{(pid=102994) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:35:36.258812 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [None req-f1e23483-9176-40f9-9424-a5f85f1dc645 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-554858', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560168', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-25199633', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-25999688'] for subnet, after_create {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:35:36.303825 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron_lib.callbacks.manager [None req-b95ea5d5-6f49-476a-b921-4d764afd92db None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7918660', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-15067', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560168', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8783631423946', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8783631008732', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8783631008750'] for port, after_update {{(pid=102994) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:35:36.316674 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f1e23483-9176-40f9-9424-a5f85f1dc645 admin admin] Pushing event updated for resources: {'Subnet': ['ID=56f5fba5-4cd3-476d-bc1c-2e0c8f45bb10,revision_number=0']} {{(pid=102992) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 23 19:35:36.326801 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-f1e23483-9176-40f9-9424-a5f85f1dc645 admin admin] Checking segment: {'id': '89776fd7-6ee8-49b6-aa38-04444322cfc6', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 837, 'network_id': 'a79fa83e-69fd-41d9-9001-545f7467c26a'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102992) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 23 19:35:36.327172 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-f1e23483-9176-40f9-9424-a5f85f1dc645 admin admin] Network hostable DHCP agents. Network: a79fa83e-69fd-41d9-9001-545f7467c26a, hostable agents: ['e51c95c7-6a36-4263-ba47-1839054f3e7a'], hosted agents: [] {{(pid=102992) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 23 19:35:36.389694 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-f1e23483-9176-40f9-9424-a5f85f1dc645 admin admin] Network a79fa83e-69fd-41d9-9001-545f7467c26a is scheduled to be hosted by DHCP agent e51c95c7-6a36-4263-ba47-1839054f3e7a with binding_index 1 {{(pid=102992) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 23 19:35:36.453872 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.scheduler.base_scheduler [None req-f1e23483-9176-40f9-9424-a5f85f1dc645 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-819011-1-iscsi, a79fa83e-69fd-41d9-9001-545f7467c26a) {{(pid=102992) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 23 19:35:36.463176 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-f1e23483-9176-40f9-9424-a5f85f1dc645 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=102992) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:35:36.463176 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [None req-f1e23483-9176-40f9-9424-a5f85f1dc645 admin admin] Publish callbacks [] for subnet, before_response {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:35:36.469614 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b1f446e1-9eac-4f79-8c20-72894b77e856 None None] Pushing event updated for resources: {'Port': ['ID=854821af-61e0-47e7-a603-95f500a49030,revision_number=3']} {{(pid=102994) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 23 19:35:36.476263 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-6a668ebb-380a-4c2f-8fd6-a7ea7796e921 None None] Network a79fa83e-69fd-41d9-9001-545f7467c26a requested from dv-cinder-819011-1-iscsi {{(pid=102994) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 23 19:35:36.581056 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.plugins.ml2.managers [None req-b95ea5d5-6f49-476a-b921-4d764afd92db None None] Attempting to bind port 854821af-61e0-47e7-a603-95f500a49030 on host dv-cinder-819011-1-iscsi for vnic_type normal with profile {{(pid=102994) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 23 19:35:36.581802 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.plugins.ml2.managers [None req-b95ea5d5-6f49-476a-b921-4d764afd92db None None] Attempting to bind port 854821af-61e0-47e7-a603-95f500a49030 by drivers openvswitch,hyperv on host dv-cinder-819011-1-iscsi at level 0 using segments [{'id': '56316385-5b81-43f5-84db-b708b46f04eb', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 800, 'network_id': '226a519f-5f3e-4d80-bb8a-0e9fc4f64828'}] {{(pid=102994) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 23 19:35:36.582036 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-b95ea5d5-6f49-476a-b921-4d764afd92db None None] Attempting to bind port 854821af-61e0-47e7-a603-95f500a49030 on network 226a519f-5f3e-4d80-bb8a-0e9fc4f64828 {{(pid=102994) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 23 19:35:36.592398 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-b95ea5d5-6f49-476a-b921-4d764afd92db None None] Checking agent: {'id': '668c8953-047c-499e-8c0d-db838fac1668', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-819011-1-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 23, 19, 25, 17), 'started_at': datetime.datetime(2021, 11, 23, 19, 25, 47), 'heartbeat_timestamp': datetime.datetime(2021, 11, 23, 19, 35, 17), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-819011-1-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=102994) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 23 19:35:36.623652 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-b95ea5d5-6f49-476a-b921-4d764afd92db None None] Checking segment: {'id': '56316385-5b81-43f5-84db-b708b46f04eb', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 800, 'network_id': '226a519f-5f3e-4d80-bb8a-0e9fc4f64828'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102994) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 23 19:35:36.623652 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron_lib.callbacks.manager [None req-b95ea5d5-6f49-476a-b921-4d764afd92db None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=102994) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:35:36.623652 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-b95ea5d5-6f49-476a-b921-4d764afd92db None None] Bound using segment: {'id': '56316385-5b81-43f5-84db-b708b46f04eb', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 800, 'network_id': '226a519f-5f3e-4d80-bb8a-0e9fc4f64828'} {{(pid=102994) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 23 19:35:36.623652 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.plugins.ml2.managers [None req-b95ea5d5-6f49-476a-b921-4d764afd92db None None] Bound port: 854821af-61e0-47e7-a603-95f500a49030, host: dv-cinder-819011-1-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '56316385-5b81-43f5-84db-b708b46f04eb', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 800, 'network_id': '226a519f-5f3e-4d80-bb8a-0e9fc4f64828'}}] {{(pid=102994) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 23 19:35:36.623652 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron_lib.callbacks.manager [None req-b95ea5d5-6f49-476a-b921-4d764afd92db None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7921281'] for port, before_update {{(pid=102994) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:35:36.732595 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [None req-f1e23483-9176-40f9-9424-a5f85f1dc645 admin admin] 10.222.0.62 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 848 time: 1.0220697 Nov 23 19:35:36.733901 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-69f11fbf-9846-453f-9447-5fd7656ece5b req-7f6f5463-d5eb-498d-902c-551f5f27d86b tempest-AttachVolumeShelveTestJSON-1172915835 tempest-AttachVolumeShelveTestJSON-1172915835-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102993) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:35:36.733901 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-69f11fbf-9846-453f-9447-5fd7656ece5b req-7f6f5463-d5eb-498d-902c-551f5f27d86b tempest-AttachVolumeShelveTestJSON-1172915835 tempest-AttachVolumeShelveTestJSON-1172915835-project] 10.222.0.62 "GET /v2.0/ports?device_id=85ea3d72-6c17-4ea2-82b7-90cce01633bd HTTP/1.1" status: 200 len: 945 time: 0.0626485 Nov 23 19:35:36.734468 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.plugins.ml2.db [None req-b95ea5d5-6f49-476a-b921-4d764afd92db None None] For port 854821af-61e0-47e7-a603-95f500a49030, host dv-cinder-819011-1-iscsi, cleared binding levels {{(pid=102994) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 23 19:35:36.734468 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.plugins.ml2.db [None req-b95ea5d5-6f49-476a-b921-4d764afd92db None None] For port 854821af-61e0-47e7-a603-95f500a49030, host dv-cinder-819011-1-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-819011-1-iscsi',level=0,port_id=854821af-61e0-47e7-a603-95f500a49030,segment=NetworkSegment(56316385-5b81-43f5-84db-b708b46f04eb),segment_id=56316385-5b81-43f5-84db-b708b46f04eb)] {{(pid=102994) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 23 19:35:36.734651 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.wsgi [-] (102992) accepted ('10.222.0.62', 45440) {{(pid=102992) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 23 19:35:36.734746 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-69f11fbf-9846-453f-9447-5fd7656ece5b req-27ff65ca-b20b-4760-ac78-2ceb22095acf tempest-AttachVolumeShelveTestJSON-1172915835 tempest-AttachVolumeShelveTestJSON-1172915835-project] 10.222.0.62 "GET /v2.0/security-groups?id=f1ca24d9-0a31-470d-a1d5-fa7059df0141&fields=id&fields=name HTTP/1.1" status: 200 len: 311 time: 0.0453727 Nov 23 19:35:36.734993 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.api.v2.base [None req-322817a8-ceaf-4aad-9ecb-b21aebdf2c72 admin admin] Request body: {'router': {'name': 'tempest-TestVolumeBootPattern-1496802758-router', 'tenant_id': '1e70ae5f657c4aebb6c283d99f5ccde0', 'external_gateway_info': {'network_id': 'a93e254e-aac9-4233-9e4d-4290fd0458e4'}}} {{(pid=102992) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 23 19:35:36.766209 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-80a9549f-b5b0-4284-9328-0412540503fc None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp8353ff9b-e01d-5e31-ab2d-60a764783255-a79fa83e-69fd-41d9-9001-545f7467c26a', 'network_id': 'a79fa83e-69fd-41d9-9001-545f7467c26a', 'tenant_id': '1e70ae5f657c4aebb6c283d99f5ccde0', 'fixed_ips': [{'subnet_id': '56f5fba5-4cd3-476d-bc1c-2e0c8f45bb10'}]}} from dv-cinder-819011-1-iscsi. {{(pid=102994) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:285}} Nov 23 19:35:36.767170 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron_lib.callbacks.manager [None req-80a9549f-b5b0-4284-9328-0412540503fc None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7921281'] for port, before_create {{(pid=102994) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:35:36.800951 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.db.provisioning_blocks [None req-9e803a95-5b7d-4601-9a32-1c97f9e7aedb None None] Provisioning complete for port 854821af-61e0-47e7-a603-95f500a49030 triggered by entity DHCP. {{(pid=102994) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 23 19:35:36.805558 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron_lib.callbacks.manager [None req-9e803a95-5b7d-4601-9a32-1c97f9e7aedb None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-8355713'] for port, provisioning_complete {{(pid=102994) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:35:36.883164 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron_lib.callbacks.manager [None req-b95ea5d5-6f49-476a-b921-4d764afd92db None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7918660', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-15067', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560168', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8783631423946', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8783631008732', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8783631008750'] for port, after_update {{(pid=102994) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:35:36.927819 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.plugins.ml2.plugin [None req-9e803a95-5b7d-4601-9a32-1c97f9e7aedb None None] Port 854821af-61e0-47e7-a603-95f500a49030 cannot update to ACTIVE because it is not bound. {{(pid=102994) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 23 19:35:36.984287 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [None req-322817a8-ceaf-4aad-9ecb-b21aebdf2c72 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-933550', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-13503'] for router, before_create {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:35:36.985697 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [None req-322817a8-ceaf-4aad-9ecb-b21aebdf2c72 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-933038', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-927700', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-622769', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-13448'] for router, precommit_create {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:35:36.997205 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.db.l3_dvrscheduler_db [None req-b95ea5d5-6f49-476a-b921-4d764afd92db None None] Routers {'0534bcc4-1e12-4026-90ce-1406543c7662'} bound to L3 agent in host dv-cinder-819011-1-iscsi {{(pid=102994) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 23 19:35:37.000525 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.db.l3_hamode_db [None req-b95ea5d5-6f49-476a-b921-4d764afd92db None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-819011-1-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-23T19:25:14Z,description=,heartbeat_timestamp=2021-11-23T19:35:14Z,host='dv-cinder-819011-1-iscsi',id=1b20f2c4-70b6-43c3-b9bd-0062cc9e57ac,load=0,resource_versions=,resources_synced=,started_at=2021-11-23T19:25:15Z,topic='l3_agent')) {'router_ids': ['0534bcc4-1e12-4026-90ce-1406543c7662'], 'active': True} {{(pid=102994) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 23 19:35:37.002718 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b1f446e1-9eac-4f79-8c20-72894b77e856 None None] Pushing event updated for resources: {'Port': ['ID=854821af-61e0-47e7-a603-95f500a49030,revision_number=4']} {{(pid=102994) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 23 19:35:37.006919 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.db.db_base_plugin_common [None req-80a9549f-b5b0-4284-9328-0412540503fc None None] Allocated IP 172.20.0.2 (a79fa83e-69fd-41d9-9001-545f7467c26a/56f5fba5-4cd3-476d-bc1c-2e0c8f45bb10/f244284e-32a3-4378-aeca-176afb29edd9) {{(pid=102994) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 23 19:35:37.053961 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [None req-322817a8-ceaf-4aad-9ecb-b21aebdf2c72 admin admin] Publish callbacks [] for router_controller, precommit_add_association {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:35:37.177790 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.db.l3_dvr_db [None req-b95ea5d5-6f49-476a-b921-4d764afd92db None None] Set router 0534bcc4-1e12-4026-90ce-1406543c7662 gateway port host: dv-cinder-819011-1-iscsi {{(pid=102994) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 23 19:35:37.289003 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [None req-322817a8-ceaf-4aad-9ecb-b21aebdf2c72 admin admin] Publish callbacks [] for router_gateway, precommit_update {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:35:37.320939 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-164a0d40-cff6-40e4-ba2f-61f71ad3da50 req-4707d4c3-d450-4ecb-9b53-43d263ed58eb tempest-VolumesActionsTest-802949502 tempest-VolumesActionsTest-802949502-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102992) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:35:37.325499 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.db.provisioning_blocks [None req-dc167e61-2b66-4425-ae1d-6e5dfc697da9 None None] Provisioning complete for port 854821af-61e0-47e7-a603-95f500a49030 triggered by entity DHCP. {{(pid=102994) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 23 19:35:37.325847 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron_lib.callbacks.manager [None req-dc167e61-2b66-4425-ae1d-6e5dfc697da9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-8355713'] for port, provisioning_complete {{(pid=102994) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:35:37.325959 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-164a0d40-cff6-40e4-ba2f-61f71ad3da50 req-4707d4c3-d450-4ecb-9b53-43d263ed58eb tempest-VolumesActionsTest-802949502 tempest-VolumesActionsTest-802949502-project] 10.222.0.62 "GET /v2.0/ports?device_id=fa2c753c-e8ba-46c8-8c59-7a35f6357117 HTTP/1.1" status: 200 len: 945 time: 0.0711567 Nov 23 19:35:37.390814 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-164a0d40-cff6-40e4-ba2f-61f71ad3da50 req-172fa8f9-97d4-4377-9c00-3d6b0696839a tempest-VolumesActionsTest-802949502 tempest-VolumesActionsTest-802949502-project] 10.222.0.62 "GET /v2.0/security-groups?id=47acb13d-cf9a-4dd6-a614-503b94072f69&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0611339 Nov 23 19:35:37.396743 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron_lib.callbacks.manager [None req-80a9549f-b5b0-4284-9328-0412540503fc None None] Publish callbacks [] for port, precommit_create {{(pid=102994) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:35:37.489944 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron_lib.callbacks.manager [None req-80a9549f-b5b0-4284-9328-0412540503fc None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7918660', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-15067', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560168', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8783631008714'] for port, after_create {{(pid=102994) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:35:37.538591 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron_lib.callbacks.manager [None req-dc167e61-2b66-4425-ae1d-6e5dfc697da9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7921281'] for port, before_update {{(pid=102994) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:35:37.567085 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-80a9549f-b5b0-4284-9328-0412540503fc None None] Network a79fa83e-69fd-41d9-9001-545f7467c26a is already hosted by enough agents. {{(pid=102994) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 23 19:35:37.581652 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.scheduler.base_scheduler [None req-80a9549f-b5b0-4284-9328-0412540503fc None None] Resources bound (agent type, host, resource id): {{(pid=102994) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 23 19:35:37.582421 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [None req-322817a8-ceaf-4aad-9ecb-b21aebdf2c72 admin admin] Publish callbacks [] for router_gateway, before_create {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:35:37.583377 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-80a9549f-b5b0-4284-9328-0412540503fc None None] Pushing event updated for resources: {'Port': ['ID=f244284e-32a3-4378-aeca-176afb29edd9,revision_number=1']} {{(pid=102994) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 23 19:35:37.587822 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.db.l3_dvrscheduler_db [None req-80a9549f-b5b0-4284-9328-0412540503fc None None] Received port after_create {{(pid=102994) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 23 19:35:37.604752 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [None req-322817a8-ceaf-4aad-9ecb-b21aebdf2c72 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7921281'] for port, before_create {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:35:37.631233 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.plugins.ml2.db [None req-dc167e61-2b66-4425-ae1d-6e5dfc697da9 None None] For port 854821af-61e0-47e7-a603-95f500a49030, host dv-cinder-819011-1-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-819011-1-iscsi',level=0,port_id=854821af-61e0-47e7-a603-95f500a49030,segment=NetworkSegment(56316385-5b81-43f5-84db-b708b46f04eb),segment_id=56316385-5b81-43f5-84db-b708b46f04eb)] {{(pid=102994) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 23 19:35:37.660418 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.db.l3_hamode_db [None req-b95ea5d5-6f49-476a-b921-4d764afd92db None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '0534bcc4-1e12-4026-90ce-1406543c7662', 'name': 'tempest-TestVolumeBootPattern-84632531-router', 'tenant_id': '257b0b2e531441b4bb745e99cfd799f3', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'a93e254e-aac9-4233-9e4d-4290fd0458e4', 'external_fixed_ips': [{'subnet_id': 'e0b32f3d-83d6-439a-bbed-01df7cf01051', 'ip_address': '172.27.1.154'}], 'enable_snat': True}, 'gw_port_id': 'c7996293-6188-4690-b614-395448e4dc25', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-23T19:35:29Z', 'updated_at': '2021-11-23T19:35:33Z', 'revision_number': 4, 'project_id': '257b0b2e531441b4bb745e99cfd799f3', 'gw_port': {'id': 'c7996293-6188-4690-b614-395448e4dc25', 'name': '', 'network_id': 'a93e254e-aac9-4233-9e4d-4290fd0458e4', 'tenant_id': '', 'mac_address': 'fa:16:3e:52:67:5e', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '0534bcc4-1e12-4026-90ce-1406543c7662', 'device_owner': 'network:router_gateway', 'standard_attr_id': 392, 'fixed_ips': [{'subnet_id': 'e0b32f3d-83d6-439a-bbed-01df7cf01051', 'ip_address': '172.27.1.154', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-819011-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-23T19:35:30Z', 'updated_at': '2021-11-23T19:35:34Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'e0b32f3d-83d6-439a-bbed-01df7cf01051', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-819011-1-iscsi', '_interfaces': [{'id': '854821af-61e0-47e7-a603-95f500a49030', 'name': '', 'network_id': '226a519f-5f3e-4d80-bb8a-0e9fc4f64828', 'tenant_id': '257b0b2e531441b4bb745e99cfd799f3', 'mac_address': 'fa:16:3e:90:11:65', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '0534bcc4-1e12-4026-90ce-1406543c7662', 'device_owner': 'network:router_interface', 'standard_attr_id': 393, 'fixed_ips': [{'subnet_id': '88de785d-c540-4651-af1e-26f27ccaee3c', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-819011-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-23T19:35:32Z', 'updated_at': '2021-11-23T19:35:36Z', 'revision_number': 4, 'project_id': '257b0b2e531441b4bb745e99cfd799f3', 'subnets': [{'id': '88de785d-c540-4651-af1e-26f27ccaee3c', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-819011-1-iscsi', False) {} {{(pid=102994) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 23 19:35:37.690313 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.plugins.ml2.managers [None req-80a9549f-b5b0-4284-9328-0412540503fc None None] Attempting to bind port f244284e-32a3-4378-aeca-176afb29edd9 on host dv-cinder-819011-1-iscsi for vnic_type normal with profile {{(pid=102994) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 23 19:35:37.690735 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.plugins.ml2.managers [None req-80a9549f-b5b0-4284-9328-0412540503fc None None] Attempting to bind port f244284e-32a3-4378-aeca-176afb29edd9 by drivers openvswitch,hyperv on host dv-cinder-819011-1-iscsi at level 0 using segments [{'id': '89776fd7-6ee8-49b6-aa38-04444322cfc6', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 837, 'network_id': 'a79fa83e-69fd-41d9-9001-545f7467c26a'}] {{(pid=102994) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 23 19:35:37.691116 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-80a9549f-b5b0-4284-9328-0412540503fc None None] Attempting to bind port f244284e-32a3-4378-aeca-176afb29edd9 on network a79fa83e-69fd-41d9-9001-545f7467c26a {{(pid=102994) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 23 19:35:37.694748 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron_lib.callbacks.manager [None req-dc167e61-2b66-4425-ae1d-6e5dfc697da9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7918660', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-15067', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560168', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8783631423946', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8783631008732', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8783631008750'] for port, after_update {{(pid=102994) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:35:37.696596 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-b95ea5d5-6f49-476a-b921-4d764afd92db None None] The sync data for ids ['0534bcc4-1e12-4026-90ce-1406543c7662'] in dv-cinder-819011-1-iscsi is: [{'id': '0534bcc4-1e12-4026-90ce-1406543c7662', 'name': 'tempest-TestVolumeBootPattern-84632531-router', 'tenant_id': '257b0b2e531441b4bb745e99cfd799f3', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'a93e254e-aac9-4233-9e4d-4290fd0458e4', 'external_fixed_ips': [{'subnet_id': 'e0b32f3d-83d6-439a-bbed-01df7cf01051', 'ip_address': '172.27.1.154'}], 'enable_snat': True}, 'gw_port_id': 'c7996293-6188-4690-b614-395448e4dc25', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-23T19:35:29Z', 'updated_at': '2021-11-23T19:35:33Z', 'revision_number': 4, 'project_id': '257b0b2e531441b4bb745e99cfd799f3', 'gw_port': {'id': 'c7996293-6188-4690-b614-395448e4dc25', 'name': '', 'network_id': 'a93e254e-aac9-4233-9e4d-4290fd0458e4', 'tenant_id': '', 'mac_address': 'fa:16:3e:52:67:5e', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '0534bcc4-1e12-4026-90ce-1406543c7662', 'device_owner': 'network:router_gateway', 'standard_attr_id': 392, 'fixed_ips': [{'subnet_id': 'e0b32f3d-83d6-439a-bbed-01df7cf01051', 'ip_address': '172.27.1.154', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-819011-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-23T19:35:30Z', 'updated_at': '2021-11-23T19:35:34Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'e0b32f3d-83d6-439a-bbed-01df7cf01051', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-819011-1-iscsi', '_interfaces': [{'id': '854821af-61e0-47e7-a603-95f500a49030', 'name': '', 'network_id': '226a519f-5f3e-4d80-bb8a-0e9fc4f64828', 'tenant_id': '257b0b2e531441b4bb745e99cfd799f3', 'mac_address': 'fa:16:3e:90:11:65', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '0534bcc4-1e12-4026-90ce-1406543c7662', 'device_owner': 'network:router_interface', 'standard_attr_id': 393, 'fixed_ips': [{'subnet_id': '88de785d-c540-4651-af1e-26f27ccaee3c', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-819011-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-23T19:35:32Z', 'updated_at': '2021-11-23T19:35:36Z', 'revision_number': 4, 'project_id': '257b0b2e531441b4bb745e99cfd799f3', 'subnets': [{'id': '88de785d-c540-4651-af1e-26f27ccaee3c', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=102994) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 23 19:35:37.707069 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-80a9549f-b5b0-4284-9328-0412540503fc None None] Checking agent: {'id': '668c8953-047c-499e-8c0d-db838fac1668', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-819011-1-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 23, 19, 25, 17), 'started_at': datetime.datetime(2021, 11, 23, 19, 25, 47), 'heartbeat_timestamp': datetime.datetime(2021, 11, 23, 19, 35, 17), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-819011-1-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=102994) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 23 19:35:37.707814 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-80a9549f-b5b0-4284-9328-0412540503fc None None] Checking segment: {'id': '89776fd7-6ee8-49b6-aa38-04444322cfc6', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 837, 'network_id': 'a79fa83e-69fd-41d9-9001-545f7467c26a'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102994) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 23 19:35:37.707943 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron_lib.callbacks.manager [None req-80a9549f-b5b0-4284-9328-0412540503fc None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=102994) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:35:37.708330 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-80a9549f-b5b0-4284-9328-0412540503fc None None] Bound using segment: {'id': '89776fd7-6ee8-49b6-aa38-04444322cfc6', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 837, 'network_id': 'a79fa83e-69fd-41d9-9001-545f7467c26a'} {{(pid=102994) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 23 19:35:37.708836 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.plugins.ml2.managers [None req-80a9549f-b5b0-4284-9328-0412540503fc None None] Bound port: f244284e-32a3-4378-aeca-176afb29edd9, host: dv-cinder-819011-1-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '89776fd7-6ee8-49b6-aa38-04444322cfc6', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 837, 'network_id': 'a79fa83e-69fd-41d9-9001-545f7467c26a'}}] {{(pid=102994) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 23 19:35:37.709221 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron_lib.callbacks.manager [None req-80a9549f-b5b0-4284-9328-0412540503fc None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7921281'] for port, before_update {{(pid=102994) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:35:37.717759 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.db.db_base_plugin_common [None req-322817a8-ceaf-4aad-9ecb-b21aebdf2c72 admin admin] Allocated IP 172.27.1.23 (a93e254e-aac9-4233-9e4d-4290fd0458e4/e0b32f3d-83d6-439a-bbed-01df7cf01051/73dcb0d3-92dc-4f06-8f5e-6b11c077207d) {{(pid=102992) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 23 19:35:37.798021 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-dc167e61-2b66-4425-ae1d-6e5dfc697da9 None None] Pushing event updated for resources: {'Port': ['ID=854821af-61e0-47e7-a603-95f500a49030,revision_number=5']} {{(pid=102994) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 23 19:35:37.833118 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.plugins.ml2.db [None req-80a9549f-b5b0-4284-9328-0412540503fc None None] For port f244284e-32a3-4378-aeca-176afb29edd9, host dv-cinder-819011-1-iscsi, cleared binding levels {{(pid=102994) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 23 19:35:37.837048 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.plugins.ml2.db [None req-80a9549f-b5b0-4284-9328-0412540503fc None None] For port f244284e-32a3-4378-aeca-176afb29edd9, host dv-cinder-819011-1-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-819011-1-iscsi',level=0,port_id=f244284e-32a3-4378-aeca-176afb29edd9,segment=NetworkSegment(89776fd7-6ee8-49b6-aa38-04444322cfc6),segment_id=89776fd7-6ee8-49b6-aa38-04444322cfc6)] {{(pid=102994) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 23 19:35:37.880683 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [None req-322817a8-ceaf-4aad-9ecb-b21aebdf2c72 admin admin] Publish callbacks [] for port, precommit_create {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:35:37.899071 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron_lib.callbacks.manager [None req-80a9549f-b5b0-4284-9328-0412540503fc None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7918660', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-15067', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560168', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8783631423946', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8783631008732', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8783631008750'] for port, after_update {{(pid=102994) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:35:37.914695 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9920c232-9c2b-4a3c-998d-abd5d55cda86 req-95b9b723-b660-440b-9362-7f43ebf78096 tempest-AttachVolumeShelveTestJSON-1172915835 tempest-AttachVolumeShelveTestJSON-1172915835-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102993) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:35:37.922266 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-9920c232-9c2b-4a3c-998d-abd5d55cda86 req-95b9b723-b660-440b-9362-7f43ebf78096 tempest-AttachVolumeShelveTestJSON-1172915835 tempest-AttachVolumeShelveTestJSON-1172915835-project] 10.222.0.62 "GET /v2.0/ports?device_id=85ea3d72-6c17-4ea2-82b7-90cce01633bd HTTP/1.1" status: 200 len: 945 time: 0.0703118 Nov 23 19:35:37.983206 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [None req-322817a8-ceaf-4aad-9ecb-b21aebdf2c72 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7918660', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-15067', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560168', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8783631008714', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-25199805'] for port, after_create {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:35:37.989790 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-9920c232-9c2b-4a3c-998d-abd5d55cda86 req-cdc3ea5e-d6f0-4bb3-a0d1-29afae064b75 tempest-AttachVolumeShelveTestJSON-1172915835 tempest-AttachVolumeShelveTestJSON-1172915835-project] 10.222.0.62 "GET /v2.0/security-groups?id=f1ca24d9-0a31-470d-a1d5-fa7059df0141&fields=id&fields=name HTTP/1.1" status: 200 len: 311 time: 0.0645130 Nov 23 19:35:38.009159 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.plugins.ml2.rpc [None req-eb87b2c3-3339-4249-8b85-e695b5b4e1f9 None None] Device 854821af-61e0-47e7-a603-95f500a49030 up at agent ovs-agent-dv-cinder-819011-1-iscsi {{(pid=102994) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 23 19:35:38.042542 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-80a9549f-b5b0-4284-9328-0412540503fc None None] Pushing event updated for resources: {'Port': ['ID=f244284e-32a3-4378-aeca-176afb29edd9,revision_number=2']} {{(pid=102994) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 23 19:35:38.046115 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-322817a8-ceaf-4aad-9ecb-b21aebdf2c72 admin admin] Network a93e254e-aac9-4233-9e4d-4290fd0458e4 is already hosted by enough agents. {{(pid=102992) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 23 19:35:38.049620 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.scheduler.base_scheduler [None req-322817a8-ceaf-4aad-9ecb-b21aebdf2c72 admin admin] Resources bound (agent type, host, resource id): {{(pid=102992) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 23 19:35:38.056305 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.db.l3_dvrscheduler_db [None req-322817a8-ceaf-4aad-9ecb-b21aebdf2c72 admin admin] Received port after_create {{(pid=102992) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 23 19:35:38.061986 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-322817a8-ceaf-4aad-9ecb-b21aebdf2c72 admin admin] Pushing event updated for resources: {'Port': ['ID=73dcb0d3-92dc-4f06-8f5e-6b11c077207d,revision_number=1']} {{(pid=102992) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 23 19:35:38.074652 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.db.provisioning_blocks [None req-eb87b2c3-3339-4249-8b85-e695b5b4e1f9 None None] Provisioning complete for port 854821af-61e0-47e7-a603-95f500a49030 triggered by entity L2. {{(pid=102994) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 23 19:35:38.075032 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron_lib.callbacks.manager [None req-eb87b2c3-3339-4249-8b85-e695b5b4e1f9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-8355713'] for port, provisioning_complete {{(pid=102994) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:35:38.447943 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [None req-322817a8-ceaf-4aad-9ecb-b21aebdf2c72 admin admin] Publish callbacks [] for router_gateway, after_create {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:35:38.585877 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b0a159c9-8ac9-4dde-a2b2-982876d3021d req-8f08606f-9941-4cbf-9a3e-f49e0b226959 tempest-VolumesActionsTest-802949502 tempest-VolumesActionsTest-802949502-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102992) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:35:38.587442 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-b0a159c9-8ac9-4dde-a2b2-982876d3021d req-8f08606f-9941-4cbf-9a3e-f49e0b226959 tempest-VolumesActionsTest-802949502 tempest-VolumesActionsTest-802949502-project] 10.222.0.62 "GET /v2.0/ports?device_id=fa2c753c-e8ba-46c8-8c59-7a35f6357117 HTTP/1.1" status: 200 len: 945 time: 0.1014152 Nov 23 19:35:38.734500 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-b0a159c9-8ac9-4dde-a2b2-982876d3021d req-d6283de8-b7bf-4dde-a53e-fd5735571c06 tempest-VolumesActionsTest-802949502 tempest-VolumesActionsTest-802949502-project] 10.222.0.62 "GET /v2.0/security-groups?id=47acb13d-cf9a-4dd6-a614-503b94072f69&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1351774 Nov 23 19:35:38.760669 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [None req-322817a8-ceaf-4aad-9ecb-b21aebdf2c72 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-932875', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-926501'] for router, after_create {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:35:39.000757 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-322817a8-ceaf-4aad-9ecb-b21aebdf2c72 admin admin] Router 1f81a2e4-42a5-4a27-ab4f-d5d6928fc891 is scheduled to L3 agent 1b20f2c4-70b6-43c3-b9bd-0062cc9e57ac with binding_index 1 {{(pid=102992) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Nov 23 19:35:39.056836 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-343237c6-9a22-4532-a6fe-969a99a568e7 None None] Network a79fa83e-69fd-41d9-9001-545f7467c26a requested from dv-cinder-819011-1-iscsi {{(pid=102994) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 23 19:35:39.078855 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.db.provisioning_blocks [None req-cc76f3a6-18ca-4fd8-b6ca-c7e1c0bdd0e4 None None] Provisioning complete for port f244284e-32a3-4378-aeca-176afb29edd9 triggered by entity DHCP. {{(pid=102994) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 23 19:35:39.079239 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron_lib.callbacks.manager [None req-cc76f3a6-18ca-4fd8-b6ca-c7e1c0bdd0e4 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-8355713'] for port, provisioning_complete {{(pid=102994) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:35:39.123954 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cdfb8229-0981-4c5a-ae39-1c1976c7ac72 req-3b5762b7-4da2-4ba6-951c-7293c7a834ff tempest-AttachVolumeShelveTestJSON-1172915835 tempest-AttachVolumeShelveTestJSON-1172915835-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102993) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:35:39.125448 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-cdfb8229-0981-4c5a-ae39-1c1976c7ac72 req-3b5762b7-4da2-4ba6-951c-7293c7a834ff tempest-AttachVolumeShelveTestJSON-1172915835 tempest-AttachVolumeShelveTestJSON-1172915835-project] 10.222.0.62 "GET /v2.0/ports?device_id=85ea3d72-6c17-4ea2-82b7-90cce01633bd HTTP/1.1" status: 200 len: 945 time: 0.0520396 Nov 23 19:35:39.130006 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-322817a8-ceaf-4aad-9ecb-b21aebdf2c72 admin admin] Notify agent at l3_agent.dv-cinder-819011-1-iscsi the message routers_updated {{(pid=102992) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 23 19:35:39.141774 dv-cinder-819011-1-iscsi neutron-server[102995]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-819ca4ce-1de7-49bb-a145-e2ae0ac31faa None None] Sync routers for ids ['1f81a2e4-42a5-4a27-ab4f-d5d6928fc891'] in dv-cinder-819011-1-iscsi {{(pid=102995) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 23 19:35:39.151216 dv-cinder-819011-1-iscsi neutron-server[102995]: DEBUG neutron.db.l3_dvrscheduler_db [None req-819ca4ce-1de7-49bb-a145-e2ae0ac31faa None None] Routers {'1f81a2e4-42a5-4a27-ab4f-d5d6928fc891'} bound to L3 agent in host dv-cinder-819011-1-iscsi {{(pid=102995) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 23 19:35:39.154294 dv-cinder-819011-1-iscsi neutron-server[102995]: DEBUG neutron.db.l3_hamode_db [None req-819ca4ce-1de7-49bb-a145-e2ae0ac31faa None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-819011-1-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-23T19:25:14Z,description=,heartbeat_timestamp=2021-11-23T19:35:14Z,host='dv-cinder-819011-1-iscsi',id=1b20f2c4-70b6-43c3-b9bd-0062cc9e57ac,load=0,resource_versions=,resources_synced=,started_at=2021-11-23T19:25:15Z,topic='l3_agent')) {'router_ids': ['1f81a2e4-42a5-4a27-ab4f-d5d6928fc891'], 'active': True} {{(pid=102995) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 23 19:35:39.187496 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-cdfb8229-0981-4c5a-ae39-1c1976c7ac72 req-74412c47-3042-453e-befc-73150cd6a9d1 tempest-AttachVolumeShelveTestJSON-1172915835 tempest-AttachVolumeShelveTestJSON-1172915835-project] 10.222.0.62 "GET /v2.0/security-groups?id=f1ca24d9-0a31-470d-a1d5-fa7059df0141&fields=id&fields=name HTTP/1.1" status: 200 len: 311 time: 0.0507867 Nov 23 19:35:39.221960 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [None req-322817a8-ceaf-4aad-9ecb-b21aebdf2c72 admin admin] Publish callbacks [] for router, before_response {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:35:39.225787 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [None req-322817a8-ceaf-4aad-9ecb-b21aebdf2c72 admin admin] 10.222.0.62 "POST /v2.0/routers HTTP/1.1" status: 201 len: 923 time: 2.4968624 Nov 23 19:35:39.226304 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.wsgi [-] (102993) accepted ('10.222.0.62', 45464) {{(pid=102993) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 23 19:35:39.260823 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron_lib.callbacks.manager [None req-cc76f3a6-18ca-4fd8-b6ca-c7e1c0bdd0e4 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7921281'] for port, before_update {{(pid=102994) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:35:39.326032 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.plugins.ml2.db [None req-cc76f3a6-18ca-4fd8-b6ca-c7e1c0bdd0e4 None None] For port f244284e-32a3-4378-aeca-176afb29edd9, host dv-cinder-819011-1-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-819011-1-iscsi',level=0,port_id=f244284e-32a3-4378-aeca-176afb29edd9,segment=NetworkSegment(89776fd7-6ee8-49b6-aa38-04444322cfc6),segment_id=89776fd7-6ee8-49b6-aa38-04444322cfc6)] {{(pid=102994) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 23 19:35:39.375093 dv-cinder-819011-1-iscsi neutron-server[102995]: DEBUG neutron.db.l3_dvr_db [None req-819ca4ce-1de7-49bb-a145-e2ae0ac31faa None None] Set router 1f81a2e4-42a5-4a27-ab4f-d5d6928fc891 gateway port host: dv-cinder-819011-1-iscsi {{(pid=102995) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 23 19:35:39.407243 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron_lib.callbacks.manager [None req-cc76f3a6-18ca-4fd8-b6ca-c7e1c0bdd0e4 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7918660', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-15067', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560168', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8783631423946', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8783631008732', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8783631008750'] for port, after_update {{(pid=102994) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:35:39.467936 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cc76f3a6-18ca-4fd8-b6ca-c7e1c0bdd0e4 None None] Pushing event updated for resources: {'Port': ['ID=f244284e-32a3-4378-aeca-176afb29edd9,revision_number=3']} {{(pid=102994) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 23 19:35:39.598389 dv-cinder-819011-1-iscsi neutron-server[102995]: DEBUG neutron.db.l3_hamode_db [None req-819ca4ce-1de7-49bb-a145-e2ae0ac31faa None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '1f81a2e4-42a5-4a27-ab4f-d5d6928fc891', 'name': 'tempest-TestVolumeBootPattern-1496802758-router', 'tenant_id': '1e70ae5f657c4aebb6c283d99f5ccde0', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'a93e254e-aac9-4233-9e4d-4290fd0458e4', 'external_fixed_ips': [{'subnet_id': 'e0b32f3d-83d6-439a-bbed-01df7cf01051', 'ip_address': '172.27.1.23'}], 'enable_snat': True}, 'gw_port_id': '73dcb0d3-92dc-4f06-8f5e-6b11c077207d', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-23T19:35:36Z', 'updated_at': '2021-11-23T19:35:38Z', 'revision_number': 3, 'project_id': '1e70ae5f657c4aebb6c283d99f5ccde0', 'gw_port': {'id': '73dcb0d3-92dc-4f06-8f5e-6b11c077207d', 'name': '', 'network_id': 'a93e254e-aac9-4233-9e4d-4290fd0458e4', 'tenant_id': '', 'mac_address': 'fa:16:3e:9c:b1:7d', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '1f81a2e4-42a5-4a27-ab4f-d5d6928fc891', 'device_owner': 'network:router_gateway', 'standard_attr_id': 404, 'fixed_ips': [{'subnet_id': 'e0b32f3d-83d6-439a-bbed-01df7cf01051', 'ip_address': '172.27.1.23', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-23T19:35:37Z', 'updated_at': '2021-11-23T19:35:37Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': 'e0b32f3d-83d6-439a-bbed-01df7cf01051', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-819011-1-iscsi'}], 'dv-cinder-819011-1-iscsi', False) {} {{(pid=102995) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 23 19:35:39.626362 dv-cinder-819011-1-iscsi neutron-server[102995]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-819ca4ce-1de7-49bb-a145-e2ae0ac31faa None None] Checking router: 1f81a2e4-42a5-4a27-ab4f-d5d6928fc891 for host: dv-cinder-819011-1-iscsi {{(pid=102995) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 23 19:35:39.626642 dv-cinder-819011-1-iscsi neutron-server[102995]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-819ca4ce-1de7-49bb-a145-e2ae0ac31faa None None] Updating router 1f81a2e4-42a5-4a27-ab4f-d5d6928fc891 port 73dcb0d3-92dc-4f06-8f5e-6b11c077207d binding host dv-cinder-819011-1-iscsi {{(pid=102995) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Nov 23 19:35:39.638618 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.db.provisioning_blocks [None req-50a76306-a12b-4b72-b8f8-1e1007632ef7 None None] Provisioning complete for port f244284e-32a3-4378-aeca-176afb29edd9 triggered by entity DHCP. {{(pid=102994) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 23 19:35:39.639082 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron_lib.callbacks.manager [None req-50a76306-a12b-4b72-b8f8-1e1007632ef7 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-8355713'] for port, provisioning_complete {{(pid=102994) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:35:39.663445 dv-cinder-819011-1-iscsi neutron-server[102995]: DEBUG neutron_lib.callbacks.manager [None req-819ca4ce-1de7-49bb-a145-e2ae0ac31faa None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7921281'] for port, before_update {{(pid=102995) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:35:39.705064 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-e35f5c67-a517-4475-b8bb-d789a2071c23 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7921281'] for port, before_create {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:35:39.861850 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-397e3969-264f-4e4e-878d-e06f0dfc47f2 req-cdce2643-1225-492a-a6a3-88b51792db17 tempest-VolumesActionsTest-802949502 tempest-VolumesActionsTest-802949502-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102992) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:35:39.863627 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-397e3969-264f-4e4e-878d-e06f0dfc47f2 req-cdce2643-1225-492a-a6a3-88b51792db17 tempest-VolumesActionsTest-802949502 tempest-VolumesActionsTest-802949502-project] 10.222.0.62 "GET /v2.0/ports?device_id=fa2c753c-e8ba-46c8-8c59-7a35f6357117 HTTP/1.1" status: 200 len: 945 time: 0.0545528 Nov 23 19:35:39.890330 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.db.db_base_plugin_common [None req-e35f5c67-a517-4475-b8bb-d789a2071c23 admin admin] Allocated IP 172.20.0.1 (a79fa83e-69fd-41d9-9001-545f7467c26a/56f5fba5-4cd3-476d-bc1c-2e0c8f45bb10/c822f8fa-fca4-481d-b3b9-e84f0deaed5a) {{(pid=102993) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 23 19:35:39.936463 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-397e3969-264f-4e4e-878d-e06f0dfc47f2 req-51a2c154-c313-4e00-bc91-788013024926 tempest-VolumesActionsTest-802949502 tempest-VolumesActionsTest-802949502-project] 10.222.0.62 "GET /v2.0/security-groups?id=47acb13d-cf9a-4dd6-a614-503b94072f69&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0624323 Nov 23 19:35:39.965595 dv-cinder-819011-1-iscsi neutron-server[102995]: DEBUG neutron_lib.callbacks.manager [None req-819ca4ce-1de7-49bb-a145-e2ae0ac31faa None None] Publish callbacks [] for port, precommit_update {{(pid=102995) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:35:39.988745 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.plugins.ml2.rpc [None req-eb87b2c3-3339-4249-8b85-e695b5b4e1f9 None None] Device f244284e-32a3-4378-aeca-176afb29edd9 up at agent ovs-agent-dv-cinder-819011-1-iscsi {{(pid=102994) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 23 19:35:40.021024 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-e35f5c67-a517-4475-b8bb-d789a2071c23 admin admin] Publish callbacks [] for port, precommit_create {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:35:40.035600 dv-cinder-819011-1-iscsi neutron-server[102995]: DEBUG neutron_lib.callbacks.manager [None req-819ca4ce-1de7-49bb-a145-e2ae0ac31faa None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7918660', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-15067', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560168', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8783631423946', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8783631008732', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8783631008750'] for port, after_update {{(pid=102995) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:35:40.037271 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.db.provisioning_blocks [None req-eb87b2c3-3339-4249-8b85-e695b5b4e1f9 None None] Provisioning complete for port f244284e-32a3-4378-aeca-176afb29edd9 triggered by entity L2. {{(pid=102994) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 23 19:35:40.037637 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron_lib.callbacks.manager [None req-eb87b2c3-3339-4249-8b85-e695b5b4e1f9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-8355713'] for port, provisioning_complete {{(pid=102994) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:35:40.089093 dv-cinder-819011-1-iscsi neutron-server[102995]: DEBUG neutron.plugins.ml2.managers [None req-819ca4ce-1de7-49bb-a145-e2ae0ac31faa None None] Attempting to bind port 73dcb0d3-92dc-4f06-8f5e-6b11c077207d on host dv-cinder-819011-1-iscsi for vnic_type normal with profile {{(pid=102995) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 23 19:35:40.089494 dv-cinder-819011-1-iscsi neutron-server[102995]: DEBUG neutron.plugins.ml2.managers [None req-819ca4ce-1de7-49bb-a145-e2ae0ac31faa None None] Attempting to bind port 73dcb0d3-92dc-4f06-8f5e-6b11c077207d by drivers openvswitch,hyperv on host dv-cinder-819011-1-iscsi at level 0 using segments [{'id': '3cb5e60b-103a-47d0-a28b-d68e3159d032', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'a93e254e-aac9-4233-9e4d-4290fd0458e4'}] {{(pid=102995) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 23 19:35:40.089872 dv-cinder-819011-1-iscsi neutron-server[102995]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-819ca4ce-1de7-49bb-a145-e2ae0ac31faa None None] Attempting to bind port 73dcb0d3-92dc-4f06-8f5e-6b11c077207d on network a93e254e-aac9-4233-9e4d-4290fd0458e4 {{(pid=102995) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 23 19:35:40.096314 dv-cinder-819011-1-iscsi neutron-server[102995]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-819ca4ce-1de7-49bb-a145-e2ae0ac31faa None None] Checking agent: {'id': '668c8953-047c-499e-8c0d-db838fac1668', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-819011-1-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 23, 19, 25, 17), 'started_at': datetime.datetime(2021, 11, 23, 19, 25, 47), 'heartbeat_timestamp': datetime.datetime(2021, 11, 23, 19, 35, 17), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-819011-1-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=102995) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 23 19:35:40.096739 dv-cinder-819011-1-iscsi neutron-server[102995]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-819ca4ce-1de7-49bb-a145-e2ae0ac31faa None None] Checking segment: {'id': '3cb5e60b-103a-47d0-a28b-d68e3159d032', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'a93e254e-aac9-4233-9e4d-4290fd0458e4'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102995) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 23 19:35:40.097143 dv-cinder-819011-1-iscsi neutron-server[102995]: DEBUG neutron_lib.callbacks.manager [None req-819ca4ce-1de7-49bb-a145-e2ae0ac31faa None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=102995) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:35:40.097934 dv-cinder-819011-1-iscsi neutron-server[102995]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-819ca4ce-1de7-49bb-a145-e2ae0ac31faa None None] Bound using segment: {'id': '3cb5e60b-103a-47d0-a28b-d68e3159d032', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'a93e254e-aac9-4233-9e4d-4290fd0458e4'} {{(pid=102995) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 23 19:35:40.098413 dv-cinder-819011-1-iscsi neutron-server[102995]: DEBUG neutron.plugins.ml2.managers [None req-819ca4ce-1de7-49bb-a145-e2ae0ac31faa None None] Bound port: 73dcb0d3-92dc-4f06-8f5e-6b11c077207d, host: dv-cinder-819011-1-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '3cb5e60b-103a-47d0-a28b-d68e3159d032', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'a93e254e-aac9-4233-9e4d-4290fd0458e4'}}] {{(pid=102995) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 23 19:35:40.098800 dv-cinder-819011-1-iscsi neutron-server[102995]: DEBUG neutron_lib.callbacks.manager [None req-819ca4ce-1de7-49bb-a145-e2ae0ac31faa None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7921281'] for port, before_update {{(pid=102995) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:35:40.122469 dv-cinder-819011-1-iscsi neutron-server[102995]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-34103765-0137-45bd-8bc3-a855b9f3c259 None None] Pushing event updated for resources: {'Port': ['ID=73dcb0d3-92dc-4f06-8f5e-6b11c077207d,revision_number=2']} {{(pid=102995) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 23 19:35:40.128709 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-e35f5c67-a517-4475-b8bb-d789a2071c23 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7918660', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-15067', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560168', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8783631008714', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-17257496'] for port, after_create {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:35:40.160677 dv-cinder-819011-1-iscsi neutron-server[102995]: DEBUG neutron.plugins.ml2.db [None req-819ca4ce-1de7-49bb-a145-e2ae0ac31faa None None] For port 73dcb0d3-92dc-4f06-8f5e-6b11c077207d, host dv-cinder-819011-1-iscsi, cleared binding levels {{(pid=102995) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 23 19:35:40.164041 dv-cinder-819011-1-iscsi neutron-server[102995]: DEBUG neutron.plugins.ml2.db [None req-819ca4ce-1de7-49bb-a145-e2ae0ac31faa None None] For port 73dcb0d3-92dc-4f06-8f5e-6b11c077207d, host dv-cinder-819011-1-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-819011-1-iscsi',level=0,port_id=73dcb0d3-92dc-4f06-8f5e-6b11c077207d,segment=NetworkSegment(3cb5e60b-103a-47d0-a28b-d68e3159d032),segment_id=3cb5e60b-103a-47d0-a28b-d68e3159d032)] {{(pid=102995) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 23 19:35:40.171054 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-e35f5c67-a517-4475-b8bb-d789a2071c23 admin admin] Network a79fa83e-69fd-41d9-9001-545f7467c26a is already hosted by enough agents. {{(pid=102993) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 23 19:35:40.176982 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.scheduler.base_scheduler [None req-e35f5c67-a517-4475-b8bb-d789a2071c23 admin admin] Resources bound (agent type, host, resource id): {{(pid=102993) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 23 19:35:40.182128 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.db.l3_dvrscheduler_db [None req-e35f5c67-a517-4475-b8bb-d789a2071c23 admin admin] Received port after_create {{(pid=102993) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 23 19:35:40.184706 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e35f5c67-a517-4475-b8bb-d789a2071c23 admin admin] Pushing event updated for resources: {'Port': ['ID=c822f8fa-fca4-481d-b3b9-e84f0deaed5a,revision_number=1']} {{(pid=102993) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 23 19:35:40.224399 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-e35f5c67-a517-4475-b8bb-d789a2071c23 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-926676'] for router_interface, before_create {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:35:40.230179 dv-cinder-819011-1-iscsi neutron-server[102995]: DEBUG neutron_lib.callbacks.manager [None req-819ca4ce-1de7-49bb-a145-e2ae0ac31faa None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7918660', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-15067', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560168', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8783631423946', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8783631008732', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8783631008750'] for port, after_update {{(pid=102995) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:35:40.304789 dv-cinder-819011-1-iscsi neutron-server[102995]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-34103765-0137-45bd-8bc3-a855b9f3c259 None None] Pushing event updated for resources: {'Port': ['ID=73dcb0d3-92dc-4f06-8f5e-6b11c077207d,revision_number=3']} {{(pid=102995) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 23 19:35:40.315206 dv-cinder-819011-1-iscsi neutron-server[102995]: DEBUG neutron.db.l3_dvrscheduler_db [None req-819ca4ce-1de7-49bb-a145-e2ae0ac31faa None None] Routers {'1f81a2e4-42a5-4a27-ab4f-d5d6928fc891'} bound to L3 agent in host dv-cinder-819011-1-iscsi {{(pid=102995) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 23 19:35:40.316551 dv-cinder-819011-1-iscsi neutron-server[102995]: DEBUG neutron.db.l3_hamode_db [None req-819ca4ce-1de7-49bb-a145-e2ae0ac31faa None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-819011-1-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-23T19:25:14Z,description=,heartbeat_timestamp=2021-11-23T19:35:14Z,host='dv-cinder-819011-1-iscsi',id=1b20f2c4-70b6-43c3-b9bd-0062cc9e57ac,load=0,resource_versions=,resources_synced=,started_at=2021-11-23T19:25:15Z,topic='l3_agent')) {'router_ids': ['1f81a2e4-42a5-4a27-ab4f-d5d6928fc891'], 'active': True} {{(pid=102995) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 23 19:35:40.370811 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-048d3ac4-9b3c-48a1-8c60-27857853f938 req-1b9ed779-4dea-4580-b4d3-7d599817b6b8 tempest-VolumesActionsTest-802949502 tempest-VolumesActionsTest-802949502-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102992) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:35:40.372719 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-048d3ac4-9b3c-48a1-8c60-27857853f938 req-1b9ed779-4dea-4580-b4d3-7d599817b6b8 tempest-VolumesActionsTest-802949502 tempest-VolumesActionsTest-802949502-project] 10.222.0.41 "GET /v2.0/ports?device_id=fa2c753c-e8ba-46c8-8c59-7a35f6357117 HTTP/1.1" status: 200 len: 945 time: 0.0720682 Nov 23 19:35:40.391641 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-31e384f2-c08a-4f8c-8b06-3b055575e54d req-5525bd86-dafb-4ef3-896a-238d00237ec0 tempest-AttachVolumeShelveTestJSON-1172915835 tempest-AttachVolumeShelveTestJSON-1172915835-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102993) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:35:40.393735 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-31e384f2-c08a-4f8c-8b06-3b055575e54d req-5525bd86-dafb-4ef3-896a-238d00237ec0 tempest-AttachVolumeShelveTestJSON-1172915835 tempest-AttachVolumeShelveTestJSON-1172915835-project] 10.222.0.62 "GET /v2.0/ports?device_id=85ea3d72-6c17-4ea2-82b7-90cce01633bd HTTP/1.1" status: 200 len: 945 time: 0.0923688 Nov 23 19:35:40.437490 dv-cinder-819011-1-iscsi neutron-server[102995]: DEBUG neutron.db.l3_dvr_db [None req-819ca4ce-1de7-49bb-a145-e2ae0ac31faa None None] Set router 1f81a2e4-42a5-4a27-ab4f-d5d6928fc891 gateway port host: dv-cinder-819011-1-iscsi {{(pid=102995) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 23 19:35:40.463158 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-31e384f2-c08a-4f8c-8b06-3b055575e54d req-57c9489e-02df-42eb-8396-aca7057d9f52 tempest-AttachVolumeShelveTestJSON-1172915835 tempest-AttachVolumeShelveTestJSON-1172915835-project] 10.222.0.62 "GET /v2.0/security-groups?id=f1ca24d9-0a31-470d-a1d5-fa7059df0141&fields=id&fields=name HTTP/1.1" status: 200 len: 311 time: 0.0615695 Nov 23 19:35:40.476902 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.db.provisioning_blocks [None req-64b881ad-520a-4f63-b8a0-3b2f11026ebd None None] Provisioning complete for port c822f8fa-fca4-481d-b3b9-e84f0deaed5a triggered by entity DHCP. {{(pid=102994) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 23 19:35:40.485824 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron_lib.callbacks.manager [None req-64b881ad-520a-4f63-b8a0-3b2f11026ebd None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-8355713'] for port, provisioning_complete {{(pid=102994) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:35:40.540051 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.plugins.ml2.plugin [None req-64b881ad-520a-4f63-b8a0-3b2f11026ebd None None] Port c822f8fa-fca4-481d-b3b9-e84f0deaed5a cannot update to ACTIVE because it is not bound. {{(pid=102994) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 23 19:35:40.566992 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.plugins.ml2.plugin [req-048d3ac4-9b3c-48a1-8c60-27857853f938 req-58565dc4-16a3-4f26-bf84-35352af189b8 tempest-VolumesActionsTest-802949502 tempest-VolumesActionsTest-802949502-project] Deleting port 8a6b6382-0b2a-4cc0-9d38-21f83a9faa3b {{(pid=102992) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 23 19:35:40.567347 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [req-048d3ac4-9b3c-48a1-8c60-27857853f938 req-58565dc4-16a3-4f26-bf84-35352af189b8 tempest-VolumesActionsTest-802949502 tempest-VolumesActionsTest-802949502-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8783631423070'] for port, before_delete {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:35:40.583547 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-e35f5c67-a517-4475-b8bb-d789a2071c23 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7921281'] for port, before_update {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:35:40.684490 dv-cinder-819011-1-iscsi neutron-server[102995]: DEBUG neutron.db.l3_hamode_db [None req-819ca4ce-1de7-49bb-a145-e2ae0ac31faa None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '1f81a2e4-42a5-4a27-ab4f-d5d6928fc891', 'name': 'tempest-TestVolumeBootPattern-1496802758-router', 'tenant_id': '1e70ae5f657c4aebb6c283d99f5ccde0', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'a93e254e-aac9-4233-9e4d-4290fd0458e4', 'external_fixed_ips': [{'subnet_id': 'e0b32f3d-83d6-439a-bbed-01df7cf01051', 'ip_address': '172.27.1.23'}], 'enable_snat': True}, 'gw_port_id': '73dcb0d3-92dc-4f06-8f5e-6b11c077207d', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-23T19:35:36Z', 'updated_at': '2021-11-23T19:35:38Z', 'revision_number': 3, 'project_id': '1e70ae5f657c4aebb6c283d99f5ccde0', 'gw_port': {'id': '73dcb0d3-92dc-4f06-8f5e-6b11c077207d', 'name': '', 'network_id': 'a93e254e-aac9-4233-9e4d-4290fd0458e4', 'tenant_id': '', 'mac_address': 'fa:16:3e:9c:b1:7d', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '1f81a2e4-42a5-4a27-ab4f-d5d6928fc891', 'device_owner': 'network:router_gateway', 'standard_attr_id': 404, 'fixed_ips': [{'subnet_id': 'e0b32f3d-83d6-439a-bbed-01df7cf01051', 'ip_address': '172.27.1.23', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-819011-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-23T19:35:37Z', 'updated_at': '2021-11-23T19:35:40Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'e0b32f3d-83d6-439a-bbed-01df7cf01051', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-819011-1-iscsi'}], 'dv-cinder-819011-1-iscsi', False) {} {{(pid=102995) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 23 19:35:40.694722 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.plugins.ml2.db [req-048d3ac4-9b3c-48a1-8c60-27857853f938 req-58565dc4-16a3-4f26-bf84-35352af189b8 tempest-VolumesActionsTest-802949502 tempest-VolumesActionsTest-802949502-project] For port 8a6b6382-0b2a-4cc0-9d38-21f83a9faa3b, host hv-cinder-81901, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81901',level=0,port_id=8a6b6382-0b2a-4cc0-9d38-21f83a9faa3b,segment=NetworkSegment(2ab14203-895d-412f-8616-df9c89e896c9),segment_id=2ab14203-895d-412f-8616-df9c89e896c9)] {{(pid=102992) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 23 19:35:40.695159 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [req-048d3ac4-9b3c-48a1-8c60-27857853f938 req-58565dc4-16a3-4f26-bf84-35352af189b8 tempest-VolumesActionsTest-802949502 tempest-VolumesActionsTest-802949502-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-927332'] for port, precommit_delete {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:35:40.714843 dv-cinder-819011-1-iscsi neutron-server[102995]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-819ca4ce-1de7-49bb-a145-e2ae0ac31faa None None] The sync data for ids ['1f81a2e4-42a5-4a27-ab4f-d5d6928fc891'] in dv-cinder-819011-1-iscsi is: [{'id': '1f81a2e4-42a5-4a27-ab4f-d5d6928fc891', 'name': 'tempest-TestVolumeBootPattern-1496802758-router', 'tenant_id': '1e70ae5f657c4aebb6c283d99f5ccde0', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'a93e254e-aac9-4233-9e4d-4290fd0458e4', 'external_fixed_ips': [{'subnet_id': 'e0b32f3d-83d6-439a-bbed-01df7cf01051', 'ip_address': '172.27.1.23'}], 'enable_snat': True}, 'gw_port_id': '73dcb0d3-92dc-4f06-8f5e-6b11c077207d', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-23T19:35:36Z', 'updated_at': '2021-11-23T19:35:38Z', 'revision_number': 3, 'project_id': '1e70ae5f657c4aebb6c283d99f5ccde0', 'gw_port': {'id': '73dcb0d3-92dc-4f06-8f5e-6b11c077207d', 'name': '', 'network_id': 'a93e254e-aac9-4233-9e4d-4290fd0458e4', 'tenant_id': '', 'mac_address': 'fa:16:3e:9c:b1:7d', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '1f81a2e4-42a5-4a27-ab4f-d5d6928fc891', 'device_owner': 'network:router_gateway', 'standard_attr_id': 404, 'fixed_ips': [{'subnet_id': 'e0b32f3d-83d6-439a-bbed-01df7cf01051', 'ip_address': '172.27.1.23', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-819011-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-23T19:35:37Z', 'updated_at': '2021-11-23T19:35:40Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'e0b32f3d-83d6-439a-bbed-01df7cf01051', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-819011-1-iscsi'}] {{(pid=102995) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 23 19:35:40.716041 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.plugins.ml2.plugin [req-048d3ac4-9b3c-48a1-8c60-27857853f938 req-58565dc4-16a3-4f26-bf84-35352af189b8 tempest-VolumesActionsTest-802949502 tempest-VolumesActionsTest-802949502-project] Calling delete_port for 8a6b6382-0b2a-4cc0-9d38-21f83a9faa3b owned by compute:nova {{(pid=102992) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 23 19:35:40.789145 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-e35f5c67-a517-4475-b8bb-d789a2071c23 admin admin] Publish callbacks [] for port, precommit_update {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:35:40.847479 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-e35f5c67-a517-4475-b8bb-d789a2071c23 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7918660', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-15067', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560168', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8783631423946', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8783631008732', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8783631008750', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-17257505'] for port, after_update {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:35:40.920869 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-e35f5c67-a517-4475-b8bb-d789a2071c23 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-553426', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-932964'] for router_interface, after_create {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:35:40.922659 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e35f5c67-a517-4475-b8bb-d789a2071c23 admin admin] Pushing event updated for resources: {'Port': ['ID=c822f8fa-fca4-481d-b3b9-e84f0deaed5a,revision_number=2']} {{(pid=102993) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 23 19:35:40.960976 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [req-048d3ac4-9b3c-48a1-8c60-27857853f938 req-58565dc4-16a3-4f26-bf84-35352af189b8 tempest-VolumesActionsTest-802949502 tempest-VolumesActionsTest-802949502-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7918660', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-15067', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560168', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8783631424624', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8783631008723', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-25199805'] for port, after_delete {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:35:41.015698 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-58565dc4-16a3-4f26-bf84-35352af189b8 tempest-VolumesActionsTest-802949502 tempest-VolumesActionsTest-802949502-project] Pushing event deleted for resources: {'Port': ['ID=8a6b6382-0b2a-4cc0-9d38-21f83a9faa3b,revision_number=None']} {{(pid=102992) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 23 19:35:41.050681 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-e35f5c67-a517-4475-b8bb-d789a2071c23 admin admin] Network a79fa83e-69fd-41d9-9001-545f7467c26a is already hosted by enough agents. {{(pid=102993) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 23 19:35:41.052180 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.scheduler.base_scheduler [None req-e35f5c67-a517-4475-b8bb-d789a2071c23 admin admin] Resources bound (agent type, host, resource id): {{(pid=102993) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 23 19:35:41.118889 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.db.l3_dvrscheduler_db [req-048d3ac4-9b3c-48a1-8c60-27857853f938 req-58565dc4-16a3-4f26-bf84-35352af189b8 tempest-VolumesActionsTest-802949502 tempest-VolumesActionsTest-802949502-project] No DVR routers for this DVR port 8a6b6382-0b2a-4cc0-9d38-21f83a9faa3b on host hv-cinder-81901 {{(pid=102992) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 23 19:35:41.132655 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [req-048d3ac4-9b3c-48a1-8c60-27857853f938 req-58565dc4-16a3-4f26-bf84-35352af189b8 tempest-VolumesActionsTest-802949502 tempest-VolumesActionsTest-802949502-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-514902'] for port, before_response {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:35:41.132917 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.plugins.ml2.rpc [None req-4bf48ff4-ecfb-4168-8b63-249b8c6e9f04 None None] Device 8a6b6382-0b2a-4cc0-9d38-21f83a9faa3b no longer exists at agent hyperv_hv-cinder-81901 {{(pid=102994) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 23 19:35:41.137398 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-048d3ac4-9b3c-48a1-8c60-27857853f938 req-58565dc4-16a3-4f26-bf84-35352af189b8 tempest-VolumesActionsTest-802949502 tempest-VolumesActionsTest-802949502-project] 10.222.0.41 "DELETE /v2.0/ports/8a6b6382-0b2a-4cc0-9d38-21f83a9faa3b HTTP/1.1" status: 204 len: 173 time: 0.7382250 Nov 23 19:35:41.138192 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'fa2c753c-e8ba-46c8-8c59-7a35f6357117', 'name': 'network-vif-deleted', 'tag': '8a6b6382-0b2a-4cc0-9d38-21f83a9faa3b'}] {{(pid=102992) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 23 19:35:41.150174 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.62/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}f86c332b591ae691ababa4b64e0601cbf242a448242f95367ce03daabfb7e1ce" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-f12c9e76-e496-4a6c-9ef0-c50f6ad1d077" -d '{"events": [{"server_uuid": "fa2c753c-e8ba-46c8-8c59-7a35f6357117", "name": "network-vif-deleted", "tag": "8a6b6382-0b2a-4cc0-9d38-21f83a9faa3b"}]}' {{(pid=102992) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 23 19:35:41.163002 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.plugins.ml2.plugin [None req-4bf48ff4-ecfb-4168-8b63-249b8c6e9f04 None None] No Port match for: 8a6b6382-0b2a-4cc0-9d38-21f83a9faa3b {{(pid=102994) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 23 19:35:41.170190 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-ac0979e7-27c9-46d9-b07f-96e0f036d932 req-e3d988ec-6004-4d43-a405-9ae19cdc7223 tempest-VolumesActionsTest-802949502 tempest-VolumesActionsTest-802949502-project] 10.222.0.62 "GET /v2.0/ports?device_id=fa2c753c-e8ba-46c8-8c59-7a35f6357117 HTTP/1.1" status: 200 len: 210 time: 0.0526550 Nov 23 19:35:41.177885 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.plugins.ml2.rpc [None req-4bf48ff4-ecfb-4168-8b63-249b8c6e9f04 None None] Device 8a6b6382-0b2a-4cc0-9d38-21f83a9faa3b not bound to the agent host hv-cinder-81901 {{(pid=102994) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 23 19:35:41.234282 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 23 Nov 2021 19:35:41 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-ed611041-6981-491c-995c-35b03dc611af x-openstack-request-id: req-ed611041-6981-491c-995c-35b03dc611af {{(pid=102992) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 23 19:35:41.234282 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "fa2c753c-e8ba-46c8-8c59-7a35f6357117", "name": "network-vif-deleted", "tag": "8a6b6382-0b2a-4cc0-9d38-21f83a9faa3b", "status": "completed", "code": 200}]} {{(pid=102992) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 23 19:35:41.234282 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.62/compute/v2.1/os-server-external-events used request id req-ed611041-6981-491c-995c-35b03dc611af {{(pid=102992) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 23 19:35:41.234282 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'fa2c753c-e8ba-46c8-8c59-7a35f6357117', 'name': 'network-vif-deleted', 'tag': '8a6b6382-0b2a-4cc0-9d38-21f83a9faa3b', 'status': 'completed', 'code': 200} Nov 23 19:35:41.284941 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-e35f5c67-a517-4475-b8bb-d789a2071c23 admin admin] Router 1f81a2e4-42a5-4a27-ab4f-d5d6928fc891 has already been hosted by L3 agent 1b20f2c4-70b6-43c3-b9bd-0062cc9e57ac {{(pid=102993) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 23 19:35:41.382009 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.db.provisioning_blocks [None req-28efe377-b573-4cc9-820a-89c9faf14ce6 None None] Provisioning complete for port c822f8fa-fca4-481d-b3b9-e84f0deaed5a triggered by entity DHCP. {{(pid=102994) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 23 19:35:41.382393 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron_lib.callbacks.manager [None req-28efe377-b573-4cc9-820a-89c9faf14ce6 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-8355713'] for port, provisioning_complete {{(pid=102994) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:35:41.446526 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-e35f5c67-a517-4475-b8bb-d789a2071c23 admin admin] Notify agent at l3_agent.dv-cinder-819011-1-iscsi the message routers_updated {{(pid=102993) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 23 19:35:41.457723 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [None req-e35f5c67-a517-4475-b8bb-d789a2071c23 admin admin] 10.222.0.62 "PUT /v2.0/routers/1f81a2e4-42a5-4a27-ab4f-d5d6928fc891/add_router_interface HTTP/1.1" status: 200 len: 503 time: 2.2254457 Nov 23 19:35:41.600878 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.plugins.ml2.plugin [None req-28efe377-b573-4cc9-820a-89c9faf14ce6 None None] Port c822f8fa-fca4-481d-b3b9-e84f0deaed5a cannot update to ACTIVE because it is not bound. {{(pid=102994) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 23 19:35:41.632873 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fc626ec4-e028-44bc-891f-b9f0fe2fc977 req-17fe846e-fee8-415d-b9e0-2d555fb72354 tempest-AttachVolumeShelveTestJSON-1172915835 tempest-AttachVolumeShelveTestJSON-1172915835-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102992) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:35:41.634956 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-fc626ec4-e028-44bc-891f-b9f0fe2fc977 req-17fe846e-fee8-415d-b9e0-2d555fb72354 tempest-AttachVolumeShelveTestJSON-1172915835 tempest-AttachVolumeShelveTestJSON-1172915835-project] 10.222.0.62 "GET /v2.0/ports?device_id=85ea3d72-6c17-4ea2-82b7-90cce01633bd HTTP/1.1" status: 200 len: 945 time: 0.0765114 Nov 23 19:35:41.692177 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron_lib.callbacks.manager [None req-692566bb-3105-4393-aeba-a5eebe4bcbb2 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8783631323329', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7978582'] for agent, after_update {{(pid=102994) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:35:41.712197 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-fc626ec4-e028-44bc-891f-b9f0fe2fc977 req-9e87596b-5179-4f78-8155-cdd8fae485cc tempest-AttachVolumeShelveTestJSON-1172915835 tempest-AttachVolumeShelveTestJSON-1172915835-project] 10.222.0.62 "GET /v2.0/security-groups?id=f1ca24d9-0a31-470d-a1d5-fa7059df0141&fields=id&fields=name HTTP/1.1" status: 200 len: 311 time: 0.0658991 Nov 23 19:35:42.004378 dv-cinder-819011-1-iscsi neutron-server[102995]: DEBUG neutron.db.agents_db [None req-84bdc9b2-57ea-4bdb-a245-07c78d37cea8 None None] Agent healthcheck: found 6 active agents {{(pid=102995) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 23 19:35:42.046892 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.plugins.ml2.rpc [None req-eb87b2c3-3339-4249-8b85-e695b5b4e1f9 None None] Device 73dcb0d3-92dc-4f06-8f5e-6b11c077207d up at agent ovs-agent-dv-cinder-819011-1-iscsi {{(pid=102994) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 23 19:35:42.109529 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.db.provisioning_blocks [None req-eb87b2c3-3339-4249-8b85-e695b5b4e1f9 None None] Provisioning complete for port 73dcb0d3-92dc-4f06-8f5e-6b11c077207d triggered by entity L2. {{(pid=102994) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 23 19:35:42.109948 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron_lib.callbacks.manager [None req-eb87b2c3-3339-4249-8b85-e695b5b4e1f9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-8355713'] for port, provisioning_complete {{(pid=102994) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:35:42.197124 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron_lib.callbacks.manager [None req-eb87b2c3-3339-4249-8b85-e695b5b4e1f9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7921281'] for port, before_update {{(pid=102994) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:35:42.220101 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.plugins.ml2.db [None req-eb87b2c3-3339-4249-8b85-e695b5b4e1f9 None None] For port 73dcb0d3-92dc-4f06-8f5e-6b11c077207d, host dv-cinder-819011-1-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-819011-1-iscsi',level=0,port_id=73dcb0d3-92dc-4f06-8f5e-6b11c077207d,segment=NetworkSegment(3cb5e60b-103a-47d0-a28b-d68e3159d032),segment_id=3cb5e60b-103a-47d0-a28b-d68e3159d032)] {{(pid=102994) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 23 19:35:42.309459 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron_lib.callbacks.manager [None req-eb87b2c3-3339-4249-8b85-e695b5b4e1f9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7918660', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-15067', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560168', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8783631423946', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8783631008732', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8783631008750'] for port, after_update {{(pid=102994) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:35:42.372031 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-eb87b2c3-3339-4249-8b85-e695b5b4e1f9 None None] Pushing event updated for resources: {'Port': ['ID=73dcb0d3-92dc-4f06-8f5e-6b11c077207d,revision_number=4']} {{(pid=102994) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 23 19:35:42.382066 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.wsgi [-] (102993) accepted ('10.222.0.62', 45526) {{(pid=102993) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 23 19:35:42.389180 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.api.v2.base [None req-cd3fcd75-fc10-4719-b558-1ce68ea88d5c tempest-TestVolumeBootPattern-147141705 tempest-TestVolumeBootPattern-147141705-project] Request body: {'security_group': {'name': 'tempest-secgroup-smoke-1973485717', 'description': 'tempest-secgroup-smoke-1973485717 description', 'project_id': '257b0b2e531441b4bb745e99cfd799f3'}} {{(pid=102993) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 23 19:35:42.525562 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-cd3fcd75-fc10-4719-b558-1ce68ea88d5c tempest-TestVolumeBootPattern-147141705 tempest-TestVolumeBootPattern-147141705-project] Publish callbacks [] for security_group, before_create {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:35:42.575617 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1193bb91-5b0c-4e51-b5aa-a1dbc243b5b1 req-431ec318-45a4-47c5-9b30-ef8cc9455fed tempest-ServerRescueNegativeTestJSON-1447477341 tempest-ServerRescueNegativeTestJSON-1447477341-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102993) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:35:42.577383 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-1193bb91-5b0c-4e51-b5aa-a1dbc243b5b1 req-431ec318-45a4-47c5-9b30-ef8cc9455fed tempest-ServerRescueNegativeTestJSON-1447477341 tempest-ServerRescueNegativeTestJSON-1447477341-project] 10.222.0.62 "GET /v2.0/ports?device_id=671f1d44-7752-4a9d-835d-4d76164c900f HTTP/1.1" status: 200 len: 945 time: 0.0826306 Nov 23 19:35:42.595409 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c37b254d-621b-465e-9f85-6d277ba9be96 req-f7e0745c-da4c-4b91-9163-df92a2fb0ca9 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102992) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:35:42.597591 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-c37b254d-621b-465e-9f85-6d277ba9be96 req-f7e0745c-da4c-4b91-9163-df92a2fb0ca9 service neutron] 10.222.0.41 "GET /v2.0/ports?tenant_id=c15ab51e579448cfb7a4b3e4f8049687&device_id=671f1d44-7752-4a9d-835d-4d76164c900f HTTP/1.1" status: 200 len: 1098 time: 0.0574203 Nov 23 19:35:42.672134 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-cd3fcd75-fc10-4719-b558-1ce68ea88d5c tempest-TestVolumeBootPattern-147141705 tempest-TestVolumeBootPattern-147141705-project] Publish callbacks [] for security_group, precommit_create {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:35:42.686025 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-1193bb91-5b0c-4e51-b5aa-a1dbc243b5b1 req-bccec932-6b74-4ca7-a99c-143b5000b0ee tempest-ServerRescueNegativeTestJSON-1447477341 tempest-ServerRescueNegativeTestJSON-1447477341-project] 10.222.0.62 "GET /v2.0/security-groups?id=62a09434-acf0-424f-9001-2c3a78119364&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0928423 Nov 23 19:35:42.755730 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-cd3fcd75-fc10-4719-b558-1ce68ea88d5c tempest-TestVolumeBootPattern-147141705 tempest-TestVolumeBootPattern-147141705-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-623933'] for security_group, after_create {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:35:42.773860 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c37b254d-621b-465e-9f85-6d277ba9be96 req-6646113a-4d1a-45c6-8b1e-5e66c32f9223 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102992) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:35:42.775470 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-c37b254d-621b-465e-9f85-6d277ba9be96 req-6646113a-4d1a-45c6-8b1e-5e66c32f9223 service neutron] 10.222.0.41 "GET /v2.0/networks?id=07eeb44e-4cdb-4c58-a83d-1dd8ab1ccb8a HTTP/1.1" status: 200 len: 920 time: 0.1700728 Nov 23 19:35:42.787089 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4c80d923-9af3-4e69-962e-33c899c68470 req-3339998d-f223-4d58-8a27-363d12cb6755 tempest-VolumesActionsTest-802949502 tempest-VolumesActionsTest-802949502-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=102992) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:35:42.791260 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-c8b8402a-3f8f-4b1e-82b5-c68d61dec3d8 None None] Sync routers for ids ['1f81a2e4-42a5-4a27-ab4f-d5d6928fc891'] in dv-cinder-819011-1-iscsi {{(pid=102994) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 23 19:35:42.794889 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-4c80d923-9af3-4e69-962e-33c899c68470 req-3339998d-f223-4d58-8a27-363d12cb6755 tempest-VolumesActionsTest-802949502 tempest-VolumesActionsTest-802949502-project] 10.222.0.62 "GET /v2.0/networks?id=4b2c41c3-6250-433d-837a-85d02cae1bde HTTP/1.1" status: 200 len: 809 time: 0.1792605 Nov 23 19:35:42.805746 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cd3fcd75-fc10-4719-b558-1ce68ea88d5c tempest-TestVolumeBootPattern-147141705 tempest-TestVolumeBootPattern-147141705-project] Pushing event updated for resources: {'SecurityGroup': ['ID=a6e2b133-1a9b-4dde-a188-1ce8bcdb7b5c,revision_number=1']} {{(pid=102993) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 23 19:35:42.819248 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.db.l3_dvrscheduler_db [None req-c8b8402a-3f8f-4b1e-82b5-c68d61dec3d8 None None] Routers {'1f81a2e4-42a5-4a27-ab4f-d5d6928fc891'} bound to L3 agent in host dv-cinder-819011-1-iscsi {{(pid=102994) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 23 19:35:42.819910 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.db.l3_hamode_db [None req-c8b8402a-3f8f-4b1e-82b5-c68d61dec3d8 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-819011-1-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-23T19:25:14Z,description=,heartbeat_timestamp=2021-11-23T19:35:14Z,host='dv-cinder-819011-1-iscsi',id=1b20f2c4-70b6-43c3-b9bd-0062cc9e57ac,load=0,resource_versions=,resources_synced=,started_at=2021-11-23T19:25:15Z,topic='l3_agent')) {'router_ids': ['1f81a2e4-42a5-4a27-ab4f-d5d6928fc891'], 'active': True} {{(pid=102994) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 23 19:35:42.844218 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-4c80d923-9af3-4e69-962e-33c899c68470 req-115a7a5b-205b-4924-b6a7-ddb8641cc0eb tempest-VolumesActionsTest-802949502 tempest-VolumesActionsTest-802949502-project] 10.222.0.62 "GET /v2.0/quotas/893242e83e2b490a98fcd7fafca0a833 HTTP/1.1" status: 200 len: 375 time: 0.0484266 Nov 23 19:35:42.847359 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-c37b254d-621b-465e-9f85-6d277ba9be96 req-2b64d51b-834a-46cd-92fd-31c50113a470 service neutron] 10.222.0.41 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.3&port_id=50e9d93b-ad23-4b6b-bdd0-ae5afe6f80ea HTTP/1.1" status: 200 len: 217 time: 0.0502281 Nov 23 19:35:42.871673 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-62504f06-4d38-4bec-ba47-35c06053cf36 req-4f1a00d7-ef26-4d9d-b062-b20ee9f683a3 tempest-AttachVolumeShelveTestJSON-1172915835 tempest-AttachVolumeShelveTestJSON-1172915835-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102993) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:35:42.880517 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-62504f06-4d38-4bec-ba47-35c06053cf36 req-4f1a00d7-ef26-4d9d-b062-b20ee9f683a3 tempest-AttachVolumeShelveTestJSON-1172915835 tempest-AttachVolumeShelveTestJSON-1172915835-project] 10.222.0.62 "GET /v2.0/ports?device_id=85ea3d72-6c17-4ea2-82b7-90cce01633bd HTTP/1.1" status: 200 len: 945 time: 0.0595930 Nov 23 19:35:42.884004 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-4c80d923-9af3-4e69-962e-33c899c68470 req-b0f5183b-6d6b-4626-acf1-a70b3eabc2c3 tempest-VolumesActionsTest-802949502 tempest-VolumesActionsTest-802949502-project] 10.222.0.62 "GET /v2.0/ports?tenant_id=893242e83e2b490a98fcd7fafca0a833&fields=id HTTP/1.1" status: 200 len: 210 time: 0.0349770 Nov 23 19:35:42.902967 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-cd3fcd75-fc10-4719-b558-1ce68ea88d5c tempest-TestVolumeBootPattern-147141705 tempest-TestVolumeBootPattern-147141705-project] Publish callbacks [] for security_group, before_response {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:35:42.904921 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [None req-cd3fcd75-fc10-4719-b558-1ce68ea88d5c tempest-TestVolumeBootPattern-147141705 tempest-TestVolumeBootPattern-147141705-project] 10.222.0.62 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1811 time: 0.5214748 Nov 23 19:35:42.911197 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.wsgi [-] (102993) accepted ('10.222.0.62', 45548) {{(pid=102993) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 23 19:35:42.922010 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.api.v2.base [None req-86950d2d-92ee-4c73-8fea-7d247a6e2450 tempest-TestVolumeBootPattern-147141705 tempest-TestVolumeBootPattern-147141705-project] Request body: {'security_group_rule': {'security_group_id': 'a6e2b133-1a9b-4dde-a188-1ce8bcdb7b5c', 'project_id': '257b0b2e531441b4bb745e99cfd799f3', 'protocol': 'tcp', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'ingress'}} {{(pid=102993) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 23 19:35:42.943321 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.db.l3_dvr_db [None req-c8b8402a-3f8f-4b1e-82b5-c68d61dec3d8 None None] Set router 1f81a2e4-42a5-4a27-ab4f-d5d6928fc891 gateway port host: dv-cinder-819011-1-iscsi {{(pid=102994) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 23 19:35:42.949806 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c37b254d-621b-465e-9f85-6d277ba9be96 req-e32df24b-7a95-4594-b6df-6ea44865b9c5 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102992) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:35:42.952107 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-c37b254d-621b-465e-9f85-6d277ba9be96 req-e32df24b-7a95-4594-b6df-6ea44865b9c5 service neutron] 10.222.0.41 "GET /v2.0/subnets?id=e4fda56f-85ff-422d-adad-ec00db6378af HTTP/1.1" status: 200 len: 859 time: 0.0911460 Nov 23 19:35:42.957991 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-62504f06-4d38-4bec-ba47-35c06053cf36 req-c6512fbd-a9c0-46d4-afdb-22d9072d97f8 tempest-AttachVolumeShelveTestJSON-1172915835 tempest-AttachVolumeShelveTestJSON-1172915835-project] 10.222.0.62 "GET /v2.0/security-groups?id=f1ca24d9-0a31-470d-a1d5-fa7059df0141&fields=id&fields=name HTTP/1.1" status: 200 len: 311 time: 0.0762637 Nov 23 19:35:43.013340 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-c37b254d-621b-465e-9f85-6d277ba9be96 req-2a7dc443-ecef-4018-813d-7b5c3ae36b99 service neutron] 10.222.0.41 "GET /v2.0/ports?network_id=07eeb44e-4cdb-4c58-a83d-1dd8ab1ccb8a&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0287480 Nov 23 19:35:43.042260 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-86950d2d-92ee-4c73-8fea-7d247a6e2450 tempest-TestVolumeBootPattern-147141705 tempest-TestVolumeBootPattern-147141705-project] Publish callbacks [] for security_group_rule, before_create {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:35:43.056230 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-4c80d923-9af3-4e69-962e-33c899c68470 req-f3191cac-bc52-4504-bd10-f03c00b5b92d service neutron] 10.222.0.62 "GET /v2.0/networks/4b2c41c3-6250-433d-837a-85d02cae1bde?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1517920 Nov 23 19:35:43.142354 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-86950d2d-92ee-4c73-8fea-7d247a6e2450 tempest-TestVolumeBootPattern-147141705 tempest-TestVolumeBootPattern-147141705-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:35:43.195211 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.db.l3_hamode_db [None req-c8b8402a-3f8f-4b1e-82b5-c68d61dec3d8 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '1f81a2e4-42a5-4a27-ab4f-d5d6928fc891', 'name': 'tempest-TestVolumeBootPattern-1496802758-router', 'tenant_id': '1e70ae5f657c4aebb6c283d99f5ccde0', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'a93e254e-aac9-4233-9e4d-4290fd0458e4', 'external_fixed_ips': [{'subnet_id': 'e0b32f3d-83d6-439a-bbed-01df7cf01051', 'ip_address': '172.27.1.23'}], 'enable_snat': True}, 'gw_port_id': '73dcb0d3-92dc-4f06-8f5e-6b11c077207d', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-23T19:35:36Z', 'updated_at': '2021-11-23T19:35:40Z', 'revision_number': 4, 'project_id': '1e70ae5f657c4aebb6c283d99f5ccde0', 'gw_port': {'id': '73dcb0d3-92dc-4f06-8f5e-6b11c077207d', 'name': '', 'network_id': 'a93e254e-aac9-4233-9e4d-4290fd0458e4', 'tenant_id': '', 'mac_address': 'fa:16:3e:9c:b1:7d', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '1f81a2e4-42a5-4a27-ab4f-d5d6928fc891', 'device_owner': 'network:router_gateway', 'standard_attr_id': 404, 'fixed_ips': [{'subnet_id': 'e0b32f3d-83d6-439a-bbed-01df7cf01051', 'ip_address': '172.27.1.23', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-819011-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-23T19:35:37Z', 'updated_at': '2021-11-23T19:35:42Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'e0b32f3d-83d6-439a-bbed-01df7cf01051', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-819011-1-iscsi', '_interfaces': [{'id': 'c822f8fa-fca4-481d-b3b9-e84f0deaed5a', 'name': '', 'network_id': 'a79fa83e-69fd-41d9-9001-545f7467c26a', 'tenant_id': '1e70ae5f657c4aebb6c283d99f5ccde0', 'mac_address': 'fa:16:3e:df:43:47', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '1f81a2e4-42a5-4a27-ab4f-d5d6928fc891', 'device_owner': 'network:router_interface', 'standard_attr_id': 405, 'fixed_ips': [{'subnet_id': '56f5fba5-4cd3-476d-bc1c-2e0c8f45bb10', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-23T19:35:39Z', 'updated_at': '2021-11-23T19:35:40Z', 'revision_number': 2, 'project_id': '1e70ae5f657c4aebb6c283d99f5ccde0', 'subnets': [{'id': '56f5fba5-4cd3-476d-bc1c-2e0c8f45bb10', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-819011-1-iscsi', False) {} {{(pid=102994) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 23 19:35:43.208073 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-86950d2d-92ee-4c73-8fea-7d247a6e2450 tempest-TestVolumeBootPattern-147141705 tempest-TestVolumeBootPattern-147141705-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-601991'] for security_group_rule, after_create {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:35:43.235159 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-c8b8402a-3f8f-4b1e-82b5-c68d61dec3d8 None None] Checking router: 1f81a2e4-42a5-4a27-ab4f-d5d6928fc891 for host: dv-cinder-819011-1-iscsi {{(pid=102994) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 23 19:35:43.235159 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-c8b8402a-3f8f-4b1e-82b5-c68d61dec3d8 None None] Updating router 1f81a2e4-42a5-4a27-ab4f-d5d6928fc891 port c822f8fa-fca4-481d-b3b9-e84f0deaed5a binding host dv-cinder-819011-1-iscsi {{(pid=102994) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Nov 23 19:35:43.240141 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-86950d2d-92ee-4c73-8fea-7d247a6e2450 tempest-TestVolumeBootPattern-147141705 tempest-TestVolumeBootPattern-147141705-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=e849f80f-1dc2-4e9d-8057-0bb6356fce1b,revision_number=0']} {{(pid=102993) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 23 19:35:43.264642 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron_lib.callbacks.manager [None req-c8b8402a-3f8f-4b1e-82b5-c68d61dec3d8 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7921281'] for port, before_update {{(pid=102994) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:35:43.312485 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-86950d2d-92ee-4c73-8fea-7d247a6e2450 tempest-TestVolumeBootPattern-147141705 tempest-TestVolumeBootPattern-147141705-project] Publish callbacks [] for security_group_rule, before_response {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:35:43.318566 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [None req-86950d2d-92ee-4c73-8fea-7d247a6e2450 tempest-TestVolumeBootPattern-147141705 tempest-TestVolumeBootPattern-147141705-project] 10.222.0.62 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 764 time: 0.4056804 Nov 23 19:35:43.319265 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.wsgi [-] (102993) accepted ('10.222.0.62', 45566) {{(pid=102993) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 23 19:35:43.325040 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.api.v2.base [None req-d9cf363f-413f-458c-b15e-18b44cd71cc7 tempest-TestVolumeBootPattern-147141705 tempest-TestVolumeBootPattern-147141705-project] Request body: {'security_group_rule': {'security_group_id': 'a6e2b133-1a9b-4dde-a188-1ce8bcdb7b5c', 'project_id': '257b0b2e531441b4bb745e99cfd799f3', 'protocol': 'tcp', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'egress'}} {{(pid=102993) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 23 19:35:43.412575 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-c37b254d-621b-465e-9f85-6d277ba9be96 req-68e579ae-c8d8-4fcf-9cdf-f67f1630e3ad service neutron] 10.222.0.41 "GET /v2.0/networks/07eeb44e-4cdb-4c58-a83d-1dd8ab1ccb8a?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.3860126 Nov 23 19:35:43.430694 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-d9cf363f-413f-458c-b15e-18b44cd71cc7 tempest-TestVolumeBootPattern-147141705 tempest-TestVolumeBootPattern-147141705-project] Publish callbacks [] for security_group_rule, before_create {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:35:43.454301 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-4c80d923-9af3-4e69-962e-33c899c68470 req-4e3c2fa5-e6ee-4878-8475-98c325411e50 service neutron] 10.222.0.62 "GET /v2.0/networks/4b2c41c3-6250-433d-837a-85d02cae1bde?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.3898263 Nov 23 19:35:43.531187 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-c37b254d-621b-465e-9f85-6d277ba9be96 req-cce6365e-0e9d-4e40-ad1f-54545b089058 service neutron] 10.222.0.41 "GET /v2.0/networks/07eeb44e-4cdb-4c58-a83d-1dd8ab1ccb8a?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1010056 Nov 23 19:35:43.548635 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-d9cf363f-413f-458c-b15e-18b44cd71cc7 tempest-TestVolumeBootPattern-147141705 tempest-TestVolumeBootPattern-147141705-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:35:43.602861 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron_lib.callbacks.manager [None req-c8b8402a-3f8f-4b1e-82b5-c68d61dec3d8 None None] Publish callbacks [] for port, precommit_update {{(pid=102994) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:35:43.726704 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-d9cf363f-413f-458c-b15e-18b44cd71cc7 tempest-TestVolumeBootPattern-147141705 tempest-TestVolumeBootPattern-147141705-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-601991'] for security_group_rule, after_create {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:35:43.745554 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d9cf363f-413f-458c-b15e-18b44cd71cc7 tempest-TestVolumeBootPattern-147141705 tempest-TestVolumeBootPattern-147141705-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=e3aa16d4-af3d-41d9-9bc0-111390f5df8d,revision_number=0']} {{(pid=102993) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 23 19:35:43.760980 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron_lib.callbacks.manager [None req-c8b8402a-3f8f-4b1e-82b5-c68d61dec3d8 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7918660', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-15067', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560168', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8783631423946', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8783631008732', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8783631008750'] for port, after_update {{(pid=102994) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:35:43.812293 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9bc085d7-3aee-46d2-afc5-2e1a824bac22 None None] Pushing event updated for resources: {'Port': ['ID=c822f8fa-fca4-481d-b3b9-e84f0deaed5a,revision_number=3']} {{(pid=102994) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 23 19:35:43.832947 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-df60a2d2-fc8e-4391-a88e-7cd54e162e9b req-7596afa0-7a98-4ffb-8e0e-e28d1d0ece2a tempest-ServerRescueNegativeTestJSON-1447477341 tempest-ServerRescueNegativeTestJSON-1447477341-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102993) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:35:43.841042 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-df60a2d2-fc8e-4391-a88e-7cd54e162e9b req-7596afa0-7a98-4ffb-8e0e-e28d1d0ece2a tempest-ServerRescueNegativeTestJSON-1447477341 tempest-ServerRescueNegativeTestJSON-1447477341-project] 10.222.0.62 "GET /v2.0/ports?device_id=671f1d44-7752-4a9d-835d-4d76164c900f HTTP/1.1" status: 200 len: 945 time: 0.0866973 Nov 23 19:35:43.851876 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-d9cf363f-413f-458c-b15e-18b44cd71cc7 tempest-TestVolumeBootPattern-147141705 tempest-TestVolumeBootPattern-147141705-project] Publish callbacks [] for security_group_rule, before_response {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:35:43.855050 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [None req-d9cf363f-413f-458c-b15e-18b44cd71cc7 tempest-TestVolumeBootPattern-147141705 tempest-TestVolumeBootPattern-147141705-project] 10.222.0.62 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 763 time: 0.5323317 Nov 23 19:35:43.855811 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.wsgi [-] (102993) accepted ('10.222.0.62', 45584) {{(pid=102993) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 23 19:35:43.870041 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.api.v2.base [None req-c3d77777-4c7a-4fc2-99e1-df6ce95cb626 tempest-TestVolumeBootPattern-147141705 tempest-TestVolumeBootPattern-147141705-project] Request body: {'security_group_rule': {'security_group_id': 'a6e2b133-1a9b-4dde-a188-1ce8bcdb7b5c', 'project_id': '257b0b2e531441b4bb745e99cfd799f3', 'protocol': 'icmp', 'direction': 'ingress'}} {{(pid=102993) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 23 19:35:43.890596 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.plugins.ml2.managers [None req-c8b8402a-3f8f-4b1e-82b5-c68d61dec3d8 None None] Attempting to bind port c822f8fa-fca4-481d-b3b9-e84f0deaed5a on host dv-cinder-819011-1-iscsi for vnic_type normal with profile {{(pid=102994) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 23 19:35:43.891234 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.plugins.ml2.managers [None req-c8b8402a-3f8f-4b1e-82b5-c68d61dec3d8 None None] Attempting to bind port c822f8fa-fca4-481d-b3b9-e84f0deaed5a by drivers openvswitch,hyperv on host dv-cinder-819011-1-iscsi at level 0 using segments [{'id': '89776fd7-6ee8-49b6-aa38-04444322cfc6', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 837, 'network_id': 'a79fa83e-69fd-41d9-9001-545f7467c26a'}] {{(pid=102994) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 23 19:35:43.891970 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-c8b8402a-3f8f-4b1e-82b5-c68d61dec3d8 None None] Attempting to bind port c822f8fa-fca4-481d-b3b9-e84f0deaed5a on network a79fa83e-69fd-41d9-9001-545f7467c26a {{(pid=102994) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 23 19:35:43.899801 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-c8b8402a-3f8f-4b1e-82b5-c68d61dec3d8 None None] Checking agent: {'id': '668c8953-047c-499e-8c0d-db838fac1668', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-819011-1-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 23, 19, 25, 17), 'started_at': datetime.datetime(2021, 11, 23, 19, 25, 47), 'heartbeat_timestamp': datetime.datetime(2021, 11, 23, 19, 35, 17), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-819011-1-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=102994) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 23 19:35:43.900442 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-c8b8402a-3f8f-4b1e-82b5-c68d61dec3d8 None None] Checking segment: {'id': '89776fd7-6ee8-49b6-aa38-04444322cfc6', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 837, 'network_id': 'a79fa83e-69fd-41d9-9001-545f7467c26a'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102994) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 23 19:35:43.901037 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron_lib.callbacks.manager [None req-c8b8402a-3f8f-4b1e-82b5-c68d61dec3d8 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=102994) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:35:43.901826 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-c8b8402a-3f8f-4b1e-82b5-c68d61dec3d8 None None] Bound using segment: {'id': '89776fd7-6ee8-49b6-aa38-04444322cfc6', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 837, 'network_id': 'a79fa83e-69fd-41d9-9001-545f7467c26a'} {{(pid=102994) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 23 19:35:43.902532 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.plugins.ml2.managers [None req-c8b8402a-3f8f-4b1e-82b5-c68d61dec3d8 None None] Bound port: c822f8fa-fca4-481d-b3b9-e84f0deaed5a, host: dv-cinder-819011-1-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '89776fd7-6ee8-49b6-aa38-04444322cfc6', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 837, 'network_id': 'a79fa83e-69fd-41d9-9001-545f7467c26a'}}] {{(pid=102994) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 23 19:35:43.903335 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron_lib.callbacks.manager [None req-c8b8402a-3f8f-4b1e-82b5-c68d61dec3d8 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7921281'] for port, before_update {{(pid=102994) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:35:43.932720 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-12b0644b-1c62-4fed-b367-20ea78ebf607 req-0476e214-b59f-4058-8a5c-f3fc7081225d tempest-VolumesActionsTest-802949502 tempest-VolumesActionsTest-802949502-project] 10.222.0.62 "GET /v2.0/ports?device_id=3b98df1d-4a12-4596-868b-56328fa3c3aa HTTP/1.1" status: 200 len: 210 time: 0.0514965 Nov 23 19:35:43.965556 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-df60a2d2-fc8e-4391-a88e-7cd54e162e9b req-76f8ff07-f861-4964-bd55-7eb260de3042 tempest-ServerRescueNegativeTestJSON-1447477341 tempest-ServerRescueNegativeTestJSON-1447477341-project] 10.222.0.62 "GET /v2.0/security-groups?id=62a09434-acf0-424f-9001-2c3a78119364&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1223388 Nov 23 19:35:44.010090 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.plugins.ml2.db [None req-c8b8402a-3f8f-4b1e-82b5-c68d61dec3d8 None None] For port c822f8fa-fca4-481d-b3b9-e84f0deaed5a, host dv-cinder-819011-1-iscsi, cleared binding levels {{(pid=102994) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 23 19:35:44.017751 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.plugins.ml2.db [None req-c8b8402a-3f8f-4b1e-82b5-c68d61dec3d8 None None] For port c822f8fa-fca4-481d-b3b9-e84f0deaed5a, host dv-cinder-819011-1-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-819011-1-iscsi',level=0,port_id=c822f8fa-fca4-481d-b3b9-e84f0deaed5a,segment=NetworkSegment(89776fd7-6ee8-49b6-aa38-04444322cfc6),segment_id=89776fd7-6ee8-49b6-aa38-04444322cfc6)] {{(pid=102994) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 23 19:35:44.026915 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.plugins.ml2.rpc [None req-eb87b2c3-3339-4249-8b85-e695b5b4e1f9 None None] Device 73dcb0d3-92dc-4f06-8f5e-6b11c077207d up at agent ovs-agent-dv-cinder-819011-1-iscsi {{(pid=102994) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 23 19:35:44.072376 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-c3d77777-4c7a-4fc2-99e1-df6ce95cb626 tempest-TestVolumeBootPattern-147141705 tempest-TestVolumeBootPattern-147141705-project] Publish callbacks [] for security_group_rule, before_create {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:35:44.103883 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.db.provisioning_blocks [None req-eb87b2c3-3339-4249-8b85-e695b5b4e1f9 None None] Provisioning complete for port 73dcb0d3-92dc-4f06-8f5e-6b11c077207d triggered by entity L2. {{(pid=102994) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 23 19:35:44.104263 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron_lib.callbacks.manager [None req-eb87b2c3-3339-4249-8b85-e695b5b4e1f9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-8355713'] for port, provisioning_complete {{(pid=102994) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:35:44.113212 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d5eae809-a0bf-418b-9285-b3491ab31d85 req-cd738308-e663-4adf-ba07-96d5b5e93fc9 tempest-AttachVolumeShelveTestJSON-1172915835 tempest-AttachVolumeShelveTestJSON-1172915835-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102992) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:35:44.116896 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-d5eae809-a0bf-418b-9285-b3491ab31d85 req-cd738308-e663-4adf-ba07-96d5b5e93fc9 tempest-AttachVolumeShelveTestJSON-1172915835 tempest-AttachVolumeShelveTestJSON-1172915835-project] 10.222.0.62 "GET /v2.0/ports?device_id=85ea3d72-6c17-4ea2-82b7-90cce01633bd HTTP/1.1" status: 200 len: 945 time: 0.0681279 Nov 23 19:35:44.144240 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron_lib.callbacks.manager [None req-c8b8402a-3f8f-4b1e-82b5-c68d61dec3d8 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7918660', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-15067', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560168', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8783631423946', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8783631008732', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8783631008750'] for port, after_update {{(pid=102994) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:35:44.148327 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-c3d77777-4c7a-4fc2-99e1-df6ce95cb626 tempest-TestVolumeBootPattern-147141705 tempest-TestVolumeBootPattern-147141705-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:35:44.173080 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-d5eae809-a0bf-418b-9285-b3491ab31d85 req-9f127191-d82d-4b7c-934b-eeea21270fee tempest-AttachVolumeShelveTestJSON-1172915835 tempest-AttachVolumeShelveTestJSON-1172915835-project] 10.222.0.62 "GET /v2.0/security-groups?id=f1ca24d9-0a31-470d-a1d5-fa7059df0141&fields=id&fields=name HTTP/1.1" status: 200 len: 311 time: 0.0441537 Nov 23 19:35:44.212263 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.db.provisioning_blocks [None req-6b5c5e94-02ec-4a7f-899d-996e81f13b1a None None] Provisioning complete for port c822f8fa-fca4-481d-b3b9-e84f0deaed5a triggered by entity DHCP. {{(pid=102994) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 23 19:35:44.212650 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron_lib.callbacks.manager [None req-6b5c5e94-02ec-4a7f-899d-996e81f13b1a None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-8355713'] for port, provisioning_complete {{(pid=102994) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:35:44.229979 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-c3d77777-4c7a-4fc2-99e1-df6ce95cb626 tempest-TestVolumeBootPattern-147141705 tempest-TestVolumeBootPattern-147141705-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-601991'] for security_group_rule, after_create {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:35:44.247435 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c3d77777-4c7a-4fc2-99e1-df6ce95cb626 tempest-TestVolumeBootPattern-147141705 tempest-TestVolumeBootPattern-147141705-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=a975bdd6-3163-4138-90b3-92f748960659,revision_number=0']} {{(pid=102993) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 23 19:35:44.271102 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.db.l3_dvrscheduler_db [None req-c8b8402a-3f8f-4b1e-82b5-c68d61dec3d8 None None] Routers {'1f81a2e4-42a5-4a27-ab4f-d5d6928fc891'} bound to L3 agent in host dv-cinder-819011-1-iscsi {{(pid=102994) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 23 19:35:44.271750 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.db.l3_hamode_db [None req-c8b8402a-3f8f-4b1e-82b5-c68d61dec3d8 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-819011-1-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-23T19:25:14Z,description=,heartbeat_timestamp=2021-11-23T19:35:14Z,host='dv-cinder-819011-1-iscsi',id=1b20f2c4-70b6-43c3-b9bd-0062cc9e57ac,load=0,resource_versions=,resources_synced=,started_at=2021-11-23T19:25:15Z,topic='l3_agent')) {'router_ids': ['1f81a2e4-42a5-4a27-ab4f-d5d6928fc891'], 'active': True} {{(pid=102994) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 23 19:35:44.320362 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-c3d77777-4c7a-4fc2-99e1-df6ce95cb626 tempest-TestVolumeBootPattern-147141705 tempest-TestVolumeBootPattern-147141705-project] Publish callbacks [] for security_group_rule, before_response {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:35:44.321738 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [None req-c3d77777-4c7a-4fc2-99e1-df6ce95cb626 tempest-TestVolumeBootPattern-147141705 tempest-TestVolumeBootPattern-147141705-project] 10.222.0.62 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 769 time: 0.4653301 Nov 23 19:35:44.327356 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.wsgi [-] (102992) accepted ('10.222.0.62', 45594) {{(pid=102992) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 23 19:35:44.340429 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.api.v2.base [None req-bb00e604-4014-4d10-ae8c-9317d210dfef tempest-TestVolumeBootPattern-147141705 tempest-TestVolumeBootPattern-147141705-project] Request body: {'security_group_rule': {'security_group_id': 'a6e2b133-1a9b-4dde-a188-1ce8bcdb7b5c', 'project_id': '257b0b2e531441b4bb745e99cfd799f3', 'protocol': 'icmp', 'direction': 'egress'}} {{(pid=102992) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 23 19:35:44.340721 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9bc085d7-3aee-46d2-afc5-2e1a824bac22 None None] Pushing event updated for resources: {'Port': ['ID=c822f8fa-fca4-481d-b3b9-e84f0deaed5a,revision_number=4']} {{(pid=102994) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 23 19:35:44.343450 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron_lib.callbacks.manager [None req-e81f4f22-a3a7-4b5d-bc24-bb3afc131edd None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8783631323329', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7978582'] for agent, after_update {{(pid=102994) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:35:44.461052 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.db.l3_dvr_db [None req-c8b8402a-3f8f-4b1e-82b5-c68d61dec3d8 None None] Set router 1f81a2e4-42a5-4a27-ab4f-d5d6928fc891 gateway port host: dv-cinder-819011-1-iscsi {{(pid=102994) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 23 19:35:44.462906 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron_lib.callbacks.manager [None req-6b5c5e94-02ec-4a7f-899d-996e81f13b1a None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7921281'] for port, before_update {{(pid=102994) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:35:44.486470 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [None req-bb00e604-4014-4d10-ae8c-9317d210dfef tempest-TestVolumeBootPattern-147141705 tempest-TestVolumeBootPattern-147141705-project] Publish callbacks [] for security_group_rule, before_create {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:35:44.561027 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.plugins.ml2.db [None req-6b5c5e94-02ec-4a7f-899d-996e81f13b1a None None] For port c822f8fa-fca4-481d-b3b9-e84f0deaed5a, host dv-cinder-819011-1-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-819011-1-iscsi',level=0,port_id=c822f8fa-fca4-481d-b3b9-e84f0deaed5a,segment=NetworkSegment(89776fd7-6ee8-49b6-aa38-04444322cfc6),segment_id=89776fd7-6ee8-49b6-aa38-04444322cfc6)] {{(pid=102994) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 23 19:35:44.566419 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [None req-bb00e604-4014-4d10-ae8c-9317d210dfef tempest-TestVolumeBootPattern-147141705 tempest-TestVolumeBootPattern-147141705-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:35:44.616779 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron_lib.callbacks.manager [None req-6b5c5e94-02ec-4a7f-899d-996e81f13b1a None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7918660', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-15067', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560168', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8783631423946', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8783631008732', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8783631008750'] for port, after_update {{(pid=102994) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:35:44.664049 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [None req-bb00e604-4014-4d10-ae8c-9317d210dfef tempest-TestVolumeBootPattern-147141705 tempest-TestVolumeBootPattern-147141705-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-601991'] for security_group_rule, after_create {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:35:44.687173 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bb00e604-4014-4d10-ae8c-9317d210dfef tempest-TestVolumeBootPattern-147141705 tempest-TestVolumeBootPattern-147141705-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=184de1cc-3b37-4bf9-9e0c-1ea95e9935b8,revision_number=0']} {{(pid=102992) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 23 19:35:44.701920 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6b5c5e94-02ec-4a7f-899d-996e81f13b1a None None] Pushing event updated for resources: {'Port': ['ID=c822f8fa-fca4-481d-b3b9-e84f0deaed5a,revision_number=5']} {{(pid=102994) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 23 19:35:44.737766 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.db.l3_hamode_db [None req-c8b8402a-3f8f-4b1e-82b5-c68d61dec3d8 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '1f81a2e4-42a5-4a27-ab4f-d5d6928fc891', 'name': 'tempest-TestVolumeBootPattern-1496802758-router', 'tenant_id': '1e70ae5f657c4aebb6c283d99f5ccde0', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'a93e254e-aac9-4233-9e4d-4290fd0458e4', 'external_fixed_ips': [{'subnet_id': 'e0b32f3d-83d6-439a-bbed-01df7cf01051', 'ip_address': '172.27.1.23'}], 'enable_snat': True}, 'gw_port_id': '73dcb0d3-92dc-4f06-8f5e-6b11c077207d', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-23T19:35:36Z', 'updated_at': '2021-11-23T19:35:40Z', 'revision_number': 4, 'project_id': '1e70ae5f657c4aebb6c283d99f5ccde0', 'gw_port': {'id': '73dcb0d3-92dc-4f06-8f5e-6b11c077207d', 'name': '', 'network_id': 'a93e254e-aac9-4233-9e4d-4290fd0458e4', 'tenant_id': '', 'mac_address': 'fa:16:3e:9c:b1:7d', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '1f81a2e4-42a5-4a27-ab4f-d5d6928fc891', 'device_owner': 'network:router_gateway', 'standard_attr_id': 404, 'fixed_ips': [{'subnet_id': 'e0b32f3d-83d6-439a-bbed-01df7cf01051', 'ip_address': '172.27.1.23', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-819011-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-23T19:35:37Z', 'updated_at': '2021-11-23T19:35:42Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'e0b32f3d-83d6-439a-bbed-01df7cf01051', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-819011-1-iscsi', '_interfaces': [{'id': 'c822f8fa-fca4-481d-b3b9-e84f0deaed5a', 'name': '', 'network_id': 'a79fa83e-69fd-41d9-9001-545f7467c26a', 'tenant_id': '1e70ae5f657c4aebb6c283d99f5ccde0', 'mac_address': 'fa:16:3e:df:43:47', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '1f81a2e4-42a5-4a27-ab4f-d5d6928fc891', 'device_owner': 'network:router_interface', 'standard_attr_id': 405, 'fixed_ips': [{'subnet_id': '56f5fba5-4cd3-476d-bc1c-2e0c8f45bb10', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-819011-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-23T19:35:39Z', 'updated_at': '2021-11-23T19:35:44Z', 'revision_number': 4, 'project_id': '1e70ae5f657c4aebb6c283d99f5ccde0', 'subnets': [{'id': '56f5fba5-4cd3-476d-bc1c-2e0c8f45bb10', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-819011-1-iscsi', False) {} {{(pid=102994) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 23 19:35:44.770530 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-c8b8402a-3f8f-4b1e-82b5-c68d61dec3d8 None None] The sync data for ids ['1f81a2e4-42a5-4a27-ab4f-d5d6928fc891'] in dv-cinder-819011-1-iscsi is: [{'id': '1f81a2e4-42a5-4a27-ab4f-d5d6928fc891', 'name': 'tempest-TestVolumeBootPattern-1496802758-router', 'tenant_id': '1e70ae5f657c4aebb6c283d99f5ccde0', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'a93e254e-aac9-4233-9e4d-4290fd0458e4', 'external_fixed_ips': [{'subnet_id': 'e0b32f3d-83d6-439a-bbed-01df7cf01051', 'ip_address': '172.27.1.23'}], 'enable_snat': True}, 'gw_port_id': '73dcb0d3-92dc-4f06-8f5e-6b11c077207d', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-23T19:35:36Z', 'updated_at': '2021-11-23T19:35:40Z', 'revision_number': 4, 'project_id': '1e70ae5f657c4aebb6c283d99f5ccde0', 'gw_port': {'id': '73dcb0d3-92dc-4f06-8f5e-6b11c077207d', 'name': '', 'network_id': 'a93e254e-aac9-4233-9e4d-4290fd0458e4', 'tenant_id': '', 'mac_address': 'fa:16:3e:9c:b1:7d', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '1f81a2e4-42a5-4a27-ab4f-d5d6928fc891', 'device_owner': 'network:router_gateway', 'standard_attr_id': 404, 'fixed_ips': [{'subnet_id': 'e0b32f3d-83d6-439a-bbed-01df7cf01051', 'ip_address': '172.27.1.23', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-819011-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-23T19:35:37Z', 'updated_at': '2021-11-23T19:35:42Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'e0b32f3d-83d6-439a-bbed-01df7cf01051', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-819011-1-iscsi', '_interfaces': [{'id': 'c822f8fa-fca4-481d-b3b9-e84f0deaed5a', 'name': '', 'network_id': 'a79fa83e-69fd-41d9-9001-545f7467c26a', 'tenant_id': '1e70ae5f657c4aebb6c283d99f5ccde0', 'mac_address': 'fa:16:3e:df:43:47', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '1f81a2e4-42a5-4a27-ab4f-d5d6928fc891', 'device_owner': 'network:router_interface', 'standard_attr_id': 405, 'fixed_ips': [{'subnet_id': '56f5fba5-4cd3-476d-bc1c-2e0c8f45bb10', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-819011-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-23T19:35:39Z', 'updated_at': '2021-11-23T19:35:44Z', 'revision_number': 4, 'project_id': '1e70ae5f657c4aebb6c283d99f5ccde0', 'subnets': [{'id': '56f5fba5-4cd3-476d-bc1c-2e0c8f45bb10', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=102994) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 23 19:35:44.776366 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.db.provisioning_blocks [None req-188a0d26-a555-4f72-a0ee-d59e1be483c5 None None] Provisioning complete for port c822f8fa-fca4-481d-b3b9-e84f0deaed5a triggered by entity DHCP. {{(pid=102994) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 23 19:35:44.776571 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [None req-bb00e604-4014-4d10-ae8c-9317d210dfef tempest-TestVolumeBootPattern-147141705 tempest-TestVolumeBootPattern-147141705-project] Publish callbacks [] for security_group_rule, before_response {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:35:44.776749 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron_lib.callbacks.manager [None req-188a0d26-a555-4f72-a0ee-d59e1be483c5 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-8355713'] for port, provisioning_complete {{(pid=102994) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:35:44.778879 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [None req-bb00e604-4014-4d10-ae8c-9317d210dfef tempest-TestVolumeBootPattern-147141705 tempest-TestVolumeBootPattern-147141705-project] 10.222.0.62 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 768 time: 0.4498377 Nov 23 19:35:44.783400 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.wsgi [-] (102992) accepted ('10.222.0.62', 45604) {{(pid=102992) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 23 19:35:44.797455 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.api.v2.base [None req-8c92533e-dc8b-4284-b634-cab06a09388a tempest-TestVolumeBootPattern-147141705 tempest-TestVolumeBootPattern-147141705-project] Request body: {'security_group_rule': {'security_group_id': 'a6e2b133-1a9b-4dde-a188-1ce8bcdb7b5c', 'project_id': '257b0b2e531441b4bb745e99cfd799f3', 'protocol': 'icmp', 'ethertype': 'IPv6', 'direction': 'ingress'}} {{(pid=102992) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 23 19:35:44.892335 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.db.securitygroups_db [None req-8c92533e-dc8b-4284-b634-cab06a09388a tempest-TestVolumeBootPattern-147141705 tempest-TestVolumeBootPattern-147141705-project] Project 257b0b2e531441b4bb745e99cfd799f3 added a security group rule with legacy IPv6 ICMP protocol name icmp, ipv6-icmp should be used instead. It was automatically converted. Nov 23 19:35:44.897589 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [None req-8c92533e-dc8b-4284-b634-cab06a09388a tempest-TestVolumeBootPattern-147141705 tempest-TestVolumeBootPattern-147141705-project] Publish callbacks [] for security_group_rule, before_create {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:35:44.977919 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [None req-8c92533e-dc8b-4284-b634-cab06a09388a tempest-TestVolumeBootPattern-147141705 tempest-TestVolumeBootPattern-147141705-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:35:45.039892 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-b0be558a-3faf-4e65-bea9-790a83c252d0 req-70b93ae2-939c-48ae-8d38-da826242053e tempest-VolumesActionsTest-802949502 tempest-VolumesActionsTest-802949502-project] 10.222.0.62 "GET /v2.0/ports?device_id=3b98df1d-4a12-4596-868b-56328fa3c3aa HTTP/1.1" status: 200 len: 210 time: 0.0341017 Nov 23 19:35:45.072538 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron_lib.callbacks.manager [None req-8346ef05-f685-4c3d-af3d-a159b683bec2 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8783631323329', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7978582'] for agent, after_update {{(pid=102994) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:35:45.078693 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [None req-8c92533e-dc8b-4284-b634-cab06a09388a tempest-TestVolumeBootPattern-147141705 tempest-TestVolumeBootPattern-147141705-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-601991'] for security_group_rule, after_create {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:35:45.107776 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8c92533e-dc8b-4284-b634-cab06a09388a tempest-TestVolumeBootPattern-147141705 tempest-TestVolumeBootPattern-147141705-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=cfe0ceaf-27f8-4d50-bf6a-da97d9bca824,revision_number=0']} {{(pid=102992) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 23 19:35:45.124956 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b505fb6a-0b05-4d52-ba78-0c898b158443 req-286e2f0f-df82-444b-b392-c19f6023a54d tempest-ServerRescueNegativeTestJSON-1447477341 tempest-ServerRescueNegativeTestJSON-1447477341-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102992) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:35:45.131945 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-b505fb6a-0b05-4d52-ba78-0c898b158443 req-286e2f0f-df82-444b-b392-c19f6023a54d tempest-ServerRescueNegativeTestJSON-1447477341 tempest-ServerRescueNegativeTestJSON-1447477341-project] 10.222.0.62 "GET /v2.0/ports?device_id=671f1d44-7752-4a9d-835d-4d76164c900f HTTP/1.1" status: 200 len: 945 time: 0.0871472 Nov 23 19:35:45.182377 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.plugins.ml2.rpc [None req-4bf48ff4-ecfb-4168-8b63-249b8c6e9f04 None None] Device 4b380ab6-f3ec-4e12-9a2a-b5a20828969d details requested by agent hyperv_hv-cinder-81901 with host hv-cinder-81901 {{(pid=102994) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Nov 23 19:35:45.183125 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [None req-8c92533e-dc8b-4284-b634-cab06a09388a tempest-TestVolumeBootPattern-147141705 tempest-TestVolumeBootPattern-147141705-project] Publish callbacks [] for security_group_rule, before_response {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:35:45.185200 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [None req-8c92533e-dc8b-4284-b634-cab06a09388a tempest-TestVolumeBootPattern-147141705 tempest-TestVolumeBootPattern-147141705-project] 10.222.0.62 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 774 time: 0.4000225 Nov 23 19:35:45.187397 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.wsgi [-] (102993) accepted ('10.222.0.62', 45610) {{(pid=102993) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 23 19:35:45.190406 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-b505fb6a-0b05-4d52-ba78-0c898b158443 req-b47bdf9d-7081-4faf-b8da-2b32444b396c tempest-ServerRescueNegativeTestJSON-1447477341 tempest-ServerRescueNegativeTestJSON-1447477341-project] 10.222.0.62 "GET /v2.0/security-groups?id=62a09434-acf0-424f-9001-2c3a78119364&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0546260 Nov 23 19:35:45.193126 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.api.v2.base [None req-29294d2d-f4f9-477f-834e-f11b44836db9 tempest-TestVolumeBootPattern-147141705 tempest-TestVolumeBootPattern-147141705-project] Request body: {'security_group_rule': {'security_group_id': 'a6e2b133-1a9b-4dde-a188-1ce8bcdb7b5c', 'project_id': '257b0b2e531441b4bb745e99cfd799f3', 'protocol': 'icmp', 'ethertype': 'IPv6', 'direction': 'egress'}} {{(pid=102993) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 23 19:35:45.301807 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.db.securitygroups_db [None req-29294d2d-f4f9-477f-834e-f11b44836db9 tempest-TestVolumeBootPattern-147141705 tempest-TestVolumeBootPattern-147141705-project] Project 257b0b2e531441b4bb745e99cfd799f3 added a security group rule with legacy IPv6 ICMP protocol name icmp, ipv6-icmp should be used instead. It was automatically converted. Nov 23 19:35:45.308183 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-29294d2d-f4f9-477f-834e-f11b44836db9 tempest-TestVolumeBootPattern-147141705 tempest-TestVolumeBootPattern-147141705-project] Publish callbacks [] for security_group_rule, before_create {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:35:45.365303 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1e5b81c6-59b1-4db4-9cff-c466e5a9abb2 req-db5debb4-81fe-4421-b7b3-d5e86b06dd2a tempest-AttachVolumeShelveTestJSON-1172915835 tempest-AttachVolumeShelveTestJSON-1172915835-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102993) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:35:45.367633 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-1e5b81c6-59b1-4db4-9cff-c466e5a9abb2 req-db5debb4-81fe-4421-b7b3-d5e86b06dd2a tempest-AttachVolumeShelveTestJSON-1172915835 tempest-AttachVolumeShelveTestJSON-1172915835-project] 10.222.0.62 "GET /v2.0/ports?device_id=85ea3d72-6c17-4ea2-82b7-90cce01633bd HTTP/1.1" status: 200 len: 945 time: 0.1064756 Nov 23 19:35:45.444370 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-29294d2d-f4f9-477f-834e-f11b44836db9 tempest-TestVolumeBootPattern-147141705 tempest-TestVolumeBootPattern-147141705-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:35:45.448825 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-1e5b81c6-59b1-4db4-9cff-c466e5a9abb2 req-b3bd8c3d-037c-41e4-8d3a-45d74466e697 tempest-AttachVolumeShelveTestJSON-1172915835 tempest-AttachVolumeShelveTestJSON-1172915835-project] 10.222.0.62 "GET /v2.0/security-groups?id=f1ca24d9-0a31-470d-a1d5-fa7059df0141&fields=id&fields=name HTTP/1.1" status: 200 len: 311 time: 0.0721970 Nov 23 19:35:45.461036 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.plugins.ml2.db [None req-4bf48ff4-ecfb-4168-8b63-249b8c6e9f04 None None] For port 4b380ab6-f3ec-4e12-9a2a-b5a20828969d, host hv-cinder-81901, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81901',level=0,port_id=4b380ab6-f3ec-4e12-9a2a-b5a20828969d,segment=NetworkSegment(b4453f21-ac7f-498c-8316-73b738820700),segment_id=b4453f21-ac7f-498c-8316-73b738820700)] {{(pid=102994) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 23 19:35:45.475256 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.plugins.ml2.rpc [None req-4bf48ff4-ecfb-4168-8b63-249b8c6e9f04 None None] Returning: {'device': '4b380ab6-f3ec-4e12-9a2a-b5a20828969d', 'network_id': 'fc901312-2937-4784-8a6d-c046666e8bf8', 'port_id': '4b380ab6-f3ec-4e12-9a2a-b5a20828969d', 'mac_address': 'fa:16:3e:c0:19:59', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 825, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '2caca985-6ed6-4ef7-ba49-7b7410bea160', 'ip_address': '172.20.0.7'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=102994) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Nov 23 19:35:45.515613 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-29294d2d-f4f9-477f-834e-f11b44836db9 tempest-TestVolumeBootPattern-147141705 tempest-TestVolumeBootPattern-147141705-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-601991'] for security_group_rule, after_create {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:35:45.520876 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron_lib.callbacks.manager [None req-4bf48ff4-ecfb-4168-8b63-249b8c6e9f04 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7921281'] for port, before_update {{(pid=102994) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:35:45.539033 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-29294d2d-f4f9-477f-834e-f11b44836db9 tempest-TestVolumeBootPattern-147141705 tempest-TestVolumeBootPattern-147141705-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=771714db-ed29-4fe2-9a6f-e6154a0920f3,revision_number=0']} {{(pid=102993) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 23 19:35:45.548728 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.notifiers.nova [None req-4bf48ff4-ecfb-4168-8b63-249b8c6e9f04 None None] Ignoring state change previous_port_status: ACTIVE current_port_status: BUILD port_id 4b380ab6-f3ec-4e12-9a2a-b5a20828969d {{(pid=102994) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 23 19:35:45.571709 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.plugins.ml2.db [None req-4bf48ff4-ecfb-4168-8b63-249b8c6e9f04 None None] For port 4b380ab6-f3ec-4e12-9a2a-b5a20828969d, host hv-cinder-81901, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81901',level=0,port_id=4b380ab6-f3ec-4e12-9a2a-b5a20828969d,segment=NetworkSegment(b4453f21-ac7f-498c-8316-73b738820700),segment_id=b4453f21-ac7f-498c-8316-73b738820700)] {{(pid=102994) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 23 19:35:45.620511 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-29294d2d-f4f9-477f-834e-f11b44836db9 tempest-TestVolumeBootPattern-147141705 tempest-TestVolumeBootPattern-147141705-project] Publish callbacks [] for security_group_rule, before_response {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:35:45.621900 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [None req-29294d2d-f4f9-477f-834e-f11b44836db9 tempest-TestVolumeBootPattern-147141705 tempest-TestVolumeBootPattern-147141705-project] 10.222.0.62 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 773 time: 0.4333789 Nov 23 19:35:45.657997 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron_lib.callbacks.manager [None req-4bf48ff4-ecfb-4168-8b63-249b8c6e9f04 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7918660', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-15067', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560168', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8783631423946', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8783631008732', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8783631008750'] for port, after_update {{(pid=102994) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:35:45.717551 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4bf48ff4-ecfb-4168-8b63-249b8c6e9f04 None None] Pushing event updated for resources: {'Port': ['ID=4b380ab6-f3ec-4e12-9a2a-b5a20828969d,revision_number=6']} {{(pid=102994) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 23 19:35:45.762684 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.plugins.ml2.db [None req-4bf48ff4-ecfb-4168-8b63-249b8c6e9f04 None None] get_ports_and_sgs() called for port_ids ['4b380ab6-f3ec-4e12-9a2a-b5a20828969d'] {{(pid=102994) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 23 19:35:45.998999 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.plugins.ml2.rpc [None req-eb87b2c3-3339-4249-8b85-e695b5b4e1f9 None None] Device c822f8fa-fca4-481d-b3b9-e84f0deaed5a up at agent ovs-agent-dv-cinder-819011-1-iscsi {{(pid=102994) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 23 19:35:46.060269 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.db.provisioning_blocks [None req-eb87b2c3-3339-4249-8b85-e695b5b4e1f9 None None] Provisioning complete for port c822f8fa-fca4-481d-b3b9-e84f0deaed5a triggered by entity L2. {{(pid=102994) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 23 19:35:46.060661 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron_lib.callbacks.manager [None req-eb87b2c3-3339-4249-8b85-e695b5b4e1f9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-8355713'] for port, provisioning_complete {{(pid=102994) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:35:46.155038 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-146a7ca0-3b55-4f64-9fb3-7312ea415d78 req-c3581eab-a475-4242-b0e9-fbb94f35bf84 tempest-VolumesActionsTest-802949502 tempest-VolumesActionsTest-802949502-project] 10.222.0.62 "GET /v2.0/ports?device_id=3b98df1d-4a12-4596-868b-56328fa3c3aa HTTP/1.1" status: 200 len: 210 time: 0.0324485 Nov 23 19:35:46.370903 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-055e90f1-a661-4f20-8991-6cb9793a1a3d req-d7401731-d9c6-4a09-bf74-acdc2c316402 tempest-ServerRescueNegativeTestJSON-1447477341 tempest-ServerRescueNegativeTestJSON-1447477341-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102993) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:35:46.372417 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-055e90f1-a661-4f20-8991-6cb9793a1a3d req-d7401731-d9c6-4a09-bf74-acdc2c316402 tempest-ServerRescueNegativeTestJSON-1447477341 tempest-ServerRescueNegativeTestJSON-1447477341-project] 10.222.0.62 "GET /v2.0/ports?device_id=671f1d44-7752-4a9d-835d-4d76164c900f HTTP/1.1" status: 200 len: 945 time: 0.0969589 Nov 23 19:35:46.380520 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4c80d923-9af3-4e69-962e-33c899c68470 req-e6fbf206-7045-4b86-8210-dfce72cd26a6 tempest-VolumesActionsTest-802949502 tempest-VolumesActionsTest-802949502-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=102992) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:35:46.382260 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-4c80d923-9af3-4e69-962e-33c899c68470 req-e6fbf206-7045-4b86-8210-dfce72cd26a6 tempest-VolumesActionsTest-802949502 tempest-VolumesActionsTest-802949502-project] 10.222.0.41 "GET /v2.0/networks?id=4b2c41c3-6250-433d-837a-85d02cae1bde HTTP/1.1" status: 200 len: 809 time: 0.1243861 Nov 23 19:35:46.416778 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.api.v2.base [req-4c80d923-9af3-4e69-962e-33c899c68470 req-fd25d236-f6e0-438e-bacf-48c8d1230734 tempest-VolumesActionsTest-802949502 tempest-VolumesActionsTest-802949502-project] Request body: {'port': {'device_id': '3b98df1d-4a12-4596-868b-56328fa3c3aa', 'network_id': '4b2c41c3-6250-433d-837a-85d02cae1bde', 'admin_state_up': True, 'tenant_id': '893242e83e2b490a98fcd7fafca0a833'}} {{(pid=102992) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 23 19:35:46.441971 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-055e90f1-a661-4f20-8991-6cb9793a1a3d req-bbfd0af2-53af-4be3-b378-e9a4f458f24b tempest-ServerRescueNegativeTestJSON-1447477341 tempest-ServerRescueNegativeTestJSON-1447477341-project] 10.222.0.62 "GET /v2.0/security-groups?id=62a09434-acf0-424f-9001-2c3a78119364&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0595806 Nov 23 19:35:46.598474 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-485504b5-a19e-41a7-a4bf-f1259c86bf1c req-aa6754a6-446d-4337-bfc8-0bef01299f5c tempest-AttachVolumeShelveTestJSON-1172915835 tempest-AttachVolumeShelveTestJSON-1172915835-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102992) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:35:46.600000 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-485504b5-a19e-41a7-a4bf-f1259c86bf1c req-aa6754a6-446d-4337-bfc8-0bef01299f5c tempest-AttachVolumeShelveTestJSON-1172915835 tempest-AttachVolumeShelveTestJSON-1172915835-project] 10.222.0.62 "GET /v2.0/ports?device_id=85ea3d72-6c17-4ea2-82b7-90cce01633bd HTTP/1.1" status: 200 len: 944 time: 0.0751083 Nov 23 19:35:46.624307 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron_lib.callbacks.manager [None req-785c1d26-11ba-42d8-b5a6-51a8b3daeef0 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8783631323329', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7978582'] for agent, after_update {{(pid=102994) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:35:46.648254 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-485504b5-a19e-41a7-a4bf-f1259c86bf1c req-9c6e4bd8-a94e-4556-a179-8a4b1dc571d5 tempest-AttachVolumeShelveTestJSON-1172915835 tempest-AttachVolumeShelveTestJSON-1172915835-project] 10.222.0.62 "GET /v2.0/security-groups?id=f1ca24d9-0a31-470d-a1d5-fa7059df0141&fields=id&fields=name HTTP/1.1" status: 200 len: 311 time: 0.0420327 Nov 23 19:35:46.681140 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-4c80d923-9af3-4e69-962e-33c899c68470 req-fd25d236-f6e0-438e-bacf-48c8d1230734 tempest-VolumesActionsTest-802949502 tempest-VolumesActionsTest-802949502-project] Made reservation on behalf of 893242e83e2b490a98fcd7fafca0a833 for: {'port': 1} {{(pid=102992) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 23 19:35:46.686709 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [req-4c80d923-9af3-4e69-962e-33c899c68470 req-fd25d236-f6e0-438e-bacf-48c8d1230734 tempest-VolumesActionsTest-802949502 tempest-VolumesActionsTest-802949502-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7921281'] for port, before_create {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:35:46.889486 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.db.db_base_plugin_common [req-4c80d923-9af3-4e69-962e-33c899c68470 req-fd25d236-f6e0-438e-bacf-48c8d1230734 tempest-VolumesActionsTest-802949502 tempest-VolumesActionsTest-802949502-project] Allocated IP 172.20.0.4 (4b2c41c3-6250-433d-837a-85d02cae1bde/168da168-ed46-4168-8b11-4b0ac0e6fbd8/9292b123-ce92-44b7-a488-3615ff195075) {{(pid=102992) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 23 19:35:47.053391 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [req-4c80d923-9af3-4e69-962e-33c899c68470 req-fd25d236-f6e0-438e-bacf-48c8d1230734 tempest-VolumesActionsTest-802949502 tempest-VolumesActionsTest-802949502-project] Publish callbacks [] for port, precommit_create {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:35:47.173063 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [req-4c80d923-9af3-4e69-962e-33c899c68470 req-fd25d236-f6e0-438e-bacf-48c8d1230734 tempest-VolumesActionsTest-802949502 tempest-VolumesActionsTest-802949502-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7918660', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-15067', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560168', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8783631008714', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-25199805'] for port, after_create {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:35:47.197499 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.plugins.ml2.rpc [None req-4bf48ff4-ecfb-4168-8b63-249b8c6e9f04 None None] Device 4b380ab6-f3ec-4e12-9a2a-b5a20828969d up at agent hyperv_hv-cinder-81901 {{(pid=102994) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 23 19:35:47.230670 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-4c80d923-9af3-4e69-962e-33c899c68470 req-fd25d236-f6e0-438e-bacf-48c8d1230734 tempest-VolumesActionsTest-802949502 tempest-VolumesActionsTest-802949502-project] Network 4b2c41c3-6250-433d-837a-85d02cae1bde is already hosted by enough agents. {{(pid=102992) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 23 19:35:47.234034 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.scheduler.base_scheduler [req-4c80d923-9af3-4e69-962e-33c899c68470 req-fd25d236-f6e0-438e-bacf-48c8d1230734 tempest-VolumesActionsTest-802949502 tempest-VolumesActionsTest-802949502-project] Resources bound (agent type, host, resource id): {{(pid=102992) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 23 19:35:47.238637 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.db.l3_dvrscheduler_db [req-4c80d923-9af3-4e69-962e-33c899c68470 req-fd25d236-f6e0-438e-bacf-48c8d1230734 tempest-VolumesActionsTest-802949502 tempest-VolumesActionsTest-802949502-project] Received port after_create {{(pid=102992) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 23 19:35:47.321613 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4c80d923-9af3-4e69-962e-33c899c68470 req-fd25d236-f6e0-438e-bacf-48c8d1230734 tempest-VolumesActionsTest-802949502 tempest-VolumesActionsTest-802949502-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=102992) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:35:47.322295 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [req-4c80d923-9af3-4e69-962e-33c899c68470 req-fd25d236-f6e0-438e-bacf-48c8d1230734 tempest-VolumesActionsTest-802949502 tempest-VolumesActionsTest-802949502-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-514902'] for port, before_response {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:35:47.354625 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.db.provisioning_blocks [None req-4bf48ff4-ecfb-4168-8b63-249b8c6e9f04 None None] Provisioning complete for port 4b380ab6-f3ec-4e12-9a2a-b5a20828969d triggered by entity L2. {{(pid=102994) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 23 19:35:47.354996 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron_lib.callbacks.manager [None req-4bf48ff4-ecfb-4168-8b63-249b8c6e9f04 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-8355713'] for port, provisioning_complete {{(pid=102994) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:35:47.366759 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fd25d236-f6e0-438e-bacf-48c8d1230734 tempest-VolumesActionsTest-802949502 tempest-VolumesActionsTest-802949502-project] Pushing event updated for resources: {'Port': ['ID=9292b123-ce92-44b7-a488-3615ff195075,revision_number=1']} {{(pid=102992) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 23 19:35:47.380315 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-99071511-3596-4071-aa10-fcd70a5de8f3 req-9132829c-7d44-4901-97ca-b658006fb90e tempest-VolumesActionsTest-802949502 tempest-VolumesActionsTest-802949502-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102993) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:35:47.382620 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-99071511-3596-4071-aa10-fcd70a5de8f3 req-9132829c-7d44-4901-97ca-b658006fb90e tempest-VolumesActionsTest-802949502 tempest-VolumesActionsTest-802949502-project] 10.222.0.62 "GET /v2.0/ports?device_id=3b98df1d-4a12-4596-868b-56328fa3c3aa HTTP/1.1" status: 200 len: 931 time: 0.1051543 Nov 23 19:35:47.411345 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron_lib.callbacks.manager [None req-eb87b2c3-3339-4249-8b85-e695b5b4e1f9 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8783631323329', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7978582'] for agent, after_update {{(pid=102994) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:35:47.459377 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-4c80d923-9af3-4e69-962e-33c899c68470 req-fd25d236-f6e0-438e-bacf-48c8d1230734 tempest-VolumesActionsTest-802949502 tempest-VolumesActionsTest-802949502-project] 10.222.0.41 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 1.0478814 Nov 23 19:35:47.461563 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-99071511-3596-4071-aa10-fcd70a5de8f3 req-2c94cebb-263b-4469-8745-4b0a92f6e25f tempest-VolumesActionsTest-802949502 tempest-VolumesActionsTest-802949502-project] 10.222.0.62 "GET /v2.0/security-groups?id=47acb13d-cf9a-4dd6-a614-503b94072f69&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0712709 Nov 23 19:35:47.483555 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.api.v2.base [req-4c80d923-9af3-4e69-962e-33c899c68470 req-9048707f-5f92-45e1-8c1c-99c6619f4942 service neutron] Request body: {'port': {'device_id': '3b98df1d-4a12-4596-868b-56328fa3c3aa', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-81901'}} {{(pid=102992) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 23 19:35:47.537586 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron_lib.callbacks.manager [None req-4bf48ff4-ecfb-4168-8b63-249b8c6e9f04 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7921281'] for port, before_update {{(pid=102994) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:35:47.597392 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.plugins.ml2.db [None req-4bf48ff4-ecfb-4168-8b63-249b8c6e9f04 None None] For port 4b380ab6-f3ec-4e12-9a2a-b5a20828969d, host hv-cinder-81901, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81901',level=0,port_id=4b380ab6-f3ec-4e12-9a2a-b5a20828969d,segment=NetworkSegment(b4453f21-ac7f-498c-8316-73b738820700),segment_id=b4453f21-ac7f-498c-8316-73b738820700)] {{(pid=102994) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 23 19:35:47.598536 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '85ea3d72-6c17-4ea2-82b7-90cce01633bd', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '4b380ab6-f3ec-4e12-9a2a-b5a20828969d'}] {{(pid=102994) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 23 19:35:47.601554 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.62/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}09a7511da0d2ba1d728b27e36a8467ec5289399952f0059588048a7cb66d3a43" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-f9344cd3-cc56-4f06-9c58-ceff1beec17f" -d '{"events": [{"server_uuid": "85ea3d72-6c17-4ea2-82b7-90cce01633bd", "name": "network-vif-plugged", "status": "completed", "tag": "4b380ab6-f3ec-4e12-9a2a-b5a20828969d"}]}' {{(pid=102994) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 23 19:35:47.654900 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 23 Nov 2021 19:35:47 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-647efb6d-15ef-4d00-a2cb-5c4d2ca4c1b1 x-openstack-request-id: req-647efb6d-15ef-4d00-a2cb-5c4d2ca4c1b1 {{(pid=102994) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 23 19:35:47.655956 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "85ea3d72-6c17-4ea2-82b7-90cce01633bd", "name": "network-vif-plugged", "status": "completed", "tag": "4b380ab6-f3ec-4e12-9a2a-b5a20828969d", "code": 200}]} {{(pid=102994) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 23 19:35:47.656401 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.62/compute/v2.1/os-server-external-events used request id req-647efb6d-15ef-4d00-a2cb-5c4d2ca4c1b1 {{(pid=102994) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 23 19:35:47.656974 dv-cinder-819011-1-iscsi neutron-server[102994]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '85ea3d72-6c17-4ea2-82b7-90cce01633bd', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '4b380ab6-f3ec-4e12-9a2a-b5a20828969d', 'code': 200} Nov 23 19:35:47.660696 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a8c627f6-68a1-4ee7-a622-52c25f8f6cb1 req-7b401804-0d50-4d81-8c07-9aa4e26cdda8 tempest-ServerRescueNegativeTestJSON-1447477341 tempest-ServerRescueNegativeTestJSON-1447477341-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102992) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:35:47.668000 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron_lib.callbacks.manager [None req-4bf48ff4-ecfb-4168-8b63-249b8c6e9f04 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7918660', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-15067', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560168', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8783631423946', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8783631008732', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8783631008750'] for port, after_update {{(pid=102994) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:35:47.668206 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-a8c627f6-68a1-4ee7-a622-52c25f8f6cb1 req-7b401804-0d50-4d81-8c07-9aa4e26cdda8 tempest-ServerRescueNegativeTestJSON-1447477341 tempest-ServerRescueNegativeTestJSON-1447477341-project] 10.222.0.62 "GET /v2.0/ports?device_id=671f1d44-7752-4a9d-835d-4d76164c900f HTTP/1.1" status: 200 len: 945 time: 0.0867746 Nov 23 19:35:47.669828 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [req-4c80d923-9af3-4e69-962e-33c899c68470 req-9048707f-5f92-45e1-8c1c-99c6619f4942 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7921281'] for port, before_update {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:35:47.746589 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4bf48ff4-ecfb-4168-8b63-249b8c6e9f04 None None] Pushing event updated for resources: {'Port': ['ID=4b380ab6-f3ec-4e12-9a2a-b5a20828969d,revision_number=7']} {{(pid=102994) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 23 19:35:47.901798 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4f636f92-5edd-4f1e-95b8-719c5e9ff112 req-e25659c6-f2b4-4772-a98f-e77546207868 tempest-AttachVolumeShelveTestJSON-1172915835 tempest-AttachVolumeShelveTestJSON-1172915835-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102993) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:35:47.912858 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-4f636f92-5edd-4f1e-95b8-719c5e9ff112 req-e25659c6-f2b4-4772-a98f-e77546207868 tempest-AttachVolumeShelveTestJSON-1172915835 tempest-AttachVolumeShelveTestJSON-1172915835-project] 10.222.0.62 "GET /v2.0/ports?device_id=85ea3d72-6c17-4ea2-82b7-90cce01633bd HTTP/1.1" status: 200 len: 945 time: 0.1131258 Nov 23 19:35:48.009463 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-4f636f92-5edd-4f1e-95b8-719c5e9ff112 req-2636d2b6-88a4-47b4-90f6-ea7f4275f49c tempest-AttachVolumeShelveTestJSON-1172915835 tempest-AttachVolumeShelveTestJSON-1172915835-project] 10.222.0.62 "GET /v2.0/security-groups?id=f1ca24d9-0a31-470d-a1d5-fa7059df0141&fields=id&fields=name HTTP/1.1" status: 200 len: 311 time: 0.0871501 Nov 23 19:35:48.095345 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-a8c627f6-68a1-4ee7-a622-52c25f8f6cb1 req-7eda3739-4bbe-4caf-a398-bae381284c2f tempest-ServerRescueNegativeTestJSON-1447477341 tempest-ServerRescueNegativeTestJSON-1447477341-project] 10.222.0.62 "GET /v2.0/security-groups?id=62a09434-acf0-424f-9001-2c3a78119364&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.4264395 Nov 23 19:35:48.100298 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.notifiers.nova [req-4c80d923-9af3-4e69-962e-33c899c68470 req-9048707f-5f92-45e1-8c1c-99c6619f4942 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 9292b123-ce92-44b7-a488-3615ff195075 {{(pid=102992) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 23 19:35:48.111195 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [req-4c80d923-9af3-4e69-962e-33c899c68470 req-9048707f-5f92-45e1-8c1c-99c6619f4942 service neutron] Publish callbacks [] for port, precommit_update {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:35:48.125537 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.db.provisioning_blocks [req-4c80d923-9af3-4e69-962e-33c899c68470 req-9048707f-5f92-45e1-8c1c-99c6619f4942 service neutron] Transition to ACTIVE for port object 9292b123-ce92-44b7-a488-3615ff195075 will not be triggered until provisioned by entity L2. {{(pid=102992) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 23 19:35:48.212501 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [req-4c80d923-9af3-4e69-962e-33c899c68470 req-9048707f-5f92-45e1-8c1c-99c6619f4942 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7918660', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-15067', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560168', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8783631423946', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8783631008732', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8783631008750', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-25199748'] for port, after_update {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:35:48.264578 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9048707f-5f92-45e1-8c1c-99c6619f4942 service neutron] Pushing event updated for resources: {'Port': ['ID=9292b123-ce92-44b7-a488-3615ff195075,revision_number=2']} {{(pid=102992) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 23 19:35:48.342809 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.plugins.ml2.managers [req-4c80d923-9af3-4e69-962e-33c899c68470 req-9048707f-5f92-45e1-8c1c-99c6619f4942 service neutron] Attempting to bind port 9292b123-ce92-44b7-a488-3615ff195075 on host hv-cinder-81901 for vnic_type normal with profile {{(pid=102992) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 23 19:35:48.343264 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.plugins.ml2.managers [req-4c80d923-9af3-4e69-962e-33c899c68470 req-9048707f-5f92-45e1-8c1c-99c6619f4942 service neutron] Attempting to bind port 9292b123-ce92-44b7-a488-3615ff195075 by drivers openvswitch,hyperv on host hv-cinder-81901 at level 0 using segments [{'id': '2ab14203-895d-412f-8616-df9c89e896c9', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 839, 'network_id': '4b2c41c3-6250-433d-837a-85d02cae1bde'}] {{(pid=102992) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 23 19:35:48.343604 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-4c80d923-9af3-4e69-962e-33c899c68470 req-9048707f-5f92-45e1-8c1c-99c6619f4942 service neutron] Attempting to bind port 9292b123-ce92-44b7-a488-3615ff195075 on network 4b2c41c3-6250-433d-837a-85d02cae1bde {{(pid=102992) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 23 19:35:48.349058 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-4c80d923-9af3-4e69-962e-33c899c68470 req-9048707f-5f92-45e1-8c1c-99c6619f4942 service neutron] Port 9292b123-ce92-44b7-a488-3615ff195075 on network 4b2c41c3-6250-433d-837a-85d02cae1bde not bound, no agent of type Open vSwitch agent registered on host hv-cinder-81901 {{(pid=102992) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Nov 23 19:35:48.349375 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-4c80d923-9af3-4e69-962e-33c899c68470 req-9048707f-5f92-45e1-8c1c-99c6619f4942 service neutron] Attempting to bind port 9292b123-ce92-44b7-a488-3615ff195075 on network 4b2c41c3-6250-433d-837a-85d02cae1bde {{(pid=102992) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 23 19:35:48.354657 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-4c80d923-9af3-4e69-962e-33c899c68470 req-9048707f-5f92-45e1-8c1c-99c6619f4942 service neutron] Checking agent: {'id': '14e5d049-431d-466a-8d1c-264e5129d376', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-81901', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 23, 19, 31, 29), 'started_at': datetime.datetime(2021, 11, 23, 19, 31, 29), 'heartbeat_timestamp': datetime.datetime(2021, 11, 23, 19, 35, 29), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=102992) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 23 19:35:48.355021 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-4c80d923-9af3-4e69-962e-33c899c68470 req-9048707f-5f92-45e1-8c1c-99c6619f4942 service neutron] Checking segment: {'id': '2ab14203-895d-412f-8616-df9c89e896c9', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 839, 'network_id': '4b2c41c3-6250-433d-837a-85d02cae1bde'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102992) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 23 19:35:48.355368 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-4c80d923-9af3-4e69-962e-33c899c68470 req-9048707f-5f92-45e1-8c1c-99c6619f4942 service neutron] Bound using segment: {'id': '2ab14203-895d-412f-8616-df9c89e896c9', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 839, 'network_id': '4b2c41c3-6250-433d-837a-85d02cae1bde'} {{(pid=102992) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 23 19:35:48.355788 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.plugins.ml2.managers [req-4c80d923-9af3-4e69-962e-33c899c68470 req-9048707f-5f92-45e1-8c1c-99c6619f4942 service neutron] Bound port: 9292b123-ce92-44b7-a488-3615ff195075, host: hv-cinder-81901, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '2ab14203-895d-412f-8616-df9c89e896c9', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 839, 'network_id': '4b2c41c3-6250-433d-837a-85d02cae1bde'}}] {{(pid=102992) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 23 19:35:48.356137 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [req-4c80d923-9af3-4e69-962e-33c899c68470 req-9048707f-5f92-45e1-8c1c-99c6619f4942 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7921281'] for port, before_update {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:35:48.458651 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.plugins.ml2.db [req-4c80d923-9af3-4e69-962e-33c899c68470 req-9048707f-5f92-45e1-8c1c-99c6619f4942 service neutron] For port 9292b123-ce92-44b7-a488-3615ff195075, host hv-cinder-81901, cleared binding levels {{(pid=102992) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 23 19:35:48.485051 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.plugins.ml2.db [req-4c80d923-9af3-4e69-962e-33c899c68470 req-9048707f-5f92-45e1-8c1c-99c6619f4942 service neutron] For port 9292b123-ce92-44b7-a488-3615ff195075, host hv-cinder-81901, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81901',level=0,port_id=9292b123-ce92-44b7-a488-3615ff195075,segment=NetworkSegment(2ab14203-895d-412f-8616-df9c89e896c9),segment_id=2ab14203-895d-412f-8616-df9c89e896c9)] {{(pid=102992) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 23 19:35:48.625257 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-334efdac-1bb5-42f5-aa4c-fdacb6730462 req-1768f7d6-ab2f-4006-ba6a-f624fd68d15d tempest-VolumesActionsTest-802949502 tempest-VolumesActionsTest-802949502-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102993) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:35:48.628412 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-334efdac-1bb5-42f5-aa4c-fdacb6730462 req-1768f7d6-ab2f-4006-ba6a-f624fd68d15d tempest-VolumesActionsTest-802949502 tempest-VolumesActionsTest-802949502-project] 10.222.0.62 "GET /v2.0/ports?device_id=3b98df1d-4a12-4596-868b-56328fa3c3aa HTTP/1.1" status: 200 len: 943 time: 0.0565078 Nov 23 19:35:48.684325 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-334efdac-1bb5-42f5-aa4c-fdacb6730462 req-972b6027-b5b5-4fa6-bd1d-49360ce1185d tempest-VolumesActionsTest-802949502 tempest-VolumesActionsTest-802949502-project] 10.222.0.62 "GET /v2.0/security-groups?id=47acb13d-cf9a-4dd6-a614-503b94072f69&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0493264 Nov 23 19:35:48.698859 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [req-4c80d923-9af3-4e69-962e-33c899c68470 req-9048707f-5f92-45e1-8c1c-99c6619f4942 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7918660', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-15067', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560168', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8783631423946', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8783631008732', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8783631008750', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-25199748'] for port, after_update {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:35:48.744513 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4c80d923-9af3-4e69-962e-33c899c68470 req-9048707f-5f92-45e1-8c1c-99c6619f4942 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102992) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:35:48.745395 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [req-4c80d923-9af3-4e69-962e-33c899c68470 req-9048707f-5f92-45e1-8c1c-99c6619f4942 service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-514902'] for port, before_response {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:35:48.746714 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-4c80d923-9af3-4e69-962e-33c899c68470 req-9048707f-5f92-45e1-8c1c-99c6619f4942 service neutron] 10.222.0.41 "PUT /v2.0/ports/9292b123-ce92-44b7-a488-3615ff195075 HTTP/1.1" status: 200 len: 1093 time: 1.2682376 Nov 23 19:35:48.747219 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '3b98df1d-4a12-4596-868b-56328fa3c3aa', 'tag': '9292b123-ce92-44b7-a488-3615ff195075'}] {{(pid=102992) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 23 19:35:48.749692 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.62/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}f86c332b591ae691ababa4b64e0601cbf242a448242f95367ce03daabfb7e1ce" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-cfc78cb6-6699-4ead-bbd7-a01e5d75f349" -d '{"events": [{"name": "network-changed", "server_uuid": "3b98df1d-4a12-4596-868b-56328fa3c3aa", "tag": "9292b123-ce92-44b7-a488-3615ff195075"}]}' {{(pid=102992) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 23 19:35:48.814573 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Tue, 23 Nov 2021 19:35:48 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-60a724c7-5256-454e-8d4d-52183479fa27 x-openstack-request-id: req-60a724c7-5256-454e-8d4d-52183479fa27 {{(pid=102992) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 23 19:35:48.816136 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "3b98df1d-4a12-4596-868b-56328fa3c3aa", "tag": "9292b123-ce92-44b7-a488-3615ff195075", "status": "completed", "code": 200}]} {{(pid=102992) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 23 19:35:48.816708 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.62/compute/v2.1/os-server-external-events used request id req-60a724c7-5256-454e-8d4d-52183479fa27 {{(pid=102992) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 23 19:35:48.817384 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '3b98df1d-4a12-4596-868b-56328fa3c3aa', 'tag': '9292b123-ce92-44b7-a488-3615ff195075', 'status': 'completed', 'code': 200} Nov 23 19:35:48.818787 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9048707f-5f92-45e1-8c1c-99c6619f4942 service neutron] Pushing event updated for resources: {'Port': ['ID=9292b123-ce92-44b7-a488-3615ff195075,revision_number=3']} {{(pid=102992) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 23 19:35:48.912089 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cfc78cb6-6699-4ead-bbd7-a01e5d75f349 req-8a0a216e-19c6-4610-9a46-bc7c9c62127d service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102992) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:35:48.914014 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-cfc78cb6-6699-4ead-bbd7-a01e5d75f349 req-8a0a216e-19c6-4610-9a46-bc7c9c62127d service neutron] 10.222.0.41 "GET /v2.0/ports?tenant_id=893242e83e2b490a98fcd7fafca0a833&device_id=3b98df1d-4a12-4596-868b-56328fa3c3aa HTTP/1.1" status: 200 len: 1096 time: 0.0613430 Nov 23 19:35:49.057288 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cfc78cb6-6699-4ead-bbd7-a01e5d75f349 req-7ae2db2a-3084-446a-8c88-38477e13e56b service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102992) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:35:49.059248 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-cfc78cb6-6699-4ead-bbd7-a01e5d75f349 req-7ae2db2a-3084-446a-8c88-38477e13e56b service neutron] 10.222.0.41 "GET /v2.0/networks?tenant_id=893242e83e2b490a98fcd7fafca0a833&shared=False HTTP/1.1" status: 200 len: 910 time: 0.1207802 Nov 23 19:35:49.217967 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f96461ce-b7ff-47bd-af47-e865e4b0e24f req-1d200de6-aaf6-4ecf-a237-cd76db2bef8b tempest-AttachVolumeShelveTestJSON-1172915835 tempest-AttachVolumeShelveTestJSON-1172915835-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102993) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:35:49.224844 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cfc78cb6-6699-4ead-bbd7-a01e5d75f349 req-b2d1be72-28e0-41e7-9355-927ece50a8d1 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102992) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:35:49.226392 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-cfc78cb6-6699-4ead-bbd7-a01e5d75f349 req-b2d1be72-28e0-41e7-9355-927ece50a8d1 service neutron] 10.222.0.41 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 870 time: 0.1528177 Nov 23 19:35:49.227036 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-f96461ce-b7ff-47bd-af47-e865e4b0e24f req-1d200de6-aaf6-4ecf-a237-cd76db2bef8b tempest-AttachVolumeShelveTestJSON-1172915835 tempest-AttachVolumeShelveTestJSON-1172915835-project] 10.222.0.62 "GET /v2.0/ports?device_id=85ea3d72-6c17-4ea2-82b7-90cce01633bd HTTP/1.1" status: 200 len: 945 time: 0.1169498 Nov 23 19:35:49.285233 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1532d73f-42d8-411e-8a0a-3aa888a8d77a req-d33ecea2-a162-4f5b-8691-bf40a1f55864 tempest-ServerRescueNegativeTestJSON-1447477341 tempest-ServerRescueNegativeTestJSON-1447477341-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102992) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:35:49.287521 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-1532d73f-42d8-411e-8a0a-3aa888a8d77a req-d33ecea2-a162-4f5b-8691-bf40a1f55864 tempest-ServerRescueNegativeTestJSON-1447477341 tempest-ServerRescueNegativeTestJSON-1447477341-project] 10.222.0.62 "GET /v2.0/ports?device_id=671f1d44-7752-4a9d-835d-4d76164c900f HTTP/1.1" status: 200 len: 945 time: 0.0770230 Nov 23 19:35:49.290482 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-f96461ce-b7ff-47bd-af47-e865e4b0e24f req-f4a7ce9e-2422-4ae1-8ce5-d9b66eecf566 tempest-AttachVolumeShelveTestJSON-1172915835 tempest-AttachVolumeShelveTestJSON-1172915835-project] 10.222.0.62 "GET /v2.0/security-groups?id=f1ca24d9-0a31-470d-a1d5-fa7059df0141&fields=id&fields=name HTTP/1.1" status: 200 len: 311 time: 0.0623260 Nov 23 19:35:49.371836 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-1532d73f-42d8-411e-8a0a-3aa888a8d77a req-bd5180b3-62aa-4197-9c26-10daba85adbc tempest-ServerRescueNegativeTestJSON-1447477341 tempest-ServerRescueNegativeTestJSON-1447477341-project] 10.222.0.62 "GET /v2.0/security-groups?id=62a09434-acf0-424f-9001-2c3a78119364&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0656717 Nov 23 19:35:49.374716 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4c80d923-9af3-4e69-962e-33c899c68470 req-a7d945ee-036c-412c-873d-ffc1dc143519 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102992) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:35:49.375951 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-4c80d923-9af3-4e69-962e-33c899c68470 req-a7d945ee-036c-412c-873d-ffc1dc143519 service neutron] 10.222.0.41 "GET /v2.0/ports?tenant_id=893242e83e2b490a98fcd7fafca0a833&device_id=3b98df1d-4a12-4596-868b-56328fa3c3aa HTTP/1.1" status: 200 len: 1096 time: 0.0786657 Nov 23 19:35:49.431386 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-4c80d923-9af3-4e69-962e-33c899c68470 req-2da7092a-852f-4823-8ac0-0248c8503ea8 service neutron] 10.222.0.41 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.4&port_id=9292b123-ce92-44b7-a488-3615ff195075 HTTP/1.1" status: 200 len: 217 time: 0.0366158 Nov 23 19:35:49.504438 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4c80d923-9af3-4e69-962e-33c899c68470 req-c7cfabca-b058-4bc4-9695-52f700f44306 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102992) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:35:49.506353 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-4c80d923-9af3-4e69-962e-33c899c68470 req-c7cfabca-b058-4bc4-9695-52f700f44306 service neutron] 10.222.0.41 "GET /v2.0/subnets?id=168da168-ed46-4168-8b11-4b0ac0e6fbd8 HTTP/1.1" status: 200 len: 849 time: 0.0593076 Nov 23 19:35:49.547587 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-4c80d923-9af3-4e69-962e-33c899c68470 req-bdaecf51-816e-4863-93b3-bd44d7d3dbb9 service neutron] 10.222.0.41 "GET /v2.0/ports?network_id=4b2c41c3-6250-433d-837a-85d02cae1bde&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0247197 Nov 23 19:35:49.661086 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-4c80d923-9af3-4e69-962e-33c899c68470 req-5fe7df8e-544f-4c73-82b6-810ca8e13427 service neutron] 10.222.0.41 "GET /v2.0/networks/4b2c41c3-6250-433d-837a-85d02cae1bde?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0993671 Nov 23 19:35:49.800346 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-4c80d923-9af3-4e69-962e-33c899c68470 req-6e18ceab-561e-4a4d-82ec-811c0883ac4c service neutron] 10.222.0.41 "GET /v2.0/networks/4b2c41c3-6250-433d-837a-85d02cae1bde?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1175251 Nov 23 19:35:49.852718 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4a491fd1-c9bc-4aa7-ba05-1b12f2f839ba req-07341afe-6944-4963-998c-bbce0b22e930 tempest-VolumesActionsTest-802949502 tempest-VolumesActionsTest-802949502-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102993) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:35:49.854422 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-4a491fd1-c9bc-4aa7-ba05-1b12f2f839ba req-07341afe-6944-4963-998c-bbce0b22e930 tempest-VolumesActionsTest-802949502 tempest-VolumesActionsTest-802949502-project] 10.222.0.62 "GET /v2.0/ports?device_id=3b98df1d-4a12-4596-868b-56328fa3c3aa HTTP/1.1" status: 200 len: 943 time: 0.0738935 Nov 23 19:35:49.913862 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-4a491fd1-c9bc-4aa7-ba05-1b12f2f839ba req-fce6e5a3-6ec6-4748-a845-1bc2393e04dc tempest-VolumesActionsTest-802949502 tempest-VolumesActionsTest-802949502-project] 10.222.0.62 "GET /v2.0/security-groups?id=47acb13d-cf9a-4dd6-a614-503b94072f69&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0523543 Nov 23 19:35:50.449517 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8e1a515b-e4cf-4697-b10c-4fda9c811e7f req-6d5c2b9f-4018-41c0-abe4-241b6f5f43f8 tempest-AttachVolumeShelveTestJSON-1172915835 tempest-AttachVolumeShelveTestJSON-1172915835-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102992) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:35:50.451483 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-8e1a515b-e4cf-4697-b10c-4fda9c811e7f req-6d5c2b9f-4018-41c0-abe4-241b6f5f43f8 tempest-AttachVolumeShelveTestJSON-1172915835 tempest-AttachVolumeShelveTestJSON-1172915835-project] 10.222.0.62 "GET /v2.0/ports?device_id=85ea3d72-6c17-4ea2-82b7-90cce01633bd HTTP/1.1" status: 200 len: 945 time: 0.0760570 Nov 23 19:35:50.517765 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-8e1a515b-e4cf-4697-b10c-4fda9c811e7f req-1184a9e3-2c8f-46ee-9dc6-3f11b16ece84 tempest-AttachVolumeShelveTestJSON-1172915835 tempest-AttachVolumeShelveTestJSON-1172915835-project] 10.222.0.62 "GET /v2.0/security-groups?id=f1ca24d9-0a31-470d-a1d5-fa7059df0141&fields=id&fields=name HTTP/1.1" status: 200 len: 311 time: 0.0537386 Nov 23 19:35:50.539159 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cf3c1568-a7f0-4f41-88f8-97e4149846ff req-7ac0d88a-163f-4ccc-9210-85adf6969be4 tempest-ServerRescueNegativeTestJSON-1447477341 tempest-ServerRescueNegativeTestJSON-1447477341-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102993) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:35:50.540862 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-cf3c1568-a7f0-4f41-88f8-97e4149846ff req-7ac0d88a-163f-4ccc-9210-85adf6969be4 tempest-ServerRescueNegativeTestJSON-1447477341 tempest-ServerRescueNegativeTestJSON-1447477341-project] 10.222.0.62 "GET /v2.0/ports?device_id=671f1d44-7752-4a9d-835d-4d76164c900f HTTP/1.1" status: 200 len: 945 time: 0.0609782 Nov 23 19:35:50.820209 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-cf3c1568-a7f0-4f41-88f8-97e4149846ff req-aca9fcff-ddb9-4b8a-8a12-5eabded54f7a tempest-ServerRescueNegativeTestJSON-1447477341 tempest-ServerRescueNegativeTestJSON-1447477341-project] 10.222.0.62 "GET /v2.0/security-groups?id=62a09434-acf0-424f-9001-2c3a78119364&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2730834 Nov 23 19:35:51.043196 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6a9c7c43-ac64-4943-9e23-934225ddf107 req-7c41ca8b-7f07-49d5-90d2-8eb69835fa16 tempest-VolumesActionsTest-802949502 tempest-VolumesActionsTest-802949502-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102992) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:35:51.044724 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-6a9c7c43-ac64-4943-9e23-934225ddf107 req-7c41ca8b-7f07-49d5-90d2-8eb69835fa16 tempest-VolumesActionsTest-802949502 tempest-VolumesActionsTest-802949502-project] 10.222.0.62 "GET /v2.0/ports?device_id=3b98df1d-4a12-4596-868b-56328fa3c3aa HTTP/1.1" status: 200 len: 943 time: 0.0536277 Nov 23 19:35:51.092832 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-6a9c7c43-ac64-4943-9e23-934225ddf107 req-b7154e61-edb1-4636-82c6-68562a0e716a tempest-VolumesActionsTest-802949502 tempest-VolumesActionsTest-802949502-project] 10.222.0.62 "GET /v2.0/security-groups?id=47acb13d-cf9a-4dd6-a614-503b94072f69&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0408530 Nov 23 19:35:51.655812 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c1ef8bde-a817-4a21-a7a2-0a7b95d84a5f req-41c94767-ee95-44a4-a1fc-71bbc9075eff tempest-AttachVolumeShelveTestJSON-1172915835 tempest-AttachVolumeShelveTestJSON-1172915835-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102993) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:35:51.664484 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-c1ef8bde-a817-4a21-a7a2-0a7b95d84a5f req-41c94767-ee95-44a4-a1fc-71bbc9075eff tempest-AttachVolumeShelveTestJSON-1172915835 tempest-AttachVolumeShelveTestJSON-1172915835-project] 10.222.0.62 "GET /v2.0/ports?device_id=85ea3d72-6c17-4ea2-82b7-90cce01633bd HTTP/1.1" status: 200 len: 945 time: 0.0681267 Nov 23 19:35:51.719595 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-c1ef8bde-a817-4a21-a7a2-0a7b95d84a5f req-e7f180c6-c529-4a09-8bae-9bb6f1db0393 tempest-AttachVolumeShelveTestJSON-1172915835 tempest-AttachVolumeShelveTestJSON-1172915835-project] 10.222.0.62 "GET /v2.0/security-groups?id=f1ca24d9-0a31-470d-a1d5-fa7059df0141&fields=id&fields=name HTTP/1.1" status: 200 len: 311 time: 0.0533004 Nov 23 19:35:51.959985 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-94328a42-4284-4858-91bc-8fecc0c15a91 req-55e848ae-ba7a-414c-bc29-ea8c387bb701 tempest-ServerRescueNegativeTestJSON-1447477341 tempest-ServerRescueNegativeTestJSON-1447477341-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102992) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:35:51.979543 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-94328a42-4284-4858-91bc-8fecc0c15a91 req-55e848ae-ba7a-414c-bc29-ea8c387bb701 tempest-ServerRescueNegativeTestJSON-1447477341 tempest-ServerRescueNegativeTestJSON-1447477341-project] 10.222.0.62 "GET /v2.0/ports?device_id=671f1d44-7752-4a9d-835d-4d76164c900f HTTP/1.1" status: 200 len: 945 time: 0.0724800 Nov 23 19:35:52.043547 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-94328a42-4284-4858-91bc-8fecc0c15a91 req-d00986fb-b163-4da3-b537-6b4e6627f394 tempest-ServerRescueNegativeTestJSON-1447477341 tempest-ServerRescueNegativeTestJSON-1447477341-project] 10.222.0.62 "GET /v2.0/security-groups?id=62a09434-acf0-424f-9001-2c3a78119364&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0563366 Nov 23 19:35:52.224075 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d4a08ff7-803b-438f-a5a7-cc775f698e0a req-a3e65162-b7da-4203-b86c-564adec7d96b tempest-VolumesActionsTest-802949502 tempest-VolumesActionsTest-802949502-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102993) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:35:52.225610 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-d4a08ff7-803b-438f-a5a7-cc775f698e0a req-a3e65162-b7da-4203-b86c-564adec7d96b tempest-VolumesActionsTest-802949502 tempest-VolumesActionsTest-802949502-project] 10.222.0.62 "GET /v2.0/ports?device_id=3b98df1d-4a12-4596-868b-56328fa3c3aa HTTP/1.1" status: 200 len: 943 time: 0.0545669 Nov 23 19:35:52.281239 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-d4a08ff7-803b-438f-a5a7-cc775f698e0a req-0abf7a9d-2bfb-4478-83ce-4428f31ad9c5 tempest-VolumesActionsTest-802949502 tempest-VolumesActionsTest-802949502-project] 10.222.0.62 "GET /v2.0/security-groups?id=47acb13d-cf9a-4dd6-a614-503b94072f69&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0493684 Nov 23 19:35:52.875094 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dedb2d15-7178-4a04-8bf6-7305207470cf req-f3bf764c-eb9d-4d63-bdd9-4a054cce61ee tempest-AttachVolumeShelveTestJSON-1172915835 tempest-AttachVolumeShelveTestJSON-1172915835-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102992) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:35:52.876709 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-dedb2d15-7178-4a04-8bf6-7305207470cf req-f3bf764c-eb9d-4d63-bdd9-4a054cce61ee tempest-AttachVolumeShelveTestJSON-1172915835 tempest-AttachVolumeShelveTestJSON-1172915835-project] 10.222.0.62 "GET /v2.0/ports?device_id=85ea3d72-6c17-4ea2-82b7-90cce01633bd HTTP/1.1" status: 200 len: 945 time: 0.0677991 Nov 23 19:35:52.938597 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-dedb2d15-7178-4a04-8bf6-7305207470cf req-0f3122a9-a57e-45ad-b1fa-8c3ee019be4e tempest-AttachVolumeShelveTestJSON-1172915835 tempest-AttachVolumeShelveTestJSON-1172915835-project] 10.222.0.62 "GET /v2.0/security-groups?id=f1ca24d9-0a31-470d-a1d5-fa7059df0141&fields=id&fields=name HTTP/1.1" status: 200 len: 311 time: 0.0551233 Nov 23 19:35:53.186018 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-812412ce-373b-47d2-8976-8e90c4b05a8a req-6f048a74-4d41-49b9-8e52-05df8a941c4b tempest-ServerRescueNegativeTestJSON-1447477341 tempest-ServerRescueNegativeTestJSON-1447477341-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102993) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:35:53.189969 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-812412ce-373b-47d2-8976-8e90c4b05a8a req-6f048a74-4d41-49b9-8e52-05df8a941c4b tempest-ServerRescueNegativeTestJSON-1447477341 tempest-ServerRescueNegativeTestJSON-1447477341-project] 10.222.0.62 "GET /v2.0/ports?device_id=671f1d44-7752-4a9d-835d-4d76164c900f HTTP/1.1" status: 200 len: 945 time: 0.0727155 Nov 23 19:35:53.237597 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-812412ce-373b-47d2-8976-8e90c4b05a8a req-edf16f51-796e-4556-a906-af3b4c1f4a91 tempest-ServerRescueNegativeTestJSON-1447477341 tempest-ServerRescueNegativeTestJSON-1447477341-project] 10.222.0.62 "GET /v2.0/security-groups?id=62a09434-acf0-424f-9001-2c3a78119364&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0437653 Nov 23 19:35:53.295900 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.plugins.ml2.rpc [None req-4bf48ff4-ecfb-4168-8b63-249b8c6e9f04 None None] Device 9292b123-ce92-44b7-a488-3615ff195075 details requested by agent hyperv_hv-cinder-81901 with host hv-cinder-81901 {{(pid=102994) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Nov 23 19:35:53.400842 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.plugins.ml2.db [None req-4bf48ff4-ecfb-4168-8b63-249b8c6e9f04 None None] For port 9292b123-ce92-44b7-a488-3615ff195075, host hv-cinder-81901, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81901',level=0,port_id=9292b123-ce92-44b7-a488-3615ff195075,segment=NetworkSegment(2ab14203-895d-412f-8616-df9c89e896c9),segment_id=2ab14203-895d-412f-8616-df9c89e896c9)] {{(pid=102994) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 23 19:35:53.414871 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.plugins.ml2.rpc [None req-4bf48ff4-ecfb-4168-8b63-249b8c6e9f04 None None] Returning: {'device': '9292b123-ce92-44b7-a488-3615ff195075', 'network_id': '4b2c41c3-6250-433d-837a-85d02cae1bde', 'port_id': '9292b123-ce92-44b7-a488-3615ff195075', 'mac_address': 'fa:16:3e:5e:5d:83', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 839, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '168da168-ed46-4168-8b11-4b0ac0e6fbd8', 'ip_address': '172.20.0.4'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=102994) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Nov 23 19:35:53.434331 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4da26f45-b8cf-4851-b7c0-42d8b4b0b8fd req-a5b30d68-a6d6-40e4-8cb7-b4babe4c8310 tempest-VolumesActionsTest-802949502 tempest-VolumesActionsTest-802949502-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102992) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:35:53.434331 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-4da26f45-b8cf-4851-b7c0-42d8b4b0b8fd req-a5b30d68-a6d6-40e4-8cb7-b4babe4c8310 tempest-VolumesActionsTest-802949502 tempest-VolumesActionsTest-802949502-project] 10.222.0.62 "GET /v2.0/ports?device_id=3b98df1d-4a12-4596-868b-56328fa3c3aa HTTP/1.1" status: 200 len: 943 time: 0.0629716 Nov 23 19:35:53.482385 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron_lib.callbacks.manager [None req-4bf48ff4-ecfb-4168-8b63-249b8c6e9f04 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7921281'] for port, before_update {{(pid=102994) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:35:53.506150 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.notifiers.nova [None req-4bf48ff4-ecfb-4168-8b63-249b8c6e9f04 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 9292b123-ce92-44b7-a488-3615ff195075 {{(pid=102994) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 23 19:35:53.507216 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-4da26f45-b8cf-4851-b7c0-42d8b4b0b8fd req-25e74565-eb4b-4688-b8c9-a24f847f3d0b tempest-VolumesActionsTest-802949502 tempest-VolumesActionsTest-802949502-project] 10.222.0.62 "GET /v2.0/security-groups?id=47acb13d-cf9a-4dd6-a614-503b94072f69&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0685716 Nov 23 19:35:53.536453 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.plugins.ml2.db [None req-4bf48ff4-ecfb-4168-8b63-249b8c6e9f04 None None] For port 9292b123-ce92-44b7-a488-3615ff195075, host hv-cinder-81901, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81901',level=0,port_id=9292b123-ce92-44b7-a488-3615ff195075,segment=NetworkSegment(2ab14203-895d-412f-8616-df9c89e896c9),segment_id=2ab14203-895d-412f-8616-df9c89e896c9)] {{(pid=102994) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 23 19:35:53.584331 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron_lib.callbacks.manager [None req-4bf48ff4-ecfb-4168-8b63-249b8c6e9f04 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7918660', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-15067', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560168', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8783631423946', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8783631008732', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8783631008750'] for port, after_update {{(pid=102994) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:35:53.636934 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4bf48ff4-ecfb-4168-8b63-249b8c6e9f04 None None] Pushing event updated for resources: {'Port': ['ID=9292b123-ce92-44b7-a488-3615ff195075,revision_number=4']} {{(pid=102994) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 23 19:35:54.058279 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-11f116bf-d46d-48ff-8bf8-177ec81f749c req-0cfa982e-0db8-49e3-ad5f-55552997ed14 tempest-AttachVolumeShelveTestJSON-1172915835 tempest-AttachVolumeShelveTestJSON-1172915835-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102993) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:35:54.059790 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-11f116bf-d46d-48ff-8bf8-177ec81f749c req-0cfa982e-0db8-49e3-ad5f-55552997ed14 tempest-AttachVolumeShelveTestJSON-1172915835 tempest-AttachVolumeShelveTestJSON-1172915835-project] 10.222.0.62 "GET /v2.0/ports?device_id=85ea3d72-6c17-4ea2-82b7-90cce01633bd HTTP/1.1" status: 200 len: 945 time: 0.0500627 Nov 23 19:35:54.114444 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-11f116bf-d46d-48ff-8bf8-177ec81f749c req-037afaa7-0d7e-4834-9450-29689ccfd96b tempest-AttachVolumeShelveTestJSON-1172915835 tempest-AttachVolumeShelveTestJSON-1172915835-project] 10.222.0.62 "GET /v2.0/security-groups?id=f1ca24d9-0a31-470d-a1d5-fa7059df0141&fields=id&fields=name HTTP/1.1" status: 200 len: 311 time: 0.0478499 Nov 23 19:35:54.363829 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-479be7fd-895c-4efc-ab0b-5ccb8660217e req-313db183-f827-4ec7-b25b-a8465257b2f7 tempest-ServerRescueNegativeTestJSON-1447477341 tempest-ServerRescueNegativeTestJSON-1447477341-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102992) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:35:54.365248 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-479be7fd-895c-4efc-ab0b-5ccb8660217e req-313db183-f827-4ec7-b25b-a8465257b2f7 tempest-ServerRescueNegativeTestJSON-1447477341 tempest-ServerRescueNegativeTestJSON-1447477341-project] 10.222.0.62 "GET /v2.0/ports?device_id=671f1d44-7752-4a9d-835d-4d76164c900f HTTP/1.1" status: 200 len: 945 time: 0.0577617 Nov 23 19:35:54.414264 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-479be7fd-895c-4efc-ab0b-5ccb8660217e req-a4282757-e267-4ce0-986c-91b09ba965c4 tempest-ServerRescueNegativeTestJSON-1447477341 tempest-ServerRescueNegativeTestJSON-1447477341-project] 10.222.0.62 "GET /v2.0/security-groups?id=62a09434-acf0-424f-9001-2c3a78119364&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0430231 Nov 23 19:35:54.647420 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f56a99be-6b56-4b3f-b13b-1aff6c47be0b req-de0927ea-6130-4eb9-8891-e4dd50bc5458 tempest-VolumesActionsTest-802949502 tempest-VolumesActionsTest-802949502-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102993) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:35:54.648927 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-f56a99be-6b56-4b3f-b13b-1aff6c47be0b req-de0927ea-6130-4eb9-8891-e4dd50bc5458 tempest-VolumesActionsTest-802949502 tempest-VolumesActionsTest-802949502-project] 10.222.0.62 "GET /v2.0/ports?device_id=3b98df1d-4a12-4596-868b-56328fa3c3aa HTTP/1.1" status: 200 len: 944 time: 0.0727088 Nov 23 19:35:54.722620 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-f56a99be-6b56-4b3f-b13b-1aff6c47be0b req-b18451f6-a38e-490d-aa0a-b196205b56fb tempest-VolumesActionsTest-802949502 tempest-VolumesActionsTest-802949502-project] 10.222.0.62 "GET /v2.0/security-groups?id=47acb13d-cf9a-4dd6-a614-503b94072f69&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0645125 Nov 23 19:35:55.112029 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.plugins.ml2.db [None req-4bf48ff4-ecfb-4168-8b63-249b8c6e9f04 None None] get_ports_and_sgs() called for port_ids ['9292b123-ce92-44b7-a488-3615ff195075'] {{(pid=102994) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 23 19:35:55.306844 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0efc6966-5256-4fac-a887-9ccfa52dddd5 req-9b9f39db-d499-45c6-8615-5a8b465c6d47 tempest-AttachVolumeShelveTestJSON-1172915835 tempest-AttachVolumeShelveTestJSON-1172915835-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102992) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:35:55.317123 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-0efc6966-5256-4fac-a887-9ccfa52dddd5 req-9b9f39db-d499-45c6-8615-5a8b465c6d47 tempest-AttachVolumeShelveTestJSON-1172915835 tempest-AttachVolumeShelveTestJSON-1172915835-project] 10.222.0.62 "GET /v2.0/ports?device_id=85ea3d72-6c17-4ea2-82b7-90cce01633bd HTTP/1.1" status: 200 len: 945 time: 0.1081536 Nov 23 19:35:55.368919 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-0efc6966-5256-4fac-a887-9ccfa52dddd5 req-4c8e47dc-08f2-48d8-98e0-309540762bb2 tempest-AttachVolumeShelveTestJSON-1172915835 tempest-AttachVolumeShelveTestJSON-1172915835-project] 10.222.0.62 "GET /v2.0/security-groups?id=f1ca24d9-0a31-470d-a1d5-fa7059df0141&fields=id&fields=name HTTP/1.1" status: 200 len: 311 time: 0.0507460 Nov 23 19:35:55.561786 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2113f913-3e57-4d18-963c-984b9599fecf req-b84f806e-bcd0-4faa-85dc-01810883da07 tempest-ServerRescueNegativeTestJSON-1447477341 tempest-ServerRescueNegativeTestJSON-1447477341-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102993) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:35:55.563390 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-2113f913-3e57-4d18-963c-984b9599fecf req-b84f806e-bcd0-4faa-85dc-01810883da07 tempest-ServerRescueNegativeTestJSON-1447477341 tempest-ServerRescueNegativeTestJSON-1447477341-project] 10.222.0.62 "GET /v2.0/ports?device_id=671f1d44-7752-4a9d-835d-4d76164c900f HTTP/1.1" status: 200 len: 945 time: 0.0552042 Nov 23 19:35:55.620791 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-2113f913-3e57-4d18-963c-984b9599fecf req-0d1b1c91-193b-4594-878c-d9e1d5e7a184 tempest-ServerRescueNegativeTestJSON-1447477341 tempest-ServerRescueNegativeTestJSON-1447477341-project] 10.222.0.62 "GET /v2.0/security-groups?id=62a09434-acf0-424f-9001-2c3a78119364&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0500486 Nov 23 19:35:55.883703 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b7d79991-fd44-4e8d-beef-211a6cefba48 req-6724e677-edee-4d7a-b624-42f98cdbfc36 tempest-VolumesActionsTest-802949502 tempest-VolumesActionsTest-802949502-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102992) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:35:55.885799 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-b7d79991-fd44-4e8d-beef-211a6cefba48 req-6724e677-edee-4d7a-b624-42f98cdbfc36 tempest-VolumesActionsTest-802949502 tempest-VolumesActionsTest-802949502-project] 10.222.0.62 "GET /v2.0/ports?device_id=3b98df1d-4a12-4596-868b-56328fa3c3aa HTTP/1.1" status: 200 len: 944 time: 0.0778115 Nov 23 19:35:55.958505 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-b7d79991-fd44-4e8d-beef-211a6cefba48 req-385f806d-b6bf-43e5-9f8f-adae01211bbc tempest-VolumesActionsTest-802949502 tempest-VolumesActionsTest-802949502-project] 10.222.0.62 "GET /v2.0/security-groups?id=47acb13d-cf9a-4dd6-a614-503b94072f69&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0665095 Nov 23 19:35:56.516926 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-afcc399d-d4b0-4eb6-b1af-875fb404fcb1 req-8b0b0802-62ef-41ea-b7a2-505da17e9256 tempest-AttachVolumeShelveTestJSON-1172915835 tempest-AttachVolumeShelveTestJSON-1172915835-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102993) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:35:56.519516 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-afcc399d-d4b0-4eb6-b1af-875fb404fcb1 req-8b0b0802-62ef-41ea-b7a2-505da17e9256 tempest-AttachVolumeShelveTestJSON-1172915835 tempest-AttachVolumeShelveTestJSON-1172915835-project] 10.222.0.62 "GET /v2.0/ports?device_id=85ea3d72-6c17-4ea2-82b7-90cce01633bd HTTP/1.1" status: 200 len: 945 time: 0.0606134 Nov 23 19:35:56.599035 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-afcc399d-d4b0-4eb6-b1af-875fb404fcb1 req-f2373339-a306-457d-b93e-fd1287738a8b tempest-AttachVolumeShelveTestJSON-1172915835 tempest-AttachVolumeShelveTestJSON-1172915835-project] 10.222.0.62 "GET /v2.0/security-groups?id=f1ca24d9-0a31-470d-a1d5-fa7059df0141&fields=id&fields=name HTTP/1.1" status: 200 len: 311 time: 0.0680785 Nov 23 19:35:56.757888 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-82d52567-6e08-496d-bcfc-9072a540d534 req-b2e7d0ec-267b-4a6b-9584-d625226746f5 tempest-ServerRescueNegativeTestJSON-1447477341 tempest-ServerRescueNegativeTestJSON-1447477341-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102992) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:35:56.766342 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-82d52567-6e08-496d-bcfc-9072a540d534 req-b2e7d0ec-267b-4a6b-9584-d625226746f5 tempest-ServerRescueNegativeTestJSON-1447477341 tempest-ServerRescueNegativeTestJSON-1447477341-project] 10.222.0.62 "GET /v2.0/ports?device_id=671f1d44-7752-4a9d-835d-4d76164c900f HTTP/1.1" status: 200 len: 945 time: 0.0661483 Nov 23 19:35:56.827341 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-82d52567-6e08-496d-bcfc-9072a540d534 req-3507601a-88d2-481c-bc5a-f15f07f3abbb tempest-ServerRescueNegativeTestJSON-1447477341 tempest-ServerRescueNegativeTestJSON-1447477341-project] 10.222.0.62 "GET /v2.0/security-groups?id=62a09434-acf0-424f-9001-2c3a78119364&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0601199 Nov 23 19:35:57.089207 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-aa37789a-6af4-4ab5-9e56-484252d8e996 req-542c410b-eb93-49c4-a48c-896294c1f673 tempest-VolumesActionsTest-802949502 tempest-VolumesActionsTest-802949502-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102993) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:35:57.090772 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-aa37789a-6af4-4ab5-9e56-484252d8e996 req-542c410b-eb93-49c4-a48c-896294c1f673 tempest-VolumesActionsTest-802949502 tempest-VolumesActionsTest-802949502-project] 10.222.0.62 "GET /v2.0/ports?device_id=3b98df1d-4a12-4596-868b-56328fa3c3aa HTTP/1.1" status: 200 len: 944 time: 0.0535827 Nov 23 19:35:57.140192 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-aa37789a-6af4-4ab5-9e56-484252d8e996 req-53006c8d-1dfe-4bf8-93be-53d8a2226c1a tempest-VolumesActionsTest-802949502 tempest-VolumesActionsTest-802949502-project] 10.222.0.62 "GET /v2.0/security-groups?id=47acb13d-cf9a-4dd6-a614-503b94072f69&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0433853 Nov 23 19:35:57.222148 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.plugins.ml2.rpc [None req-4bf48ff4-ecfb-4168-8b63-249b8c6e9f04 None None] Device 9292b123-ce92-44b7-a488-3615ff195075 up at agent hyperv_hv-cinder-81901 {{(pid=102994) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 23 19:35:57.394911 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.db.provisioning_blocks [None req-4bf48ff4-ecfb-4168-8b63-249b8c6e9f04 None None] Provisioning for port 9292b123-ce92-44b7-a488-3615ff195075 completed by entity L2. {{(pid=102994) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 23 19:35:57.401158 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.db.provisioning_blocks [None req-4bf48ff4-ecfb-4168-8b63-249b8c6e9f04 None None] Provisioning complete for port 9292b123-ce92-44b7-a488-3615ff195075 triggered by entity L2. {{(pid=102994) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 23 19:35:57.401158 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron_lib.callbacks.manager [None req-4bf48ff4-ecfb-4168-8b63-249b8c6e9f04 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-8355713'] for port, provisioning_complete {{(pid=102994) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:35:57.495873 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron_lib.callbacks.manager [None req-4bf48ff4-ecfb-4168-8b63-249b8c6e9f04 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7921281'] for port, before_update {{(pid=102994) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:35:57.519594 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '3b98df1d-4a12-4596-868b-56328fa3c3aa', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '9292b123-ce92-44b7-a488-3615ff195075'}] {{(pid=102994) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 23 19:35:57.521972 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.62/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}09a7511da0d2ba1d728b27e36a8467ec5289399952f0059588048a7cb66d3a43" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-772806b7-2985-4401-9168-eceb3c905d30" -d '{"events": [{"server_uuid": "3b98df1d-4a12-4596-868b-56328fa3c3aa", "name": "network-vif-plugged", "status": "completed", "tag": "9292b123-ce92-44b7-a488-3615ff195075"}]}' {{(pid=102994) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 23 19:35:57.568404 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.plugins.ml2.db [None req-4bf48ff4-ecfb-4168-8b63-249b8c6e9f04 None None] For port 9292b123-ce92-44b7-a488-3615ff195075, host hv-cinder-81901, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81901',level=0,port_id=9292b123-ce92-44b7-a488-3615ff195075,segment=NetworkSegment(2ab14203-895d-412f-8616-df9c89e896c9),segment_id=2ab14203-895d-412f-8616-df9c89e896c9)] {{(pid=102994) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 23 19:35:57.568404 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 23 Nov 2021 19:35:57 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-75df6523-39bd-4324-9a75-84ec352c8fc2 x-openstack-request-id: req-75df6523-39bd-4324-9a75-84ec352c8fc2 {{(pid=102994) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 23 19:35:57.568404 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "3b98df1d-4a12-4596-868b-56328fa3c3aa", "name": "network-vif-plugged", "status": "completed", "tag": "9292b123-ce92-44b7-a488-3615ff195075", "code": 200}]} {{(pid=102994) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 23 19:35:57.568404 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.62/compute/v2.1/os-server-external-events used request id req-75df6523-39bd-4324-9a75-84ec352c8fc2 {{(pid=102994) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 23 19:35:57.568404 dv-cinder-819011-1-iscsi neutron-server[102994]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '3b98df1d-4a12-4596-868b-56328fa3c3aa', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '9292b123-ce92-44b7-a488-3615ff195075', 'code': 200} Nov 23 19:35:57.718735 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0f66dca3-eda4-42ff-ac69-186639da0232 req-0a410664-e39b-45d7-97c4-4b033f0de7a6 tempest-AttachVolumeShelveTestJSON-1172915835 tempest-AttachVolumeShelveTestJSON-1172915835-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102993) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:35:57.720243 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-0f66dca3-eda4-42ff-ac69-186639da0232 req-0a410664-e39b-45d7-97c4-4b033f0de7a6 tempest-AttachVolumeShelveTestJSON-1172915835 tempest-AttachVolumeShelveTestJSON-1172915835-project] 10.222.0.62 "GET /v2.0/ports?device_id=85ea3d72-6c17-4ea2-82b7-90cce01633bd HTTP/1.1" status: 200 len: 945 time: 0.0551503 Nov 23 19:35:57.780681 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-0f66dca3-eda4-42ff-ac69-186639da0232 req-d6ed3a54-ae3d-458f-b15a-7686cb6feff6 tempest-AttachVolumeShelveTestJSON-1172915835 tempest-AttachVolumeShelveTestJSON-1172915835-project] 10.222.0.62 "GET /v2.0/security-groups?id=f1ca24d9-0a31-470d-a1d5-fa7059df0141&fields=id&fields=name HTTP/1.1" status: 200 len: 311 time: 0.0535259 Nov 23 19:35:57.959376 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bcbdaa77-ce2f-4b32-9f11-d89f465c5ba5 req-9c36c444-9a39-4cfd-b40b-cc382fee7c7a tempest-ServerRescueNegativeTestJSON-1447477341 tempest-ServerRescueNegativeTestJSON-1447477341-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102992) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:35:57.960876 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-bcbdaa77-ce2f-4b32-9f11-d89f465c5ba5 req-9c36c444-9a39-4cfd-b40b-cc382fee7c7a tempest-ServerRescueNegativeTestJSON-1447477341 tempest-ServerRescueNegativeTestJSON-1447477341-project] 10.222.0.62 "GET /v2.0/ports?device_id=671f1d44-7752-4a9d-835d-4d76164c900f HTTP/1.1" status: 200 len: 945 time: 0.0570371 Nov 23 19:35:58.012770 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron_lib.callbacks.manager [None req-4bf48ff4-ecfb-4168-8b63-249b8c6e9f04 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7918660', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-15067', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560168', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8783631423946', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8783631008732', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8783631008750'] for port, after_update {{(pid=102994) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:35:58.016206 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-bcbdaa77-ce2f-4b32-9f11-d89f465c5ba5 req-152ee2b2-d68a-4e1c-a17e-b3c3f1029caf tempest-ServerRescueNegativeTestJSON-1447477341 tempest-ServerRescueNegativeTestJSON-1447477341-project] 10.222.0.62 "GET /v2.0/security-groups?id=62a09434-acf0-424f-9001-2c3a78119364&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0448346 Nov 23 19:35:58.061038 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4bf48ff4-ecfb-4168-8b63-249b8c6e9f04 None None] Pushing event updated for resources: {'Port': ['ID=9292b123-ce92-44b7-a488-3615ff195075,revision_number=5']} {{(pid=102994) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 23 19:35:58.257192 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0bea436a-f4c6-47bd-aed2-45664b60a565 req-278cc657-0836-4a5b-b7b4-abb40c1f21f5 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102992) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:35:58.259216 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-0bea436a-f4c6-47bd-aed2-45664b60a565 req-278cc657-0836-4a5b-b7b4-abb40c1f21f5 service neutron] 10.222.0.41 "GET /v2.0/ports?device_id=3b98df1d-4a12-4596-868b-56328fa3c3aa HTTP/1.1" status: 200 len: 1098 time: 0.0506239 Nov 23 19:35:58.321429 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d1282026-a746-41fb-bf46-807b4cfdd06e req-ac4b2676-1136-4177-ba0c-8be9177a9f7f tempest-VolumesActionsTest-802949502 tempest-VolumesActionsTest-802949502-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102993) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:35:58.323345 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-d1282026-a746-41fb-bf46-807b4cfdd06e req-ac4b2676-1136-4177-ba0c-8be9177a9f7f tempest-VolumesActionsTest-802949502 tempest-VolumesActionsTest-802949502-project] 10.222.0.62 "GET /v2.0/ports?device_id=3b98df1d-4a12-4596-868b-56328fa3c3aa HTTP/1.1" status: 200 len: 945 time: 0.0852005 Nov 23 19:35:58.338110 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-0bea436a-f4c6-47bd-aed2-45664b60a565 req-9124b0e4-ae1e-4b61-bbd6-1d96c098062c service neutron] 10.222.0.41 "GET /v2.0/security-groups?id=47acb13d-cf9a-4dd6-a614-503b94072f69&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0681040 Nov 23 19:35:58.387375 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-d1282026-a746-41fb-bf46-807b4cfdd06e req-eec6655f-6f76-46e7-a79f-b9a2289e28ee tempest-VolumesActionsTest-802949502 tempest-VolumesActionsTest-802949502-project] 10.222.0.62 "GET /v2.0/security-groups?id=47acb13d-cf9a-4dd6-a614-503b94072f69&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0563607 Nov 23 19:35:58.918232 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bb255ea9-3a9c-4894-a9cd-09b58dd81354 req-4275f63f-cbc5-4751-9a96-389b02975aaa tempest-AttachVolumeShelveTestJSON-1172915835 tempest-AttachVolumeShelveTestJSON-1172915835-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102992) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:35:58.919769 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-bb255ea9-3a9c-4894-a9cd-09b58dd81354 req-4275f63f-cbc5-4751-9a96-389b02975aaa tempest-AttachVolumeShelveTestJSON-1172915835 tempest-AttachVolumeShelveTestJSON-1172915835-project] 10.222.0.62 "GET /v2.0/ports?device_id=85ea3d72-6c17-4ea2-82b7-90cce01633bd HTTP/1.1" status: 200 len: 945 time: 0.0659447 Nov 23 19:35:58.970059 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-bb255ea9-3a9c-4894-a9cd-09b58dd81354 req-a92a237b-62c6-4e19-8b64-b9cb0aaace0e tempest-AttachVolumeShelveTestJSON-1172915835 tempest-AttachVolumeShelveTestJSON-1172915835-project] 10.222.0.62 "GET /v2.0/security-groups?id=f1ca24d9-0a31-470d-a1d5-fa7059df0141&fields=id&fields=name HTTP/1.1" status: 200 len: 311 time: 0.0443053 Nov 23 19:35:59.110016 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron_lib.callbacks.manager [None req-4bf48ff4-ecfb-4168-8b63-249b8c6e9f04 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8783631323329', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7978582'] for agent, after_update {{(pid=102994) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:35:59.138006 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5dedc915-a257-46f2-a852-64710b2dbc77 req-156125f4-309f-4251-bd51-4b07e372b7bb tempest-ServerRescueNegativeTestJSON-1447477341 tempest-ServerRescueNegativeTestJSON-1447477341-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102993) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:35:59.139624 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-5dedc915-a257-46f2-a852-64710b2dbc77 req-156125f4-309f-4251-bd51-4b07e372b7bb tempest-ServerRescueNegativeTestJSON-1447477341 tempest-ServerRescueNegativeTestJSON-1447477341-project] 10.222.0.62 "GET /v2.0/ports?device_id=671f1d44-7752-4a9d-835d-4d76164c900f HTTP/1.1" status: 200 len: 945 time: 0.0522902 Nov 23 19:35:59.188854 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-5dedc915-a257-46f2-a852-64710b2dbc77 req-d8c0240e-e588-4c88-8ddf-a15580bfc99b tempest-ServerRescueNegativeTestJSON-1447477341 tempest-ServerRescueNegativeTestJSON-1447477341-project] 10.222.0.62 "GET /v2.0/security-groups?id=62a09434-acf0-424f-9001-2c3a78119364&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0428021 Nov 23 19:35:59.505569 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8c3045c7-a9c9-4f94-9e7b-a5df1438364a req-1af66f57-4eaf-41b9-89a2-38029534619f tempest-VolumesActionsTest-802949502 tempest-VolumesActionsTest-802949502-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102992) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:35:59.507163 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-8c3045c7-a9c9-4f94-9e7b-a5df1438364a req-1af66f57-4eaf-41b9-89a2-38029534619f tempest-VolumesActionsTest-802949502 tempest-VolumesActionsTest-802949502-project] 10.222.0.62 "GET /v2.0/ports?device_id=3b98df1d-4a12-4596-868b-56328fa3c3aa HTTP/1.1" status: 200 len: 945 time: 0.0486438 Nov 23 19:35:59.568301 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-8c3045c7-a9c9-4f94-9e7b-a5df1438364a req-c685b116-b982-44b1-a3bc-af6bdaeffbd7 tempest-VolumesActionsTest-802949502 tempest-VolumesActionsTest-802949502-project] 10.222.0.62 "GET /v2.0/security-groups?id=47acb13d-cf9a-4dd6-a614-503b94072f69&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0550609 Nov 23 19:35:59.947413 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f57a39e0-cced-4bda-a3c1-4591f2dc42f1 req-b92ece31-8669-450a-a19b-358ff13458de service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102992) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:35:59.949190 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-f57a39e0-cced-4bda-a3c1-4591f2dc42f1 req-b92ece31-8669-450a-a19b-358ff13458de service neutron] 10.222.0.41 "GET /v2.0/ports?tenant_id=2d925fb59ba34355aa85758374d76928&device_id=85ea3d72-6c17-4ea2-82b7-90cce01633bd HTTP/1.1" status: 200 len: 1098 time: 0.0466309 Nov 23 19:36:00.065110 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f57a39e0-cced-4bda-a3c1-4591f2dc42f1 req-ce9301ff-3e9a-4b9e-b912-a71cad73e969 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102992) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:36:00.067509 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-f57a39e0-cced-4bda-a3c1-4591f2dc42f1 req-ce9301ff-3e9a-4b9e-b912-a71cad73e969 service neutron] 10.222.0.41 "GET /v2.0/networks?id=fc901312-2937-4784-8a6d-c046666e8bf8 HTTP/1.1" status: 200 len: 918 time: 0.0901845 Nov 23 19:36:00.099073 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-16d4103a-469f-48f9-aa2b-84d2987ef98f req-56d6c8b0-3b4e-44d6-a959-b909a663e501 tempest-AttachVolumeShelveTestJSON-1172915835 tempest-AttachVolumeShelveTestJSON-1172915835-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102993) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:36:00.100543 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-16d4103a-469f-48f9-aa2b-84d2987ef98f req-56d6c8b0-3b4e-44d6-a959-b909a663e501 tempest-AttachVolumeShelveTestJSON-1172915835 tempest-AttachVolumeShelveTestJSON-1172915835-project] 10.222.0.62 "GET /v2.0/ports?device_id=85ea3d72-6c17-4ea2-82b7-90cce01633bd HTTP/1.1" status: 200 len: 945 time: 0.0536487 Nov 23 19:36:00.151019 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-16d4103a-469f-48f9-aa2b-84d2987ef98f req-2970d1a5-e073-4972-a913-71e0a5fb772d tempest-AttachVolumeShelveTestJSON-1172915835 tempest-AttachVolumeShelveTestJSON-1172915835-project] 10.222.0.62 "GET /v2.0/security-groups?id=f1ca24d9-0a31-470d-a1d5-fa7059df0141&fields=id&fields=name HTTP/1.1" status: 200 len: 311 time: 0.0441601 Nov 23 19:36:00.179071 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-f57a39e0-cced-4bda-a3c1-4591f2dc42f1 req-8cd06b45-b1c8-4173-8547-e80a4005c4b6 service neutron] 10.222.0.41 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.7&port_id=4b380ab6-f3ec-4e12-9a2a-b5a20828969d HTTP/1.1" status: 200 len: 1001 time: 0.1015022 Nov 23 19:36:00.231238 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f57a39e0-cced-4bda-a3c1-4591f2dc42f1 req-7f8077c9-18d7-4dcb-a85e-1d2fdfb7be9c service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102992) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:36:00.232694 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-f57a39e0-cced-4bda-a3c1-4591f2dc42f1 req-7f8077c9-18d7-4dcb-a85e-1d2fdfb7be9c service neutron] 10.222.0.41 "GET /v2.0/subnets?id=2caca985-6ed6-4ef7-ba49-7b7410bea160 HTTP/1.1" status: 200 len: 856 time: 0.0438771 Nov 23 19:36:00.330097 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-be6f8fc1-5b29-4c9f-8d35-7c34e026df39 req-dbe54430-7c01-4769-b7e4-34ce5e4fef88 tempest-ServerRescueNegativeTestJSON-1447477341 tempest-ServerRescueNegativeTestJSON-1447477341-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102992) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:36:00.331491 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-be6f8fc1-5b29-4c9f-8d35-7c34e026df39 req-dbe54430-7c01-4769-b7e4-34ce5e4fef88 tempest-ServerRescueNegativeTestJSON-1447477341 tempest-ServerRescueNegativeTestJSON-1447477341-project] 10.222.0.62 "GET /v2.0/ports?device_id=671f1d44-7752-4a9d-835d-4d76164c900f HTTP/1.1" status: 200 len: 945 time: 0.0702939 Nov 23 19:36:00.334821 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f57a39e0-cced-4bda-a3c1-4591f2dc42f1 req-02793399-1e52-45b7-9a74-cce9556db5b5 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102992) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:36:00.336195 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-f57a39e0-cced-4bda-a3c1-4591f2dc42f1 req-02793399-1e52-45b7-9a74-cce9556db5b5 service neutron] 10.222.0.41 "GET /v2.0/ports?network_id=fc901312-2937-4784-8a6d-c046666e8bf8&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0835159 Nov 23 19:36:00.374014 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.wsgi [-] (102992) accepted ('10.222.0.62', 45992) {{(pid=102992) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 23 19:36:00.411875 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-be6f8fc1-5b29-4c9f-8d35-7c34e026df39 req-39557ab5-8576-4fb1-9261-89a8a31addb5 tempest-ServerRescueNegativeTestJSON-1447477341 tempest-ServerRescueNegativeTestJSON-1447477341-project] 10.222.0.62 "GET /v2.0/security-groups?id=62a09434-acf0-424f-9001-2c3a78119364&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0727749 Nov 23 19:36:00.470526 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-f57a39e0-cced-4bda-a3c1-4591f2dc42f1 req-58db4b6c-998a-4f8d-b058-6abacd702d17 service neutron] 10.222.0.41 "GET /v2.0/networks/fc901312-2937-4784-8a6d-c046666e8bf8?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1183598 Nov 23 19:36:00.554778 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [None req-787c9d84-cebf-4661-aae4-837f4319cfeb admin admin] Publish callbacks [] for security_group, before_create {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:36:00.593897 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-f57a39e0-cced-4bda-a3c1-4591f2dc42f1 req-94405810-736a-423a-ac56-004f0858fc5d service neutron] 10.222.0.41 "GET /v2.0/networks/fc901312-2937-4784-8a6d-c046666e8bf8?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1129997 Nov 23 19:36:00.650339 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [None req-787c9d84-cebf-4661-aae4-837f4319cfeb admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:36:00.696145 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-83ea3c77-e4e9-4cc3-94b4-7de98ccffe0b req-48cc1150-230e-4021-a79d-ddc796ecb6ca tempest-VolumesActionsTest-802949502 tempest-VolumesActionsTest-802949502-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102993) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:36:00.697853 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-83ea3c77-e4e9-4cc3-94b4-7de98ccffe0b req-48cc1150-230e-4021-a79d-ddc796ecb6ca tempest-VolumesActionsTest-802949502 tempest-VolumesActionsTest-802949502-project] 10.222.0.62 "GET /v2.0/ports?device_id=3b98df1d-4a12-4596-868b-56328fa3c3aa HTTP/1.1" status: 200 len: 945 time: 0.0511923 Nov 23 19:36:00.698395 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [None req-787c9d84-cebf-4661-aae4-837f4319cfeb admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-623933'] for security_group, after_create {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:36:00.741981 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [None req-787c9d84-cebf-4661-aae4-837f4319cfeb admin admin] 10.222.0.62 "GET /v2.0/security-groups?tenant_id=f548fe5f7dee419498ca7d7e9531af8b&name=default HTTP/1.1" status: 200 len: 2996 time: 0.3615074 Nov 23 19:36:00.743948 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-787c9d84-cebf-4661-aae4-837f4319cfeb admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=afe8daa1-7f91-46af-b5c0-ac15b0ee499c,revision_number=1']} {{(pid=102992) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 23 19:36:00.744501 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.wsgi [-] (102993) accepted ('10.222.0.62', 46000) {{(pid=102993) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 23 19:36:00.754179 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-83ea3c77-e4e9-4cc3-94b4-7de98ccffe0b req-e2355e05-403a-4721-8e55-750c53da79dd tempest-VolumesActionsTest-802949502 tempest-VolumesActionsTest-802949502-project] 10.222.0.62 "GET /v2.0/security-groups?id=47acb13d-cf9a-4dd6-a614-503b94072f69&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0499895 Nov 23 19:36:00.797121 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-d5c9f130-3ba9-4ba9-bfc8-b1a4334d8439 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:36:00.820785 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-d5c9f130-3ba9-4ba9-bfc8-b1a4334d8439 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:36:00.961189 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-d5c9f130-3ba9-4ba9-bfc8-b1a4334d8439 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-623933'] for security_group, after_delete {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:36:00.964021 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-d5c9f130-3ba9-4ba9-bfc8-b1a4334d8439 admin admin] Publish callbacks [] for security_group, before_response {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:36:00.965250 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [None req-d5c9f130-3ba9-4ba9-bfc8-b1a4334d8439 admin admin] 10.222.0.62 "DELETE /v2.0/security-groups/afe8daa1-7f91-46af-b5c0-ac15b0ee499c HTTP/1.1" status: 204 len: 168 time: 0.2194676 Nov 23 19:36:00.973337 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d5c9f130-3ba9-4ba9-bfc8-b1a4334d8439 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=afe8daa1-7f91-46af-b5c0-ac15b0ee499c,revision_number=None']} {{(pid=102993) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 23 19:36:01.288656 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a91b1c39-fce1-4b07-8f80-a0dce559b9e4 req-91d1b828-6831-4d61-be2a-e20d4ac09193 tempest-AttachVolumeShelveTestJSON-1172915835 tempest-AttachVolumeShelveTestJSON-1172915835-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102992) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:36:01.288656 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-a91b1c39-fce1-4b07-8f80-a0dce559b9e4 req-91d1b828-6831-4d61-be2a-e20d4ac09193 tempest-AttachVolumeShelveTestJSON-1172915835 tempest-AttachVolumeShelveTestJSON-1172915835-project] 10.222.0.62 "GET /v2.0/ports?device_id=85ea3d72-6c17-4ea2-82b7-90cce01633bd HTTP/1.1" status: 200 len: 945 time: 0.0580034 Nov 23 19:36:01.339925 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-a91b1c39-fce1-4b07-8f80-a0dce559b9e4 req-0992760d-40af-4995-a177-6fa894e0fcb2 tempest-AttachVolumeShelveTestJSON-1172915835 tempest-AttachVolumeShelveTestJSON-1172915835-project] 10.222.0.62 "GET /v2.0/security-groups?id=f1ca24d9-0a31-470d-a1d5-fa7059df0141&fields=id&fields=name HTTP/1.1" status: 200 len: 311 time: 0.0457160 Nov 23 19:36:01.529633 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4629bebd-1343-42e6-8df5-ac089d6aeb1a req-9d2cac0f-3d05-44b3-94c4-a19ac2751091 tempest-ServerRescueNegativeTestJSON-1447477341 tempest-ServerRescueNegativeTestJSON-1447477341-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102993) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:36:01.531188 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-4629bebd-1343-42e6-8df5-ac089d6aeb1a req-9d2cac0f-3d05-44b3-94c4-a19ac2751091 tempest-ServerRescueNegativeTestJSON-1447477341 tempest-ServerRescueNegativeTestJSON-1447477341-project] 10.222.0.62 "GET /v2.0/ports?device_id=671f1d44-7752-4a9d-835d-4d76164c900f HTTP/1.1" status: 200 len: 945 time: 0.0492127 Nov 23 19:36:01.581882 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-4629bebd-1343-42e6-8df5-ac089d6aeb1a req-144e562d-2a7d-48e7-ac39-d3d2f06ae031 tempest-ServerRescueNegativeTestJSON-1447477341 tempest-ServerRescueNegativeTestJSON-1447477341-project] 10.222.0.62 "GET /v2.0/security-groups?id=62a09434-acf0-424f-9001-2c3a78119364&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0424230 Nov 23 19:36:01.594512 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.wsgi [-] (102993) accepted ('10.222.0.62', 46020) {{(pid=102993) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 23 19:36:01.616782 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-7d7795db-d43c-41ba-94c3-fd457d9b30b3 admin admin] Publish callbacks [] for security_group, before_create {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:36:01.702837 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-7d7795db-d43c-41ba-94c3-fd457d9b30b3 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:36:01.749764 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-7d7795db-d43c-41ba-94c3-fd457d9b30b3 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-623933'] for security_group, after_create {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:36:01.762406 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-126ffaaa-91cf-41eb-9e57-28c3ce5d7f2e req-e4674fb3-4d1a-45cb-ad74-262e9e3be2d8 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102992) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:36:01.769468 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-126ffaaa-91cf-41eb-9e57-28c3ce5d7f2e req-e4674fb3-4d1a-45cb-ad74-262e9e3be2d8 service neutron] 10.222.0.41 "GET /v2.0/ports?device_id=671f1d44-7752-4a9d-835d-4d76164c900f HTTP/1.1" status: 200 len: 1098 time: 0.0478034 Nov 23 19:36:01.792692 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [None req-7d7795db-d43c-41ba-94c3-fd457d9b30b3 admin admin] 10.222.0.62 "GET /v2.0/security-groups?tenant_id=6e9a24d7eeed4e93b4e6b3f1eef8fa8c&name=default HTTP/1.1" status: 200 len: 2996 time: 0.1967411 Nov 23 19:36:01.795103 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.wsgi [-] (102992) accepted ('10.222.0.62', 46028) {{(pid=102992) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 23 19:36:01.803944 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7d7795db-d43c-41ba-94c3-fd457d9b30b3 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=f3074a99-0675-4443-9aa1-e0fb15c815b2,revision_number=1']} {{(pid=102993) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 23 19:36:01.875212 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-126ffaaa-91cf-41eb-9e57-28c3ce5d7f2e req-8b0b54b7-5fb7-4938-bdfd-929dd46c5dea service neutron] 10.222.0.41 "GET /v2.0/security-groups?id=62a09434-acf0-424f-9001-2c3a78119364&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0897670 Nov 23 19:36:01.889694 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [None req-e5b76188-8a74-4e77-8ede-e76ab29e33ff admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:36:01.911851 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [None req-e5b76188-8a74-4e77-8ede-e76ab29e33ff admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:36:01.990770 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [None req-e5b76188-8a74-4e77-8ede-e76ab29e33ff admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-623933'] for security_group, after_delete {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:36:01.993476 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [None req-e5b76188-8a74-4e77-8ede-e76ab29e33ff admin admin] Publish callbacks [] for security_group, before_response {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:36:01.997880 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [None req-e5b76188-8a74-4e77-8ede-e76ab29e33ff admin admin] 10.222.0.62 "DELETE /v2.0/security-groups/f3074a99-0675-4443-9aa1-e0fb15c815b2 HTTP/1.1" status: 204 len: 168 time: 0.1984851 Nov 23 19:36:02.002838 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e5b76188-8a74-4e77-8ede-e76ab29e33ff admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=f3074a99-0675-4443-9aa1-e0fb15c815b2,revision_number=None']} {{(pid=102992) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 23 19:36:02.133330 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-716ca1cd-c522-41af-86b3-6401c89f9017 req-ed53e88c-135c-46ee-9085-71620da886cb tempest-VolumesActionsTest-802949502 tempest-VolumesActionsTest-802949502-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102993) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:36:02.134868 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-716ca1cd-c522-41af-86b3-6401c89f9017 req-ed53e88c-135c-46ee-9085-71620da886cb tempest-VolumesActionsTest-802949502 tempest-VolumesActionsTest-802949502-project] 10.222.0.62 "GET /v2.0/ports?device_id=3b98df1d-4a12-4596-868b-56328fa3c3aa HTTP/1.1" status: 200 len: 945 time: 0.0546129 Nov 23 19:36:02.184533 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-716ca1cd-c522-41af-86b3-6401c89f9017 req-c3e49a85-c701-4b57-bd59-fbdca97ddb97 tempest-VolumesActionsTest-802949502 tempest-VolumesActionsTest-802949502-project] 10.222.0.62 "GET /v2.0/security-groups?id=47acb13d-cf9a-4dd6-a614-503b94072f69&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0436821 Nov 23 19:36:02.467100 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-65345aca-da48-4b92-9261-439f488a497b req-24606482-195e-4392-ad18-d4168b1a08d5 tempest-AttachVolumeShelveTestJSON-1172915835 tempest-AttachVolumeShelveTestJSON-1172915835-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102992) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:36:02.468739 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-65345aca-da48-4b92-9261-439f488a497b req-24606482-195e-4392-ad18-d4168b1a08d5 tempest-AttachVolumeShelveTestJSON-1172915835 tempest-AttachVolumeShelveTestJSON-1172915835-project] 10.222.0.62 "GET /v2.0/ports?device_id=85ea3d72-6c17-4ea2-82b7-90cce01633bd HTTP/1.1" status: 200 len: 945 time: 0.0504813 Nov 23 19:36:02.515317 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-65345aca-da48-4b92-9261-439f488a497b req-6d6f52dc-6c9d-4e95-a70f-5d47362eda33 tempest-AttachVolumeShelveTestJSON-1172915835 tempest-AttachVolumeShelveTestJSON-1172915835-project] 10.222.0.62 "GET /v2.0/security-groups?id=f1ca24d9-0a31-470d-a1d5-fa7059df0141&fields=id&fields=name HTTP/1.1" status: 200 len: 311 time: 0.0402100 Nov 23 19:36:02.717614 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-16725da7-b0e7-4443-8b3d-86a49499ace8 req-cfb1c150-75db-4466-baf4-41f4f86fb024 tempest-ServerRescueNegativeTestJSON-1447477341 tempest-ServerRescueNegativeTestJSON-1447477341-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102993) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:36:02.719119 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-16725da7-b0e7-4443-8b3d-86a49499ace8 req-cfb1c150-75db-4466-baf4-41f4f86fb024 tempest-ServerRescueNegativeTestJSON-1447477341 tempest-ServerRescueNegativeTestJSON-1447477341-project] 10.222.0.62 "GET /v2.0/ports?device_id=671f1d44-7752-4a9d-835d-4d76164c900f HTTP/1.1" status: 200 len: 945 time: 0.0632575 Nov 23 19:36:02.770830 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-16725da7-b0e7-4443-8b3d-86a49499ace8 req-a923ab65-52c9-4795-b2d0-71aeead6c80a tempest-ServerRescueNegativeTestJSON-1447477341 tempest-ServerRescueNegativeTestJSON-1447477341-project] 10.222.0.62 "GET /v2.0/security-groups?id=62a09434-acf0-424f-9001-2c3a78119364&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0448220 Nov 23 19:36:03.311514 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.plugins.ml2.rpc [None req-4bf48ff4-ecfb-4168-8b63-249b8c6e9f04 None None] Device 4b380ab6-f3ec-4e12-9a2a-b5a20828969d no longer exists at agent hyperv_hv-cinder-81901 {{(pid=102994) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 23 19:36:03.312166 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-097876b1-5e26-45ba-85dd-15f73b28646b req-55779b43-c871-4a2a-b70d-1be95fb034a8 tempest-VolumesActionsTest-802949502 tempest-VolumesActionsTest-802949502-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102992) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:36:03.319260 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-097876b1-5e26-45ba-85dd-15f73b28646b req-55779b43-c871-4a2a-b70d-1be95fb034a8 tempest-VolumesActionsTest-802949502 tempest-VolumesActionsTest-802949502-project] 10.222.0.62 "GET /v2.0/ports?device_id=3b98df1d-4a12-4596-868b-56328fa3c3aa HTTP/1.1" status: 200 len: 945 time: 0.0575035 Nov 23 19:36:03.372943 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-097876b1-5e26-45ba-85dd-15f73b28646b req-4e8a717d-0279-4cd5-8029-593532e6ebfe tempest-VolumesActionsTest-802949502 tempest-VolumesActionsTest-802949502-project] 10.222.0.62 "GET /v2.0/security-groups?id=47acb13d-cf9a-4dd6-a614-503b94072f69&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0525987 Nov 23 19:36:03.397706 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron_lib.callbacks.manager [None req-4bf48ff4-ecfb-4168-8b63-249b8c6e9f04 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7921281'] for port, before_update {{(pid=102994) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:36:03.430499 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '85ea3d72-6c17-4ea2-82b7-90cce01633bd', 'name': 'network-vif-unplugged', 'status': 'completed', 'tag': '4b380ab6-f3ec-4e12-9a2a-b5a20828969d'}] {{(pid=102994) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 23 19:36:03.433463 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.62/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}09a7511da0d2ba1d728b27e36a8467ec5289399952f0059588048a7cb66d3a43" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-91ccf4ed-689e-40fc-a7b9-b1c5b55ae9db" -d '{"events": [{"server_uuid": "85ea3d72-6c17-4ea2-82b7-90cce01633bd", "name": "network-vif-unplugged", "status": "completed", "tag": "4b380ab6-f3ec-4e12-9a2a-b5a20828969d"}]}' {{(pid=102994) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 23 19:36:03.451267 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.plugins.ml2.db [None req-4bf48ff4-ecfb-4168-8b63-249b8c6e9f04 None None] For port 4b380ab6-f3ec-4e12-9a2a-b5a20828969d, host hv-cinder-81901, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81901',level=0,port_id=4b380ab6-f3ec-4e12-9a2a-b5a20828969d,segment=NetworkSegment(b4453f21-ac7f-498c-8316-73b738820700),segment_id=b4453f21-ac7f-498c-8316-73b738820700)] {{(pid=102994) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 23 19:36:03.477709 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 185 Content-Type: application/json Date: Tue, 23 Nov 2021 19:36:03 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-c4294c9c-5f21-4db7-a8a8-7062538a92f8 x-openstack-request-id: req-c4294c9c-5f21-4db7-a8a8-7062538a92f8 {{(pid=102994) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 23 19:36:03.478115 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "85ea3d72-6c17-4ea2-82b7-90cce01633bd", "name": "network-vif-unplugged", "status": "completed", "tag": "4b380ab6-f3ec-4e12-9a2a-b5a20828969d", "code": 200}]} {{(pid=102994) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 23 19:36:03.478405 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.62/compute/v2.1/os-server-external-events used request id req-c4294c9c-5f21-4db7-a8a8-7062538a92f8 {{(pid=102994) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 23 19:36:03.478837 dv-cinder-819011-1-iscsi neutron-server[102994]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '85ea3d72-6c17-4ea2-82b7-90cce01633bd', 'name': 'network-vif-unplugged', 'status': 'completed', 'tag': '4b380ab6-f3ec-4e12-9a2a-b5a20828969d', 'code': 200} Nov 23 19:36:03.510908 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron_lib.callbacks.manager [None req-4bf48ff4-ecfb-4168-8b63-249b8c6e9f04 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7918660', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-15067', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560168', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8783631423946', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8783631008732', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8783631008750'] for port, after_update {{(pid=102994) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:36:03.566472 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4bf48ff4-ecfb-4168-8b63-249b8c6e9f04 None None] Pushing event updated for resources: {'Port': ['ID=4b380ab6-f3ec-4e12-9a2a-b5a20828969d,revision_number=8']} {{(pid=102994) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 23 19:36:03.663004 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6e45cb2c-0972-4113-b98a-d0692499fef0 req-ee6416bd-169c-4de7-8745-bf17e1ca80a7 tempest-AttachVolumeShelveTestJSON-1172915835 tempest-AttachVolumeShelveTestJSON-1172915835-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102992) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:36:03.665377 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-6e45cb2c-0972-4113-b98a-d0692499fef0 req-ee6416bd-169c-4de7-8745-bf17e1ca80a7 tempest-AttachVolumeShelveTestJSON-1172915835 tempest-AttachVolumeShelveTestJSON-1172915835-project] 10.222.0.62 "GET /v2.0/ports?device_id=85ea3d72-6c17-4ea2-82b7-90cce01633bd HTTP/1.1" status: 200 len: 943 time: 0.0575221 Nov 23 19:36:03.721264 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-6e45cb2c-0972-4113-b98a-d0692499fef0 req-3f02548e-78d2-4a08-ba4e-e9e6c7b9390e tempest-AttachVolumeShelveTestJSON-1172915835 tempest-AttachVolumeShelveTestJSON-1172915835-project] 10.222.0.62 "GET /v2.0/security-groups?id=f1ca24d9-0a31-470d-a1d5-fa7059df0141&fields=id&fields=name HTTP/1.1" status: 200 len: 311 time: 0.0489321 Nov 23 19:36:03.904536 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3dcc194e-0b7e-4cdf-bfb4-7caf701c0820 req-b52f7437-e2d3-4626-b10e-81d72d80f644 tempest-ServerRescueNegativeTestJSON-1447477341 tempest-ServerRescueNegativeTestJSON-1447477341-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102993) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:36:03.906134 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-3dcc194e-0b7e-4cdf-bfb4-7caf701c0820 req-b52f7437-e2d3-4626-b10e-81d72d80f644 tempest-ServerRescueNegativeTestJSON-1447477341 tempest-ServerRescueNegativeTestJSON-1447477341-project] 10.222.0.62 "GET /v2.0/ports?device_id=671f1d44-7752-4a9d-835d-4d76164c900f HTTP/1.1" status: 200 len: 945 time: 0.0511558 Nov 23 19:36:03.960748 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-3dcc194e-0b7e-4cdf-bfb4-7caf701c0820 req-db4ae076-c264-4707-aed5-b2f3929e2333 tempest-ServerRescueNegativeTestJSON-1447477341 tempest-ServerRescueNegativeTestJSON-1447477341-project] 10.222.0.62 "GET /v2.0/security-groups?id=62a09434-acf0-424f-9001-2c3a78119364&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0478110 Nov 23 19:36:04.519911 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-19d47709-ec97-4d9e-a7a2-f6833c15dd14 req-162e2739-ee3f-4687-84b4-64f5ec2d6542 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102992) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:36:04.522019 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-19d47709-ec97-4d9e-a7a2-f6833c15dd14 req-162e2739-ee3f-4687-84b4-64f5ec2d6542 service neutron] 10.222.0.41 "GET /v2.0/ports?tenant_id=c15ab51e579448cfb7a4b3e4f8049687&device_id=671f1d44-7752-4a9d-835d-4d76164c900f HTTP/1.1" status: 200 len: 1098 time: 0.0454874 Nov 23 19:36:04.532743 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8ef348ad-6696-44b8-a710-b4298280cd93 req-fd7ddd77-a708-4e70-8b44-5e57d97f483a tempest-VolumesActionsTest-802949502 tempest-VolumesActionsTest-802949502-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102993) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:36:04.534330 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-8ef348ad-6696-44b8-a710-b4298280cd93 req-fd7ddd77-a708-4e70-8b44-5e57d97f483a tempest-VolumesActionsTest-802949502 tempest-VolumesActionsTest-802949502-project] 10.222.0.62 "GET /v2.0/ports?device_id=3b98df1d-4a12-4596-868b-56328fa3c3aa HTTP/1.1" status: 200 len: 945 time: 0.0586009 Nov 23 19:36:04.590285 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-8ef348ad-6696-44b8-a710-b4298280cd93 req-637d62db-13bc-45f9-8dc6-fd7bd683d9c0 tempest-VolumesActionsTest-802949502 tempest-VolumesActionsTest-802949502-project] 10.222.0.62 "GET /v2.0/security-groups?id=47acb13d-cf9a-4dd6-a614-503b94072f69&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0494173 Nov 23 19:36:04.693319 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-45a46188-f7e6-4236-8032-8ccfd4992ba8 req-23aebea6-8ea2-4e82-8598-9bafc1d0e649 tempest-VolumesActionsTest-802949502 tempest-VolumesActionsTest-802949502-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102993) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:36:04.694904 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-45a46188-f7e6-4236-8032-8ccfd4992ba8 req-23aebea6-8ea2-4e82-8598-9bafc1d0e649 tempest-VolumesActionsTest-802949502 tempest-VolumesActionsTest-802949502-project] 10.222.0.41 "GET /v2.0/ports?device_id=3b98df1d-4a12-4596-868b-56328fa3c3aa HTTP/1.1" status: 200 len: 945 time: 0.0518105 Nov 23 19:36:04.833117 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.plugins.ml2.plugin [req-45a46188-f7e6-4236-8032-8ccfd4992ba8 req-61413ac2-c90b-4477-b3c9-59adf9827fb6 tempest-VolumesActionsTest-802949502 tempest-VolumesActionsTest-802949502-project] Deleting port 9292b123-ce92-44b7-a488-3615ff195075 {{(pid=102993) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 23 19:36:04.833494 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [req-45a46188-f7e6-4236-8032-8ccfd4992ba8 req-61413ac2-c90b-4477-b3c9-59adf9827fb6 tempest-VolumesActionsTest-802949502 tempest-VolumesActionsTest-802949502-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8783631423070'] for port, before_delete {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:36:04.880709 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.wsgi [-] (102993) accepted ('10.222.0.62', 46120) {{(pid=102993) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 23 19:36:04.938858 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-19d47709-ec97-4d9e-a7a2-f6833c15dd14 req-5bced6b6-b7cf-46c0-8079-63cd44b3c5ba service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102992) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:36:04.940332 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-19d47709-ec97-4d9e-a7a2-f6833c15dd14 req-5bced6b6-b7cf-46c0-8079-63cd44b3c5ba service neutron] 10.222.0.41 "GET /v2.0/networks?id=07eeb44e-4cdb-4c58-a83d-1dd8ab1ccb8a HTTP/1.1" status: 200 len: 920 time: 0.4030950 Nov 23 19:36:04.976389 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-587b8625-1186-4415-a65d-d02f734cc77a req-228af219-0db4-440d-8c20-95eecf22569a tempest-AttachVolumeShelveTestJSON-1172915835 tempest-AttachVolumeShelveTestJSON-1172915835-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102993) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:36:04.983962 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-587b8625-1186-4415-a65d-d02f734cc77a req-228af219-0db4-440d-8c20-95eecf22569a tempest-AttachVolumeShelveTestJSON-1172915835 tempest-AttachVolumeShelveTestJSON-1172915835-project] 10.222.0.62 "GET /v2.0/ports?device_id=85ea3d72-6c17-4ea2-82b7-90cce01633bd HTTP/1.1" status: 200 len: 943 time: 0.1288030 Nov 23 19:36:04.997224 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-19d47709-ec97-4d9e-a7a2-f6833c15dd14 req-0156e5a1-33aa-47da-b64b-d41353f83e40 service neutron] 10.222.0.41 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.3&port_id=50e9d93b-ad23-4b6b-bdd0-ae5afe6f80ea HTTP/1.1" status: 200 len: 217 time: 0.0477722 Nov 23 19:36:05.006501 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-43fce129-20cc-4283-97ea-dfbd78568fb1 req-13d84d7a-1928-4e01-934b-bcd165ffc2b6 tempest-ServerRescueNegativeTestJSON-1447477341 tempest-ServerRescueNegativeTestJSON-1447477341-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102992) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:36:05.008574 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-43fce129-20cc-4283-97ea-dfbd78568fb1 req-13d84d7a-1928-4e01-934b-bcd165ffc2b6 tempest-ServerRescueNegativeTestJSON-1447477341 tempest-ServerRescueNegativeTestJSON-1447477341-project] 10.222.0.62 "GET /v2.0/ports?device_id=671f1d44-7752-4a9d-835d-4d76164c900f HTTP/1.1" status: 200 len: 945 time: 0.4525747 Nov 23 19:36:05.038281 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.plugins.ml2.db [req-45a46188-f7e6-4236-8032-8ccfd4992ba8 req-61413ac2-c90b-4477-b3c9-59adf9827fb6 tempest-VolumesActionsTest-802949502 tempest-VolumesActionsTest-802949502-project] For port 9292b123-ce92-44b7-a488-3615ff195075, host hv-cinder-81901, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81901',level=0,port_id=9292b123-ce92-44b7-a488-3615ff195075,segment=NetworkSegment(2ab14203-895d-412f-8616-df9c89e896c9),segment_id=2ab14203-895d-412f-8616-df9c89e896c9)] {{(pid=102993) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 23 19:36:05.038665 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [req-45a46188-f7e6-4236-8032-8ccfd4992ba8 req-61413ac2-c90b-4477-b3c9-59adf9827fb6 tempest-VolumesActionsTest-802949502 tempest-VolumesActionsTest-802949502-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-927332'] for port, precommit_delete {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:36:05.042646 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-f5fca39d-4eac-4208-8d87-21554d27e3c2 admin admin] Publish callbacks [] for security_group, before_create {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:36:05.081531 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.plugins.ml2.plugin [req-45a46188-f7e6-4236-8032-8ccfd4992ba8 req-61413ac2-c90b-4477-b3c9-59adf9827fb6 tempest-VolumesActionsTest-802949502 tempest-VolumesActionsTest-802949502-project] Calling delete_port for 9292b123-ce92-44b7-a488-3615ff195075 owned by compute:nova {{(pid=102993) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 23 19:36:05.100677 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-19d47709-ec97-4d9e-a7a2-f6833c15dd14 req-6bb94ced-5d7a-4731-9167-d23c2915766c service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102992) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:36:05.100830 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-587b8625-1186-4415-a65d-d02f734cc77a req-19adb5df-fd87-4f71-858f-b9757ec2194d tempest-AttachVolumeShelveTestJSON-1172915835 tempest-AttachVolumeShelveTestJSON-1172915835-project] 10.222.0.62 "GET /v2.0/security-groups?id=f1ca24d9-0a31-470d-a1d5-fa7059df0141&fields=id&fields=name HTTP/1.1" status: 200 len: 311 time: 0.1109567 Nov 23 19:36:05.100929 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-19d47709-ec97-4d9e-a7a2-f6833c15dd14 req-6bb94ced-5d7a-4731-9167-d23c2915766c service neutron] 10.222.0.41 "GET /v2.0/subnets?id=e4fda56f-85ff-422d-adad-ec00db6378af HTTP/1.1" status: 200 len: 859 time: 0.0865293 Nov 23 19:36:05.101599 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-43fce129-20cc-4283-97ea-dfbd78568fb1 req-f8fdac83-7c26-42db-9050-1371abeb3227 tempest-ServerRescueNegativeTestJSON-1447477341 tempest-ServerRescueNegativeTestJSON-1447477341-project] 10.222.0.62 "GET /v2.0/security-groups?id=62a09434-acf0-424f-9001-2c3a78119364&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0844831 Nov 23 19:36:05.151063 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-19d47709-ec97-4d9e-a7a2-f6833c15dd14 req-953508f5-a1e4-4b0e-9541-56beb2ba71d0 service neutron] 10.222.0.41 "GET /v2.0/ports?network_id=07eeb44e-4cdb-4c58-a83d-1dd8ab1ccb8a&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0375960 Nov 23 19:36:05.264741 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-f5fca39d-4eac-4208-8d87-21554d27e3c2 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:36:05.286612 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-19d47709-ec97-4d9e-a7a2-f6833c15dd14 req-84ddbd05-7a12-4c3d-93d7-e28e8cd17cbc service neutron] 10.222.0.41 "GET /v2.0/networks/07eeb44e-4cdb-4c58-a83d-1dd8ab1ccb8a?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1264009 Nov 23 19:36:05.379980 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [req-45a46188-f7e6-4236-8032-8ccfd4992ba8 req-61413ac2-c90b-4477-b3c9-59adf9827fb6 tempest-VolumesActionsTest-802949502 tempest-VolumesActionsTest-802949502-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7918660', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-15067', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560168', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8783631424624', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8783631008723', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-17257496'] for port, after_delete {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:36:05.382476 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-f5fca39d-4eac-4208-8d87-21554d27e3c2 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-623933'] for security_group, after_create {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:36:05.386897 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-19d47709-ec97-4d9e-a7a2-f6833c15dd14 req-58e3f04b-1c24-4880-a1a0-500c1c942054 service neutron] 10.222.0.41 "GET /v2.0/networks/07eeb44e-4cdb-4c58-a83d-1dd8ab1ccb8a?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0859940 Nov 23 19:36:05.400758 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.plugins.ml2.db [None req-4bf48ff4-ecfb-4168-8b63-249b8c6e9f04 None None] get_ports_and_sgs() called for port_ids ['9292b123-ce92-44b7-a488-3615ff195075'] {{(pid=102994) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 23 19:36:05.431962 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-61413ac2-c90b-4477-b3c9-59adf9827fb6 tempest-VolumesActionsTest-802949502 tempest-VolumesActionsTest-802949502-project] Pushing event deleted for resources: {'Port': ['ID=9292b123-ce92-44b7-a488-3615ff195075,revision_number=None']} {{(pid=102993) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 23 19:36:05.473993 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f5fca39d-4eac-4208-8d87-21554d27e3c2 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=0ca86b99-464b-45a6-b0ca-ba8db6b076e2,revision_number=1']} {{(pid=102993) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 23 19:36:05.479678 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [None req-f5fca39d-4eac-4208-8d87-21554d27e3c2 admin admin] 10.222.0.62 "GET /v2.0/security-groups?tenant_id=a404bda9699446c1875c13fbed3d8b54&name=default HTTP/1.1" status: 200 len: 2996 time: 0.5978267 Nov 23 19:36:05.482627 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.wsgi [-] (102992) accepted ('10.222.0.62', 46138) {{(pid=102992) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 23 19:36:05.498097 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.db.l3_dvrscheduler_db [req-45a46188-f7e6-4236-8032-8ccfd4992ba8 req-61413ac2-c90b-4477-b3c9-59adf9827fb6 tempest-VolumesActionsTest-802949502 tempest-VolumesActionsTest-802949502-project] No DVR routers for this DVR port 9292b123-ce92-44b7-a488-3615ff195075 on host hv-cinder-81901 {{(pid=102993) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 23 19:36:05.501110 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [req-45a46188-f7e6-4236-8032-8ccfd4992ba8 req-61413ac2-c90b-4477-b3c9-59adf9827fb6 tempest-VolumesActionsTest-802949502 tempest-VolumesActionsTest-802949502-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-514902'] for port, before_response {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:36:05.504597 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-45a46188-f7e6-4236-8032-8ccfd4992ba8 req-61413ac2-c90b-4477-b3c9-59adf9827fb6 tempest-VolumesActionsTest-802949502 tempest-VolumesActionsTest-802949502-project] 10.222.0.41 "DELETE /v2.0/ports/9292b123-ce92-44b7-a488-3615ff195075 HTTP/1.1" status: 204 len: 173 time: 0.7956605 Nov 23 19:36:05.505054 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '3b98df1d-4a12-4596-868b-56328fa3c3aa', 'name': 'network-vif-deleted', 'tag': '9292b123-ce92-44b7-a488-3615ff195075'}] {{(pid=102993) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 23 19:36:05.507339 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.62/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}9b10b92acbee16fb695be1efeed0b68f7c36a5b215ec004a8d9d707fa3d35b2c" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-4ff90e74-42dc-4e99-977e-6120d1f3e62c" -d '{"events": [{"server_uuid": "3b98df1d-4a12-4596-868b-56328fa3c3aa", "name": "network-vif-deleted", "tag": "9292b123-ce92-44b7-a488-3615ff195075"}]}' {{(pid=102993) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 23 19:36:05.539693 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [None req-4656a5ed-6c11-4507-a067-1377b42ae9de admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:36:05.561159 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [None req-4656a5ed-6c11-4507-a067-1377b42ae9de admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:36:05.687897 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [None req-4656a5ed-6c11-4507-a067-1377b42ae9de admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-623933'] for security_group, after_delete {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:36:05.692139 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [None req-4656a5ed-6c11-4507-a067-1377b42ae9de admin admin] Publish callbacks [] for security_group, before_response {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:36:05.696285 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [None req-4656a5ed-6c11-4507-a067-1377b42ae9de admin admin] 10.222.0.62 "DELETE /v2.0/security-groups/0ca86b99-464b-45a6-b0ca-ba8db6b076e2 HTTP/1.1" status: 204 len: 168 time: 0.2125251 Nov 23 19:36:05.705855 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4656a5ed-6c11-4507-a067-1377b42ae9de admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=0ca86b99-464b-45a6-b0ca-ba8db6b076e2,revision_number=None']} {{(pid=102992) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 23 19:36:05.968397 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 23 Nov 2021 19:36:05 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-a5b22177-3936-4128-80b2-da5f97da95be x-openstack-request-id: req-a5b22177-3936-4128-80b2-da5f97da95be {{(pid=102993) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 23 19:36:05.968702 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "3b98df1d-4a12-4596-868b-56328fa3c3aa", "name": "network-vif-deleted", "tag": "9292b123-ce92-44b7-a488-3615ff195075", "status": "completed", "code": 200}]} {{(pid=102993) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 23 19:36:05.968966 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.62/compute/v2.1/os-server-external-events used request id req-a5b22177-3936-4128-80b2-da5f97da95be {{(pid=102993) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 23 19:36:05.969371 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '3b98df1d-4a12-4596-868b-56328fa3c3aa', 'name': 'network-vif-deleted', 'tag': '9292b123-ce92-44b7-a488-3615ff195075', 'status': 'completed', 'code': 200} Nov 23 19:36:06.058536 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-4fd04b8b-a319-4a93-80dc-835c91bb7708 req-50e97b39-5056-4108-81cb-996abe2ba44b tempest-VolumesActionsTest-802949502 tempest-VolumesActionsTest-802949502-project] 10.222.0.62 "GET /v2.0/ports?device_id=3b98df1d-4a12-4596-868b-56328fa3c3aa HTTP/1.1" status: 200 len: 210 time: 0.0290444 Nov 23 19:36:06.226436 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f27775ea-5bf0-41f8-8d74-d9c9f2e8cd44 req-91875701-800a-4a3c-937d-21918c444a3c tempest-ServerRescueNegativeTestJSON-1447477341 tempest-ServerRescueNegativeTestJSON-1447477341-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102992) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:36:06.227926 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-f27775ea-5bf0-41f8-8d74-d9c9f2e8cd44 req-91875701-800a-4a3c-937d-21918c444a3c tempest-ServerRescueNegativeTestJSON-1447477341 tempest-ServerRescueNegativeTestJSON-1447477341-project] 10.222.0.62 "GET /v2.0/ports?device_id=671f1d44-7752-4a9d-835d-4d76164c900f HTTP/1.1" status: 200 len: 945 time: 0.0569267 Nov 23 19:36:06.264801 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.wsgi [-] (102993) accepted ('10.222.0.62', 46170) {{(pid=102993) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 23 19:36:06.279015 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-5b20025a-4b3b-4607-b3b8-4af2a5c3c236 admin admin] Publish callbacks [] for security_group, before_create {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:36:06.281563 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-f27775ea-5bf0-41f8-8d74-d9c9f2e8cd44 req-c69176aa-7040-4773-99aa-03488a05e770 tempest-ServerRescueNegativeTestJSON-1447477341 tempest-ServerRescueNegativeTestJSON-1447477341-project] 10.222.0.62 "GET /v2.0/security-groups?id=62a09434-acf0-424f-9001-2c3a78119364&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0475295 Nov 23 19:36:06.354617 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-5b20025a-4b3b-4607-b3b8-4af2a5c3c236 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:36:06.418223 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-5b20025a-4b3b-4607-b3b8-4af2a5c3c236 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-623933'] for security_group, after_create {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:36:06.445300 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.wsgi [req-03e316f8-169c-4365-a923-893b21cb959d req-d9c46687-4005-46ba-944b-57ad46995494 service neutron] http://10.222.0.62:9696/v2.0/extensions returned with HTTP 200 {{(pid=102993) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Nov 23 19:36:06.446319 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-03e316f8-169c-4365-a923-893b21cb959d req-d9c46687-4005-46ba-944b-57ad46995494 service neutron] 10.222.0.62 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 14082 time: 0.0082684 Nov 23 19:36:06.462360 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5b20025a-4b3b-4607-b3b8-4af2a5c3c236 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=54ea93ad-a639-45be-9abb-61cfc41a7ce9,revision_number=1']} {{(pid=102993) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 23 19:36:06.466656 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [None req-5b20025a-4b3b-4607-b3b8-4af2a5c3c236 admin admin] 10.222.0.62 "GET /v2.0/security-groups?tenant_id=07254d56db8e4c49bbc9402ab0fe78d6&name=default HTTP/1.1" status: 200 len: 2996 time: 0.2007854 Nov 23 19:36:06.469350 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.wsgi [-] (102993) accepted ('10.222.0.62', 46182) {{(pid=102993) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 23 19:36:06.519022 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-e5f408b5-2a03-4b92-a580-6dd1927f18ba admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:36:06.541054 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-e5f408b5-2a03-4b92-a580-6dd1927f18ba admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:36:06.670076 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-e5f408b5-2a03-4b92-a580-6dd1927f18ba admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-623933'] for security_group, after_delete {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:36:06.675154 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-e5f408b5-2a03-4b92-a580-6dd1927f18ba admin admin] Publish callbacks [] for security_group, before_response {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:36:06.675154 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [None req-e5f408b5-2a03-4b92-a580-6dd1927f18ba admin admin] 10.222.0.62 "DELETE /v2.0/security-groups/54ea93ad-a639-45be-9abb-61cfc41a7ce9 HTTP/1.1" status: 204 len: 168 time: 0.2036681 Nov 23 19:36:06.685436 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e5f408b5-2a03-4b92-a580-6dd1927f18ba admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=54ea93ad-a639-45be-9abb-61cfc41a7ce9,revision_number=None']} {{(pid=102993) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 23 19:36:06.760587 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f750029e-a4b5-45e9-9ae0-1247ad758ea4 req-a191e27a-cb8a-47ae-bca2-cfc26680b721 tempest-AttachVolumeShelveTestJSON-1172915835 tempest-AttachVolumeShelveTestJSON-1172915835-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102992) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:36:06.762163 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-f750029e-a4b5-45e9-9ae0-1247ad758ea4 req-a191e27a-cb8a-47ae-bca2-cfc26680b721 tempest-AttachVolumeShelveTestJSON-1172915835 tempest-AttachVolumeShelveTestJSON-1172915835-project] 10.222.0.62 "GET /v2.0/ports?device_id=85ea3d72-6c17-4ea2-82b7-90cce01633bd HTTP/1.1" status: 200 len: 943 time: 0.0509276 Nov 23 19:36:06.814204 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-f750029e-a4b5-45e9-9ae0-1247ad758ea4 req-dc0cfe5e-f757-45d9-8cb5-8bcc4cbff200 tempest-AttachVolumeShelveTestJSON-1172915835 tempest-AttachVolumeShelveTestJSON-1172915835-project] 10.222.0.62 "GET /v2.0/security-groups?id=f1ca24d9-0a31-470d-a1d5-fa7059df0141&fields=id&fields=name HTTP/1.1" status: 200 len: 311 time: 0.0450997 Nov 23 19:36:07.306077 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.plugins.ml2.rpc [None req-4bf48ff4-ecfb-4168-8b63-249b8c6e9f04 None None] Device 9292b123-ce92-44b7-a488-3615ff195075 no longer exists at agent hyperv_hv-cinder-81901 {{(pid=102994) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 23 19:36:07.327139 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.plugins.ml2.plugin [None req-4bf48ff4-ecfb-4168-8b63-249b8c6e9f04 None None] No Port match for: 9292b123-ce92-44b7-a488-3615ff195075 {{(pid=102994) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 23 19:36:07.327500 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.plugins.ml2.rpc [None req-4bf48ff4-ecfb-4168-8b63-249b8c6e9f04 None None] Device 9292b123-ce92-44b7-a488-3615ff195075 not bound to the agent host hv-cinder-81901 {{(pid=102994) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 23 19:36:07.328192 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.plugins.ml2.rpc [None req-4bf48ff4-ecfb-4168-8b63-249b8c6e9f04 None None] Device 4b380ab6-f3ec-4e12-9a2a-b5a20828969d no longer exists at agent hyperv_hv-cinder-81901 {{(pid=102994) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 23 19:36:07.454424 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a333a561-4caa-45ab-bc01-8bc8c5b9af7d req-27adf3fc-0e43-42b7-a575-3e5fd2c25357 tempest-ServerRescueNegativeTestJSON-1447477341 tempest-ServerRescueNegativeTestJSON-1447477341-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102992) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:36:07.455979 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-a333a561-4caa-45ab-bc01-8bc8c5b9af7d req-27adf3fc-0e43-42b7-a575-3e5fd2c25357 tempest-ServerRescueNegativeTestJSON-1447477341 tempest-ServerRescueNegativeTestJSON-1447477341-project] 10.222.0.62 "GET /v2.0/ports?device_id=671f1d44-7752-4a9d-835d-4d76164c900f HTTP/1.1" status: 200 len: 945 time: 0.0867410 Nov 23 19:36:07.477103 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.wsgi [-] (102993) accepted ('10.222.0.62', 46230) {{(pid=102993) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 23 19:36:07.508111 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-a333a561-4caa-45ab-bc01-8bc8c5b9af7d req-4a6cb004-e3d7-4009-92e0-581353eba9cd tempest-ServerRescueNegativeTestJSON-1447477341 tempest-ServerRescueNegativeTestJSON-1447477341-project] 10.222.0.62 "GET /v2.0/security-groups?id=62a09434-acf0-424f-9001-2c3a78119364&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0452132 Nov 23 19:36:07.567986 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-ab561e01-dde8-4282-8e3b-49738a33a8d5 req-841a784f-d13c-4d5d-ad7c-0ce56a8b5866 service neutron] 10.222.0.62 "GET /v2.0/ports?device_id=85ea3d72-6c17-4ea2-82b7-90cce01633bd&fields=id&fields=resource_request HTTP/1.1" status: 200 len: 255 time: 0.0896709 Nov 23 19:36:07.577013 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.wsgi [req-ab561e01-dde8-4282-8e3b-49738a33a8d5 req-006b0150-719d-4e39-a8ab-5286e9ad7ec8 service neutron] http://10.222.0.62:9696/v2.0/extensions returned with HTTP 200 {{(pid=102993) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Nov 23 19:36:07.578288 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-ab561e01-dde8-4282-8e3b-49738a33a8d5 req-006b0150-719d-4e39-a8ab-5286e9ad7ec8 service neutron] 10.222.0.62 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 14082 time: 0.0050247 Nov 23 19:36:07.941761 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-35d9e96f-100e-4fd6-8687-900125d90091 req-9c2ae4ac-cd88-4d8b-8306-7dabff811825 tempest-AttachVolumeShelveTestJSON-1172915835 tempest-AttachVolumeShelveTestJSON-1172915835-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102993) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:36:07.943663 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-35d9e96f-100e-4fd6-8687-900125d90091 req-9c2ae4ac-cd88-4d8b-8306-7dabff811825 tempest-AttachVolumeShelveTestJSON-1172915835 tempest-AttachVolumeShelveTestJSON-1172915835-project] 10.222.0.62 "GET /v2.0/ports?device_id=85ea3d72-6c17-4ea2-82b7-90cce01633bd HTTP/1.1" status: 200 len: 943 time: 0.0562584 Nov 23 19:36:08.018062 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-35d9e96f-100e-4fd6-8687-900125d90091 req-f21afd2c-e042-4aaf-875d-5dbb65c9e28b tempest-AttachVolumeShelveTestJSON-1172915835 tempest-AttachVolumeShelveTestJSON-1172915835-project] 10.222.0.62 "GET /v2.0/security-groups?id=f1ca24d9-0a31-470d-a1d5-fa7059df0141&fields=id&fields=name HTTP/1.1" status: 200 len: 311 time: 0.0565546 Nov 23 19:36:08.646855 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8c29ae44-026d-4465-95ab-12f3294bd586 req-45982daa-1e3b-4a2a-bd78-d3fcbf38fd85 tempest-ServerRescueNegativeTestJSON-1447477341 tempest-ServerRescueNegativeTestJSON-1447477341-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102992) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:36:08.648356 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-8c29ae44-026d-4465-95ab-12f3294bd586 req-45982daa-1e3b-4a2a-bd78-d3fcbf38fd85 tempest-ServerRescueNegativeTestJSON-1447477341 tempest-ServerRescueNegativeTestJSON-1447477341-project] 10.222.0.62 "GET /v2.0/ports?device_id=671f1d44-7752-4a9d-835d-4d76164c900f HTTP/1.1" status: 200 len: 945 time: 0.0562091 Nov 23 19:36:08.695541 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-8c29ae44-026d-4465-95ab-12f3294bd586 req-5bded02e-e34d-45f5-97a6-6556932bfacd tempest-ServerRescueNegativeTestJSON-1447477341 tempest-ServerRescueNegativeTestJSON-1447477341-project] 10.222.0.62 "GET /v2.0/security-groups?id=62a09434-acf0-424f-9001-2c3a78119364&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0412686 Nov 23 19:36:09.128987 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c74f4878-ec2c-4350-a2bc-021cd8d44978 req-14f34e20-1b67-4ef4-8941-3932bfc3e44c tempest-AttachVolumeShelveTestJSON-1172915835 tempest-AttachVolumeShelveTestJSON-1172915835-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102992) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:36:09.130659 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-c74f4878-ec2c-4350-a2bc-021cd8d44978 req-14f34e20-1b67-4ef4-8941-3932bfc3e44c tempest-AttachVolumeShelveTestJSON-1172915835 tempest-AttachVolumeShelveTestJSON-1172915835-project] 10.222.0.62 "GET /v2.0/ports?device_id=85ea3d72-6c17-4ea2-82b7-90cce01633bd HTTP/1.1" status: 200 len: 943 time: 0.0495951 Nov 23 19:36:09.195086 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-c74f4878-ec2c-4350-a2bc-021cd8d44978 req-f9dd462d-7dc6-4eeb-85b3-c3dbd2a815e9 tempest-AttachVolumeShelveTestJSON-1172915835 tempest-AttachVolumeShelveTestJSON-1172915835-project] 10.222.0.62 "GET /v2.0/security-groups?id=f1ca24d9-0a31-470d-a1d5-fa7059df0141&fields=id&fields=name HTTP/1.1" status: 200 len: 311 time: 0.0581727 Nov 23 19:36:10.317977 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d3bb8eb7-2861-49fb-ba67-fcca191239b8 req-b4e53312-d8b9-4335-a73c-4ca3d56ad0c8 tempest-AttachVolumeShelveTestJSON-1172915835 tempest-AttachVolumeShelveTestJSON-1172915835-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102992) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:36:10.319471 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-d3bb8eb7-2861-49fb-ba67-fcca191239b8 req-b4e53312-d8b9-4335-a73c-4ca3d56ad0c8 tempest-AttachVolumeShelveTestJSON-1172915835 tempest-AttachVolumeShelveTestJSON-1172915835-project] 10.222.0.62 "GET /v2.0/ports?device_id=85ea3d72-6c17-4ea2-82b7-90cce01633bd HTTP/1.1" status: 200 len: 943 time: 0.0477486 Nov 23 19:36:10.369195 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-d3bb8eb7-2861-49fb-ba67-fcca191239b8 req-2b542f22-5507-4eb4-903e-14755319867a tempest-AttachVolumeShelveTestJSON-1172915835 tempest-AttachVolumeShelveTestJSON-1172915835-project] 10.222.0.62 "GET /v2.0/security-groups?id=f1ca24d9-0a31-470d-a1d5-fa7059df0141&fields=id&fields=name HTTP/1.1" status: 200 len: 311 time: 0.0437598 Nov 23 19:36:11.486550 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-39fa8a52-d587-43a3-a4c0-63cc061e6239 req-4e316a78-eb47-48f8-9db3-150255a81666 tempest-AttachVolumeShelveTestJSON-1172915835 tempest-AttachVolumeShelveTestJSON-1172915835-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102992) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:36:11.488193 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-39fa8a52-d587-43a3-a4c0-63cc061e6239 req-4e316a78-eb47-48f8-9db3-150255a81666 tempest-AttachVolumeShelveTestJSON-1172915835 tempest-AttachVolumeShelveTestJSON-1172915835-project] 10.222.0.62 "GET /v2.0/ports?device_id=85ea3d72-6c17-4ea2-82b7-90cce01633bd HTTP/1.1" status: 200 len: 943 time: 0.0486276 Nov 23 19:36:11.534818 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-39fa8a52-d587-43a3-a4c0-63cc061e6239 req-ea1afc42-0203-41b2-ac3d-214a56e188a5 tempest-AttachVolumeShelveTestJSON-1172915835 tempest-AttachVolumeShelveTestJSON-1172915835-project] 10.222.0.62 "GET /v2.0/security-groups?id=f1ca24d9-0a31-470d-a1d5-fa7059df0141&fields=id&fields=name HTTP/1.1" status: 200 len: 311 time: 0.0408580 Nov 23 19:36:11.703675 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron_lib.callbacks.manager [None req-6c0c5f5f-876f-480a-a12b-c3fc903bc066 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8783631323329', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7978582'] for agent, after_update {{(pid=102994) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:36:12.653373 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bf262351-5a2b-4a3e-be72-e5a1a781d00e req-c6f20fb2-b5d1-4d96-9ca4-3d1575b8005f tempest-AttachVolumeShelveTestJSON-1172915835 tempest-AttachVolumeShelveTestJSON-1172915835-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102992) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:36:12.654838 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-bf262351-5a2b-4a3e-be72-e5a1a781d00e req-c6f20fb2-b5d1-4d96-9ca4-3d1575b8005f tempest-AttachVolumeShelveTestJSON-1172915835 tempest-AttachVolumeShelveTestJSON-1172915835-project] 10.222.0.62 "GET /v2.0/ports?device_id=85ea3d72-6c17-4ea2-82b7-90cce01633bd HTTP/1.1" status: 200 len: 943 time: 0.0483682 Nov 23 19:36:12.704059 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-bf262351-5a2b-4a3e-be72-e5a1a781d00e req-900e1ce7-9595-4b10-93cd-a7ef56b9abc4 tempest-AttachVolumeShelveTestJSON-1172915835 tempest-AttachVolumeShelveTestJSON-1172915835-project] 10.222.0.62 "GET /v2.0/security-groups?id=f1ca24d9-0a31-470d-a1d5-fa7059df0141&fields=id&fields=name HTTP/1.1" status: 200 len: 311 time: 0.0428100 Nov 23 19:36:13.831503 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f3933a2f-26e0-4001-a574-a18dc166de2b req-e3074173-fc93-4508-b75c-521ea3d42693 tempest-AttachVolumeShelveTestJSON-1172915835 tempest-AttachVolumeShelveTestJSON-1172915835-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102992) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:36:13.833155 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-f3933a2f-26e0-4001-a574-a18dc166de2b req-e3074173-fc93-4508-b75c-521ea3d42693 tempest-AttachVolumeShelveTestJSON-1172915835 tempest-AttachVolumeShelveTestJSON-1172915835-project] 10.222.0.62 "GET /v2.0/ports?device_id=85ea3d72-6c17-4ea2-82b7-90cce01633bd HTTP/1.1" status: 200 len: 943 time: 0.0546310 Nov 23 19:36:13.887962 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-f3933a2f-26e0-4001-a574-a18dc166de2b req-7ff5e87e-b5c0-4c6b-8872-ea49e5760579 tempest-AttachVolumeShelveTestJSON-1172915835 tempest-AttachVolumeShelveTestJSON-1172915835-project] 10.222.0.62 "GET /v2.0/security-groups?id=f1ca24d9-0a31-470d-a1d5-fa7059df0141&fields=id&fields=name HTTP/1.1" status: 200 len: 311 time: 0.0487070 Nov 23 19:36:14.183642 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron_lib.callbacks.manager [None req-f25541f0-8385-479a-8cae-36a4bb75b484 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8783631323329', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7978582'] for agent, after_update {{(pid=102994) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:36:15.044652 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9bc84ab9-0cff-4251-bd56-2fcd896048c3 req-77284fa6-101d-4ee7-898b-b57aabde97b2 tempest-AttachVolumeShelveTestJSON-1172915835 tempest-AttachVolumeShelveTestJSON-1172915835-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102992) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:36:15.048644 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-9bc84ab9-0cff-4251-bd56-2fcd896048c3 req-77284fa6-101d-4ee7-898b-b57aabde97b2 tempest-AttachVolumeShelveTestJSON-1172915835 tempest-AttachVolumeShelveTestJSON-1172915835-project] 10.222.0.62 "GET /v2.0/ports?device_id=85ea3d72-6c17-4ea2-82b7-90cce01633bd HTTP/1.1" status: 200 len: 943 time: 0.0708168 Nov 23 19:36:15.110397 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron_lib.callbacks.manager [None req-8346ef05-f685-4c3d-af3d-a159b683bec2 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8783631323329', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7978582'] for agent, after_update {{(pid=102994) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:36:15.151689 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-9bc84ab9-0cff-4251-bd56-2fcd896048c3 req-a4aaa703-d68b-4c5f-afbc-7d015320a080 tempest-AttachVolumeShelveTestJSON-1172915835 tempest-AttachVolumeShelveTestJSON-1172915835-project] 10.222.0.62 "GET /v2.0/security-groups?id=f1ca24d9-0a31-470d-a1d5-fa7059df0141&fields=id&fields=name HTTP/1.1" status: 200 len: 311 time: 0.0944159 Nov 23 19:36:15.838224 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-2cda6938-7733-4788-8ba8-c2c78648a38f req-035de546-9971-4f02-bc4e-0f17dbb99329 tempest-TestVolumeBootPattern-147141705 tempest-TestVolumeBootPattern-147141705-project] 10.222.0.62 "GET /v2.0/security-groups?name=tempest-secgroup-smoke-1973485717&fields=id&tenant_id=257b0b2e531441b4bb745e99cfd799f3 HTTP/1.1" status: 200 len: 267 time: 0.0974200 Nov 23 19:36:15.976340 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2cda6938-7733-4788-8ba8-c2c78648a38f req-9b7153d3-42cd-44da-b0d5-fc118cd7e6f2 tempest-TestVolumeBootPattern-147141705 tempest-TestVolumeBootPattern-147141705-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=102992) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:36:15.977910 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-2cda6938-7733-4788-8ba8-c2c78648a38f req-9b7153d3-42cd-44da-b0d5-fc118cd7e6f2 tempest-TestVolumeBootPattern-147141705 tempest-TestVolumeBootPattern-147141705-project] 10.222.0.62 "GET /v2.0/networks?id=226a519f-5f3e-4d80-bb8a-0e9fc4f64828 HTTP/1.1" status: 200 len: 810 time: 0.1327341 Nov 23 19:36:15.996031 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-2cda6938-7733-4788-8ba8-c2c78648a38f req-0ed09b12-1079-4824-b7a6-fc9f148cbe28 tempest-TestVolumeBootPattern-147141705 tempest-TestVolumeBootPattern-147141705-project] 10.222.0.62 "GET /v2.0/quotas/257b0b2e531441b4bb745e99cfd799f3 HTTP/1.1" status: 200 len: 375 time: 0.0101070 Nov 23 19:36:16.072723 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-2cda6938-7733-4788-8ba8-c2c78648a38f req-1cf7643e-751a-4d10-8610-b5b97e5dc381 tempest-TestVolumeBootPattern-147141705 tempest-TestVolumeBootPattern-147141705-project] 10.222.0.62 "GET /v2.0/ports?tenant_id=257b0b2e531441b4bb745e99cfd799f3&fields=id HTTP/1.1" status: 200 len: 302 time: 0.0694809 Nov 23 19:36:16.200023 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-2cda6938-7733-4788-8ba8-c2c78648a38f req-92af7da6-51fb-4dd1-9bb8-104d7d8f87d2 service neutron] 10.222.0.62 "GET /v2.0/networks/226a519f-5f3e-4d80-bb8a-0e9fc4f64828?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1098080 Nov 23 19:36:16.303231 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-407ee1a9-0a41-4b37-9710-2a0376588601 req-4042e0c1-de32-48dd-a625-67f0925fc421 tempest-AttachVolumeShelveTestJSON-1172915835 tempest-AttachVolumeShelveTestJSON-1172915835-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102993) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:36:16.305999 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-407ee1a9-0a41-4b37-9710-2a0376588601 req-4042e0c1-de32-48dd-a625-67f0925fc421 tempest-AttachVolumeShelveTestJSON-1172915835 tempest-AttachVolumeShelveTestJSON-1172915835-project] 10.222.0.62 "GET /v2.0/ports?device_id=85ea3d72-6c17-4ea2-82b7-90cce01633bd HTTP/1.1" status: 200 len: 943 time: 0.0577474 Nov 23 19:36:16.317857 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-2cda6938-7733-4788-8ba8-c2c78648a38f req-3041972b-8598-45a2-bbe2-4d285213b97a service neutron] 10.222.0.62 "GET /v2.0/networks/226a519f-5f3e-4d80-bb8a-0e9fc4f64828?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1164145 Nov 23 19:36:16.361493 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-407ee1a9-0a41-4b37-9710-2a0376588601 req-94056d1b-c67e-489f-a7b5-07a81cbf88fa tempest-AttachVolumeShelveTestJSON-1172915835 tempest-AttachVolumeShelveTestJSON-1172915835-project] 10.222.0.62 "GET /v2.0/security-groups?id=f1ca24d9-0a31-470d-a1d5-fa7059df0141&fields=id&fields=name HTTP/1.1" status: 200 len: 311 time: 0.0494123 Nov 23 19:36:16.742863 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron_lib.callbacks.manager [None req-785c1d26-11ba-42d8-b5a6-51a8b3daeef0 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8783631323329', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7978582'] for agent, after_update {{(pid=102994) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:36:17.165907 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-ab2399db-25f5-4f3b-85ca-a76cfbdf3865 req-e492e54f-bdab-4894-b5d5-84a2df3d9afe tempest-TestVolumeBootPattern-147141705 tempest-TestVolumeBootPattern-147141705-project] 10.222.0.62 "GET /v2.0/ports?device_id=4ee0b7a3-f787-4a7c-816a-71f3a99b7193 HTTP/1.1" status: 200 len: 210 time: 0.0415335 Nov 23 19:36:17.371923 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron_lib.callbacks.manager [None req-eb87b2c3-3339-4249-8b85-e695b5b4e1f9 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8783631323329', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7978582'] for agent, after_update {{(pid=102994) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:36:17.509659 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6f2b1884-e33c-4512-ae91-c33a2ac2250c req-659d4f08-7609-415b-b32b-5ebafff8cb95 tempest-AttachVolumeShelveTestJSON-1172915835 tempest-AttachVolumeShelveTestJSON-1172915835-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102992) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:36:17.511347 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-6f2b1884-e33c-4512-ae91-c33a2ac2250c req-659d4f08-7609-415b-b32b-5ebafff8cb95 tempest-AttachVolumeShelveTestJSON-1172915835 tempest-AttachVolumeShelveTestJSON-1172915835-project] 10.222.0.62 "GET /v2.0/ports?device_id=85ea3d72-6c17-4ea2-82b7-90cce01633bd HTTP/1.1" status: 200 len: 943 time: 0.0553865 Nov 23 19:36:17.577718 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-6f2b1884-e33c-4512-ae91-c33a2ac2250c req-67d9b5f3-9960-43ad-a607-034ee2de2f7e tempest-AttachVolumeShelveTestJSON-1172915835 tempest-AttachVolumeShelveTestJSON-1172915835-project] 10.222.0.62 "GET /v2.0/security-groups?id=f1ca24d9-0a31-470d-a1d5-fa7059df0141&fields=id&fields=name HTTP/1.1" status: 200 len: 311 time: 0.0584517 Nov 23 19:36:18.265741 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-4458b458-5f32-4fe7-a73e-cc95a655eb9a req-3b6e278d-a26f-4456-8390-3918bf5bb3f0 tempest-TestVolumeBootPattern-147141705 tempest-TestVolumeBootPattern-147141705-project] 10.222.0.62 "GET /v2.0/ports?device_id=4ee0b7a3-f787-4a7c-816a-71f3a99b7193 HTTP/1.1" status: 200 len: 210 time: 0.0338030 Nov 23 19:36:18.716408 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d596ea52-bdd4-4879-b6ef-c2b6948e14cd req-bc0aa791-1b92-4051-92e8-a70fa9f52b7f tempest-AttachVolumeShelveTestJSON-1172915835 tempest-AttachVolumeShelveTestJSON-1172915835-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102993) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:36:18.717974 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-d596ea52-bdd4-4879-b6ef-c2b6948e14cd req-bc0aa791-1b92-4051-92e8-a70fa9f52b7f tempest-AttachVolumeShelveTestJSON-1172915835 tempest-AttachVolumeShelveTestJSON-1172915835-project] 10.222.0.62 "GET /v2.0/ports?device_id=85ea3d72-6c17-4ea2-82b7-90cce01633bd HTTP/1.1" status: 200 len: 943 time: 0.0523412 Nov 23 19:36:18.778278 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-d596ea52-bdd4-4879-b6ef-c2b6948e14cd req-8cfed3f8-1140-406b-b162-f52273bfa44e tempest-AttachVolumeShelveTestJSON-1172915835 tempest-AttachVolumeShelveTestJSON-1172915835-project] 10.222.0.62 "GET /v2.0/security-groups?id=f1ca24d9-0a31-470d-a1d5-fa7059df0141&fields=id&fields=name HTTP/1.1" status: 200 len: 311 time: 0.0533495 Nov 23 19:36:19.004348 dv-cinder-819011-1-iscsi neutron-server[102995]: DEBUG neutron.db.agents_db [None req-84bdc9b2-57ea-4bdb-a245-07c78d37cea8 None None] Agent healthcheck: found 6 active agents {{(pid=102995) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 23 19:36:19.407243 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-6ea34e17-ec97-4bac-8378-5fad40491794 req-afa92013-bebb-4c80-af56-4200b7b16dc3 tempest-TestVolumeBootPattern-147141705 tempest-TestVolumeBootPattern-147141705-project] 10.222.0.62 "GET /v2.0/ports?device_id=4ee0b7a3-f787-4a7c-816a-71f3a99b7193 HTTP/1.1" status: 200 len: 210 time: 0.0483088 Nov 23 19:36:19.432023 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ab561e01-dde8-4282-8e3b-49738a33a8d5 req-d8e692ce-5917-49b3-907a-d3ab59a0b803 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102993) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:36:19.433523 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-ab561e01-dde8-4282-8e3b-49738a33a8d5 req-d8e692ce-5917-49b3-907a-d3ab59a0b803 service neutron] 10.222.0.41 "GET /v2.0/ports?device_id=85ea3d72-6c17-4ea2-82b7-90cce01633bd&tenant_id=2d925fb59ba34355aa85758374d76928 HTTP/1.1" status: 200 len: 1096 time: 0.1033492 Nov 23 19:36:19.544625 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ab561e01-dde8-4282-8e3b-49738a33a8d5 req-6669ca1c-d00e-46b8-b674-29ac6b6c2f63 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102993) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:36:19.546330 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-ab561e01-dde8-4282-8e3b-49738a33a8d5 req-6669ca1c-d00e-46b8-b674-29ac6b6c2f63 service neutron] 10.222.0.41 "GET /v2.0/ports?tenant_id=2d925fb59ba34355aa85758374d76928&device_id=85ea3d72-6c17-4ea2-82b7-90cce01633bd HTTP/1.1" status: 200 len: 1096 time: 0.0654593 Nov 23 19:36:19.655950 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ab561e01-dde8-4282-8e3b-49738a33a8d5 req-c7d51505-ee2c-4207-9bf9-da2449b037ea service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102993) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:36:19.657870 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-ab561e01-dde8-4282-8e3b-49738a33a8d5 req-c7d51505-ee2c-4207-9bf9-da2449b037ea service neutron] 10.222.0.41 "GET /v2.0/networks?id=fc901312-2937-4784-8a6d-c046666e8bf8 HTTP/1.1" status: 200 len: 918 time: 0.0991585 Nov 23 19:36:19.746126 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-ab561e01-dde8-4282-8e3b-49738a33a8d5 req-e3293545-f001-4809-a9d8-8ce7025ec60c service neutron] 10.222.0.41 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.7&port_id=4b380ab6-f3ec-4e12-9a2a-b5a20828969d HTTP/1.1" status: 200 len: 999 time: 0.0783582 Nov 23 19:36:19.932224 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ab561e01-dde8-4282-8e3b-49738a33a8d5 req-49088319-50f7-4409-bf85-5760849f3eb4 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102993) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:36:19.934544 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-ab561e01-dde8-4282-8e3b-49738a33a8d5 req-49088319-50f7-4409-bf85-5760849f3eb4 service neutron] 10.222.0.41 "GET /v2.0/subnets?id=2caca985-6ed6-4ef7-ba49-7b7410bea160 HTTP/1.1" status: 200 len: 856 time: 0.0887296 Nov 23 19:36:19.979265 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d9956e50-c28b-485b-891e-e75e4118d7ec req-f59af62e-4d37-4ce2-997e-ea0136b7e970 tempest-AttachVolumeShelveTestJSON-1172915835 tempest-AttachVolumeShelveTestJSON-1172915835-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102992) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:36:19.991290 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-d9956e50-c28b-485b-891e-e75e4118d7ec req-f59af62e-4d37-4ce2-997e-ea0136b7e970 tempest-AttachVolumeShelveTestJSON-1172915835 tempest-AttachVolumeShelveTestJSON-1172915835-project] 10.222.0.62 "GET /v2.0/ports?device_id=85ea3d72-6c17-4ea2-82b7-90cce01633bd HTTP/1.1" status: 200 len: 943 time: 0.1174755 Nov 23 19:36:20.043054 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ab561e01-dde8-4282-8e3b-49738a33a8d5 req-bef16b30-be92-4f5b-bb77-a73c8301e289 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102993) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:36:20.044555 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-ab561e01-dde8-4282-8e3b-49738a33a8d5 req-bef16b30-be92-4f5b-bb77-a73c8301e289 service neutron] 10.222.0.41 "GET /v2.0/ports?network_id=fc901312-2937-4784-8a6d-c046666e8bf8&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0956788 Nov 23 19:36:20.051199 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-d9956e50-c28b-485b-891e-e75e4118d7ec req-528b39f4-d982-44e5-b796-fa59052a7d3e tempest-AttachVolumeShelveTestJSON-1172915835 tempest-AttachVolumeShelveTestJSON-1172915835-project] 10.222.0.62 "GET /v2.0/security-groups?id=f1ca24d9-0a31-470d-a1d5-fa7059df0141&fields=id&fields=name HTTP/1.1" status: 200 len: 311 time: 0.0589952 Nov 23 19:36:20.199233 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-ab561e01-dde8-4282-8e3b-49738a33a8d5 req-6264ce69-a3c3-4b69-9cc1-dc7c98206d70 service neutron] 10.222.0.41 "GET /v2.0/networks/fc901312-2937-4784-8a6d-c046666e8bf8?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1301918 Nov 23 19:36:20.355159 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-ab561e01-dde8-4282-8e3b-49738a33a8d5 req-6bb0a207-fdd7-4e34-9f4f-46d0e0e793b5 service neutron] 10.222.0.41 "GET /v2.0/networks/fc901312-2937-4784-8a6d-c046666e8bf8?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1499670 Nov 23 19:36:20.558111 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2cda6938-7733-4788-8ba8-c2c78648a38f req-eb52eab7-6d68-4233-b0fb-4342f05462f6 tempest-TestVolumeBootPattern-147141705 tempest-TestVolumeBootPattern-147141705-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=102993) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:36:20.559646 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-2cda6938-7733-4788-8ba8-c2c78648a38f req-eb52eab7-6d68-4233-b0fb-4342f05462f6 tempest-TestVolumeBootPattern-147141705 tempest-TestVolumeBootPattern-147141705-project] 10.222.0.41 "GET /v2.0/networks?id=226a519f-5f3e-4d80-bb8a-0e9fc4f64828 HTTP/1.1" status: 200 len: 810 time: 0.1673441 Nov 23 19:36:20.580283 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-af6a9d7a-6983-4cc2-a874-cceaec592e7e req-d292be02-dee5-4273-a07b-06da653f6002 tempest-TestVolumeBootPattern-147141705 tempest-TestVolumeBootPattern-147141705-project] 10.222.0.62 "GET /v2.0/ports?device_id=4ee0b7a3-f787-4a7c-816a-71f3a99b7193 HTTP/1.1" status: 200 len: 210 time: 0.0422294 Nov 23 19:36:20.664397 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-2cda6938-7733-4788-8ba8-c2c78648a38f req-05a4e681-fa46-4ee3-9d48-99ea4a9576f0 tempest-TestVolumeBootPattern-147141705 tempest-TestVolumeBootPattern-147141705-project] 10.222.0.41 "GET /v2.0/security-groups?fields=id&fields=name&tenant_id=257b0b2e531441b4bb745e99cfd799f3 HTTP/1.1" status: 200 len: 380 time: 0.0866871 Nov 23 19:36:20.682348 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.api.v2.base [req-2cda6938-7733-4788-8ba8-c2c78648a38f req-b4d1060a-ef80-4ef9-8224-a26976068c44 tempest-TestVolumeBootPattern-147141705 tempest-TestVolumeBootPattern-147141705-project] Request body: {'port': {'device_id': '4ee0b7a3-f787-4a7c-816a-71f3a99b7193', 'network_id': '226a519f-5f3e-4d80-bb8a-0e9fc4f64828', 'admin_state_up': True, 'tenant_id': '257b0b2e531441b4bb745e99cfd799f3', 'security_groups': ['a6e2b133-1a9b-4dde-a188-1ce8bcdb7b5c']}} {{(pid=102993) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 23 19:36:20.880260 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-2cda6938-7733-4788-8ba8-c2c78648a38f req-b4d1060a-ef80-4ef9-8224-a26976068c44 tempest-TestVolumeBootPattern-147141705 tempest-TestVolumeBootPattern-147141705-project] Made reservation on behalf of 257b0b2e531441b4bb745e99cfd799f3 for: {'port': 1} {{(pid=102993) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 23 19:36:20.888418 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [req-2cda6938-7733-4788-8ba8-c2c78648a38f req-b4d1060a-ef80-4ef9-8224-a26976068c44 tempest-TestVolumeBootPattern-147141705 tempest-TestVolumeBootPattern-147141705-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7921281'] for port, before_create {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:36:21.087705 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.db.db_base_plugin_common [req-2cda6938-7733-4788-8ba8-c2c78648a38f req-b4d1060a-ef80-4ef9-8224-a26976068c44 tempest-TestVolumeBootPattern-147141705 tempest-TestVolumeBootPattern-147141705-project] Allocated IP 172.20.0.14 (226a519f-5f3e-4d80-bb8a-0e9fc4f64828/88de785d-c540-4651-af1e-26f27ccaee3c/1a0a2345-c03d-4159-89a8-35402d8d2448) {{(pid=102993) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 23 19:36:21.275945 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a1680f1d-7f30-4086-822a-6aa5a0ac77d0 req-304b64db-6390-4b09-8f55-0e5b31ebf29f tempest-AttachVolumeShelveTestJSON-1172915835 tempest-AttachVolumeShelveTestJSON-1172915835-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102992) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:36:21.280330 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-a1680f1d-7f30-4086-822a-6aa5a0ac77d0 req-304b64db-6390-4b09-8f55-0e5b31ebf29f tempest-AttachVolumeShelveTestJSON-1172915835 tempest-AttachVolumeShelveTestJSON-1172915835-project] 10.222.0.62 "GET /v2.0/ports?device_id=85ea3d72-6c17-4ea2-82b7-90cce01633bd HTTP/1.1" status: 200 len: 943 time: 0.0779829 Nov 23 19:36:21.316372 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [req-2cda6938-7733-4788-8ba8-c2c78648a38f req-b4d1060a-ef80-4ef9-8224-a26976068c44 tempest-TestVolumeBootPattern-147141705 tempest-TestVolumeBootPattern-147141705-project] Publish callbacks [] for port, precommit_create {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:36:21.382325 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-a1680f1d-7f30-4086-822a-6aa5a0ac77d0 req-a687ca7e-d004-4226-8e7f-6af50fdef016 tempest-AttachVolumeShelveTestJSON-1172915835 tempest-AttachVolumeShelveTestJSON-1172915835-project] 10.222.0.62 "GET /v2.0/security-groups?id=f1ca24d9-0a31-470d-a1d5-fa7059df0141&fields=id&fields=name HTTP/1.1" status: 200 len: 311 time: 0.0963268 Nov 23 19:36:21.460888 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [req-2cda6938-7733-4788-8ba8-c2c78648a38f req-b4d1060a-ef80-4ef9-8224-a26976068c44 tempest-TestVolumeBootPattern-147141705 tempest-TestVolumeBootPattern-147141705-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7918660', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-15067', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560168', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8783631008714', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-17257496'] for port, after_create {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:36:21.559746 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-2cda6938-7733-4788-8ba8-c2c78648a38f req-b4d1060a-ef80-4ef9-8224-a26976068c44 tempest-TestVolumeBootPattern-147141705 tempest-TestVolumeBootPattern-147141705-project] Network 226a519f-5f3e-4d80-bb8a-0e9fc4f64828 is already hosted by enough agents. {{(pid=102993) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 23 19:36:21.569159 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.scheduler.base_scheduler [req-2cda6938-7733-4788-8ba8-c2c78648a38f req-b4d1060a-ef80-4ef9-8224-a26976068c44 tempest-TestVolumeBootPattern-147141705 tempest-TestVolumeBootPattern-147141705-project] Resources bound (agent type, host, resource id): {{(pid=102993) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 23 19:36:21.578686 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.db.l3_dvrscheduler_db [req-2cda6938-7733-4788-8ba8-c2c78648a38f req-b4d1060a-ef80-4ef9-8224-a26976068c44 tempest-TestVolumeBootPattern-147141705 tempest-TestVolumeBootPattern-147141705-project] Received port after_create {{(pid=102993) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 23 19:36:21.735125 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2cda6938-7733-4788-8ba8-c2c78648a38f req-b4d1060a-ef80-4ef9-8224-a26976068c44 tempest-TestVolumeBootPattern-147141705 tempest-TestVolumeBootPattern-147141705-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=102993) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:36:21.737938 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [req-2cda6938-7733-4788-8ba8-c2c78648a38f req-b4d1060a-ef80-4ef9-8224-a26976068c44 tempest-TestVolumeBootPattern-147141705 tempest-TestVolumeBootPattern-147141705-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-514902'] for port, before_response {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:36:21.802697 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b4d1060a-ef80-4ef9-8224-a26976068c44 tempest-TestVolumeBootPattern-147141705 tempest-TestVolumeBootPattern-147141705-project] Pushing event updated for resources: {'Port': ['ID=1a0a2345-c03d-4159-89a8-35402d8d2448,revision_number=1']} {{(pid=102993) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 23 19:36:21.819139 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b4d1060a-ef80-4ef9-8224-a26976068c44 tempest-TestVolumeBootPattern-147141705 tempest-TestVolumeBootPattern-147141705-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-819011-1-iscsi {{(pid=102993) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 23 19:36:21.819498 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b4d1060a-ef80-4ef9-8224-a26976068c44 tempest-TestVolumeBootPattern-147141705 tempest-TestVolumeBootPattern-147141705-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-819011-1-iscsi {{(pid=102993) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 23 19:36:21.819845 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b4d1060a-ef80-4ef9-8224-a26976068c44 tempest-TestVolumeBootPattern-147141705 tempest-TestVolumeBootPattern-147141705-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-819011-1-iscsi {{(pid=102993) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 23 19:36:21.820185 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b4d1060a-ef80-4ef9-8224-a26976068c44 tempest-TestVolumeBootPattern-147141705 tempest-TestVolumeBootPattern-147141705-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-819011-1-iscsi {{(pid=102993) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 23 19:36:21.820530 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b4d1060a-ef80-4ef9-8224-a26976068c44 tempest-TestVolumeBootPattern-147141705 tempest-TestVolumeBootPattern-147141705-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-819011-1-iscsi {{(pid=102993) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 23 19:36:21.821041 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b4d1060a-ef80-4ef9-8224-a26976068c44 tempest-TestVolumeBootPattern-147141705 tempest-TestVolumeBootPattern-147141705-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-819011-1-iscsi {{(pid=102993) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 23 19:36:21.821385 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b4d1060a-ef80-4ef9-8224-a26976068c44 tempest-TestVolumeBootPattern-147141705 tempest-TestVolumeBootPattern-147141705-project] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-819011-1-iscsi {{(pid=102993) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 23 19:36:21.822295 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b4d1060a-ef80-4ef9-8224-a26976068c44 tempest-TestVolumeBootPattern-147141705 tempest-TestVolumeBootPattern-147141705-project] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-819011-1-iscsi {{(pid=102993) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 23 19:36:21.822696 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b4d1060a-ef80-4ef9-8224-a26976068c44 tempest-TestVolumeBootPattern-147141705 tempest-TestVolumeBootPattern-147141705-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-819011-1-iscsi {{(pid=102993) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 23 19:36:21.822964 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b4d1060a-ef80-4ef9-8224-a26976068c44 tempest-TestVolumeBootPattern-147141705 tempest-TestVolumeBootPattern-147141705-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-819011-1-iscsi {{(pid=102993) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 23 19:36:21.823336 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b4d1060a-ef80-4ef9-8224-a26976068c44 tempest-TestVolumeBootPattern-147141705 tempest-TestVolumeBootPattern-147141705-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-819011-1-iscsi {{(pid=102993) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 23 19:36:21.823661 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b4d1060a-ef80-4ef9-8224-a26976068c44 tempest-TestVolumeBootPattern-147141705 tempest-TestVolumeBootPattern-147141705-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-819011-1-iscsi {{(pid=102993) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 23 19:36:21.836071 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.db.provisioning_blocks [None req-963f3e15-16f1-410d-9440-dcc70a8b8644 None None] Provisioning complete for port 1a0a2345-c03d-4159-89a8-35402d8d2448 triggered by entity DHCP. {{(pid=102994) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 23 19:36:21.837044 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron_lib.callbacks.manager [None req-963f3e15-16f1-410d-9440-dcc70a8b8644 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-8355713'] for port, provisioning_complete {{(pid=102994) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:36:21.838457 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8b8782e5-88e9-4b13-965d-daa666d31cc3 req-dbd543c4-7080-4869-80e0-33f6a1f3b261 tempest-TestVolumeBootPattern-147141705 tempest-TestVolumeBootPattern-147141705-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102993) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:36:21.842367 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-8b8782e5-88e9-4b13-965d-daa666d31cc3 req-dbd543c4-7080-4869-80e0-33f6a1f3b261 tempest-TestVolumeBootPattern-147141705 tempest-TestVolumeBootPattern-147141705-project] 10.222.0.62 "GET /v2.0/ports?device_id=4ee0b7a3-f787-4a7c-816a-71f3a99b7193 HTTP/1.1" status: 200 len: 932 time: 0.0963337 Nov 23 19:36:21.876954 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.plugins.ml2.plugin [None req-963f3e15-16f1-410d-9440-dcc70a8b8644 None None] Port 1a0a2345-c03d-4159-89a8-35402d8d2448 cannot update to ACTIVE because it is not bound. {{(pid=102994) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 23 19:36:21.903091 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-2cda6938-7733-4788-8ba8-c2c78648a38f req-b4d1060a-ef80-4ef9-8224-a26976068c44 tempest-TestVolumeBootPattern-147141705 tempest-TestVolumeBootPattern-147141705-project] 10.222.0.41 "POST /v2.0/ports HTTP/1.1" status: 201 len: 934 time: 1.2247601 Nov 23 19:36:21.915247 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-8b8782e5-88e9-4b13-965d-daa666d31cc3 req-6b2b8884-e7ec-4e27-9a72-fa4d0ddc3ab8 tempest-TestVolumeBootPattern-147141705 tempest-TestVolumeBootPattern-147141705-project] 10.222.0.62 "GET /v2.0/security-groups?id=a6e2b133-1a9b-4dde-a188-1ce8bcdb7b5c&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0648584 Nov 23 19:36:22.541451 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bdf038d8-7ee9-4da7-ad68-af8db0cc6c4b req-0052b0ab-7ebb-4ea7-b4ee-67a11c17dc9d tempest-AttachVolumeShelveTestJSON-1172915835 tempest-AttachVolumeShelveTestJSON-1172915835-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102992) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:36:22.542995 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-bdf038d8-7ee9-4da7-ad68-af8db0cc6c4b req-0052b0ab-7ebb-4ea7-b4ee-67a11c17dc9d tempest-AttachVolumeShelveTestJSON-1172915835 tempest-AttachVolumeShelveTestJSON-1172915835-project] 10.222.0.62 "GET /v2.0/ports?device_id=85ea3d72-6c17-4ea2-82b7-90cce01633bd HTTP/1.1" status: 200 len: 943 time: 0.0598805 Nov 23 19:36:22.602145 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-bdf038d8-7ee9-4da7-ad68-af8db0cc6c4b req-4459f54e-f65f-4b4b-9ba8-008d28c2590f tempest-AttachVolumeShelveTestJSON-1172915835 tempest-AttachVolumeShelveTestJSON-1172915835-project] 10.222.0.62 "GET /v2.0/security-groups?id=f1ca24d9-0a31-470d-a1d5-fa7059df0141&fields=id&fields=name HTTP/1.1" status: 200 len: 311 time: 0.0530536 Nov 23 19:36:23.037572 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9b9b4ad8-2d1a-4383-b197-bdbbf6cf503a req-4d6b1498-5d0c-4ea1-bd24-a7e703c1adb0 tempest-TestVolumeBootPattern-147141705 tempest-TestVolumeBootPattern-147141705-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102993) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:36:23.039039 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-9b9b4ad8-2d1a-4383-b197-bdbbf6cf503a req-4d6b1498-5d0c-4ea1-bd24-a7e703c1adb0 tempest-TestVolumeBootPattern-147141705 tempest-TestVolumeBootPattern-147141705-project] 10.222.0.62 "GET /v2.0/ports?device_id=4ee0b7a3-f787-4a7c-816a-71f3a99b7193 HTTP/1.1" status: 200 len: 932 time: 0.0486929 Nov 23 19:36:23.088387 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-9b9b4ad8-2d1a-4383-b197-bdbbf6cf503a req-a05530ff-a064-483b-b4d0-e98001d657bd tempest-TestVolumeBootPattern-147141705 tempest-TestVolumeBootPattern-147141705-project] 10.222.0.62 "GET /v2.0/security-groups?id=a6e2b133-1a9b-4dde-a188-1ce8bcdb7b5c&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0435503 Nov 23 19:36:23.783441 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-70a20f23-c384-4195-8864-74cbbd3ee135 req-60daa35c-e316-498d-a54f-b3ce86f0c571 tempest-AttachVolumeShelveTestJSON-1172915835 tempest-AttachVolumeShelveTestJSON-1172915835-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102992) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:36:23.785782 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-70a20f23-c384-4195-8864-74cbbd3ee135 req-60daa35c-e316-498d-a54f-b3ce86f0c571 tempest-AttachVolumeShelveTestJSON-1172915835 tempest-AttachVolumeShelveTestJSON-1172915835-project] 10.222.0.62 "GET /v2.0/ports?device_id=85ea3d72-6c17-4ea2-82b7-90cce01633bd HTTP/1.1" status: 200 len: 943 time: 0.0730164 Nov 23 19:36:23.846258 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-70a20f23-c384-4195-8864-74cbbd3ee135 req-66aba672-9f07-4536-8e18-ca156399d795 tempest-AttachVolumeShelveTestJSON-1172915835 tempest-AttachVolumeShelveTestJSON-1172915835-project] 10.222.0.62 "GET /v2.0/security-groups?id=f1ca24d9-0a31-470d-a1d5-fa7059df0141&fields=id&fields=name HTTP/1.1" status: 200 len: 311 time: 0.0540328 Nov 23 19:36:24.230884 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-488fd819-25d4-4924-a4d8-04b519a24a0e req-9bd15c25-f46e-488d-b59e-3a0d9349d495 tempest-TestVolumeBootPattern-147141705 tempest-TestVolumeBootPattern-147141705-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102993) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:36:24.232362 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-488fd819-25d4-4924-a4d8-04b519a24a0e req-9bd15c25-f46e-488d-b59e-3a0d9349d495 tempest-TestVolumeBootPattern-147141705 tempest-TestVolumeBootPattern-147141705-project] 10.222.0.62 "GET /v2.0/ports?device_id=4ee0b7a3-f787-4a7c-816a-71f3a99b7193 HTTP/1.1" status: 200 len: 932 time: 0.0529463 Nov 23 19:36:24.286081 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-488fd819-25d4-4924-a4d8-04b519a24a0e req-3187668c-b15d-4912-ac53-ad64972c2ef8 tempest-TestVolumeBootPattern-147141705 tempest-TestVolumeBootPattern-147141705-project] 10.222.0.62 "GET /v2.0/security-groups?id=a6e2b133-1a9b-4dde-a188-1ce8bcdb7b5c&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0469134 Nov 23 19:36:24.985022 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f46acde7-203f-48e3-a032-a89351919d99 req-cb3cf17b-434f-4f26-94f1-be544d975099 tempest-AttachVolumeShelveTestJSON-1172915835 tempest-AttachVolumeShelveTestJSON-1172915835-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102992) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:36:24.993888 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-f46acde7-203f-48e3-a032-a89351919d99 req-cb3cf17b-434f-4f26-94f1-be544d975099 tempest-AttachVolumeShelveTestJSON-1172915835 tempest-AttachVolumeShelveTestJSON-1172915835-project] 10.222.0.62 "GET /v2.0/ports?device_id=85ea3d72-6c17-4ea2-82b7-90cce01633bd HTTP/1.1" status: 200 len: 943 time: 0.0662098 Nov 23 19:36:25.062382 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-f46acde7-203f-48e3-a032-a89351919d99 req-9e02c363-2c80-4e60-b7c2-85ed084baaab tempest-AttachVolumeShelveTestJSON-1172915835 tempest-AttachVolumeShelveTestJSON-1172915835-project] 10.222.0.62 "GET /v2.0/security-groups?id=f1ca24d9-0a31-470d-a1d5-fa7059df0141&fields=id&fields=name HTTP/1.1" status: 200 len: 311 time: 0.0665727 Nov 23 19:36:25.506027 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-07dddb6e-8f0e-429d-a27c-3d8ba1d41fd9 req-b7668e20-0915-4ac5-a985-a61efab49bd8 tempest-TestVolumeBootPattern-147141705 tempest-TestVolumeBootPattern-147141705-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102993) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:36:25.513926 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-07dddb6e-8f0e-429d-a27c-3d8ba1d41fd9 req-b7668e20-0915-4ac5-a985-a61efab49bd8 tempest-TestVolumeBootPattern-147141705 tempest-TestVolumeBootPattern-147141705-project] 10.222.0.62 "GET /v2.0/ports?device_id=4ee0b7a3-f787-4a7c-816a-71f3a99b7193 HTTP/1.1" status: 200 len: 932 time: 0.1007061 Nov 23 19:36:25.582611 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-07dddb6e-8f0e-429d-a27c-3d8ba1d41fd9 req-04940e9d-fe9b-4153-bf7a-adf9f0062353 tempest-TestVolumeBootPattern-147141705 tempest-TestVolumeBootPattern-147141705-project] 10.222.0.62 "GET /v2.0/security-groups?id=a6e2b133-1a9b-4dde-a188-1ce8bcdb7b5c&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0674644 Nov 23 19:36:26.205186 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2f1ed2ce-5aab-4b9b-a060-519f450a3a56 req-1ff84e14-71e4-4c55-8826-a4043b7d27de tempest-AttachVolumeShelveTestJSON-1172915835 tempest-AttachVolumeShelveTestJSON-1172915835-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102992) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:36:26.207615 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-2f1ed2ce-5aab-4b9b-a060-519f450a3a56 req-1ff84e14-71e4-4c55-8826-a4043b7d27de tempest-AttachVolumeShelveTestJSON-1172915835 tempest-AttachVolumeShelveTestJSON-1172915835-project] 10.222.0.62 "GET /v2.0/ports?device_id=85ea3d72-6c17-4ea2-82b7-90cce01633bd HTTP/1.1" status: 200 len: 943 time: 0.0619643 Nov 23 19:36:26.270803 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-2f1ed2ce-5aab-4b9b-a060-519f450a3a56 req-cec81fae-d3ed-4097-96cb-6c1d46e1c5c0 tempest-AttachVolumeShelveTestJSON-1172915835 tempest-AttachVolumeShelveTestJSON-1172915835-project] 10.222.0.62 "GET /v2.0/security-groups?id=f1ca24d9-0a31-470d-a1d5-fa7059df0141&fields=id&fields=name HTTP/1.1" status: 200 len: 311 time: 0.0556061 Nov 23 19:36:26.746423 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e478343b-6886-4131-97d0-284f5f913d31 req-b26c4bc6-3a1b-4c0a-8a24-5ec822537e4e tempest-TestVolumeBootPattern-147141705 tempest-TestVolumeBootPattern-147141705-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102992) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:36:26.754798 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-e478343b-6886-4131-97d0-284f5f913d31 req-b26c4bc6-3a1b-4c0a-8a24-5ec822537e4e tempest-TestVolumeBootPattern-147141705 tempest-TestVolumeBootPattern-147141705-project] 10.222.0.62 "GET /v2.0/ports?device_id=4ee0b7a3-f787-4a7c-816a-71f3a99b7193 HTTP/1.1" status: 200 len: 932 time: 0.0842886 Nov 23 19:36:26.833491 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-e478343b-6886-4131-97d0-284f5f913d31 req-8abe05e1-5e66-4d17-ac93-32f1db5f844d tempest-TestVolumeBootPattern-147141705 tempest-TestVolumeBootPattern-147141705-project] 10.222.0.62 "GET /v2.0/security-groups?id=a6e2b133-1a9b-4dde-a188-1ce8bcdb7b5c&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0715988 Nov 23 19:36:26.978507 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3470de1a-e725-4c23-86c4-d58138ebb881 req-b45c3aae-812f-4eef-8f41-ede3856809fb tempest-ServerRescueNegativeTestJSON-1447477341 tempest-ServerRescueNegativeTestJSON-1447477341-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102993) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:36:26.986335 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-3470de1a-e725-4c23-86c4-d58138ebb881 req-b45c3aae-812f-4eef-8f41-ede3856809fb tempest-ServerRescueNegativeTestJSON-1447477341 tempest-ServerRescueNegativeTestJSON-1447477341-project] 10.222.0.62 "GET /v2.0/ports?device_id=90cb32bd-c375-400a-b79a-97fc61e2a3a3 HTTP/1.1" status: 200 len: 945 time: 0.0658708 Nov 23 19:36:27.050727 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-3470de1a-e725-4c23-86c4-d58138ebb881 req-2c35a87f-2130-4915-ab83-f14da9c7a1ab tempest-ServerRescueNegativeTestJSON-1447477341 tempest-ServerRescueNegativeTestJSON-1447477341-project] 10.222.0.62 "GET /v2.0/security-groups?id=62a09434-acf0-424f-9001-2c3a78119364&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0584950 Nov 23 19:36:27.455192 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4708f6df-6ec8-4ff5-a16b-3c6bb6e39ff0 req-b0a4b8a7-c10c-46a9-b641-1bf8f57baded tempest-AttachVolumeShelveTestJSON-1172915835 tempest-AttachVolumeShelveTestJSON-1172915835-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102992) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:36:27.458305 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-4708f6df-6ec8-4ff5-a16b-3c6bb6e39ff0 req-b0a4b8a7-c10c-46a9-b641-1bf8f57baded tempest-AttachVolumeShelveTestJSON-1172915835 tempest-AttachVolumeShelveTestJSON-1172915835-project] 10.222.0.62 "GET /v2.0/ports?device_id=85ea3d72-6c17-4ea2-82b7-90cce01633bd HTTP/1.1" status: 200 len: 943 time: 0.0742519 Nov 23 19:36:27.522277 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-4708f6df-6ec8-4ff5-a16b-3c6bb6e39ff0 req-be82ce88-2106-47a3-bc14-cf41d49bd764 tempest-AttachVolumeShelveTestJSON-1172915835 tempest-AttachVolumeShelveTestJSON-1172915835-project] 10.222.0.62 "GET /v2.0/security-groups?id=f1ca24d9-0a31-470d-a1d5-fa7059df0141&fields=id&fields=name HTTP/1.1" status: 200 len: 311 time: 0.0570521 Nov 23 19:36:27.958057 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-349c56bc-e9e8-49da-8d2b-6a34db1bfab8 req-ab043921-e7a0-4c4d-92fc-c6d143816da2 tempest-TestVolumeBootPattern-147141705 tempest-TestVolumeBootPattern-147141705-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102993) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:36:27.959583 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-349c56bc-e9e8-49da-8d2b-6a34db1bfab8 req-ab043921-e7a0-4c4d-92fc-c6d143816da2 tempest-TestVolumeBootPattern-147141705 tempest-TestVolumeBootPattern-147141705-project] 10.222.0.62 "GET /v2.0/ports?device_id=4ee0b7a3-f787-4a7c-816a-71f3a99b7193 HTTP/1.1" status: 200 len: 932 time: 0.0556483 Nov 23 19:36:28.009393 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-349c56bc-e9e8-49da-8d2b-6a34db1bfab8 req-298977dd-848a-4072-a362-63cdd261c7b9 tempest-TestVolumeBootPattern-147141705 tempest-TestVolumeBootPattern-147141705-project] 10.222.0.62 "GET /v2.0/security-groups?id=a6e2b133-1a9b-4dde-a188-1ce8bcdb7b5c&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0435975 Nov 23 19:36:28.186820 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-95bec456-f487-489d-b380-d644bb7c02e3 req-08229b80-f63a-4782-9872-0cba1227cb17 tempest-ServerRescueNegativeTestJSON-1447477341 tempest-ServerRescueNegativeTestJSON-1447477341-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102992) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:36:28.188288 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-95bec456-f487-489d-b380-d644bb7c02e3 req-08229b80-f63a-4782-9872-0cba1227cb17 tempest-ServerRescueNegativeTestJSON-1447477341 tempest-ServerRescueNegativeTestJSON-1447477341-project] 10.222.0.62 "GET /v2.0/ports?device_id=90cb32bd-c375-400a-b79a-97fc61e2a3a3 HTTP/1.1" status: 200 len: 945 time: 0.0531428 Nov 23 19:36:28.239760 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-95bec456-f487-489d-b380-d644bb7c02e3 req-739737d6-4f10-48dc-98e2-c2ccbe07e41e tempest-ServerRescueNegativeTestJSON-1447477341 tempest-ServerRescueNegativeTestJSON-1447477341-project] 10.222.0.62 "GET /v2.0/security-groups?id=62a09434-acf0-424f-9001-2c3a78119364&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0446377 Nov 23 19:36:28.668946 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0edbf2db-068e-405c-a380-3238288fd341 req-b01e679b-d372-4367-8026-1d964de47f2b tempest-AttachVolumeShelveTestJSON-1172915835 tempest-AttachVolumeShelveTestJSON-1172915835-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102993) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:36:28.670401 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-0edbf2db-068e-405c-a380-3238288fd341 req-b01e679b-d372-4367-8026-1d964de47f2b tempest-AttachVolumeShelveTestJSON-1172915835 tempest-AttachVolumeShelveTestJSON-1172915835-project] 10.222.0.62 "GET /v2.0/ports?device_id=85ea3d72-6c17-4ea2-82b7-90cce01633bd HTTP/1.1" status: 200 len: 943 time: 0.0571587 Nov 23 19:36:28.720006 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-0edbf2db-068e-405c-a380-3238288fd341 req-3fecd7c4-1737-4138-b9c2-7014966640d3 tempest-AttachVolumeShelveTestJSON-1172915835 tempest-AttachVolumeShelveTestJSON-1172915835-project] 10.222.0.62 "GET /v2.0/security-groups?id=f1ca24d9-0a31-470d-a1d5-fa7059df0141&fields=id&fields=name HTTP/1.1" status: 200 len: 311 time: 0.0417514 Nov 23 19:36:29.028408 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron_lib.callbacks.manager [None req-4bf48ff4-ecfb-4168-8b63-249b8c6e9f04 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8783631323329', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7978582'] for agent, after_update {{(pid=102994) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:36:29.128443 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3f691223-2f03-4855-abda-061c99d3214a req-17105a78-8ea5-4d99-a79a-73291f3b380a tempest-TestVolumeBootPattern-147141705 tempest-TestVolumeBootPattern-147141705-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102992) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:36:29.129956 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-3f691223-2f03-4855-abda-061c99d3214a req-17105a78-8ea5-4d99-a79a-73291f3b380a tempest-TestVolumeBootPattern-147141705 tempest-TestVolumeBootPattern-147141705-project] 10.222.0.62 "GET /v2.0/ports?device_id=4ee0b7a3-f787-4a7c-816a-71f3a99b7193 HTTP/1.1" status: 200 len: 932 time: 0.0479972 Nov 23 19:36:29.185612 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-3f691223-2f03-4855-abda-061c99d3214a req-93df96ab-6c64-4911-9f10-9dc791af243e tempest-TestVolumeBootPattern-147141705 tempest-TestVolumeBootPattern-147141705-project] 10.222.0.62 "GET /v2.0/security-groups?id=a6e2b133-1a9b-4dde-a188-1ce8bcdb7b5c&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0495563 Nov 23 19:36:29.357093 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5782d008-b6ae-4e22-ba07-3c9f08de849f req-f5cd7247-0c74-4824-9fac-58dedabd85c9 tempest-ServerRescueNegativeTestJSON-1447477341 tempest-ServerRescueNegativeTestJSON-1447477341-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102993) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:36:29.358561 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-5782d008-b6ae-4e22-ba07-3c9f08de849f req-f5cd7247-0c74-4824-9fac-58dedabd85c9 tempest-ServerRescueNegativeTestJSON-1447477341 tempest-ServerRescueNegativeTestJSON-1447477341-project] 10.222.0.62 "GET /v2.0/ports?device_id=90cb32bd-c375-400a-b79a-97fc61e2a3a3 HTTP/1.1" status: 200 len: 945 time: 0.0504334 Nov 23 19:36:29.410450 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-5782d008-b6ae-4e22-ba07-3c9f08de849f req-e7ddcd7f-dd07-4b19-9e16-d7c1b556043a tempest-ServerRescueNegativeTestJSON-1447477341 tempest-ServerRescueNegativeTestJSON-1447477341-project] 10.222.0.62 "GET /v2.0/security-groups?id=62a09434-acf0-424f-9001-2c3a78119364&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0449653 Nov 23 19:36:29.841763 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8e07273d-13b0-4613-ab6e-65021d7bb94f req-7fac3445-fa2c-4f40-bfa7-5623177904df tempest-AttachVolumeShelveTestJSON-1172915835 tempest-AttachVolumeShelveTestJSON-1172915835-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102992) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:36:29.843233 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-8e07273d-13b0-4613-ab6e-65021d7bb94f req-7fac3445-fa2c-4f40-bfa7-5623177904df tempest-AttachVolumeShelveTestJSON-1172915835 tempest-AttachVolumeShelveTestJSON-1172915835-project] 10.222.0.62 "GET /v2.0/ports?device_id=85ea3d72-6c17-4ea2-82b7-90cce01633bd HTTP/1.1" status: 200 len: 943 time: 0.0518126 Nov 23 19:36:29.889158 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-8e07273d-13b0-4613-ab6e-65021d7bb94f req-e66e4866-5baf-4824-bc35-26c3b3dbb4e6 tempest-AttachVolumeShelveTestJSON-1172915835 tempest-AttachVolumeShelveTestJSON-1172915835-project] 10.222.0.62 "GET /v2.0/security-groups?id=f1ca24d9-0a31-470d-a1d5-fa7059df0141&fields=id&fields=name HTTP/1.1" status: 200 len: 311 time: 0.0399036 Nov 23 19:36:30.317397 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c6e6da35-0f05-47f1-91b6-db4d743b9717 req-b74f0261-7f51-4a7d-98b3-fb424d4eeee4 tempest-TestVolumeBootPattern-147141705 tempest-TestVolumeBootPattern-147141705-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102993) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:36:30.328403 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-c6e6da35-0f05-47f1-91b6-db4d743b9717 req-b74f0261-7f51-4a7d-98b3-fb424d4eeee4 tempest-TestVolumeBootPattern-147141705 tempest-TestVolumeBootPattern-147141705-project] 10.222.0.62 "GET /v2.0/ports?device_id=4ee0b7a3-f787-4a7c-816a-71f3a99b7193 HTTP/1.1" status: 200 len: 932 time: 0.0687771 Nov 23 19:36:30.430002 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-c6e6da35-0f05-47f1-91b6-db4d743b9717 req-25adedc3-4d43-4ab3-a6b2-282c61fa838b tempest-TestVolumeBootPattern-147141705 tempest-TestVolumeBootPattern-147141705-project] 10.222.0.62 "GET /v2.0/security-groups?id=a6e2b133-1a9b-4dde-a188-1ce8bcdb7b5c&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1001520 Nov 23 19:36:30.639600 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8f7551fb-9b6a-4c09-a3ee-57801f2fed1f req-92bb3f60-1822-4bb6-978c-2103c63b4234 tempest-ServerRescueNegativeTestJSON-1447477341 tempest-ServerRescueNegativeTestJSON-1447477341-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102992) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:36:30.641880 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-8f7551fb-9b6a-4c09-a3ee-57801f2fed1f req-92bb3f60-1822-4bb6-978c-2103c63b4234 tempest-ServerRescueNegativeTestJSON-1447477341 tempest-ServerRescueNegativeTestJSON-1447477341-project] 10.222.0.62 "GET /v2.0/ports?device_id=90cb32bd-c375-400a-b79a-97fc61e2a3a3 HTTP/1.1" status: 200 len: 945 time: 0.0962005 Nov 23 19:36:30.711243 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-8f7551fb-9b6a-4c09-a3ee-57801f2fed1f req-ca134faf-8250-45d4-b3f9-05091d270de0 tempest-ServerRescueNegativeTestJSON-1447477341 tempest-ServerRescueNegativeTestJSON-1447477341-project] 10.222.0.62 "GET /v2.0/security-groups?id=62a09434-acf0-424f-9001-2c3a78119364&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0584462 Nov 23 19:36:31.093003 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c5f382bf-a380-4515-ad3d-ee70ed5bb038 req-2a2df3a9-fc31-4d23-9221-d2819b184c7d tempest-AttachVolumeShelveTestJSON-1172915835 tempest-AttachVolumeShelveTestJSON-1172915835-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102993) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:36:31.094958 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-c5f382bf-a380-4515-ad3d-ee70ed5bb038 req-2a2df3a9-fc31-4d23-9221-d2819b184c7d tempest-AttachVolumeShelveTestJSON-1172915835 tempest-AttachVolumeShelveTestJSON-1172915835-project] 10.222.0.62 "GET /v2.0/ports?device_id=85ea3d72-6c17-4ea2-82b7-90cce01633bd HTTP/1.1" status: 200 len: 943 time: 0.0905316 Nov 23 19:36:31.211153 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-c5f382bf-a380-4515-ad3d-ee70ed5bb038 req-eee3ebb2-9c28-47a9-8b19-095aee061499 tempest-AttachVolumeShelveTestJSON-1172915835 tempest-AttachVolumeShelveTestJSON-1172915835-project] 10.222.0.62 "GET /v2.0/security-groups?id=f1ca24d9-0a31-470d-a1d5-fa7059df0141&fields=id&fields=name HTTP/1.1" status: 200 len: 311 time: 0.0983915 Nov 23 19:36:31.606629 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-47b8546d-4e0d-4be4-9404-0eeb83cf28a6 req-54a1ff16-ec48-47ae-8012-e2f45e847a5c tempest-TestVolumeBootPattern-147141705 tempest-TestVolumeBootPattern-147141705-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102992) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:36:31.612584 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-47b8546d-4e0d-4be4-9404-0eeb83cf28a6 req-54a1ff16-ec48-47ae-8012-e2f45e847a5c tempest-TestVolumeBootPattern-147141705 tempest-TestVolumeBootPattern-147141705-project] 10.222.0.62 "GET /v2.0/ports?device_id=4ee0b7a3-f787-4a7c-816a-71f3a99b7193 HTTP/1.1" status: 200 len: 932 time: 0.0859396 Nov 23 19:36:31.728018 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-47b8546d-4e0d-4be4-9404-0eeb83cf28a6 req-8edfd874-adaa-45ef-8ee3-8a545ef42f36 tempest-TestVolumeBootPattern-147141705 tempest-TestVolumeBootPattern-147141705-project] 10.222.0.62 "GET /v2.0/security-groups?id=a6e2b133-1a9b-4dde-a188-1ce8bcdb7b5c&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1057124 Nov 23 19:36:31.919371 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-970d2a07-f3be-4fd4-8cef-c7e7c3b26dd3 req-423941b7-4d45-4be2-9e65-b61acc456a96 tempest-ServerRescueNegativeTestJSON-1447477341 tempest-ServerRescueNegativeTestJSON-1447477341-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102993) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:36:31.927957 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-970d2a07-f3be-4fd4-8cef-c7e7c3b26dd3 req-423941b7-4d45-4be2-9e65-b61acc456a96 tempest-ServerRescueNegativeTestJSON-1447477341 tempest-ServerRescueNegativeTestJSON-1447477341-project] 10.222.0.62 "GET /v2.0/ports?device_id=90cb32bd-c375-400a-b79a-97fc61e2a3a3 HTTP/1.1" status: 200 len: 945 time: 0.1005890 Nov 23 19:36:32.134801 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-970d2a07-f3be-4fd4-8cef-c7e7c3b26dd3 req-c66dd109-bd81-49b7-9356-b2dbc05e0e54 tempest-ServerRescueNegativeTestJSON-1447477341 tempest-ServerRescueNegativeTestJSON-1447477341-project] 10.222.0.62 "GET /v2.0/security-groups?id=62a09434-acf0-424f-9001-2c3a78119364&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2010136 Nov 23 19:36:32.360662 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-80f16601-d02c-4889-80e2-fd258bac5769 req-b8dfec13-a142-4379-99eb-9d5ae3893c17 tempest-AttachVolumeShelveTestJSON-1172915835 tempest-AttachVolumeShelveTestJSON-1172915835-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102992) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:36:32.362888 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-80f16601-d02c-4889-80e2-fd258bac5769 req-b8dfec13-a142-4379-99eb-9d5ae3893c17 tempest-AttachVolumeShelveTestJSON-1172915835 tempest-AttachVolumeShelveTestJSON-1172915835-project] 10.222.0.62 "GET /v2.0/ports?device_id=85ea3d72-6c17-4ea2-82b7-90cce01633bd HTTP/1.1" status: 200 len: 943 time: 0.0529962 Nov 23 19:36:32.412858 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-80f16601-d02c-4889-80e2-fd258bac5769 req-498f0131-b7c9-4ee3-949f-525ec06ebdcd tempest-AttachVolumeShelveTestJSON-1172915835 tempest-AttachVolumeShelveTestJSON-1172915835-project] 10.222.0.62 "GET /v2.0/security-groups?id=f1ca24d9-0a31-470d-a1d5-fa7059df0141&fields=id&fields=name HTTP/1.1" status: 200 len: 311 time: 0.0439243 Nov 23 19:36:32.999276 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a73ef475-621e-4ff8-a3a0-8428b89e8ea9 req-7265985b-b02a-4678-8147-70db3407a5fc tempest-TestVolumeBootPattern-147141705 tempest-TestVolumeBootPattern-147141705-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102993) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:36:33.003157 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-a73ef475-621e-4ff8-a3a0-8428b89e8ea9 req-7265985b-b02a-4678-8147-70db3407a5fc tempest-TestVolumeBootPattern-147141705 tempest-TestVolumeBootPattern-147141705-project] 10.222.0.62 "GET /v2.0/ports?device_id=4ee0b7a3-f787-4a7c-816a-71f3a99b7193 HTTP/1.1" status: 200 len: 932 time: 0.0999393 Nov 23 19:36:33.074613 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-a73ef475-621e-4ff8-a3a0-8428b89e8ea9 req-2f25dea4-c455-4a7d-a431-35df4c832f04 tempest-TestVolumeBootPattern-147141705 tempest-TestVolumeBootPattern-147141705-project] 10.222.0.62 "GET /v2.0/security-groups?id=a6e2b133-1a9b-4dde-a188-1ce8bcdb7b5c&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0641756 Nov 23 19:36:33.445048 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8a42be9f-e673-4878-a1af-6708f88f6c36 req-053f5d67-178b-4ad9-8aad-406136bc49c4 tempest-ServerRescueNegativeTestJSON-1447477341 tempest-ServerRescueNegativeTestJSON-1447477341-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102992) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:36:33.452245 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-8a42be9f-e673-4878-a1af-6708f88f6c36 req-053f5d67-178b-4ad9-8aad-406136bc49c4 tempest-ServerRescueNegativeTestJSON-1447477341 tempest-ServerRescueNegativeTestJSON-1447477341-project] 10.222.0.62 "GET /v2.0/ports?device_id=90cb32bd-c375-400a-b79a-97fc61e2a3a3 HTTP/1.1" status: 200 len: 945 time: 0.1001937 Nov 23 19:36:33.560477 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-8a42be9f-e673-4878-a1af-6708f88f6c36 req-60895ecd-4e4b-4348-b971-ae8beab52a89 tempest-ServerRescueNegativeTestJSON-1447477341 tempest-ServerRescueNegativeTestJSON-1447477341-project] 10.222.0.62 "GET /v2.0/security-groups?id=62a09434-acf0-424f-9001-2c3a78119364&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0961199 Nov 23 19:36:33.635958 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a1d8a62c-386e-4531-bf93-ae6959e9b383 req-0ddb4dd9-910f-40c0-83b7-0e07d0c668cc tempest-AttachVolumeShelveTestJSON-1172915835 tempest-AttachVolumeShelveTestJSON-1172915835-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102993) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:36:33.646696 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-a1d8a62c-386e-4531-bf93-ae6959e9b383 req-0ddb4dd9-910f-40c0-83b7-0e07d0c668cc tempest-AttachVolumeShelveTestJSON-1172915835 tempest-AttachVolumeShelveTestJSON-1172915835-project] 10.222.0.62 "GET /v2.0/ports?device_id=85ea3d72-6c17-4ea2-82b7-90cce01633bd HTTP/1.1" status: 200 len: 943 time: 0.1027884 Nov 23 19:36:33.765720 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-a1d8a62c-386e-4531-bf93-ae6959e9b383 req-2e470849-4cb3-4e82-86ed-d8686677acbb tempest-AttachVolumeShelveTestJSON-1172915835 tempest-AttachVolumeShelveTestJSON-1172915835-project] 10.222.0.62 "GET /v2.0/security-groups?id=f1ca24d9-0a31-470d-a1d5-fa7059df0141&fields=id&fields=name HTTP/1.1" status: 200 len: 311 time: 0.1178994 Nov 23 19:36:34.393150 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a9f23f2d-0b82-43f3-b9e1-568cda62da12 req-428de1f1-24e9-45b7-9a60-be52cd0fabee tempest-TestVolumeBootPattern-147141705 tempest-TestVolumeBootPattern-147141705-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102992) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:36:34.401184 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-a9f23f2d-0b82-43f3-b9e1-568cda62da12 req-428de1f1-24e9-45b7-9a60-be52cd0fabee tempest-TestVolumeBootPattern-147141705 tempest-TestVolumeBootPattern-147141705-project] 10.222.0.62 "GET /v2.0/ports?device_id=4ee0b7a3-f787-4a7c-816a-71f3a99b7193 HTTP/1.1" status: 200 len: 932 time: 0.1895697 Nov 23 19:36:34.504690 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-a9f23f2d-0b82-43f3-b9e1-568cda62da12 req-42040535-8a11-4ac1-980d-93b253cb8751 tempest-TestVolumeBootPattern-147141705 tempest-TestVolumeBootPattern-147141705-project] 10.222.0.62 "GET /v2.0/security-groups?id=a6e2b133-1a9b-4dde-a188-1ce8bcdb7b5c&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1019239 Nov 23 19:36:34.721853 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-064e219d-bb9a-4f58-b306-5dde3a9e6953 req-9531123b-66c9-4b37-b746-64e0fe6a4e21 tempest-ServerRescueNegativeTestJSON-1447477341 tempest-ServerRescueNegativeTestJSON-1447477341-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102993) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:36:34.731195 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-064e219d-bb9a-4f58-b306-5dde3a9e6953 req-9531123b-66c9-4b37-b746-64e0fe6a4e21 tempest-ServerRescueNegativeTestJSON-1447477341 tempest-ServerRescueNegativeTestJSON-1447477341-project] 10.222.0.62 "GET /v2.0/ports?device_id=90cb32bd-c375-400a-b79a-97fc61e2a3a3 HTTP/1.1" status: 200 len: 945 time: 0.0737989 Nov 23 19:36:34.783942 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-064e219d-bb9a-4f58-b306-5dde3a9e6953 req-65b90a5c-0472-4f32-922e-90955df04f40 tempest-ServerRescueNegativeTestJSON-1447477341 tempest-ServerRescueNegativeTestJSON-1447477341-project] 10.222.0.62 "GET /v2.0/security-groups?id=62a09434-acf0-424f-9001-2c3a78119364&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0507851 Nov 23 19:36:34.909792 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c77a147b-cdd7-4cfc-a93e-9d350edb9996 req-3a4eab5a-a8ee-45f2-87f1-9c088d738cab tempest-AttachVolumeShelveTestJSON-1172915835 tempest-AttachVolumeShelveTestJSON-1172915835-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102992) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:36:34.911665 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-c77a147b-cdd7-4cfc-a93e-9d350edb9996 req-3a4eab5a-a8ee-45f2-87f1-9c088d738cab tempest-AttachVolumeShelveTestJSON-1172915835 tempest-AttachVolumeShelveTestJSON-1172915835-project] 10.222.0.62 "GET /v2.0/ports?device_id=85ea3d72-6c17-4ea2-82b7-90cce01633bd HTTP/1.1" status: 200 len: 943 time: 0.0574422 Nov 23 19:36:35.024758 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-c77a147b-cdd7-4cfc-a93e-9d350edb9996 req-a88a8e25-e37d-4132-af39-821f94837259 tempest-AttachVolumeShelveTestJSON-1172915835 tempest-AttachVolumeShelveTestJSON-1172915835-project] 10.222.0.62 "GET /v2.0/security-groups?id=f1ca24d9-0a31-470d-a1d5-fa7059df0141&fields=id&fields=name HTTP/1.1" status: 200 len: 311 time: 0.0834279 Nov 23 19:36:35.670435 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2c8f86d5-7107-4794-8b04-2251a2675eb5 req-a4e71c9f-ba9f-4c1a-90f0-ff94ab38fc14 tempest-TestVolumeBootPattern-147141705 tempest-TestVolumeBootPattern-147141705-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102992) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:36:35.674434 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-2c8f86d5-7107-4794-8b04-2251a2675eb5 req-a4e71c9f-ba9f-4c1a-90f0-ff94ab38fc14 tempest-TestVolumeBootPattern-147141705 tempest-TestVolumeBootPattern-147141705-project] 10.222.0.62 "GET /v2.0/ports?device_id=4ee0b7a3-f787-4a7c-816a-71f3a99b7193 HTTP/1.1" status: 200 len: 932 time: 0.0836880 Nov 23 19:36:35.730163 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-2c8f86d5-7107-4794-8b04-2251a2675eb5 req-67afb8ab-3329-4e72-afb1-4201ccf17b0b tempest-TestVolumeBootPattern-147141705 tempest-TestVolumeBootPattern-147141705-project] 10.222.0.62 "GET /v2.0/security-groups?id=a6e2b133-1a9b-4dde-a188-1ce8bcdb7b5c&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0512040 Nov 23 19:36:35.932145 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-735e5077-c130-4406-a6b3-85fad6d751d2 req-5ac03ec8-bf56-42b8-bb69-0ebc662b2b0c tempest-ServerRescueNegativeTestJSON-1447477341 tempest-ServerRescueNegativeTestJSON-1447477341-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102993) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:36:35.933921 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-735e5077-c130-4406-a6b3-85fad6d751d2 req-5ac03ec8-bf56-42b8-bb69-0ebc662b2b0c tempest-ServerRescueNegativeTestJSON-1447477341 tempest-ServerRescueNegativeTestJSON-1447477341-project] 10.222.0.62 "GET /v2.0/ports?device_id=90cb32bd-c375-400a-b79a-97fc61e2a3a3 HTTP/1.1" status: 200 len: 945 time: 0.0590680 Nov 23 19:36:35.991412 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-735e5077-c130-4406-a6b3-85fad6d751d2 req-e41e2fc3-9568-4f1a-99c7-7344371ad87f tempest-ServerRescueNegativeTestJSON-1447477341 tempest-ServerRescueNegativeTestJSON-1447477341-project] 10.222.0.62 "GET /v2.0/security-groups?id=62a09434-acf0-424f-9001-2c3a78119364&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0496085 Nov 23 19:36:36.154019 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-14ee851f-ff75-4ff7-ab26-eb2b7901f788 req-6974da6d-c189-4fe5-a0d3-222eaeceec85 tempest-AttachVolumeShelveTestJSON-1172915835 tempest-AttachVolumeShelveTestJSON-1172915835-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102992) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:36:36.155407 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-14ee851f-ff75-4ff7-ab26-eb2b7901f788 req-6974da6d-c189-4fe5-a0d3-222eaeceec85 tempest-AttachVolumeShelveTestJSON-1172915835 tempest-AttachVolumeShelveTestJSON-1172915835-project] 10.222.0.62 "GET /v2.0/ports?device_id=85ea3d72-6c17-4ea2-82b7-90cce01633bd HTTP/1.1" status: 200 len: 943 time: 0.0508459 Nov 23 19:36:36.206729 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-14ee851f-ff75-4ff7-ab26-eb2b7901f788 req-5bf70ca6-7cdb-49b4-8014-e3d9abc0ee12 tempest-AttachVolumeShelveTestJSON-1172915835 tempest-AttachVolumeShelveTestJSON-1172915835-project] 10.222.0.62 "GET /v2.0/security-groups?id=f1ca24d9-0a31-470d-a1d5-fa7059df0141&fields=id&fields=name HTTP/1.1" status: 200 len: 311 time: 0.0442550 Nov 23 19:36:36.862513 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-38d4c118-71b2-4b23-8646-e0152edbc81a req-813b8378-c886-4ecd-9c04-ca04594ba06f tempest-TestVolumeBootPattern-147141705 tempest-TestVolumeBootPattern-147141705-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102993) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:36:36.864005 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-38d4c118-71b2-4b23-8646-e0152edbc81a req-813b8378-c886-4ecd-9c04-ca04594ba06f tempest-TestVolumeBootPattern-147141705 tempest-TestVolumeBootPattern-147141705-project] 10.222.0.62 "GET /v2.0/ports?device_id=4ee0b7a3-f787-4a7c-816a-71f3a99b7193 HTTP/1.1" status: 200 len: 932 time: 0.0575345 Nov 23 19:36:36.917792 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-38d4c118-71b2-4b23-8646-e0152edbc81a req-9c393786-bfad-41e5-9b10-2a19038cdbe8 tempest-TestVolumeBootPattern-147141705 tempest-TestVolumeBootPattern-147141705-project] 10.222.0.62 "GET /v2.0/security-groups?id=a6e2b133-1a9b-4dde-a188-1ce8bcdb7b5c&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0475972 Nov 23 19:36:37.111386 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a54086b0-88b5-424a-993f-03de2bd9abad req-a0d7bc76-66a1-45e5-8fe0-57fb9c60cd2d tempest-ServerRescueNegativeTestJSON-1447477341 tempest-ServerRescueNegativeTestJSON-1447477341-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102992) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:36:37.112877 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-a54086b0-88b5-424a-993f-03de2bd9abad req-a0d7bc76-66a1-45e5-8fe0-57fb9c60cd2d tempest-ServerRescueNegativeTestJSON-1447477341 tempest-ServerRescueNegativeTestJSON-1447477341-project] 10.222.0.62 "GET /v2.0/ports?device_id=90cb32bd-c375-400a-b79a-97fc61e2a3a3 HTTP/1.1" status: 200 len: 945 time: 0.0491803 Nov 23 19:36:37.163230 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-a54086b0-88b5-424a-993f-03de2bd9abad req-5656584a-c46d-4838-a796-c1bc712959be tempest-ServerRescueNegativeTestJSON-1447477341 tempest-ServerRescueNegativeTestJSON-1447477341-project] 10.222.0.62 "GET /v2.0/security-groups?id=62a09434-acf0-424f-9001-2c3a78119364&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0443859 Nov 23 19:36:37.341299 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-987eaa62-ba8c-49f1-a3ee-e040f5b99fc4 req-5e2c5d5d-1246-4292-9442-e8f6ed52a395 tempest-AttachVolumeShelveTestJSON-1172915835 tempest-AttachVolumeShelveTestJSON-1172915835-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102993) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:36:37.349302 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-987eaa62-ba8c-49f1-a3ee-e040f5b99fc4 req-5e2c5d5d-1246-4292-9442-e8f6ed52a395 tempest-AttachVolumeShelveTestJSON-1172915835 tempest-AttachVolumeShelveTestJSON-1172915835-project] 10.222.0.62 "GET /v2.0/ports?device_id=85ea3d72-6c17-4ea2-82b7-90cce01633bd HTTP/1.1" status: 200 len: 943 time: 0.0626674 Nov 23 19:36:37.349302 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.api.v2.base [req-2cda6938-7733-4788-8ba8-c2c78648a38f req-764d15a1-6cfb-48bc-97f0-a7428adc1acb service neutron] Request body: {'port': {'device_id': '4ee0b7a3-f787-4a7c-816a-71f3a99b7193', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-81901'}} {{(pid=102993) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 23 19:36:37.432770 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [req-2cda6938-7733-4788-8ba8-c2c78648a38f req-764d15a1-6cfb-48bc-97f0-a7428adc1acb service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7921281'] for port, before_update {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:36:37.447549 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-987eaa62-ba8c-49f1-a3ee-e040f5b99fc4 req-44bb74b8-d3ff-4e3f-a7a6-25d174196256 tempest-AttachVolumeShelveTestJSON-1172915835 tempest-AttachVolumeShelveTestJSON-1172915835-project] 10.222.0.62 "GET /v2.0/security-groups?id=f1ca24d9-0a31-470d-a1d5-fa7059df0141&fields=id&fields=name HTTP/1.1" status: 200 len: 311 time: 0.0953619 Nov 23 19:36:37.700656 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.notifiers.nova [req-2cda6938-7733-4788-8ba8-c2c78648a38f req-764d15a1-6cfb-48bc-97f0-a7428adc1acb service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 1a0a2345-c03d-4159-89a8-35402d8d2448 {{(pid=102993) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 23 19:36:37.710282 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [req-2cda6938-7733-4788-8ba8-c2c78648a38f req-764d15a1-6cfb-48bc-97f0-a7428adc1acb service neutron] Publish callbacks [] for port, precommit_update {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:36:37.723522 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.db.provisioning_blocks [req-2cda6938-7733-4788-8ba8-c2c78648a38f req-764d15a1-6cfb-48bc-97f0-a7428adc1acb service neutron] Transition to ACTIVE for port object 1a0a2345-c03d-4159-89a8-35402d8d2448 will not be triggered until provisioned by entity L2. {{(pid=102993) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 23 19:36:37.787553 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [req-2cda6938-7733-4788-8ba8-c2c78648a38f req-764d15a1-6cfb-48bc-97f0-a7428adc1acb service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7918660', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-15067', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560168', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8783631423946', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8783631008732', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8783631008750', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-17257505'] for port, after_update {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:36:38.092459 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-651c179e-5852-4287-990b-91bc00db27d2 req-8fc9d34c-4827-4da1-bdd5-a81ae6fa1d55 tempest-TestVolumeBootPattern-147141705 tempest-TestVolumeBootPattern-147141705-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102992) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:36:38.100991 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-651c179e-5852-4287-990b-91bc00db27d2 req-8fc9d34c-4827-4da1-bdd5-a81ae6fa1d55 tempest-TestVolumeBootPattern-147141705 tempest-TestVolumeBootPattern-147141705-project] 10.222.0.62 "GET /v2.0/ports?device_id=4ee0b7a3-f787-4a7c-816a-71f3a99b7193 HTTP/1.1" status: 200 len: 944 time: 0.0969489 Nov 23 19:36:38.112023 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-764d15a1-6cfb-48bc-97f0-a7428adc1acb service neutron] Pushing event updated for resources: {'Port': ['ID=1a0a2345-c03d-4159-89a8-35402d8d2448,revision_number=2']} {{(pid=102993) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 23 19:36:38.176411 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.plugins.ml2.managers [req-2cda6938-7733-4788-8ba8-c2c78648a38f req-764d15a1-6cfb-48bc-97f0-a7428adc1acb service neutron] Attempting to bind port 1a0a2345-c03d-4159-89a8-35402d8d2448 on host hv-cinder-81901 for vnic_type normal with profile {{(pid=102993) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 23 19:36:38.176760 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.plugins.ml2.managers [req-2cda6938-7733-4788-8ba8-c2c78648a38f req-764d15a1-6cfb-48bc-97f0-a7428adc1acb service neutron] Attempting to bind port 1a0a2345-c03d-4159-89a8-35402d8d2448 by drivers openvswitch,hyperv on host hv-cinder-81901 at level 0 using segments [{'id': '56316385-5b81-43f5-84db-b708b46f04eb', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 800, 'network_id': '226a519f-5f3e-4d80-bb8a-0e9fc4f64828'}] {{(pid=102993) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 23 19:36:38.177227 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-2cda6938-7733-4788-8ba8-c2c78648a38f req-764d15a1-6cfb-48bc-97f0-a7428adc1acb service neutron] Attempting to bind port 1a0a2345-c03d-4159-89a8-35402d8d2448 on network 226a519f-5f3e-4d80-bb8a-0e9fc4f64828 {{(pid=102993) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 23 19:36:38.181853 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-2cda6938-7733-4788-8ba8-c2c78648a38f req-764d15a1-6cfb-48bc-97f0-a7428adc1acb service neutron] Port 1a0a2345-c03d-4159-89a8-35402d8d2448 on network 226a519f-5f3e-4d80-bb8a-0e9fc4f64828 not bound, no agent of type Open vSwitch agent registered on host hv-cinder-81901 {{(pid=102993) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Nov 23 19:36:38.182179 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-2cda6938-7733-4788-8ba8-c2c78648a38f req-764d15a1-6cfb-48bc-97f0-a7428adc1acb service neutron] Attempting to bind port 1a0a2345-c03d-4159-89a8-35402d8d2448 on network 226a519f-5f3e-4d80-bb8a-0e9fc4f64828 {{(pid=102993) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 23 19:36:38.192703 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-651c179e-5852-4287-990b-91bc00db27d2 req-933fb8a7-b5f4-442f-9e1c-5b5f09fe11a7 tempest-TestVolumeBootPattern-147141705 tempest-TestVolumeBootPattern-147141705-project] 10.222.0.62 "GET /v2.0/security-groups?id=a6e2b133-1a9b-4dde-a188-1ce8bcdb7b5c&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0867550 Nov 23 19:36:38.203354 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-2cda6938-7733-4788-8ba8-c2c78648a38f req-764d15a1-6cfb-48bc-97f0-a7428adc1acb service neutron] Checking agent: {'id': '14e5d049-431d-466a-8d1c-264e5129d376', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-81901', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 23, 19, 31, 29), 'started_at': datetime.datetime(2021, 11, 23, 19, 31, 29), 'heartbeat_timestamp': datetime.datetime(2021, 11, 23, 19, 36, 29), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=102993) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 23 19:36:38.209819 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-2cda6938-7733-4788-8ba8-c2c78648a38f req-764d15a1-6cfb-48bc-97f0-a7428adc1acb service neutron] Checking segment: {'id': '56316385-5b81-43f5-84db-b708b46f04eb', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 800, 'network_id': '226a519f-5f3e-4d80-bb8a-0e9fc4f64828'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102993) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 23 19:36:38.209819 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-2cda6938-7733-4788-8ba8-c2c78648a38f req-764d15a1-6cfb-48bc-97f0-a7428adc1acb service neutron] Bound using segment: {'id': '56316385-5b81-43f5-84db-b708b46f04eb', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 800, 'network_id': '226a519f-5f3e-4d80-bb8a-0e9fc4f64828'} {{(pid=102993) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 23 19:36:38.209819 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.plugins.ml2.managers [req-2cda6938-7733-4788-8ba8-c2c78648a38f req-764d15a1-6cfb-48bc-97f0-a7428adc1acb service neutron] Bound port: 1a0a2345-c03d-4159-89a8-35402d8d2448, host: hv-cinder-81901, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '56316385-5b81-43f5-84db-b708b46f04eb', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 800, 'network_id': '226a519f-5f3e-4d80-bb8a-0e9fc4f64828'}}] {{(pid=102993) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 23 19:36:38.209819 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [req-2cda6938-7733-4788-8ba8-c2c78648a38f req-764d15a1-6cfb-48bc-97f0-a7428adc1acb service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7921281'] for port, before_update {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:36:38.305769 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.plugins.ml2.db [req-2cda6938-7733-4788-8ba8-c2c78648a38f req-764d15a1-6cfb-48bc-97f0-a7428adc1acb service neutron] For port 1a0a2345-c03d-4159-89a8-35402d8d2448, host hv-cinder-81901, cleared binding levels {{(pid=102993) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 23 19:36:38.308781 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.plugins.ml2.db [req-2cda6938-7733-4788-8ba8-c2c78648a38f req-764d15a1-6cfb-48bc-97f0-a7428adc1acb service neutron] For port 1a0a2345-c03d-4159-89a8-35402d8d2448, host hv-cinder-81901, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81901',level=0,port_id=1a0a2345-c03d-4159-89a8-35402d8d2448,segment=NetworkSegment(56316385-5b81-43f5-84db-b708b46f04eb),segment_id=56316385-5b81-43f5-84db-b708b46f04eb)] {{(pid=102993) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 23 19:36:38.324495 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cd01d7e6-a629-4ae8-b42c-407313d24579 req-97e2f7fc-6b4f-454a-9e16-5a5e66329373 tempest-ServerRescueNegativeTestJSON-1447477341 tempest-ServerRescueNegativeTestJSON-1447477341-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102993) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:36:38.328623 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-cd01d7e6-a629-4ae8-b42c-407313d24579 req-97e2f7fc-6b4f-454a-9e16-5a5e66329373 tempest-ServerRescueNegativeTestJSON-1447477341 tempest-ServerRescueNegativeTestJSON-1447477341-project] 10.222.0.62 "GET /v2.0/ports?device_id=90cb32bd-c375-400a-b79a-97fc61e2a3a3 HTTP/1.1" status: 200 len: 945 time: 0.0765874 Nov 23 19:36:38.373430 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-cd01d7e6-a629-4ae8-b42c-407313d24579 req-3c9495c0-89c4-4153-b46c-9e36b7d83ae4 tempest-ServerRescueNegativeTestJSON-1447477341 tempest-ServerRescueNegativeTestJSON-1447477341-project] 10.222.0.62 "GET /v2.0/security-groups?id=62a09434-acf0-424f-9001-2c3a78119364&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0410590 Nov 23 19:36:38.399989 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [req-2cda6938-7733-4788-8ba8-c2c78648a38f req-764d15a1-6cfb-48bc-97f0-a7428adc1acb service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7918660', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-15067', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560168', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8783631423946', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8783631008732', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8783631008750', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-17257505'] for port, after_update {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:36:38.444818 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2cda6938-7733-4788-8ba8-c2c78648a38f req-764d15a1-6cfb-48bc-97f0-a7428adc1acb service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102993) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:36:38.446239 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [req-2cda6938-7733-4788-8ba8-c2c78648a38f req-764d15a1-6cfb-48bc-97f0-a7428adc1acb service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-514902'] for port, before_response {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:36:38.447689 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-2cda6938-7733-4788-8ba8-c2c78648a38f req-764d15a1-6cfb-48bc-97f0-a7428adc1acb service neutron] 10.222.0.41 "PUT /v2.0/ports/1a0a2345-c03d-4159-89a8-35402d8d2448 HTTP/1.1" status: 200 len: 1094 time: 1.1038303 Nov 23 19:36:38.448136 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '4ee0b7a3-f787-4a7c-816a-71f3a99b7193', 'tag': '1a0a2345-c03d-4159-89a8-35402d8d2448'}] {{(pid=102993) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 23 19:36:38.451235 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.62/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}9b10b92acbee16fb695be1efeed0b68f7c36a5b215ec004a8d9d707fa3d35b2c" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-0bcadbff-9bd7-45b2-a38a-576257a8f99b" -d '{"events": [{"name": "network-changed", "server_uuid": "4ee0b7a3-f787-4a7c-816a-71f3a99b7193", "tag": "1a0a2345-c03d-4159-89a8-35402d8d2448"}]}' {{(pid=102993) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 23 19:36:38.491204 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-764d15a1-6cfb-48bc-97f0-a7428adc1acb service neutron] Pushing event updated for resources: {'Port': ['ID=1a0a2345-c03d-4159-89a8-35402d8d2448,revision_number=3']} {{(pid=102993) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 23 19:36:38.504738 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Tue, 23 Nov 2021 19:36:38 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-b3d70f05-1ad1-461a-8f79-9c64603fc1f9 x-openstack-request-id: req-b3d70f05-1ad1-461a-8f79-9c64603fc1f9 {{(pid=102993) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 23 19:36:38.505059 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "4ee0b7a3-f787-4a7c-816a-71f3a99b7193", "tag": "1a0a2345-c03d-4159-89a8-35402d8d2448", "status": "completed", "code": 200}]} {{(pid=102993) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 23 19:36:38.505313 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.62/compute/v2.1/os-server-external-events used request id req-b3d70f05-1ad1-461a-8f79-9c64603fc1f9 {{(pid=102993) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 23 19:36:38.505750 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '4ee0b7a3-f787-4a7c-816a-71f3a99b7193', 'tag': '1a0a2345-c03d-4159-89a8-35402d8d2448', 'status': 'completed', 'code': 200} Nov 23 19:36:38.632364 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1e1a0da4-9c4f-4381-b0b1-bfe0ffab5ad1 req-25933214-1227-49a1-8aa9-61e8f45b48bc tempest-AttachVolumeShelveTestJSON-1172915835 tempest-AttachVolumeShelveTestJSON-1172915835-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102993) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:36:38.633990 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-1e1a0da4-9c4f-4381-b0b1-bfe0ffab5ad1 req-25933214-1227-49a1-8aa9-61e8f45b48bc tempest-AttachVolumeShelveTestJSON-1172915835 tempest-AttachVolumeShelveTestJSON-1172915835-project] 10.222.0.62 "GET /v2.0/ports?device_id=85ea3d72-6c17-4ea2-82b7-90cce01633bd HTTP/1.1" status: 200 len: 943 time: 0.0948994 Nov 23 19:36:38.666884 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0bcadbff-9bd7-45b2-a38a-576257a8f99b req-ee6f7fd8-a7f7-489e-8eb8-f2b14bd49474 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102993) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:36:38.672963 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-0bcadbff-9bd7-45b2-a38a-576257a8f99b req-ee6f7fd8-a7f7-489e-8eb8-f2b14bd49474 service neutron] 10.222.0.41 "GET /v2.0/ports?tenant_id=257b0b2e531441b4bb745e99cfd799f3&device_id=4ee0b7a3-f787-4a7c-816a-71f3a99b7193 HTTP/1.1" status: 200 len: 1097 time: 0.0851896 Nov 23 19:36:38.724899 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-1e1a0da4-9c4f-4381-b0b1-bfe0ffab5ad1 req-93d58275-b02b-439e-976b-289f5c0a4556 tempest-AttachVolumeShelveTestJSON-1172915835 tempest-AttachVolumeShelveTestJSON-1172915835-project] 10.222.0.62 "GET /v2.0/security-groups?id=f1ca24d9-0a31-470d-a1d5-fa7059df0141&fields=id&fields=name HTTP/1.1" status: 200 len: 311 time: 0.0816522 Nov 23 19:36:38.792273 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0bcadbff-9bd7-45b2-a38a-576257a8f99b req-0d28f1c9-7dce-4a65-859d-01d8be39db18 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102993) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:36:38.793748 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-0bcadbff-9bd7-45b2-a38a-576257a8f99b req-0d28f1c9-7dce-4a65-859d-01d8be39db18 service neutron] 10.222.0.41 "GET /v2.0/networks?tenant_id=257b0b2e531441b4bb745e99cfd799f3&shared=False HTTP/1.1" status: 200 len: 911 time: 0.1149068 Nov 23 19:36:38.902401 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0bcadbff-9bd7-45b2-a38a-576257a8f99b req-307a16b9-fe8b-480d-a3e1-3ae01feba2e4 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102993) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:36:38.909178 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-0bcadbff-9bd7-45b2-a38a-576257a8f99b req-307a16b9-fe8b-480d-a3e1-3ae01feba2e4 service neutron] 10.222.0.41 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 870 time: 0.0999315 Nov 23 19:36:38.999977 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2cda6938-7733-4788-8ba8-c2c78648a38f req-21ecd4c6-89ba-4098-ac8c-f4a6ee64dbef service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102993) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:36:39.002068 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-2cda6938-7733-4788-8ba8-c2c78648a38f req-21ecd4c6-89ba-4098-ac8c-f4a6ee64dbef service neutron] 10.222.0.41 "GET /v2.0/ports?tenant_id=257b0b2e531441b4bb745e99cfd799f3&device_id=4ee0b7a3-f787-4a7c-816a-71f3a99b7193 HTTP/1.1" status: 200 len: 1097 time: 0.0440507 Nov 23 19:36:39.049007 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-2cda6938-7733-4788-8ba8-c2c78648a38f req-c806654d-a4f3-4772-ba15-c3707d79396a service neutron] 10.222.0.41 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.14&port_id=1a0a2345-c03d-4159-89a8-35402d8d2448 HTTP/1.1" status: 200 len: 217 time: 0.0368528 Nov 23 19:36:39.098790 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2cda6938-7733-4788-8ba8-c2c78648a38f req-86c81fdd-e56f-4535-9282-dcf988b93c2b service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102993) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:36:39.100133 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-2cda6938-7733-4788-8ba8-c2c78648a38f req-86c81fdd-e56f-4535-9282-dcf988b93c2b service neutron] 10.222.0.41 "GET /v2.0/subnets?id=88de785d-c540-4651-af1e-26f27ccaee3c HTTP/1.1" status: 200 len: 849 time: 0.0432596 Nov 23 19:36:39.147773 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2cda6938-7733-4788-8ba8-c2c78648a38f req-e7ac0e54-dd36-4274-a914-2520a8a2b876 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102993) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:36:39.149237 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-2cda6938-7733-4788-8ba8-c2c78648a38f req-e7ac0e54-dd36-4274-a914-2520a8a2b876 service neutron] 10.222.0.41 "GET /v2.0/ports?network_id=226a519f-5f3e-4d80-bb8a-0e9fc4f64828&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0406325 Nov 23 19:36:39.249083 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-2cda6938-7733-4788-8ba8-c2c78648a38f req-984938ce-4798-4d4c-9731-1a720ca63ba8 service neutron] 10.222.0.41 "GET /v2.0/networks/226a519f-5f3e-4d80-bb8a-0e9fc4f64828?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0882642 Nov 23 19:36:39.313246 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8ce17996-5578-40f3-9413-e0f4e66f6819 req-b934885a-de7b-4989-b01c-4d100bce166c tempest-TestVolumeBootPattern-147141705 tempest-TestVolumeBootPattern-147141705-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102992) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:36:39.315553 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-8ce17996-5578-40f3-9413-e0f4e66f6819 req-b934885a-de7b-4989-b01c-4d100bce166c tempest-TestVolumeBootPattern-147141705 tempest-TestVolumeBootPattern-147141705-project] 10.222.0.62 "GET /v2.0/ports?device_id=4ee0b7a3-f787-4a7c-816a-71f3a99b7193 HTTP/1.1" status: 200 len: 944 time: 0.0544055 Nov 23 19:36:39.368099 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-2cda6938-7733-4788-8ba8-c2c78648a38f req-9e970133-e584-4a0a-8a5f-688808f7ee88 service neutron] 10.222.0.41 "GET /v2.0/networks/226a519f-5f3e-4d80-bb8a-0e9fc4f64828?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1082096 Nov 23 19:36:39.372798 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-8ce17996-5578-40f3-9413-e0f4e66f6819 req-c529c7bd-4ead-484e-a90a-0ded0be32e25 tempest-TestVolumeBootPattern-147141705 tempest-TestVolumeBootPattern-147141705-project] 10.222.0.62 "GET /v2.0/security-groups?id=a6e2b133-1a9b-4dde-a188-1ce8bcdb7b5c&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0491960 Nov 23 19:36:39.497626 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b7498a59-492a-4625-aa08-befda1459bb5 req-65ec42ff-ab71-431f-a076-35dc48be9a11 tempest-ServerRescueNegativeTestJSON-1447477341 tempest-ServerRescueNegativeTestJSON-1447477341-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102993) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:36:39.499112 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-b7498a59-492a-4625-aa08-befda1459bb5 req-65ec42ff-ab71-431f-a076-35dc48be9a11 tempest-ServerRescueNegativeTestJSON-1447477341 tempest-ServerRescueNegativeTestJSON-1447477341-project] 10.222.0.62 "GET /v2.0/ports?device_id=90cb32bd-c375-400a-b79a-97fc61e2a3a3 HTTP/1.1" status: 200 len: 945 time: 0.0513368 Nov 23 19:36:39.553819 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-b7498a59-492a-4625-aa08-befda1459bb5 req-acd8399d-23dd-4683-965f-d7c4c375a8e2 tempest-ServerRescueNegativeTestJSON-1447477341 tempest-ServerRescueNegativeTestJSON-1447477341-project] 10.222.0.62 "GET /v2.0/security-groups?id=62a09434-acf0-424f-9001-2c3a78119364&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0486081 Nov 23 19:36:39.849708 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5e4f70a3-f717-41bc-a3fd-10dd595b6602 req-47732f68-1d8e-43b8-825a-f777cdb74586 tempest-AttachVolumeShelveTestJSON-1172915835 tempest-AttachVolumeShelveTestJSON-1172915835-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102993) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:36:39.851196 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-5e4f70a3-f717-41bc-a3fd-10dd595b6602 req-47732f68-1d8e-43b8-825a-f777cdb74586 tempest-AttachVolumeShelveTestJSON-1172915835 tempest-AttachVolumeShelveTestJSON-1172915835-project] 10.222.0.62 "GET /v2.0/ports?device_id=85ea3d72-6c17-4ea2-82b7-90cce01633bd HTTP/1.1" status: 200 len: 943 time: 0.0514765 Nov 23 19:36:39.899111 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-5e4f70a3-f717-41bc-a3fd-10dd595b6602 req-8a3f055d-347a-4616-a9f5-91aa49f74b1f tempest-AttachVolumeShelveTestJSON-1172915835 tempest-AttachVolumeShelveTestJSON-1172915835-project] 10.222.0.62 "GET /v2.0/security-groups?id=f1ca24d9-0a31-470d-a1d5-fa7059df0141&fields=id&fields=name HTTP/1.1" status: 200 len: 311 time: 0.0418169 Nov 23 19:36:40.145726 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-174b8bf0-92b8-497b-a669-996920270ea6 req-eaed78f5-18ed-4879-89a0-f03245895223 tempest-VolumesSnapshotTestJSON-97879810 tempest-VolumesSnapshotTestJSON-97879810-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102993) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:36:40.147249 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-174b8bf0-92b8-497b-a669-996920270ea6 req-eaed78f5-18ed-4879-89a0-f03245895223 tempest-VolumesSnapshotTestJSON-97879810 tempest-VolumesSnapshotTestJSON-97879810-project] 10.222.0.62 "GET /v2.0/ports?device_id=d8c269ba-e8f8-4705-a5a5-fbfbb498151f HTTP/1.1" status: 200 len: 945 time: 0.0482247 Nov 23 19:36:40.195109 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-174b8bf0-92b8-497b-a669-996920270ea6 req-fdc7a108-66bb-4e79-825e-e3eebf59a865 tempest-VolumesSnapshotTestJSON-97879810 tempest-VolumesSnapshotTestJSON-97879810-project] 10.222.0.62 "GET /v2.0/security-groups?id=2fd4bf42-f1cd-4ab5-94a3-e2347f7bb016&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0417366 Nov 23 19:36:40.376458 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.wsgi [-] (102993) accepted ('10.222.0.62', 47000) {{(pid=102993) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 23 19:36:40.489995 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-2a339514-24d8-4b52-8c4c-60dd4c3a3bbe admin admin] Publish callbacks [] for security_group, before_create {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:36:40.498473 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b7cd6997-9341-41bb-b944-b5bfbf4998f3 req-bdf6b088-27f9-4e93-b477-ea0ff624bbe5 tempest-TestVolumeBootPattern-147141705 tempest-TestVolumeBootPattern-147141705-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102992) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:36:40.500109 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-b7cd6997-9341-41bb-b944-b5bfbf4998f3 req-bdf6b088-27f9-4e93-b477-ea0ff624bbe5 tempest-TestVolumeBootPattern-147141705 tempest-TestVolumeBootPattern-147141705-project] 10.222.0.62 "GET /v2.0/ports?device_id=4ee0b7a3-f787-4a7c-816a-71f3a99b7193 HTTP/1.1" status: 200 len: 944 time: 0.0534899 Nov 23 19:36:40.549711 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-b7cd6997-9341-41bb-b944-b5bfbf4998f3 req-a18aee43-5ccd-4476-90fb-a7a188f719a0 tempest-TestVolumeBootPattern-147141705 tempest-TestVolumeBootPattern-147141705-project] 10.222.0.62 "GET /v2.0/security-groups?id=a6e2b133-1a9b-4dde-a188-1ce8bcdb7b5c&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0433960 Nov 23 19:36:40.561648 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-2a339514-24d8-4b52-8c4c-60dd4c3a3bbe admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:36:40.610286 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.wsgi [-] (102992) accepted ('10.222.0.62', 47010) {{(pid=102992) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 23 19:36:40.655880 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.db.db_base_plugin_v2 [None req-66ff8056-a8d7-4176-9d56-6480225570ee admin admin] Deleting subnet 168da168-ed46-4168-8b11-4b0ac0e6fbd8 {{(pid=102992) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Nov 23 19:36:40.659578 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [None req-66ff8056-a8d7-4176-9d56-6480225570ee admin admin] Publish callbacks [] for subnet, before_delete {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:36:40.662468 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-2a339514-24d8-4b52-8c4c-60dd4c3a3bbe admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-623933'] for security_group, after_create {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:36:40.695154 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [None req-66ff8056-a8d7-4176-9d56-6480225570ee admin admin] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-25272549'] for subnet, precommit_delete_associations {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:36:40.713020 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7d5beb97-386b-4751-ac09-7152bfedca6a req-9bf02950-df29-477c-ae17-333132e156fe tempest-ServerRescueNegativeTestJSON-1447477341 tempest-ServerRescueNegativeTestJSON-1447477341-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102993) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:36:40.714531 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-7d5beb97-386b-4751-ac09-7152bfedca6a req-9bf02950-df29-477c-ae17-333132e156fe tempest-ServerRescueNegativeTestJSON-1447477341 tempest-ServerRescueNegativeTestJSON-1447477341-project] 10.222.0.41 "GET /v2.0/ports?device_id=90cb32bd-c375-400a-b79a-97fc61e2a3a3 HTTP/1.1" status: 200 len: 945 time: 0.1119545 Nov 23 19:36:40.728893 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [None req-2a339514-24d8-4b52-8c4c-60dd4c3a3bbe admin admin] 10.222.0.62 "GET /v2.0/security-groups?tenant_id=6f2dc20a04f84a6bb4543b3d69cf0abc&name=default HTTP/1.1" status: 200 len: 2996 time: 0.3487906 Nov 23 19:36:40.730195 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.wsgi [-] (102993) accepted ('10.222.0.62', 47012) {{(pid=102993) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 23 19:36:40.739628 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [None req-66ff8056-a8d7-4176-9d56-6480225570ee admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-7975863'] for subnet, precommit_delete {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:36:40.742579 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8ef5cd42-37d3-4fb6-8340-a8aca513d53a req-863c05a4-4f62-4310-bba5-af55dd9831fb tempest-ServerRescueNegativeTestJSON-1447477341 tempest-ServerRescueNegativeTestJSON-1447477341-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102993) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:36:40.744007 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-8ef5cd42-37d3-4fb6-8340-a8aca513d53a req-863c05a4-4f62-4310-bba5-af55dd9831fb tempest-ServerRescueNegativeTestJSON-1447477341 tempest-ServerRescueNegativeTestJSON-1447477341-project] 10.222.0.62 "GET /v2.0/ports?device_id=90cb32bd-c375-400a-b79a-97fc61e2a3a3 HTTP/1.1" status: 200 len: 945 time: 0.1140594 Nov 23 19:36:40.752297 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2a339514-24d8-4b52-8c4c-60dd4c3a3bbe admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=ecc7495b-8d31-4e51-acc5-9a4775d72847,revision_number=1']} {{(pid=102993) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 23 19:36:40.884566 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [None req-66ff8056-a8d7-4176-9d56-6480225570ee admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-7982148', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-554858', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560168', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-25199822', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-25999729'] for subnet, after_delete {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:36:40.890291 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-8ef5cd42-37d3-4fb6-8340-a8aca513d53a req-cc101e17-7c5b-449d-9225-e23ff4ff0862 tempest-ServerRescueNegativeTestJSON-1447477341 tempest-ServerRescueNegativeTestJSON-1447477341-project] 10.222.0.62 "GET /v2.0/security-groups?id=62a09434-acf0-424f-9001-2c3a78119364&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1352992 Nov 23 19:36:40.895633 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-4605047e-51f7-4870-8213-bcc46e015cb7 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:36:40.914430 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-66ff8056-a8d7-4176-9d56-6480225570ee admin admin] Pushing event deleted for resources: {'Subnet': ['ID=168da168-ed46-4168-8b11-4b0ac0e6fbd8,revision_number=None']} {{(pid=102992) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 23 19:36:40.917307 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [None req-66ff8056-a8d7-4176-9d56-6480225570ee admin admin] Publish callbacks [] for subnet, before_response {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:36:40.920333 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [None req-66ff8056-a8d7-4176-9d56-6480225570ee admin admin] 10.222.0.62 "DELETE /v2.0/subnets/168da168-ed46-4168-8b11-4b0ac0e6fbd8 HTTP/1.1" status: 204 len: 168 time: 0.3084366 Nov 23 19:36:40.925918 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.wsgi [-] (102993) accepted ('10.222.0.62', 47014) {{(pid=102993) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 23 19:36:40.927051 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-66ff8056-a8d7-4176-9d56-6480225570ee admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-819011-1-iscsi {{(pid=102992) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 23 19:36:40.927324 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-66ff8056-a8d7-4176-9d56-6480225570ee admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-819011-1-iscsi {{(pid=102992) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 23 19:36:40.927677 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-66ff8056-a8d7-4176-9d56-6480225570ee admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-819011-1-iscsi {{(pid=102992) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 23 19:36:40.928023 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-66ff8056-a8d7-4176-9d56-6480225570ee admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-819011-1-iscsi {{(pid=102992) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 23 19:36:40.928406 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-66ff8056-a8d7-4176-9d56-6480225570ee admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-819011-1-iscsi {{(pid=102992) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 23 19:36:40.928698 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-66ff8056-a8d7-4176-9d56-6480225570ee admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-819011-1-iscsi {{(pid=102992) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 23 19:36:40.929037 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-66ff8056-a8d7-4176-9d56-6480225570ee admin admin] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-819011-1-iscsi {{(pid=102992) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 23 19:36:40.929372 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-66ff8056-a8d7-4176-9d56-6480225570ee admin admin] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-819011-1-iscsi {{(pid=102992) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 23 19:36:40.929735 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-66ff8056-a8d7-4176-9d56-6480225570ee admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-819011-1-iscsi {{(pid=102992) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 23 19:36:40.930067 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-66ff8056-a8d7-4176-9d56-6480225570ee admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-819011-1-iscsi {{(pid=102992) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 23 19:36:40.930401 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-66ff8056-a8d7-4176-9d56-6480225570ee admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-819011-1-iscsi {{(pid=102992) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 23 19:36:40.930735 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-66ff8056-a8d7-4176-9d56-6480225570ee admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-819011-1-iscsi {{(pid=102992) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 23 19:36:40.938369 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.plugins.ml2.plugin [req-7d5beb97-386b-4751-ac09-7152bfedca6a req-d01b0423-fd7b-4a18-83ab-c87072ac170d tempest-ServerRescueNegativeTestJSON-1447477341 tempest-ServerRescueNegativeTestJSON-1447477341-project] Deleting port 0a64c11d-0cb3-4c1e-aa45-5bcdf2771c8c {{(pid=102993) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 23 19:36:40.938710 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [req-7d5beb97-386b-4751-ac09-7152bfedca6a req-d01b0423-fd7b-4a18-83ab-c87072ac170d tempest-ServerRescueNegativeTestJSON-1447477341 tempest-ServerRescueNegativeTestJSON-1447477341-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8783631423070'] for port, before_delete {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:36:40.943738 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-4605047e-51f7-4870-8213-bcc46e015cb7 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:36:41.023584 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f1be37a8-08c2-4028-b313-d45d655aab20 req-b715445b-40f4-40b2-89fd-1f4bf98b21fe tempest-AttachVolumeShelveTestJSON-1172915835 tempest-AttachVolumeShelveTestJSON-1172915835-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102992) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:36:41.025102 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-f1be37a8-08c2-4028-b313-d45d655aab20 req-b715445b-40f4-40b2-89fd-1f4bf98b21fe tempest-AttachVolumeShelveTestJSON-1172915835 tempest-AttachVolumeShelveTestJSON-1172915835-project] 10.222.0.62 "GET /v2.0/ports?device_id=85ea3d72-6c17-4ea2-82b7-90cce01633bd HTTP/1.1" status: 200 len: 943 time: 0.0502305 Nov 23 19:36:41.076227 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-f1be37a8-08c2-4028-b313-d45d655aab20 req-99c3dfdb-0200-44e4-9558-20be521c3ec1 tempest-AttachVolumeShelveTestJSON-1172915835 tempest-AttachVolumeShelveTestJSON-1172915835-project] 10.222.0.62 "GET /v2.0/security-groups?id=f1ca24d9-0a31-470d-a1d5-fa7059df0141&fields=id&fields=name HTTP/1.1" status: 200 len: 311 time: 0.0446823 Nov 23 19:36:41.093217 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-d7f41c58-70fd-4ca7-9c76-88312f068810 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-8133038'] for network, before_delete {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:36:41.118444 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.plugins.ml2.db [req-7d5beb97-386b-4751-ac09-7152bfedca6a req-d01b0423-fd7b-4a18-83ab-c87072ac170d tempest-ServerRescueNegativeTestJSON-1447477341 tempest-ServerRescueNegativeTestJSON-1447477341-project] For port 0a64c11d-0cb3-4c1e-aa45-5bcdf2771c8c, host hv-cinder-81901, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81901',level=0,port_id=0a64c11d-0cb3-4c1e-aa45-5bcdf2771c8c,segment=NetworkSegment(b8302c34-e78d-4c43-9d45-a2604c95a2d2),segment_id=b8302c34-e78d-4c43-9d45-a2604c95a2d2)] {{(pid=102993) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 23 19:36:41.118796 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [req-7d5beb97-386b-4751-ac09-7152bfedca6a req-d01b0423-fd7b-4a18-83ab-c87072ac170d tempest-ServerRescueNegativeTestJSON-1447477341 tempest-ServerRescueNegativeTestJSON-1447477341-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-927332'] for port, precommit_delete {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:36:41.134220 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.plugins.ml2.plugin [req-7d5beb97-386b-4751-ac09-7152bfedca6a req-d01b0423-fd7b-4a18-83ab-c87072ac170d tempest-ServerRescueNegativeTestJSON-1447477341 tempest-ServerRescueNegativeTestJSON-1447477341-project] Calling delete_port for 0a64c11d-0cb3-4c1e-aa45-5bcdf2771c8c owned by compute:nova {{(pid=102993) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 23 19:36:41.208800 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-4605047e-51f7-4870-8213-bcc46e015cb7 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-623933'] for security_group, after_delete {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:36:41.211424 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-4605047e-51f7-4870-8213-bcc46e015cb7 admin admin] Publish callbacks [] for security_group, before_response {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:36:41.212544 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [None req-4605047e-51f7-4870-8213-bcc46e015cb7 admin admin] 10.222.0.62 "DELETE /v2.0/security-groups/ecc7495b-8d31-4e51-acc5-9a4775d72847 HTTP/1.1" status: 204 len: 168 time: 0.4676716 Nov 23 19:36:41.246629 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-d7f41c58-70fd-4ca7-9c76-88312f068810 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-7977576', 'neutron.services.segments.db._delete_segments_for_network-8783631323320'] for network, precommit_delete {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:36:41.270138 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4605047e-51f7-4870-8213-bcc46e015cb7 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=ecc7495b-8d31-4e51-acc5-9a4775d72847,revision_number=None']} {{(pid=102993) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 23 19:36:41.293974 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.services.segments.db [None req-d7f41c58-70fd-4ca7-9c76-88312f068810 admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['4b2c41c3-6250-433d-837a-85d02cae1bde']}} {{(pid=102993) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 23 19:36:41.318610 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.services.segments.db [None req-d7f41c58-70fd-4ca7-9c76-88312f068810 admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '2ab14203-895d-412f-8616-df9c89e896c9') {'for_net_delete': True} {{(pid=102993) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 23 19:36:41.318897 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.services.segments.db [None req-d7f41c58-70fd-4ca7-9c76-88312f068810 admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '2ab14203-895d-412f-8616-df9c89e896c9') {} {{(pid=102993) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 23 19:36:41.339277 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-d7f41c58-70fd-4ca7-9c76-88312f068810 admin admin] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8783631432524', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-16914685'] for segment, before_delete {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:36:41.361140 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-d7f41c58-70fd-4ca7-9c76-88312f068810 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7982218'] for segment, precommit_delete {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:36:41.375625 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dd3d47d4-33ac-4206-8f29-095559f1d6e0 req-039ed7af-68d8-4d35-999a-f9d7deada705 tempest-VolumesSnapshotTestJSON-97879810 tempest-VolumesSnapshotTestJSON-97879810-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102993) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:36:41.377343 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-dd3d47d4-33ac-4206-8f29-095559f1d6e0 req-039ed7af-68d8-4d35-999a-f9d7deada705 tempest-VolumesSnapshotTestJSON-97879810 tempest-VolumesSnapshotTestJSON-97879810-project] 10.222.0.62 "GET /v2.0/ports?device_id=d8c269ba-e8f8-4705-a5a5-fbfbb498151f HTTP/1.1" status: 200 len: 945 time: 0.1083543 Nov 23 19:36:41.378351 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-d7f41c58-70fd-4ca7-9c76-88312f068810 admin admin] Releasing vlan 839 on physical network physnet1 to pool {{(pid=102993) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Nov 23 19:36:41.378731 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-d7f41c58-70fd-4ca7-9c76-88312f068810 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7982218', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-17258441'] for segment, after_delete {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:36:41.383479 dv-cinder-819011-1-iscsi neutron-server[102993]: Traceback (most recent call last): Nov 23 19:36:41.383479 dv-cinder-819011-1-iscsi neutron-server[102993]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Nov 23 19:36:41.383479 dv-cinder-819011-1-iscsi neutron-server[102993]: timer() Nov 23 19:36:41.383479 dv-cinder-819011-1-iscsi neutron-server[102993]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 23 19:36:41.383479 dv-cinder-819011-1-iscsi neutron-server[102993]: cb(*args, **kw) Nov 23 19:36:41.383479 dv-cinder-819011-1-iscsi neutron-server[102993]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Nov 23 19:36:41.383479 dv-cinder-819011-1-iscsi neutron-server[102993]: return func(*args, **kwargs) Nov 23 19:36:41.383479 dv-cinder-819011-1-iscsi neutron-server[102993]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 23 19:36:41.383479 dv-cinder-819011-1-iscsi neutron-server[102993]: self._notify() Nov 23 19:36:41.383479 dv-cinder-819011-1-iscsi neutron-server[102993]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 23 19:36:41.383479 dv-cinder-819011-1-iscsi neutron-server[102993]: self.callback(batched_events) Nov 23 19:36:41.383479 dv-cinder-819011-1-iscsi neutron-server[102993]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 23 19:36:41.383479 dv-cinder-819011-1-iscsi neutron-server[102993]: event.method(event) Nov 23 19:36:41.383479 dv-cinder-819011-1-iscsi neutron-server[102993]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Nov 23 19:36:41.383479 dv-cinder-819011-1-iscsi neutron-server[102993]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 23 19:36:41.383479 dv-cinder-819011-1-iscsi neutron-server[102993]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Nov 23 19:36:41.383479 dv-cinder-819011-1-iscsi neutron-server[102993]: aggregate_uuid = self.p_client.list_aggregates( Nov 23 19:36:41.383479 dv-cinder-819011-1-iscsi neutron-server[102993]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Nov 23 19:36:41.383479 dv-cinder-819011-1-iscsi neutron-server[102993]: return f(self, *a, **k) Nov 23 19:36:41.383479 dv-cinder-819011-1-iscsi neutron-server[102993]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 23 19:36:41.383479 dv-cinder-819011-1-iscsi neutron-server[102993]: return self._get(url).json() Nov 23 19:36:41.383479 dv-cinder-819011-1-iscsi neutron-server[102993]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 23 19:36:41.383479 dv-cinder-819011-1-iscsi neutron-server[102993]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 23 19:36:41.383479 dv-cinder-819011-1-iscsi neutron-server[102993]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Nov 23 19:36:41.383479 dv-cinder-819011-1-iscsi neutron-server[102993]: return self.request(url, 'GET', **kwargs) Nov 23 19:36:41.383479 dv-cinder-819011-1-iscsi neutron-server[102993]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Nov 23 19:36:41.383479 dv-cinder-819011-1-iscsi neutron-server[102993]: base_url = self.get_endpoint(auth, allow=allow, Nov 23 19:36:41.383479 dv-cinder-819011-1-iscsi neutron-server[102993]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Nov 23 19:36:41.383479 dv-cinder-819011-1-iscsi neutron-server[102993]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 23 19:36:41.383479 dv-cinder-819011-1-iscsi neutron-server[102993]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Nov 23 19:36:41.383479 dv-cinder-819011-1-iscsi neutron-server[102993]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 23 19:36:41.383479 dv-cinder-819011-1-iscsi neutron-server[102993]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 23 19:36:41.506626 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-dd3d47d4-33ac-4206-8f29-095559f1d6e0 req-139b3495-73b4-4fef-895e-11df2cc5029d tempest-VolumesSnapshotTestJSON-97879810 tempest-VolumesSnapshotTestJSON-97879810-project] 10.222.0.62 "GET /v2.0/security-groups?id=2fd4bf42-f1cd-4ab5-94a3-e2347f7bb016&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1104491 Nov 23 19:36:41.558880 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [req-7d5beb97-386b-4751-ac09-7152bfedca6a req-d01b0423-fd7b-4a18-83ab-c87072ac170d tempest-ServerRescueNegativeTestJSON-1447477341 tempest-ServerRescueNegativeTestJSON-1447477341-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7918660', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-15067', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560168', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8783631424624', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8783631008723', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-17257496'] for port, after_delete {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:36:41.578752 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.plugins.ml2.db [None req-4bf48ff4-ecfb-4168-8b63-249b8c6e9f04 None None] get_ports_and_sgs() called for port_ids ['50e9d93b-ad23-4b6b-bdd0-ae5afe6f80ea', '0a64c11d-0cb3-4c1e-aa45-5bcdf2771c8c'] {{(pid=102994) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 23 19:36:41.593857 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d01b0423-fd7b-4a18-83ab-c87072ac170d tempest-ServerRescueNegativeTestJSON-1447477341 tempest-ServerRescueNegativeTestJSON-1447477341-project] Pushing event deleted for resources: {'Port': ['ID=0a64c11d-0cb3-4c1e-aa45-5bcdf2771c8c,revision_number=None']} {{(pid=102993) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 23 19:36:41.595751 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-d7f41c58-70fd-4ca7-9c76-88312f068810 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-7977567', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-554949', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560168', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-926557'] for network, after_delete {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:36:41.609541 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-d7f41c58-70fd-4ca7-9c76-88312f068810 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-560186'] for network, before_response {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:36:41.609541 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [None req-d7f41c58-70fd-4ca7-9c76-88312f068810 admin admin] 10.222.0.62 "DELETE /v2.0/networks/4b2c41c3-6250-433d-837a-85d02cae1bde HTTP/1.1" status: 204 len: 168 time: 0.6797223 Nov 23 19:36:41.635206 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d7f41c58-70fd-4ca7-9c76-88312f068810 admin admin] Pushing event deleted for resources: {'Network': ['ID=4b2c41c3-6250-433d-837a-85d02cae1bde,revision_number=None']} {{(pid=102993) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 23 19:36:41.656565 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.db.l3_dvrscheduler_db [req-7d5beb97-386b-4751-ac09-7152bfedca6a req-d01b0423-fd7b-4a18-83ab-c87072ac170d tempest-ServerRescueNegativeTestJSON-1447477341 tempest-ServerRescueNegativeTestJSON-1447477341-project] No DVR routers for this DVR port 0a64c11d-0cb3-4c1e-aa45-5bcdf2771c8c on host hv-cinder-81901 {{(pid=102993) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 23 19:36:41.661452 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [req-7d5beb97-386b-4751-ac09-7152bfedca6a req-d01b0423-fd7b-4a18-83ab-c87072ac170d tempest-ServerRescueNegativeTestJSON-1447477341 tempest-ServerRescueNegativeTestJSON-1447477341-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-514902'] for port, before_response {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:36:41.664871 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-7d5beb97-386b-4751-ac09-7152bfedca6a req-d01b0423-fd7b-4a18-83ab-c87072ac170d tempest-ServerRescueNegativeTestJSON-1447477341 tempest-ServerRescueNegativeTestJSON-1447477341-project] 10.222.0.41 "DELETE /v2.0/ports/0a64c11d-0cb3-4c1e-aa45-5bcdf2771c8c HTTP/1.1" status: 204 len: 173 time: 0.9358945 Nov 23 19:36:41.665329 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '90cb32bd-c375-400a-b79a-97fc61e2a3a3', 'name': 'network-vif-deleted', 'tag': '0a64c11d-0cb3-4c1e-aa45-5bcdf2771c8c'}] {{(pid=102993) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 23 19:36:41.673735 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.62/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}9b10b92acbee16fb695be1efeed0b68f7c36a5b215ec004a8d9d707fa3d35b2c" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-17164cce-78e4-4339-923f-d64f02a703d1" -d '{"events": [{"server_uuid": "90cb32bd-c375-400a-b79a-97fc61e2a3a3", "name": "network-vif-deleted", "tag": "0a64c11d-0cb3-4c1e-aa45-5bcdf2771c8c"}]}' {{(pid=102993) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 23 19:36:41.701333 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron_lib.callbacks.manager [None req-f6f90fe8-3cc0-4464-8656-4ebe4e98cdd4 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8783631323329', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7978582'] for agent, after_update {{(pid=102994) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:36:41.717543 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 23 Nov 2021 19:36:41 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-85b3284f-a1af-483c-90c0-b485c226d906 x-openstack-request-id: req-85b3284f-a1af-483c-90c0-b485c226d906 {{(pid=102993) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 23 19:36:41.717847 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "90cb32bd-c375-400a-b79a-97fc61e2a3a3", "name": "network-vif-deleted", "tag": "0a64c11d-0cb3-4c1e-aa45-5bcdf2771c8c", "status": "completed", "code": 200}]} {{(pid=102993) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 23 19:36:41.718112 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.62/compute/v2.1/os-server-external-events used request id req-85b3284f-a1af-483c-90c0-b485c226d906 {{(pid=102993) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 23 19:36:41.718512 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '90cb32bd-c375-400a-b79a-97fc61e2a3a3', 'name': 'network-vif-deleted', 'tag': '0a64c11d-0cb3-4c1e-aa45-5bcdf2771c8c', 'status': 'completed', 'code': 200} Nov 23 19:36:41.722825 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b861c60a-51bc-4019-ac6e-a92d240cfd45 req-deeb6f53-03c6-459f-8210-f78404b50583 tempest-TestVolumeBootPattern-147141705 tempest-TestVolumeBootPattern-147141705-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102992) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:36:41.727461 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-b861c60a-51bc-4019-ac6e-a92d240cfd45 req-deeb6f53-03c6-459f-8210-f78404b50583 tempest-TestVolumeBootPattern-147141705 tempest-TestVolumeBootPattern-147141705-project] 10.222.0.62 "GET /v2.0/ports?device_id=4ee0b7a3-f787-4a7c-816a-71f3a99b7193 HTTP/1.1" status: 200 len: 944 time: 0.0672007 Nov 23 19:36:41.779041 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-b861c60a-51bc-4019-ac6e-a92d240cfd45 req-fede9fc6-0d72-4c57-9cfa-34e311c5b649 tempest-TestVolumeBootPattern-147141705 tempest-TestVolumeBootPattern-147141705-project] 10.222.0.62 "GET /v2.0/security-groups?id=a6e2b133-1a9b-4dde-a188-1ce8bcdb7b5c&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0474975 Nov 23 19:36:41.836231 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.wsgi [-] (102993) accepted ('10.222.0.62', 47030) {{(pid=102993) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 23 19:36:41.850171 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-06d44839-d699-419a-9dfa-65b1e485b99c admin admin] Publish callbacks [] for security_group, before_create {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:36:41.926503 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-06d44839-d699-419a-9dfa-65b1e485b99c admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:36:41.991822 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-22dc9311-0a31-4912-9042-e24fb96961a0 req-eb39bb0f-8ad3-4af8-a6b8-6f9646027a55 tempest-ServerRescueNegativeTestJSON-1447477341 tempest-ServerRescueNegativeTestJSON-1447477341-project] 10.222.0.62 "GET /v2.0/ports?device_id=90cb32bd-c375-400a-b79a-97fc61e2a3a3 HTTP/1.1" status: 200 len: 210 time: 0.0278995 Nov 23 19:36:41.992780 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-06d44839-d699-419a-9dfa-65b1e485b99c admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-623933'] for security_group, after_create {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:36:42.034710 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-06d44839-d699-419a-9dfa-65b1e485b99c admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=0b3cdd50-2f6d-4452-9cb3-36cec9e04b7f,revision_number=1']} {{(pid=102993) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 23 19:36:42.040343 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [None req-06d44839-d699-419a-9dfa-65b1e485b99c admin admin] 10.222.0.62 "GET /v2.0/security-groups?tenant_id=cae52e582b74423fbb911fe613e0abd6&name=default HTTP/1.1" status: 200 len: 2996 time: 0.2030573 Nov 23 19:36:42.043048 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.wsgi [-] (102993) accepted ('10.222.0.62', 47034) {{(pid=102993) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 23 19:36:42.063556 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.wsgi [-] (102992) accepted ('10.222.0.62', 47036) {{(pid=102992) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 23 19:36:42.105707 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [None req-888dcbed-0e65-43e6-9e72-6ffb92b45e38 admin admin] 10.222.0.62 "GET /v2.0/security-groups?tenant_id=893242e83e2b490a98fcd7fafca0a833&name=default HTTP/1.1" status: 200 len: 2996 time: 0.0405943 Nov 23 19:36:42.107994 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.wsgi [-] (102992) accepted ('10.222.0.62', 47038) {{(pid=102992) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 23 19:36:42.130813 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d9461f6d-82a5-49bd-9408-5b8dc11403fa req-83791fbb-b676-46f4-a7de-7abe1221c5d1 tempest-VolumesSnapshotTestJSON-97879810 tempest-VolumesSnapshotTestJSON-97879810-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102993) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:36:42.132314 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-d9461f6d-82a5-49bd-9408-5b8dc11403fa req-83791fbb-b676-46f4-a7de-7abe1221c5d1 tempest-VolumesSnapshotTestJSON-97879810 tempest-VolumesSnapshotTestJSON-97879810-project] 10.222.0.41 "GET /v2.0/ports?device_id=d8c269ba-e8f8-4705-a5a5-fbfbb498151f HTTP/1.1" status: 200 len: 945 time: 0.0823996 Nov 23 19:36:42.141557 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-dbd7e51f-d3c1-47f9-beb4-ca723f0ebfa1 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:36:42.170990 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [None req-2866bcbc-da0b-4fe3-a227-90b8db55b6fa admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:36:42.192943 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-dbd7e51f-d3c1-47f9-beb4-ca723f0ebfa1 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:36:42.213268 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [None req-2866bcbc-da0b-4fe3-a227-90b8db55b6fa admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:36:42.241585 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2adb3356-053f-483a-a933-5555b59a3346 req-fb3a286f-b0fd-4c44-8306-932e38b4e8dd tempest-AttachVolumeShelveTestJSON-1172915835 tempest-AttachVolumeShelveTestJSON-1172915835-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102992) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:36:42.243065 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-2adb3356-053f-483a-a933-5555b59a3346 req-fb3a286f-b0fd-4c44-8306-932e38b4e8dd tempest-AttachVolumeShelveTestJSON-1172915835 tempest-AttachVolumeShelveTestJSON-1172915835-project] 10.222.0.62 "GET /v2.0/ports?device_id=85ea3d72-6c17-4ea2-82b7-90cce01633bd HTTP/1.1" status: 200 len: 943 time: 0.0858965 Nov 23 19:36:42.279541 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.plugins.ml2.plugin [req-d9461f6d-82a5-49bd-9408-5b8dc11403fa req-20b6c6eb-49ca-4c87-a9f9-3cc08ecb18d1 tempest-VolumesSnapshotTestJSON-97879810 tempest-VolumesSnapshotTestJSON-97879810-project] Deleting port f82fc68a-422f-4577-b6c3-98bd45727b03 {{(pid=102993) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 23 19:36:42.279877 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [req-d9461f6d-82a5-49bd-9408-5b8dc11403fa req-20b6c6eb-49ca-4c87-a9f9-3cc08ecb18d1 tempest-VolumesSnapshotTestJSON-97879810 tempest-VolumesSnapshotTestJSON-97879810-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8783631423070'] for port, before_delete {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:36:42.305110 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-2adb3356-053f-483a-a933-5555b59a3346 req-90ba8d4b-001a-4c20-8b8b-cdbdfde4d199 tempest-AttachVolumeShelveTestJSON-1172915835 tempest-AttachVolumeShelveTestJSON-1172915835-project] 10.222.0.62 "GET /v2.0/security-groups?id=f1ca24d9-0a31-470d-a1d5-fa7059df0141&fields=id&fields=name HTTP/1.1" status: 200 len: 311 time: 0.0485542 Nov 23 19:36:42.370908 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.plugins.ml2.db [req-d9461f6d-82a5-49bd-9408-5b8dc11403fa req-20b6c6eb-49ca-4c87-a9f9-3cc08ecb18d1 tempest-VolumesSnapshotTestJSON-97879810 tempest-VolumesSnapshotTestJSON-97879810-project] For port f82fc68a-422f-4577-b6c3-98bd45727b03, host hv-cinder-81901, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81901',level=0,port_id=f82fc68a-422f-4577-b6c3-98bd45727b03,segment=NetworkSegment(b67642b4-1845-4b49-9392-51fd2c9bc8b8),segment_id=b67642b4-1845-4b49-9392-51fd2c9bc8b8)] {{(pid=102993) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 23 19:36:42.371266 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [req-d9461f6d-82a5-49bd-9408-5b8dc11403fa req-20b6c6eb-49ca-4c87-a9f9-3cc08ecb18d1 tempest-VolumesSnapshotTestJSON-97879810 tempest-VolumesSnapshotTestJSON-97879810-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-927332'] for port, precommit_delete {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:36:42.379776 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-dbd7e51f-d3c1-47f9-beb4-ca723f0ebfa1 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-623933'] for security_group, after_delete {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:36:42.382410 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-dbd7e51f-d3c1-47f9-beb4-ca723f0ebfa1 admin admin] Publish callbacks [] for security_group, before_response {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:36:42.383547 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [None req-dbd7e51f-d3c1-47f9-beb4-ca723f0ebfa1 admin admin] 10.222.0.62 "DELETE /v2.0/security-groups/0b3cdd50-2f6d-4452-9cb3-36cec9e04b7f HTTP/1.1" status: 204 len: 168 time: 0.3394179 Nov 23 19:36:42.396834 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.plugins.ml2.plugin [req-d9461f6d-82a5-49bd-9408-5b8dc11403fa req-20b6c6eb-49ca-4c87-a9f9-3cc08ecb18d1 tempest-VolumesSnapshotTestJSON-97879810 tempest-VolumesSnapshotTestJSON-97879810-project] Calling delete_port for f82fc68a-422f-4577-b6c3-98bd45727b03 owned by compute:nova {{(pid=102993) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 23 19:36:42.398973 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-dbd7e51f-d3c1-47f9-beb4-ca723f0ebfa1 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=0b3cdd50-2f6d-4452-9cb3-36cec9e04b7f,revision_number=None']} {{(pid=102993) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 23 19:36:42.415926 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [None req-2866bcbc-da0b-4fe3-a227-90b8db55b6fa admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-623933'] for security_group, after_delete {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:36:42.418988 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [None req-2866bcbc-da0b-4fe3-a227-90b8db55b6fa admin admin] Publish callbacks [] for security_group, before_response {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:36:42.421383 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [None req-2866bcbc-da0b-4fe3-a227-90b8db55b6fa admin admin] 10.222.0.62 "DELETE /v2.0/security-groups/47acb13d-cf9a-4dd6-a614-503b94072f69 HTTP/1.1" status: 204 len: 168 time: 0.3108709 Nov 23 19:36:42.437831 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2866bcbc-da0b-4fe3-a227-90b8db55b6fa admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=47acb13d-cf9a-4dd6-a614-503b94072f69,revision_number=None']} {{(pid=102992) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 23 19:36:42.631844 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-03b93b5e-5012-4e3a-aa96-8ea43cc38ac2 req-e346ac26-0dd5-4b64-8bab-44d5b700a2d3 tempest-VolumesSnapshotTestJSON-97879810 tempest-VolumesSnapshotTestJSON-97879810-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102993) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:36:42.633240 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-03b93b5e-5012-4e3a-aa96-8ea43cc38ac2 req-e346ac26-0dd5-4b64-8bab-44d5b700a2d3 tempest-VolumesSnapshotTestJSON-97879810 tempest-VolumesSnapshotTestJSON-97879810-project] 10.222.0.62 "GET /v2.0/ports?device_id=d8c269ba-e8f8-4705-a5a5-fbfbb498151f HTTP/1.1" status: 200 len: 945 time: 0.0490766 Nov 23 19:36:42.634341 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [req-d9461f6d-82a5-49bd-9408-5b8dc11403fa req-20b6c6eb-49ca-4c87-a9f9-3cc08ecb18d1 tempest-VolumesSnapshotTestJSON-97879810 tempest-VolumesSnapshotTestJSON-97879810-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7918660', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-15067', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560168', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8783631424624', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8783631008723', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-17257496'] for port, after_delete {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:36:42.648268 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.plugins.ml2.db [None req-4bf48ff4-ecfb-4168-8b63-249b8c6e9f04 None None] get_ports_and_sgs() called for port_ids ['f82fc68a-422f-4577-b6c3-98bd45727b03'] {{(pid=102994) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 23 19:36:42.676685 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-20b6c6eb-49ca-4c87-a9f9-3cc08ecb18d1 tempest-VolumesSnapshotTestJSON-97879810 tempest-VolumesSnapshotTestJSON-97879810-project] Pushing event deleted for resources: {'Port': ['ID=f82fc68a-422f-4577-b6c3-98bd45727b03,revision_number=None']} {{(pid=102993) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 23 19:36:42.737316 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.db.l3_dvrscheduler_db [req-d9461f6d-82a5-49bd-9408-5b8dc11403fa req-20b6c6eb-49ca-4c87-a9f9-3cc08ecb18d1 tempest-VolumesSnapshotTestJSON-97879810 tempest-VolumesSnapshotTestJSON-97879810-project] No DVR routers for this DVR port f82fc68a-422f-4577-b6c3-98bd45727b03 on host hv-cinder-81901 {{(pid=102993) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 23 19:36:42.742032 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [req-d9461f6d-82a5-49bd-9408-5b8dc11403fa req-20b6c6eb-49ca-4c87-a9f9-3cc08ecb18d1 tempest-VolumesSnapshotTestJSON-97879810 tempest-VolumesSnapshotTestJSON-97879810-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-514902'] for port, before_response {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:36:42.745364 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-d9461f6d-82a5-49bd-9408-5b8dc11403fa req-20b6c6eb-49ca-4c87-a9f9-3cc08ecb18d1 tempest-VolumesSnapshotTestJSON-97879810 tempest-VolumesSnapshotTestJSON-97879810-project] 10.222.0.41 "DELETE /v2.0/ports/f82fc68a-422f-4577-b6c3-98bd45727b03 HTTP/1.1" status: 204 len: 173 time: 0.5982797 Nov 23 19:36:42.750260 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-03b93b5e-5012-4e3a-aa96-8ea43cc38ac2 req-b5495662-550c-4a49-9bbe-2dcf76aa8d5c tempest-VolumesSnapshotTestJSON-97879810 tempest-VolumesSnapshotTestJSON-97879810-project] 10.222.0.62 "GET /v2.0/security-groups?id=2fd4bf42-f1cd-4ab5-94a3-e2347f7bb016&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1097972 Nov 23 19:36:42.921545 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2c2cbbba-41b5-4f80-84ab-3e4422e19f2e req-f445020b-cf98-4072-a642-d90ad3cd555e tempest-TestVolumeBootPattern-147141705 tempest-TestVolumeBootPattern-147141705-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102992) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:36:42.921545 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-2c2cbbba-41b5-4f80-84ab-3e4422e19f2e req-f445020b-cf98-4072-a642-d90ad3cd555e tempest-TestVolumeBootPattern-147141705 tempest-TestVolumeBootPattern-147141705-project] 10.222.0.62 "GET /v2.0/ports?device_id=4ee0b7a3-f787-4a7c-816a-71f3a99b7193 HTTP/1.1" status: 200 len: 944 time: 0.0569129 Nov 23 19:36:42.981816 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-2c2cbbba-41b5-4f80-84ab-3e4422e19f2e req-fc4a6537-6bf8-431c-80d8-260b827f6832 tempest-TestVolumeBootPattern-147141705 tempest-TestVolumeBootPattern-147141705-project] 10.222.0.62 "GET /v2.0/security-groups?id=a6e2b133-1a9b-4dde-a188-1ce8bcdb7b5c&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0600178 Nov 23 19:36:43.438496 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5a898217-21c5-4c0b-9f6d-cc7e7917603f req-08b933eb-0049-4f6a-9005-d666a9580906 tempest-AttachVolumeShelveTestJSON-1172915835 tempest-AttachVolumeShelveTestJSON-1172915835-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102993) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:36:43.440102 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-5a898217-21c5-4c0b-9f6d-cc7e7917603f req-08b933eb-0049-4f6a-9005-d666a9580906 tempest-AttachVolumeShelveTestJSON-1172915835 tempest-AttachVolumeShelveTestJSON-1172915835-project] 10.222.0.62 "GET /v2.0/ports?device_id=85ea3d72-6c17-4ea2-82b7-90cce01633bd HTTP/1.1" status: 200 len: 943 time: 0.0597758 Nov 23 19:36:43.492240 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-5a898217-21c5-4c0b-9f6d-cc7e7917603f req-a86b47e9-fa38-4ad7-abbd-a98c9b8cce9a tempest-AttachVolumeShelveTestJSON-1172915835 tempest-AttachVolumeShelveTestJSON-1172915835-project] 10.222.0.62 "GET /v2.0/security-groups?id=f1ca24d9-0a31-470d-a1d5-fa7059df0141&fields=id&fields=name HTTP/1.1" status: 200 len: 311 time: 0.0453157 Nov 23 19:36:43.573939 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1366202a-9870-4588-8e11-4b7743648140 req-7c339d1b-6b7f-4b63-a415-65de7ac299c8 tempest-ServerRescueNegativeTestJSON-1447477341 tempest-ServerRescueNegativeTestJSON-1447477341-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102992) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:36:43.575716 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-1366202a-9870-4588-8e11-4b7743648140 req-7c339d1b-6b7f-4b63-a415-65de7ac299c8 tempest-ServerRescueNegativeTestJSON-1447477341 tempest-ServerRescueNegativeTestJSON-1447477341-project] 10.222.0.62 "GET /v2.0/ports?device_id=671f1d44-7752-4a9d-835d-4d76164c900f HTTP/1.1" status: 200 len: 945 time: 0.0514517 Nov 23 19:36:43.634235 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-1366202a-9870-4588-8e11-4b7743648140 req-8e72f870-c3e2-48ec-a13e-536459128ded tempest-ServerRescueNegativeTestJSON-1447477341 tempest-ServerRescueNegativeTestJSON-1447477341-project] 10.222.0.62 "GET /v2.0/security-groups?id=62a09434-acf0-424f-9001-2c3a78119364&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0503926 Nov 23 19:36:43.721289 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'd8c269ba-e8f8-4705-a5a5-fbfbb498151f', 'name': 'network-vif-deleted', 'tag': 'f82fc68a-422f-4577-b6c3-98bd45727b03'}] {{(pid=102993) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 23 19:36:43.724345 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.62/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}9b10b92acbee16fb695be1efeed0b68f7c36a5b215ec004a8d9d707fa3d35b2c" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-257ee83c-e372-4153-9b30-3469933df64c" -d '{"events": [{"server_uuid": "d8c269ba-e8f8-4705-a5a5-fbfbb498151f", "name": "network-vif-deleted", "tag": "f82fc68a-422f-4577-b6c3-98bd45727b03"}]}' {{(pid=102993) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 23 19:36:43.763416 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 23 Nov 2021 19:36:43 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-61476a14-90d7-4354-8fd8-154bce4c1706 x-openstack-request-id: req-61476a14-90d7-4354-8fd8-154bce4c1706 {{(pid=102993) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 23 19:36:43.763741 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "d8c269ba-e8f8-4705-a5a5-fbfbb498151f", "name": "network-vif-deleted", "tag": "f82fc68a-422f-4577-b6c3-98bd45727b03", "status": "completed", "code": 200}]} {{(pid=102993) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 23 19:36:43.764037 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.62/compute/v2.1/os-server-external-events used request id req-61476a14-90d7-4354-8fd8-154bce4c1706 {{(pid=102993) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 23 19:36:43.764331 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'd8c269ba-e8f8-4705-a5a5-fbfbb498151f', 'name': 'network-vif-deleted', 'tag': 'f82fc68a-422f-4577-b6c3-98bd45727b03', 'status': 'completed', 'code': 200} Nov 23 19:36:43.880509 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-c850762e-b4d5-4e80-8324-d633ffbdeca1 req-e81de552-2a25-4dfc-aa93-47f94b806808 tempest-VolumesSnapshotTestJSON-97879810 tempest-VolumesSnapshotTestJSON-97879810-project] 10.222.0.62 "GET /v2.0/ports?device_id=d8c269ba-e8f8-4705-a5a5-fbfbb498151f HTTP/1.1" status: 200 len: 210 time: 0.0260963 Nov 23 19:36:44.113053 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bb563b97-6d70-4ed8-8c1c-035d7d686544 req-96759140-d918-4f6b-a61f-fb8976c2fa17 tempest-TestVolumeBootPattern-147141705 tempest-TestVolumeBootPattern-147141705-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102993) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:36:44.115066 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-bb563b97-6d70-4ed8-8c1c-035d7d686544 req-96759140-d918-4f6b-a61f-fb8976c2fa17 tempest-TestVolumeBootPattern-147141705 tempest-TestVolumeBootPattern-147141705-project] 10.222.0.62 "GET /v2.0/ports?device_id=4ee0b7a3-f787-4a7c-816a-71f3a99b7193 HTTP/1.1" status: 200 len: 944 time: 0.0568500 Nov 23 19:36:44.167532 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-bb563b97-6d70-4ed8-8c1c-035d7d686544 req-446006c1-739c-45bf-a4fb-77fe156803a8 tempest-TestVolumeBootPattern-147141705 tempest-TestVolumeBootPattern-147141705-project] 10.222.0.62 "GET /v2.0/security-groups?id=a6e2b133-1a9b-4dde-a188-1ce8bcdb7b5c&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0461490 Nov 23 19:36:44.187335 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron_lib.callbacks.manager [None req-24b21c45-5b1f-467d-a7bd-33659ff32c34 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8783631323329', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7978582'] for agent, after_update {{(pid=102994) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:36:44.614148 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cb632ef8-fa00-4ea0-9587-4975d2d381b3 req-1001e524-c029-48b1-af5f-b0be794d9185 tempest-AttachVolumeShelveTestJSON-1172915835 tempest-AttachVolumeShelveTestJSON-1172915835-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102992) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:36:44.615620 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-cb632ef8-fa00-4ea0-9587-4975d2d381b3 req-1001e524-c029-48b1-af5f-b0be794d9185 tempest-AttachVolumeShelveTestJSON-1172915835 tempest-AttachVolumeShelveTestJSON-1172915835-project] 10.222.0.62 "GET /v2.0/ports?device_id=85ea3d72-6c17-4ea2-82b7-90cce01633bd HTTP/1.1" status: 200 len: 943 time: 0.0488744 Nov 23 19:36:44.662238 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-cb632ef8-fa00-4ea0-9587-4975d2d381b3 req-f2c9ebe5-c5a3-4c2d-9cc5-d5c6130844f9 tempest-AttachVolumeShelveTestJSON-1172915835 tempest-AttachVolumeShelveTestJSON-1172915835-project] 10.222.0.62 "GET /v2.0/security-groups?id=f1ca24d9-0a31-470d-a1d5-fa7059df0141&fields=id&fields=name HTTP/1.1" status: 200 len: 311 time: 0.0405550 Nov 23 19:36:44.708598 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.plugins.ml2.rpc [None req-4bf48ff4-ecfb-4168-8b63-249b8c6e9f04 None None] Device 4b380ab6-f3ec-4e12-9a2a-b5a20828969d details requested by agent hyperv_hv-cinder-81901 with host hv-cinder-81901 {{(pid=102994) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Nov 23 19:36:44.712594 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.plugins.ml2.rpc [None req-4bf48ff4-ecfb-4168-8b63-249b8c6e9f04 None None] Device 0a64c11d-0cb3-4c1e-aa45-5bcdf2771c8c no longer exists at agent hyperv_hv-cinder-81901 {{(pid=102994) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 23 19:36:44.740455 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.plugins.ml2.plugin [None req-4bf48ff4-ecfb-4168-8b63-249b8c6e9f04 None None] No Port match for: 0a64c11d-0cb3-4c1e-aa45-5bcdf2771c8c {{(pid=102994) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 23 19:36:44.740802 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.plugins.ml2.rpc [None req-4bf48ff4-ecfb-4168-8b63-249b8c6e9f04 None None] Device 0a64c11d-0cb3-4c1e-aa45-5bcdf2771c8c not bound to the agent host hv-cinder-81901 {{(pid=102994) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 23 19:36:44.741231 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.plugins.ml2.rpc [None req-4bf48ff4-ecfb-4168-8b63-249b8c6e9f04 None None] Device f82fc68a-422f-4577-b6c3-98bd45727b03 no longer exists at agent hyperv_hv-cinder-81901 {{(pid=102994) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 23 19:36:44.763172 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.plugins.ml2.plugin [None req-4bf48ff4-ecfb-4168-8b63-249b8c6e9f04 None None] No Port match for: f82fc68a-422f-4577-b6c3-98bd45727b03 {{(pid=102994) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 23 19:36:44.763430 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.plugins.ml2.rpc [None req-4bf48ff4-ecfb-4168-8b63-249b8c6e9f04 None None] Device f82fc68a-422f-4577-b6c3-98bd45727b03 not bound to the agent host hv-cinder-81901 {{(pid=102994) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 23 19:36:44.768656 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ff9836d6-546e-45da-9c58-df2270542027 req-bfdc472f-9241-4d9b-b9e1-7b9451185a0a tempest-ServerRescueNegativeTestJSON-1447477341 tempest-ServerRescueNegativeTestJSON-1447477341-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102993) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:36:44.770262 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-ff9836d6-546e-45da-9c58-df2270542027 req-bfdc472f-9241-4d9b-b9e1-7b9451185a0a tempest-ServerRescueNegativeTestJSON-1447477341 tempest-ServerRescueNegativeTestJSON-1447477341-project] 10.222.0.62 "GET /v2.0/ports?device_id=671f1d44-7752-4a9d-835d-4d76164c900f HTTP/1.1" status: 200 len: 945 time: 0.0563025 Nov 23 19:36:44.826768 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-ff9836d6-546e-45da-9c58-df2270542027 req-d0d14224-4ab9-4420-8f14-53471e613a01 tempest-ServerRescueNegativeTestJSON-1447477341 tempest-ServerRescueNegativeTestJSON-1447477341-project] 10.222.0.62 "GET /v2.0/security-groups?id=62a09434-acf0-424f-9001-2c3a78119364&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0504274 Nov 23 19:36:44.854944 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.plugins.ml2.db [None req-4bf48ff4-ecfb-4168-8b63-249b8c6e9f04 None None] For port 4b380ab6-f3ec-4e12-9a2a-b5a20828969d, host hv-cinder-81901, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81901',level=0,port_id=4b380ab6-f3ec-4e12-9a2a-b5a20828969d,segment=NetworkSegment(b4453f21-ac7f-498c-8316-73b738820700),segment_id=b4453f21-ac7f-498c-8316-73b738820700)] {{(pid=102994) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 23 19:36:44.865261 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.plugins.ml2.rpc [None req-4bf48ff4-ecfb-4168-8b63-249b8c6e9f04 None None] Returning: {'device': '4b380ab6-f3ec-4e12-9a2a-b5a20828969d', 'network_id': 'fc901312-2937-4784-8a6d-c046666e8bf8', 'port_id': '4b380ab6-f3ec-4e12-9a2a-b5a20828969d', 'mac_address': 'fa:16:3e:c0:19:59', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 825, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '2caca985-6ed6-4ef7-ba49-7b7410bea160', 'ip_address': '172.20.0.7'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=102994) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Nov 23 19:36:44.908771 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron_lib.callbacks.manager [None req-4bf48ff4-ecfb-4168-8b63-249b8c6e9f04 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7921281'] for port, before_update {{(pid=102994) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:36:44.922900 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.notifiers.nova [None req-4bf48ff4-ecfb-4168-8b63-249b8c6e9f04 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 4b380ab6-f3ec-4e12-9a2a-b5a20828969d {{(pid=102994) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 23 19:36:44.949517 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.plugins.ml2.db [None req-4bf48ff4-ecfb-4168-8b63-249b8c6e9f04 None None] For port 4b380ab6-f3ec-4e12-9a2a-b5a20828969d, host hv-cinder-81901, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81901',level=0,port_id=4b380ab6-f3ec-4e12-9a2a-b5a20828969d,segment=NetworkSegment(b4453f21-ac7f-498c-8316-73b738820700),segment_id=b4453f21-ac7f-498c-8316-73b738820700)] {{(pid=102994) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 23 19:36:44.987139 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron_lib.callbacks.manager [None req-4bf48ff4-ecfb-4168-8b63-249b8c6e9f04 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7918660', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-15067', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560168', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8783631423946', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8783631008732', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8783631008750'] for port, after_update {{(pid=102994) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:36:45.047799 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4bf48ff4-ecfb-4168-8b63-249b8c6e9f04 None None] Pushing event updated for resources: {'Port': ['ID=4b380ab6-f3ec-4e12-9a2a-b5a20828969d,revision_number=9']} {{(pid=102994) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 23 19:36:45.054862 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4bf48ff4-ecfb-4168-8b63-249b8c6e9f04 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-819011-1-iscsi {{(pid=102994) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 23 19:36:45.055229 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4bf48ff4-ecfb-4168-8b63-249b8c6e9f04 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-819011-1-iscsi {{(pid=102994) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 23 19:36:45.055706 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4bf48ff4-ecfb-4168-8b63-249b8c6e9f04 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-819011-1-iscsi {{(pid=102994) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 23 19:36:45.055929 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4bf48ff4-ecfb-4168-8b63-249b8c6e9f04 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-819011-1-iscsi {{(pid=102994) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 23 19:36:45.056241 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4bf48ff4-ecfb-4168-8b63-249b8c6e9f04 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-819011-1-iscsi {{(pid=102994) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 23 19:36:45.056573 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4bf48ff4-ecfb-4168-8b63-249b8c6e9f04 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-819011-1-iscsi {{(pid=102994) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 23 19:36:45.056899 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4bf48ff4-ecfb-4168-8b63-249b8c6e9f04 None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-819011-1-iscsi {{(pid=102994) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 23 19:36:45.057236 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4bf48ff4-ecfb-4168-8b63-249b8c6e9f04 None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-819011-1-iscsi {{(pid=102994) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 23 19:36:45.057578 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4bf48ff4-ecfb-4168-8b63-249b8c6e9f04 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-819011-1-iscsi {{(pid=102994) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 23 19:36:45.057906 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4bf48ff4-ecfb-4168-8b63-249b8c6e9f04 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-819011-1-iscsi {{(pid=102994) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 23 19:36:45.058230 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4bf48ff4-ecfb-4168-8b63-249b8c6e9f04 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-819011-1-iscsi {{(pid=102994) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 23 19:36:45.058554 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4bf48ff4-ecfb-4168-8b63-249b8c6e9f04 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-819011-1-iscsi {{(pid=102994) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 23 19:36:45.072661 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron_lib.callbacks.manager [None req-8346ef05-f685-4c3d-af3d-a159b683bec2 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8783631323329', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7978582'] for agent, after_update {{(pid=102994) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:36:45.290835 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fee7934d-e64c-4871-9806-7084dc0ee3a5 req-5f412ce7-da69-46e3-becc-3eee573cc5ed tempest-TestVolumeBootPattern-147141705 tempest-TestVolumeBootPattern-147141705-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102993) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:36:45.292315 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-fee7934d-e64c-4871-9806-7084dc0ee3a5 req-5f412ce7-da69-46e3-becc-3eee573cc5ed tempest-TestVolumeBootPattern-147141705 tempest-TestVolumeBootPattern-147141705-project] 10.222.0.62 "GET /v2.0/ports?device_id=4ee0b7a3-f787-4a7c-816a-71f3a99b7193 HTTP/1.1" status: 200 len: 944 time: 0.0574875 Nov 23 19:36:45.345972 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-fee7934d-e64c-4871-9806-7084dc0ee3a5 req-c877da2e-e163-4b8e-8c61-ad1c241f8180 tempest-TestVolumeBootPattern-147141705 tempest-TestVolumeBootPattern-147141705-project] 10.222.0.62 "GET /v2.0/security-groups?id=a6e2b133-1a9b-4dde-a188-1ce8bcdb7b5c&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0477607 Nov 23 19:36:45.350714 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.plugins.ml2.db [None req-4bf48ff4-ecfb-4168-8b63-249b8c6e9f04 None None] get_ports_and_sgs() called for port_ids ['4b380ab6-f3ec-4e12-9a2a-b5a20828969d'] {{(pid=102994) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 23 19:36:45.631050 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-62127792-65ee-44ce-bab5-c10689490d23 req-140d4172-7813-4f0a-b380-7f54675fbb5b tempest-VolumesNegativeTest-1760818768 tempest-VolumesNegativeTest-1760818768-project] 10.222.0.62 "GET /v2.0/networks?tenant_id=c52c093db38c40a383ef38ffbc4083a5&shared=False HTTP/1.1" status: 200 len: 213 time: 0.0312374 Nov 23 19:36:45.789951 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-31cd62f5-22dd-4ed1-8d33-a2fe27e4d0b9 req-d99fb770-a17b-439c-8e82-699b2ee68527 tempest-AttachVolumeShelveTestJSON-1172915835 tempest-AttachVolumeShelveTestJSON-1172915835-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102993) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:36:45.791561 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-31cd62f5-22dd-4ed1-8d33-a2fe27e4d0b9 req-d99fb770-a17b-439c-8e82-699b2ee68527 tempest-AttachVolumeShelveTestJSON-1172915835 tempest-AttachVolumeShelveTestJSON-1172915835-project] 10.222.0.62 "GET /v2.0/ports?device_id=85ea3d72-6c17-4ea2-82b7-90cce01633bd HTTP/1.1" status: 200 len: 944 time: 0.0549624 Nov 23 19:36:45.827600 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-62127792-65ee-44ce-bab5-c10689490d23 req-a31895bf-6d56-42ef-8cd3-a29f90a8f7f4 tempest-VolumesNegativeTest-1760818768 tempest-VolumesNegativeTest-1760818768-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=102992) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:36:45.829170 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-62127792-65ee-44ce-bab5-c10689490d23 req-a31895bf-6d56-42ef-8cd3-a29f90a8f7f4 tempest-VolumesNegativeTest-1760818768 tempest-VolumesNegativeTest-1760818768-project] 10.222.0.62 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 769 time: 0.1918786 Nov 23 19:36:45.842889 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-31cd62f5-22dd-4ed1-8d33-a2fe27e4d0b9 req-72e7263b-614b-44c0-85f5-1e0be25bd014 tempest-AttachVolumeShelveTestJSON-1172915835 tempest-AttachVolumeShelveTestJSON-1172915835-project] 10.222.0.62 "GET /v2.0/security-groups?id=f1ca24d9-0a31-470d-a1d5-fa7059df0141&fields=id&fields=name HTTP/1.1" status: 200 len: 311 time: 0.0438025 Nov 23 19:36:45.850875 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-62127792-65ee-44ce-bab5-c10689490d23 req-3f3aa7ee-c855-48b0-b0d0-1eec9cedd200 tempest-VolumesNegativeTest-1760818768 tempest-VolumesNegativeTest-1760818768-project] 10.222.0.62 "GET /v2.0/quotas/c52c093db38c40a383ef38ffbc4083a5 HTTP/1.1" status: 200 len: 375 time: 0.0096467 Nov 23 19:36:45.889534 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-62127792-65ee-44ce-bab5-c10689490d23 req-0527ac9b-b683-4fc7-88b0-68ccc5d24d54 tempest-VolumesNegativeTest-1760818768 tempest-VolumesNegativeTest-1760818768-project] 10.222.0.62 "GET /v2.0/ports?tenant_id=c52c093db38c40a383ef38ffbc4083a5&fields=id HTTP/1.1" status: 200 len: 210 time: 0.0317953 Nov 23 19:36:45.961020 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-39b6705f-a9f4-41b3-b178-e0298605ca49 req-199fc0c6-38b2-481b-a49a-cd71fecf6d4f tempest-ServerRescueNegativeTestJSON-1447477341 tempest-ServerRescueNegativeTestJSON-1447477341-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102993) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:36:45.962596 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-39b6705f-a9f4-41b3-b178-e0298605ca49 req-199fc0c6-38b2-481b-a49a-cd71fecf6d4f tempest-ServerRescueNegativeTestJSON-1447477341 tempest-ServerRescueNegativeTestJSON-1447477341-project] 10.222.0.62 "GET /v2.0/ports?device_id=671f1d44-7752-4a9d-835d-4d76164c900f HTTP/1.1" status: 200 len: 945 time: 0.0513685 Nov 23 19:36:46.012573 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-39b6705f-a9f4-41b3-b178-e0298605ca49 req-cf710f57-e34b-4065-9b06-ec99cadf98e6 tempest-ServerRescueNegativeTestJSON-1447477341 tempest-ServerRescueNegativeTestJSON-1447477341-project] 10.222.0.62 "GET /v2.0/security-groups?id=62a09434-acf0-424f-9001-2c3a78119364&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0435996 Nov 23 19:36:46.133670 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-557e33f5-5676-46fa-8120-0b12022065ef req-77189999-367c-4dc9-a7ae-6b91d8936537 tempest-VolumesNegativeTest-1760818768 tempest-VolumesNegativeTest-1760818768-project] 10.222.0.62 "GET /v2.0/ports?device_id=2b4c5734-55b0-47f1-9223-9875c9561c64 HTTP/1.1" status: 200 len: 210 time: 0.0320113 Nov 23 19:36:46.470687 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-247e64f6-8dc9-44c1-b4d1-fd86f49251cb req-47b32596-db87-4189-a005-6b7c514086e2 tempest-TestVolumeBootPattern-147141705 tempest-TestVolumeBootPattern-147141705-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102992) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:36:46.472170 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-247e64f6-8dc9-44c1-b4d1-fd86f49251cb req-47b32596-db87-4189-a005-6b7c514086e2 tempest-TestVolumeBootPattern-147141705 tempest-TestVolumeBootPattern-147141705-project] 10.222.0.62 "GET /v2.0/ports?device_id=4ee0b7a3-f787-4a7c-816a-71f3a99b7193 HTTP/1.1" status: 200 len: 944 time: 0.0494359 Nov 23 19:36:46.525780 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-247e64f6-8dc9-44c1-b4d1-fd86f49251cb req-04918f08-7e9d-44b2-b92e-e92f5556ae7c tempest-TestVolumeBootPattern-147141705 tempest-TestVolumeBootPattern-147141705-project] 10.222.0.62 "GET /v2.0/security-groups?id=a6e2b133-1a9b-4dde-a188-1ce8bcdb7b5c&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0454426 Nov 23 19:36:46.604118 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron_lib.callbacks.manager [None req-785c1d26-11ba-42d8-b5a6-51a8b3daeef0 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8783631323329', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7978582'] for agent, after_update {{(pid=102994) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:36:46.966294 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-630e9844-65a0-4979-b6e4-be91383f5731 req-5060c3b9-b7e0-402d-915e-3db77d91f888 tempest-AttachVolumeShelveTestJSON-1172915835 tempest-AttachVolumeShelveTestJSON-1172915835-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102993) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:36:46.967730 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-630e9844-65a0-4979-b6e4-be91383f5731 req-5060c3b9-b7e0-402d-915e-3db77d91f888 tempest-AttachVolumeShelveTestJSON-1172915835 tempest-AttachVolumeShelveTestJSON-1172915835-project] 10.222.0.62 "GET /v2.0/ports?device_id=85ea3d72-6c17-4ea2-82b7-90cce01633bd HTTP/1.1" status: 200 len: 944 time: 0.0482531 Nov 23 19:36:47.020680 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-630e9844-65a0-4979-b6e4-be91383f5731 req-2b36a72e-c5e0-4562-8803-18e5dd61e514 tempest-AttachVolumeShelveTestJSON-1172915835 tempest-AttachVolumeShelveTestJSON-1172915835-project] 10.222.0.62 "GET /v2.0/security-groups?id=f1ca24d9-0a31-470d-a1d5-fa7059df0141&fields=id&fields=name HTTP/1.1" status: 200 len: 311 time: 0.0458102 Nov 23 19:36:47.153501 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-22bee847-39b3-4b90-bf7f-cadbc230d31e req-9314d33b-7ca0-4788-a188-29a9b9da4caf tempest-ServerRescueNegativeTestJSON-1447477341 tempest-ServerRescueNegativeTestJSON-1447477341-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102992) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:36:47.156740 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-22bee847-39b3-4b90-bf7f-cadbc230d31e req-9314d33b-7ca0-4788-a188-29a9b9da4caf tempest-ServerRescueNegativeTestJSON-1447477341 tempest-ServerRescueNegativeTestJSON-1447477341-project] 10.222.0.62 "GET /v2.0/ports?device_id=671f1d44-7752-4a9d-835d-4d76164c900f HTTP/1.1" status: 200 len: 945 time: 0.0580688 Nov 23 19:36:47.213180 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-22bee847-39b3-4b90-bf7f-cadbc230d31e req-369be59b-df19-4d9a-920e-25f43d2000d6 tempest-ServerRescueNegativeTestJSON-1447477341 tempest-ServerRescueNegativeTestJSON-1447477341-project] 10.222.0.62 "GET /v2.0/security-groups?id=62a09434-acf0-424f-9001-2c3a78119364&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0430944 Nov 23 19:36:47.242264 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-41259cbe-707b-45ef-8d24-9c97a7834f54 req-1a3b9902-4dab-40fe-adbc-6e33a7e2a422 tempest-VolumesNegativeTest-1760818768 tempest-VolumesNegativeTest-1760818768-project] 10.222.0.62 "GET /v2.0/ports?device_id=2b4c5734-55b0-47f1-9223-9875c9561c64 HTTP/1.1" status: 200 len: 210 time: 0.0260398 Nov 23 19:36:47.306869 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron_lib.callbacks.manager [None req-eb87b2c3-3339-4249-8b85-e695b5b4e1f9 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8783631323329', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7978582'] for agent, after_update {{(pid=102994) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:36:47.640950 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-80c4e1e8-1873-41d3-b8a1-1e98c3f81183 req-67483752-7cf8-4c18-9ca4-1de54f851ec7 tempest-TestVolumeBootPattern-147141705 tempest-TestVolumeBootPattern-147141705-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102992) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:36:47.644025 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-80c4e1e8-1873-41d3-b8a1-1e98c3f81183 req-67483752-7cf8-4c18-9ca4-1de54f851ec7 tempest-TestVolumeBootPattern-147141705 tempest-TestVolumeBootPattern-147141705-project] 10.222.0.62 "GET /v2.0/ports?device_id=4ee0b7a3-f787-4a7c-816a-71f3a99b7193 HTTP/1.1" status: 200 len: 944 time: 0.0497892 Nov 23 19:36:47.657027 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.wsgi [-] (102993) accepted ('10.222.0.62', 47272) {{(pid=102993) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 23 19:36:47.697631 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-80c4e1e8-1873-41d3-b8a1-1e98c3f81183 req-83979641-84e0-480d-8174-84a1a83805d5 tempest-TestVolumeBootPattern-147141705 tempest-TestVolumeBootPattern-147141705-project] 10.222.0.62 "GET /v2.0/security-groups?id=a6e2b133-1a9b-4dde-a188-1ce8bcdb7b5c&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0464106 Nov 23 19:36:47.766064 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-454082f5-be55-4bd6-9b4b-56d9ec1c292e admin admin] Publish callbacks [] for security_group, before_create {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:36:47.839800 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-454082f5-be55-4bd6-9b4b-56d9ec1c292e admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:36:47.906559 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-454082f5-be55-4bd6-9b4b-56d9ec1c292e admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-623933'] for security_group, after_create {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:36:47.948972 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [None req-454082f5-be55-4bd6-9b4b-56d9ec1c292e admin admin] 10.222.0.62 "GET /v2.0/security-groups?tenant_id=1634fa93f89c45b594dc79dd6c08734b&name=default HTTP/1.1" status: 200 len: 2996 time: 0.2901542 Nov 23 19:36:47.949950 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-454082f5-be55-4bd6-9b4b-56d9ec1c292e admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=aec85d24-9456-4b21-ad03-f11fedf17bce,revision_number=1']} {{(pid=102993) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 23 19:36:47.951887 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.wsgi [-] (102992) accepted ('10.222.0.62', 47276) {{(pid=102992) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 23 19:36:48.001761 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [None req-a3e63b82-60b7-4fce-ad7f-a8b7e3aadd53 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:36:48.024078 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [None req-a3e63b82-60b7-4fce-ad7f-a8b7e3aadd53 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:36:48.141051 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [None req-a3e63b82-60b7-4fce-ad7f-a8b7e3aadd53 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-623933'] for security_group, after_delete {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:36:48.144249 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [None req-a3e63b82-60b7-4fce-ad7f-a8b7e3aadd53 admin admin] Publish callbacks [] for security_group, before_response {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:36:48.145565 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [None req-a3e63b82-60b7-4fce-ad7f-a8b7e3aadd53 admin admin] 10.222.0.62 "DELETE /v2.0/security-groups/aec85d24-9456-4b21-ad03-f11fedf17bce HTTP/1.1" status: 204 len: 168 time: 0.1926634 Nov 23 19:36:48.145839 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-63ce068d-cb5f-4f6a-a989-520cf96c97f5 req-27e9be40-a873-4365-b138-1ee211649136 tempest-AttachVolumeShelveTestJSON-1172915835 tempest-AttachVolumeShelveTestJSON-1172915835-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102993) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:36:48.147361 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-63ce068d-cb5f-4f6a-a989-520cf96c97f5 req-27e9be40-a873-4365-b138-1ee211649136 tempest-AttachVolumeShelveTestJSON-1172915835 tempest-AttachVolumeShelveTestJSON-1172915835-project] 10.222.0.62 "GET /v2.0/ports?device_id=85ea3d72-6c17-4ea2-82b7-90cce01633bd HTTP/1.1" status: 200 len: 944 time: 0.0502124 Nov 23 19:36:48.154639 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a3e63b82-60b7-4fce-ad7f-a8b7e3aadd53 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=aec85d24-9456-4b21-ad03-f11fedf17bce,revision_number=None']} {{(pid=102992) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 23 19:36:48.197336 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-63ce068d-cb5f-4f6a-a989-520cf96c97f5 req-ac32f302-761b-40eb-819d-2edfc1d28c91 tempest-AttachVolumeShelveTestJSON-1172915835 tempest-AttachVolumeShelveTestJSON-1172915835-project] 10.222.0.62 "GET /v2.0/security-groups?id=f1ca24d9-0a31-470d-a1d5-fa7059df0141&fields=id&fields=name HTTP/1.1" status: 200 len: 311 time: 0.0432422 Nov 23 19:36:48.331962 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a3f6936e-6a83-477b-a5dc-aa56869bc2ce req-84aeaaf5-3f93-4682-a656-3bdb812064f1 tempest-ServerRescueNegativeTestJSON-1447477341 tempest-ServerRescueNegativeTestJSON-1447477341-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102992) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:36:48.333457 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-a3f6936e-6a83-477b-a5dc-aa56869bc2ce req-84aeaaf5-3f93-4682-a656-3bdb812064f1 tempest-ServerRescueNegativeTestJSON-1447477341 tempest-ServerRescueNegativeTestJSON-1447477341-project] 10.222.0.62 "GET /v2.0/ports?device_id=671f1d44-7752-4a9d-835d-4d76164c900f HTTP/1.1" status: 200 len: 945 time: 0.0494518 Nov 23 19:36:48.337367 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-af2fc779-d7fd-4ba7-9a39-c51c2807a6e8 req-b7935dbf-fc9c-4be1-8432-c2237c046d54 tempest-VolumesNegativeTest-1760818768 tempest-VolumesNegativeTest-1760818768-project] 10.222.0.62 "GET /v2.0/ports?device_id=2b4c5734-55b0-47f1-9223-9875c9561c64 HTTP/1.1" status: 200 len: 210 time: 0.0270667 Nov 23 19:36:48.382702 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-a3f6936e-6a83-477b-a5dc-aa56869bc2ce req-2d02bde6-32b8-4b71-8616-8658b0bdda85 tempest-ServerRescueNegativeTestJSON-1447477341 tempest-ServerRescueNegativeTestJSON-1447477341-project] 10.222.0.62 "GET /v2.0/security-groups?id=62a09434-acf0-424f-9001-2c3a78119364&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0432065 Nov 23 19:36:48.780031 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.wsgi [-] (102992) accepted ('10.222.0.62', 47292) {{(pid=102992) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 23 19:36:48.793595 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [None req-589cecfc-2c11-4e8c-876f-bd705b6364c6 admin admin] Publish callbacks [] for security_group, before_create {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:36:48.814927 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8fbd4a06-3b00-447d-abc3-3a2af386e6eb req-e03ccf58-d26e-4248-80b6-594f860d1a6f tempest-TestVolumeBootPattern-147141705 tempest-TestVolumeBootPattern-147141705-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102993) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:36:48.816632 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-8fbd4a06-3b00-447d-abc3-3a2af386e6eb req-e03ccf58-d26e-4248-80b6-594f860d1a6f tempest-TestVolumeBootPattern-147141705 tempest-TestVolumeBootPattern-147141705-project] 10.222.0.62 "GET /v2.0/ports?device_id=4ee0b7a3-f787-4a7c-816a-71f3a99b7193 HTTP/1.1" status: 200 len: 944 time: 0.0525756 Nov 23 19:36:48.870453 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [None req-589cecfc-2c11-4e8c-876f-bd705b6364c6 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:36:48.870923 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-8fbd4a06-3b00-447d-abc3-3a2af386e6eb req-77a68fe1-882a-435f-bc7a-eccf959ab135 tempest-TestVolumeBootPattern-147141705 tempest-TestVolumeBootPattern-147141705-project] 10.222.0.62 "GET /v2.0/security-groups?id=a6e2b133-1a9b-4dde-a188-1ce8bcdb7b5c&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0481768 Nov 23 19:36:48.975634 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [None req-589cecfc-2c11-4e8c-876f-bd705b6364c6 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-623933'] for security_group, after_create {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:36:49.014181 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [None req-589cecfc-2c11-4e8c-876f-bd705b6364c6 admin admin] 10.222.0.62 "GET /v2.0/security-groups?tenant_id=0548732c41f54e88b694f6fd9074ba3c&name=default HTTP/1.1" status: 200 len: 2996 time: 0.2330081 Nov 23 19:36:49.015128 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-589cecfc-2c11-4e8c-876f-bd705b6364c6 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=0e7eadc1-3528-425f-8406-a100b39edadc,revision_number=1']} {{(pid=102992) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 23 19:36:49.017510 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.wsgi [-] (102993) accepted ('10.222.0.62', 47294) {{(pid=102993) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 23 19:36:49.065330 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-286f8201-600a-434f-acab-afa2efcdd65d admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:36:49.086740 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-286f8201-600a-434f-acab-afa2efcdd65d admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:36:49.174939 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-286f8201-600a-434f-acab-afa2efcdd65d admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-623933'] for security_group, after_delete {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:36:49.177515 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-286f8201-600a-434f-acab-afa2efcdd65d admin admin] Publish callbacks [] for security_group, before_response {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:36:49.178648 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [None req-286f8201-600a-434f-acab-afa2efcdd65d admin admin] 10.222.0.62 "DELETE /v2.0/security-groups/0e7eadc1-3528-425f-8406-a100b39edadc HTTP/1.1" status: 204 len: 168 time: 0.1600125 Nov 23 19:36:49.186515 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-286f8201-600a-434f-acab-afa2efcdd65d admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=0e7eadc1-3528-425f-8406-a100b39edadc,revision_number=None']} {{(pid=102993) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 23 19:36:49.323550 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8f748695-e680-428e-aa76-533921f0cf9a req-0f2ef4f5-d78a-4684-9574-7df2868cb36d tempest-AttachVolumeShelveTestJSON-1172915835 tempest-AttachVolumeShelveTestJSON-1172915835-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102992) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:36:49.325002 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-8f748695-e680-428e-aa76-533921f0cf9a req-0f2ef4f5-d78a-4684-9574-7df2868cb36d tempest-AttachVolumeShelveTestJSON-1172915835 tempest-AttachVolumeShelveTestJSON-1172915835-project] 10.222.0.62 "GET /v2.0/ports?device_id=85ea3d72-6c17-4ea2-82b7-90cce01633bd HTTP/1.1" status: 200 len: 944 time: 0.0518131 Nov 23 19:36:49.381487 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-8f748695-e680-428e-aa76-533921f0cf9a req-f25a08d7-f45f-470d-940c-ce0904b5688a tempest-AttachVolumeShelveTestJSON-1172915835 tempest-AttachVolumeShelveTestJSON-1172915835-project] 10.222.0.62 "GET /v2.0/security-groups?id=f1ca24d9-0a31-470d-a1d5-fa7059df0141&fields=id&fields=name HTTP/1.1" status: 200 len: 311 time: 0.0441916 Nov 23 19:36:49.448298 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-2e03a13c-249e-4dbf-9355-b071615da788 req-f5b4e397-dc5b-4c47-b28a-0a8883aa6749 tempest-VolumesNegativeTest-1760818768 tempest-VolumesNegativeTest-1760818768-project] 10.222.0.62 "GET /v2.0/ports?device_id=2b4c5734-55b0-47f1-9223-9875c9561c64 HTTP/1.1" status: 200 len: 210 time: 0.0340393 Nov 23 19:36:49.509788 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4b3b906d-16ef-4da5-bd67-ede0784c4237 req-6a6af971-9455-40a6-9113-2e26aa1cb8c4 tempest-ServerRescueNegativeTestJSON-1447477341 tempest-ServerRescueNegativeTestJSON-1447477341-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102992) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:36:49.511406 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-4b3b906d-16ef-4da5-bd67-ede0784c4237 req-6a6af971-9455-40a6-9113-2e26aa1cb8c4 tempest-ServerRescueNegativeTestJSON-1447477341 tempest-ServerRescueNegativeTestJSON-1447477341-project] 10.222.0.62 "GET /v2.0/ports?device_id=671f1d44-7752-4a9d-835d-4d76164c900f HTTP/1.1" status: 200 len: 945 time: 0.0548675 Nov 23 19:36:49.560185 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-4b3b906d-16ef-4da5-bd67-ede0784c4237 req-0af1352b-d4e8-4c07-9f57-04652d62ac7d tempest-ServerRescueNegativeTestJSON-1447477341 tempest-ServerRescueNegativeTestJSON-1447477341-project] 10.222.0.62 "GET /v2.0/security-groups?id=62a09434-acf0-424f-9001-2c3a78119364&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0426931 Nov 23 19:36:49.792853 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-62127792-65ee-44ce-bab5-c10689490d23 req-0d92b81c-89f2-4655-9aa4-af665538a54d tempest-VolumesNegativeTest-1760818768 tempest-VolumesNegativeTest-1760818768-project] 10.222.0.41 "GET /v2.0/networks?tenant_id=c52c093db38c40a383ef38ffbc4083a5&shared=False HTTP/1.1" status: 200 len: 213 time: 0.0305271 Nov 23 19:36:50.008664 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-62127792-65ee-44ce-bab5-c10689490d23 req-1c31e67d-a5db-4f22-9276-59dc7b49aee5 tempest-VolumesNegativeTest-1760818768 tempest-VolumesNegativeTest-1760818768-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=102993) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:36:50.009521 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-62127792-65ee-44ce-bab5-c10689490d23 req-1c31e67d-a5db-4f22-9276-59dc7b49aee5 tempest-VolumesNegativeTest-1760818768 tempest-VolumesNegativeTest-1760818768-project] 10.222.0.41 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 769 time: 0.2091820 Nov 23 19:36:50.028659 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-465387e0-ed57-440e-8aed-a4f169ab47cb req-eea4bfec-9714-4fc4-a981-a1e47524874f tempest-TestVolumeBootPattern-147141705 tempest-TestVolumeBootPattern-147141705-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102993) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:36:50.030122 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-465387e0-ed57-440e-8aed-a4f169ab47cb req-eea4bfec-9714-4fc4-a981-a1e47524874f tempest-TestVolumeBootPattern-147141705 tempest-TestVolumeBootPattern-147141705-project] 10.222.0.62 "GET /v2.0/ports?device_id=4ee0b7a3-f787-4a7c-816a-71f3a99b7193 HTTP/1.1" status: 200 len: 944 time: 0.0822039 Nov 23 19:36:50.034707 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.api.v2.base [req-62127792-65ee-44ce-bab5-c10689490d23 req-f76e529f-f851-4f79-b14f-b60f1aa4d862 tempest-VolumesNegativeTest-1760818768 tempest-VolumesNegativeTest-1760818768-project] Request body: {'port': {'device_id': '2b4c5734-55b0-47f1-9223-9875c9561c64', 'network_id': '2096bff1-f35e-4603-897c-41fe38bec144', 'admin_state_up': True, 'tenant_id': 'c52c093db38c40a383ef38ffbc4083a5'}} {{(pid=102993) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 23 19:36:50.359713 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-465387e0-ed57-440e-8aed-a4f169ab47cb req-3d280de7-4bc5-45cf-a658-74fa98839609 tempest-TestVolumeBootPattern-147141705 tempest-TestVolumeBootPattern-147141705-project] 10.222.0.62 "GET /v2.0/security-groups?id=a6e2b133-1a9b-4dde-a188-1ce8bcdb7b5c&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.3216295 Nov 23 19:36:50.489574 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-62127792-65ee-44ce-bab5-c10689490d23 req-f76e529f-f851-4f79-b14f-b60f1aa4d862 tempest-VolumesNegativeTest-1760818768 tempest-VolumesNegativeTest-1760818768-project] Made reservation on behalf of c52c093db38c40a383ef38ffbc4083a5 for: {'port': 1} {{(pid=102993) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 23 19:36:50.493114 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [req-62127792-65ee-44ce-bab5-c10689490d23 req-f76e529f-f851-4f79-b14f-b60f1aa4d862 tempest-VolumesNegativeTest-1760818768 tempest-VolumesNegativeTest-1760818768-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7921281'] for port, before_create {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:36:50.502983 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [req-62127792-65ee-44ce-bab5-c10689490d23 req-f76e529f-f851-4f79-b14f-b60f1aa4d862 tempest-VolumesNegativeTest-1760818768 tempest-VolumesNegativeTest-1760818768-project] Publish callbacks [] for security_group, before_create {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:36:50.503777 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b3aa032a-b2be-4662-b8c1-3fb7a28acc2f req-6d321ac1-89c1-4073-b54d-c420c1828fff tempest-AttachVolumeShelveTestJSON-1172915835 tempest-AttachVolumeShelveTestJSON-1172915835-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102992) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:36:50.513285 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-b3aa032a-b2be-4662-b8c1-3fb7a28acc2f req-6d321ac1-89c1-4073-b54d-c420c1828fff tempest-AttachVolumeShelveTestJSON-1172915835 tempest-AttachVolumeShelveTestJSON-1172915835-project] 10.222.0.62 "GET /v2.0/ports?device_id=85ea3d72-6c17-4ea2-82b7-90cce01633bd HTTP/1.1" status: 200 len: 944 time: 0.0616281 Nov 23 19:36:50.552106 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-a8caa1ba-8230-4a4e-9c07-5afcbded582f req-f8dee778-4718-4683-bc3c-7a482c028dfa tempest-VolumesNegativeTest-1760818768 tempest-VolumesNegativeTest-1760818768-project] 10.222.0.62 "GET /v2.0/ports?device_id=2b4c5734-55b0-47f1-9223-9875c9561c64 HTTP/1.1" status: 200 len: 210 time: 0.0292182 Nov 23 19:36:50.586001 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-b3aa032a-b2be-4662-b8c1-3fb7a28acc2f req-4c62efe7-2b8d-4f42-b714-e2dfa8a3ef93 tempest-AttachVolumeShelveTestJSON-1172915835 tempest-AttachVolumeShelveTestJSON-1172915835-project] 10.222.0.62 "GET /v2.0/security-groups?id=f1ca24d9-0a31-470d-a1d5-fa7059df0141&fields=id&fields=name HTTP/1.1" status: 200 len: 311 time: 0.0719211 Nov 23 19:36:50.624455 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [req-62127792-65ee-44ce-bab5-c10689490d23 req-f76e529f-f851-4f79-b14f-b60f1aa4d862 tempest-VolumesNegativeTest-1760818768 tempest-VolumesNegativeTest-1760818768-project] Publish callbacks [] for security_group, precommit_create {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:36:50.690337 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c37f320a-f136-4272-8cf1-4c321c495950 req-553f5d44-d0c2-492a-9a58-83dc77c3a50a tempest-ServerRescueNegativeTestJSON-1447477341 tempest-ServerRescueNegativeTestJSON-1447477341-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102993) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:36:50.691793 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-c37f320a-f136-4272-8cf1-4c321c495950 req-553f5d44-d0c2-492a-9a58-83dc77c3a50a tempest-ServerRescueNegativeTestJSON-1447477341 tempest-ServerRescueNegativeTestJSON-1447477341-project] 10.222.0.62 "GET /v2.0/ports?device_id=671f1d44-7752-4a9d-835d-4d76164c900f HTTP/1.1" status: 200 len: 945 time: 0.0521562 Nov 23 19:36:50.715457 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.plugins.ml2.rpc [None req-4bf48ff4-ecfb-4168-8b63-249b8c6e9f04 None None] Device 1a0a2345-c03d-4159-89a8-35402d8d2448 details requested by agent hyperv_hv-cinder-81901 with host hv-cinder-81901 {{(pid=102994) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Nov 23 19:36:50.718627 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.plugins.ml2.rpc [None req-4bf48ff4-ecfb-4168-8b63-249b8c6e9f04 None None] Device 4b380ab6-f3ec-4e12-9a2a-b5a20828969d up at agent hyperv_hv-cinder-81901 {{(pid=102994) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 23 19:36:50.745283 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-c37f320a-f136-4272-8cf1-4c321c495950 req-54f85ed7-f29a-4ba5-9e72-c7d3eb2dfd93 tempest-ServerRescueNegativeTestJSON-1447477341 tempest-ServerRescueNegativeTestJSON-1447477341-project] 10.222.0.62 "GET /v2.0/security-groups?id=62a09434-acf0-424f-9001-2c3a78119364&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0473688 Nov 23 19:36:50.746853 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [req-62127792-65ee-44ce-bab5-c10689490d23 req-f76e529f-f851-4f79-b14f-b60f1aa4d862 tempest-VolumesNegativeTest-1760818768 tempest-VolumesNegativeTest-1760818768-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-623933'] for security_group, after_create {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:36:50.813025 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f76e529f-f851-4f79-b14f-b60f1aa4d862 tempest-VolumesNegativeTest-1760818768 tempest-VolumesNegativeTest-1760818768-project] Pushing event updated for resources: {'SecurityGroup': ['ID=ac69cba1-f881-4fe2-ba1d-5270c0d54618,revision_number=1']} {{(pid=102993) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 23 19:36:50.877295 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.plugins.ml2.db [None req-4bf48ff4-ecfb-4168-8b63-249b8c6e9f04 None None] For port 1a0a2345-c03d-4159-89a8-35402d8d2448, host hv-cinder-81901, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81901',level=0,port_id=1a0a2345-c03d-4159-89a8-35402d8d2448,segment=NetworkSegment(56316385-5b81-43f5-84db-b708b46f04eb),segment_id=56316385-5b81-43f5-84db-b708b46f04eb)] {{(pid=102994) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 23 19:36:50.890888 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.db.provisioning_blocks [None req-4bf48ff4-ecfb-4168-8b63-249b8c6e9f04 None None] Provisioning complete for port 4b380ab6-f3ec-4e12-9a2a-b5a20828969d triggered by entity L2. {{(pid=102994) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 23 19:36:50.891984 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron_lib.callbacks.manager [None req-4bf48ff4-ecfb-4168-8b63-249b8c6e9f04 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-8355713'] for port, provisioning_complete {{(pid=102994) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:36:50.894793 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.plugins.ml2.rpc [None req-4bf48ff4-ecfb-4168-8b63-249b8c6e9f04 None None] Returning: {'device': '1a0a2345-c03d-4159-89a8-35402d8d2448', 'network_id': '226a519f-5f3e-4d80-bb8a-0e9fc4f64828', 'port_id': '1a0a2345-c03d-4159-89a8-35402d8d2448', 'mac_address': 'fa:16:3e:17:1a:2b', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 800, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '88de785d-c540-4651-af1e-26f27ccaee3c', 'ip_address': '172.20.0.14'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=102994) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Nov 23 19:36:50.895648 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.db.db_base_plugin_common [req-62127792-65ee-44ce-bab5-c10689490d23 req-f76e529f-f851-4f79-b14f-b60f1aa4d862 tempest-VolumesNegativeTest-1760818768 tempest-VolumesNegativeTest-1760818768-project] Allocated IP 192.168.233.144 (2096bff1-f35e-4603-897c-41fe38bec144/2a6b6168-a59d-4c5e-be49-7d9bee937678/cde3ee31-252a-4d6a-ab52-e04028f9cab7) {{(pid=102993) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 23 19:36:50.967110 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron_lib.callbacks.manager [None req-4bf48ff4-ecfb-4168-8b63-249b8c6e9f04 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7921281'] for port, before_update {{(pid=102994) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:36:50.984443 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.notifiers.nova [None req-4bf48ff4-ecfb-4168-8b63-249b8c6e9f04 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 1a0a2345-c03d-4159-89a8-35402d8d2448 {{(pid=102994) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 23 19:36:51.028388 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.plugins.ml2.db [None req-4bf48ff4-ecfb-4168-8b63-249b8c6e9f04 None None] For port 1a0a2345-c03d-4159-89a8-35402d8d2448, host hv-cinder-81901, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81901',level=0,port_id=1a0a2345-c03d-4159-89a8-35402d8d2448,segment=NetworkSegment(56316385-5b81-43f5-84db-b708b46f04eb),segment_id=56316385-5b81-43f5-84db-b708b46f04eb)] {{(pid=102994) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 23 19:36:51.042497 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron_lib.callbacks.manager [None req-4bf48ff4-ecfb-4168-8b63-249b8c6e9f04 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7921281'] for port, before_update {{(pid=102994) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:36:51.058993 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '85ea3d72-6c17-4ea2-82b7-90cce01633bd', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '4b380ab6-f3ec-4e12-9a2a-b5a20828969d'}] {{(pid=102994) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 23 19:36:51.061234 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.62/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}09a7511da0d2ba1d728b27e36a8467ec5289399952f0059588048a7cb66d3a43" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-48b4b5fa-bb1f-4aef-a332-0be6977677b0" -d '{"events": [{"server_uuid": "85ea3d72-6c17-4ea2-82b7-90cce01633bd", "name": "network-vif-plugged", "status": "completed", "tag": "4b380ab6-f3ec-4e12-9a2a-b5a20828969d"}]}' {{(pid=102994) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 23 19:36:51.070250 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [req-62127792-65ee-44ce-bab5-c10689490d23 req-f76e529f-f851-4f79-b14f-b60f1aa4d862 tempest-VolumesNegativeTest-1760818768 tempest-VolumesNegativeTest-1760818768-project] Publish callbacks [] for port, precommit_create {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:36:51.074328 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.plugins.ml2.db [None req-4bf48ff4-ecfb-4168-8b63-249b8c6e9f04 None None] For port 4b380ab6-f3ec-4e12-9a2a-b5a20828969d, host hv-cinder-81901, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81901',level=0,port_id=4b380ab6-f3ec-4e12-9a2a-b5a20828969d,segment=NetworkSegment(b4453f21-ac7f-498c-8316-73b738820700),segment_id=b4453f21-ac7f-498c-8316-73b738820700)] {{(pid=102994) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 23 19:36:51.089137 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron_lib.callbacks.manager [None req-4bf48ff4-ecfb-4168-8b63-249b8c6e9f04 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7918660', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-15067', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560168', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8783631423946', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8783631008732', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8783631008750'] for port, after_update {{(pid=102994) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:36:51.181199 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [req-62127792-65ee-44ce-bab5-c10689490d23 req-f76e529f-f851-4f79-b14f-b60f1aa4d862 tempest-VolumesNegativeTest-1760818768 tempest-VolumesNegativeTest-1760818768-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7918660', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-15067', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560168', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8783631008714', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-17257496'] for port, after_create {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:36:51.236383 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-62127792-65ee-44ce-bab5-c10689490d23 req-f76e529f-f851-4f79-b14f-b60f1aa4d862 tempest-VolumesNegativeTest-1760818768 tempest-VolumesNegativeTest-1760818768-project] Network 2096bff1-f35e-4603-897c-41fe38bec144 is already hosted by enough agents. {{(pid=102993) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 23 19:36:51.237392 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 23 Nov 2021 19:36:51 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-c29389a3-6e35-43a3-a1ff-66c63cfe34d4 x-openstack-request-id: req-c29389a3-6e35-43a3-a1ff-66c63cfe34d4 {{(pid=102994) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 23 19:36:51.237718 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "85ea3d72-6c17-4ea2-82b7-90cce01633bd", "name": "network-vif-plugged", "status": "completed", "tag": "4b380ab6-f3ec-4e12-9a2a-b5a20828969d", "code": 200}]} {{(pid=102994) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 23 19:36:51.237980 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.62/compute/v2.1/os-server-external-events used request id req-c29389a3-6e35-43a3-a1ff-66c63cfe34d4 {{(pid=102994) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 23 19:36:51.238371 dv-cinder-819011-1-iscsi neutron-server[102994]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '85ea3d72-6c17-4ea2-82b7-90cce01633bd', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '4b380ab6-f3ec-4e12-9a2a-b5a20828969d', 'code': 200} Nov 23 19:36:51.242590 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron_lib.callbacks.manager [None req-4bf48ff4-ecfb-4168-8b63-249b8c6e9f04 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7918660', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-15067', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560168', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8783631423946', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8783631008732', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8783631008750'] for port, after_update {{(pid=102994) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:36:51.242741 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.scheduler.base_scheduler [req-62127792-65ee-44ce-bab5-c10689490d23 req-f76e529f-f851-4f79-b14f-b60f1aa4d862 tempest-VolumesNegativeTest-1760818768 tempest-VolumesNegativeTest-1760818768-project] Resources bound (agent type, host, resource id): {{(pid=102993) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 23 19:36:51.244603 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f76e529f-f851-4f79-b14f-b60f1aa4d862 tempest-VolumesNegativeTest-1760818768 tempest-VolumesNegativeTest-1760818768-project] Pushing event updated for resources: {'Port': ['ID=cde3ee31-252a-4d6a-ab52-e04028f9cab7,revision_number=1']} {{(pid=102993) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 23 19:36:51.246822 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.db.l3_dvrscheduler_db [req-62127792-65ee-44ce-bab5-c10689490d23 req-f76e529f-f851-4f79-b14f-b60f1aa4d862 tempest-VolumesNegativeTest-1760818768 tempest-VolumesNegativeTest-1760818768-project] Received port after_create {{(pid=102993) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 23 19:36:51.268248 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4bf48ff4-ecfb-4168-8b63-249b8c6e9f04 None None] Pushing event updated for resources: {'Port': ['ID=1a0a2345-c03d-4159-89a8-35402d8d2448,revision_number=4']} {{(pid=102994) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 23 19:36:51.326108 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4bf48ff4-ecfb-4168-8b63-249b8c6e9f04 None None] Pushing event updated for resources: {'Port': ['ID=4b380ab6-f3ec-4e12-9a2a-b5a20828969d,revision_number=10']} {{(pid=102994) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 23 19:36:51.341385 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-62127792-65ee-44ce-bab5-c10689490d23 req-f76e529f-f851-4f79-b14f-b60f1aa4d862 tempest-VolumesNegativeTest-1760818768 tempest-VolumesNegativeTest-1760818768-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=102993) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:36:51.343139 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [req-62127792-65ee-44ce-bab5-c10689490d23 req-f76e529f-f851-4f79-b14f-b60f1aa4d862 tempest-VolumesNegativeTest-1760818768 tempest-VolumesNegativeTest-1760818768-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-514902'] for port, before_response {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:36:51.361824 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-786e01a1-ae7f-45f2-af43-2a48fa6f7451 req-e0e0727a-5a8a-4bd9-a4f7-85804fa41e07 tempest-ServerRescueNegativeTestJSON-1447477341 tempest-ServerRescueNegativeTestJSON-1447477341-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102992) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:36:51.363734 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-786e01a1-ae7f-45f2-af43-2a48fa6f7451 req-e0e0727a-5a8a-4bd9-a4f7-85804fa41e07 tempest-ServerRescueNegativeTestJSON-1447477341 tempest-ServerRescueNegativeTestJSON-1447477341-project] 10.222.0.41 "GET /v2.0/ports?device_id=671f1d44-7752-4a9d-835d-4d76164c900f HTTP/1.1" status: 200 len: 945 time: 0.0540664 Nov 23 19:36:51.396332 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.plugins.ml2.db [None req-4bf48ff4-ecfb-4168-8b63-249b8c6e9f04 None None] get_ports_and_sgs() called for port_ids ['1a0a2345-c03d-4159-89a8-35402d8d2448'] {{(pid=102994) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 23 19:36:51.446840 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-62127792-65ee-44ce-bab5-c10689490d23 req-f76e529f-f851-4f79-b14f-b60f1aa4d862 tempest-VolumesNegativeTest-1760818768 tempest-VolumesNegativeTest-1760818768-project] 10.222.0.41 "POST /v2.0/ports HTTP/1.1" status: 201 len: 938 time: 1.4156876 Nov 23 19:36:51.460570 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.api.v2.base [req-62127792-65ee-44ce-bab5-c10689490d23 req-af94735d-6690-48cd-8f10-44dca451ee67 service neutron] Request body: {'port': {'device_id': '2b4c5734-55b0-47f1-9223-9875c9561c64', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-81901'}} {{(pid=102993) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 23 19:36:51.527652 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.plugins.ml2.plugin [req-786e01a1-ae7f-45f2-af43-2a48fa6f7451 req-a9d60400-56fd-4840-ae4d-813cd2707883 tempest-ServerRescueNegativeTestJSON-1447477341 tempest-ServerRescueNegativeTestJSON-1447477341-project] Deleting port 50e9d93b-ad23-4b6b-bdd0-ae5afe6f80ea {{(pid=102992) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 23 19:36:51.537030 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [req-786e01a1-ae7f-45f2-af43-2a48fa6f7451 req-a9d60400-56fd-4840-ae4d-813cd2707883 tempest-ServerRescueNegativeTestJSON-1447477341 tempest-ServerRescueNegativeTestJSON-1447477341-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8783631423070'] for port, before_delete {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:36:51.565921 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6530a64a-411f-45f1-9635-5a2a429c0393 req-f292663c-eb67-4267-aaae-06bdb8579b68 tempest-TestVolumeBootPattern-147141705 tempest-TestVolumeBootPattern-147141705-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102993) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:36:51.573211 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-6530a64a-411f-45f1-9635-5a2a429c0393 req-f292663c-eb67-4267-aaae-06bdb8579b68 tempest-TestVolumeBootPattern-147141705 tempest-TestVolumeBootPattern-147141705-project] 10.222.0.62 "GET /v2.0/ports?device_id=4ee0b7a3-f787-4a7c-816a-71f3a99b7193 HTTP/1.1" status: 200 len: 945 time: 0.1071332 Nov 23 19:36:51.585331 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.db.provisioning_blocks [None req-bf2b541e-bc57-4ddc-a7b1-a5ab26ec210c None None] Provisioning complete for port cde3ee31-252a-4d6a-ab52-e04028f9cab7 triggered by entity DHCP. {{(pid=102994) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 23 19:36:51.586100 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron_lib.callbacks.manager [None req-bf2b541e-bc57-4ddc-a7b1-a5ab26ec210c None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-8355713'] for port, provisioning_complete {{(pid=102994) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:36:51.587840 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [req-62127792-65ee-44ce-bab5-c10689490d23 req-af94735d-6690-48cd-8f10-44dca451ee67 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7921281'] for port, before_update {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:36:51.658178 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.plugins.ml2.plugin [None req-bf2b541e-bc57-4ddc-a7b1-a5ab26ec210c None None] Port cde3ee31-252a-4d6a-ab52-e04028f9cab7 cannot update to ACTIVE because it is not bound. {{(pid=102994) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 23 19:36:51.667771 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-6530a64a-411f-45f1-9635-5a2a429c0393 req-860c4087-fc56-437f-a1c8-9b5a559e8311 tempest-TestVolumeBootPattern-147141705 tempest-TestVolumeBootPattern-147141705-project] 10.222.0.62 "GET /v2.0/security-groups?id=a6e2b133-1a9b-4dde-a188-1ce8bcdb7b5c&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0918448 Nov 23 19:36:51.680428 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.plugins.ml2.db [req-786e01a1-ae7f-45f2-af43-2a48fa6f7451 req-a9d60400-56fd-4840-ae4d-813cd2707883 tempest-ServerRescueNegativeTestJSON-1447477341 tempest-ServerRescueNegativeTestJSON-1447477341-project] For port 50e9d93b-ad23-4b6b-bdd0-ae5afe6f80ea, host hv-cinder-81901, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81901',level=0,port_id=50e9d93b-ad23-4b6b-bdd0-ae5afe6f80ea,segment=NetworkSegment(b8302c34-e78d-4c43-9d45-a2604c95a2d2),segment_id=b8302c34-e78d-4c43-9d45-a2604c95a2d2)] {{(pid=102992) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 23 19:36:51.681315 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [req-786e01a1-ae7f-45f2-af43-2a48fa6f7451 req-a9d60400-56fd-4840-ae4d-813cd2707883 tempest-ServerRescueNegativeTestJSON-1447477341 tempest-ServerRescueNegativeTestJSON-1447477341-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-927332'] for port, precommit_delete {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:36:51.727306 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.plugins.ml2.plugin [req-786e01a1-ae7f-45f2-af43-2a48fa6f7451 req-a9d60400-56fd-4840-ae4d-813cd2707883 tempest-ServerRescueNegativeTestJSON-1447477341 tempest-ServerRescueNegativeTestJSON-1447477341-project] Calling delete_port for 50e9d93b-ad23-4b6b-bdd0-ae5afe6f80ea owned by compute:nova {{(pid=102992) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 23 19:36:51.836097 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e354af74-c37b-493e-be6e-08cbe7e921f0 req-747862e8-3353-4061-8eca-3db46375648a tempest-AttachVolumeShelveTestJSON-1172915835 tempest-AttachVolumeShelveTestJSON-1172915835-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102993) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:36:51.837592 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-e354af74-c37b-493e-be6e-08cbe7e921f0 req-747862e8-3353-4061-8eca-3db46375648a tempest-AttachVolumeShelveTestJSON-1172915835 tempest-AttachVolumeShelveTestJSON-1172915835-project] 10.222.0.62 "GET /v2.0/ports?device_id=85ea3d72-6c17-4ea2-82b7-90cce01633bd HTTP/1.1" status: 200 len: 946 time: 0.0728459 Nov 23 19:36:51.952159 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-e354af74-c37b-493e-be6e-08cbe7e921f0 req-e5ade4a9-cf9e-453a-982e-260f8917a077 tempest-AttachVolumeShelveTestJSON-1172915835 tempest-AttachVolumeShelveTestJSON-1172915835-project] 10.222.0.62 "GET /v2.0/security-groups?id=f1ca24d9-0a31-470d-a1d5-fa7059df0141&fields=id&fields=name HTTP/1.1" status: 200 len: 311 time: 0.0967629 Nov 23 19:36:52.047670 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0c74964f-12fe-463f-915c-591e4b994952 req-76b9caf9-e02c-432e-97c3-a0c08a51fc71 tempest-VolumesNegativeTest-1760818768 tempest-VolumesNegativeTest-1760818768-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102992) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:36:52.049358 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-0c74964f-12fe-463f-915c-591e4b994952 req-76b9caf9-e02c-432e-97c3-a0c08a51fc71 tempest-VolumesNegativeTest-1760818768 tempest-VolumesNegativeTest-1760818768-project] 10.222.0.62 "GET /v2.0/ports?device_id=2b4c5734-55b0-47f1-9223-9875c9561c64 HTTP/1.1" status: 200 len: 936 time: 0.3727808 Nov 23 19:36:52.086944 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.notifiers.nova [req-62127792-65ee-44ce-bab5-c10689490d23 req-af94735d-6690-48cd-8f10-44dca451ee67 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id cde3ee31-252a-4d6a-ab52-e04028f9cab7 {{(pid=102993) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 23 19:36:52.097255 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [req-62127792-65ee-44ce-bab5-c10689490d23 req-af94735d-6690-48cd-8f10-44dca451ee67 service neutron] Publish callbacks [] for port, precommit_update {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:36:52.117467 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ff8c4f3c-ea44-480e-afc0-e03e10589fe4 req-d975be5b-1407-48ab-a606-d7ead1b0fa00 tempest-ServerRescueNegativeTestJSON-1447477341 tempest-ServerRescueNegativeTestJSON-1447477341-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102993) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:36:52.118955 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-ff8c4f3c-ea44-480e-afc0-e03e10589fe4 req-d975be5b-1407-48ab-a606-d7ead1b0fa00 tempest-ServerRescueNegativeTestJSON-1447477341 tempest-ServerRescueNegativeTestJSON-1447477341-project] 10.222.0.62 "GET /v2.0/ports?device_id=671f1d44-7752-4a9d-835d-4d76164c900f HTTP/1.1" status: 200 len: 945 time: 0.0962150 Nov 23 19:36:52.121347 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-0c74964f-12fe-463f-915c-591e4b994952 req-a302d733-2725-460f-bf5f-421fb04fd0ff tempest-VolumesNegativeTest-1760818768 tempest-VolumesNegativeTest-1760818768-project] 10.222.0.62 "GET /v2.0/security-groups?id=ac69cba1-f881-4fe2-ba1d-5270c0d54618&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0603654 Nov 23 19:36:52.122825 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.db.provisioning_blocks [req-62127792-65ee-44ce-bab5-c10689490d23 req-af94735d-6690-48cd-8f10-44dca451ee67 service neutron] Transition to ACTIVE for port object cde3ee31-252a-4d6a-ab52-e04028f9cab7 will not be triggered until provisioned by entity L2. {{(pid=102993) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 23 19:36:52.175057 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-ff8c4f3c-ea44-480e-afc0-e03e10589fe4 req-d855a78f-ee36-46ed-85c7-a1661ed9a86e tempest-ServerRescueNegativeTestJSON-1447477341 tempest-ServerRescueNegativeTestJSON-1447477341-project] 10.222.0.62 "GET /v2.0/security-groups?id=62a09434-acf0-424f-9001-2c3a78119364&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0458653 Nov 23 19:36:52.180475 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [req-62127792-65ee-44ce-bab5-c10689490d23 req-af94735d-6690-48cd-8f10-44dca451ee67 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7918660', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-15067', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560168', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8783631423946', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8783631008732', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8783631008750', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-17257505'] for port, after_update {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:36:52.248871 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-af94735d-6690-48cd-8f10-44dca451ee67 service neutron] Pushing event updated for resources: {'Port': ['ID=cde3ee31-252a-4d6a-ab52-e04028f9cab7,revision_number=2']} {{(pid=102993) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 23 19:36:52.267119 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [req-786e01a1-ae7f-45f2-af43-2a48fa6f7451 req-a9d60400-56fd-4840-ae4d-813cd2707883 tempest-ServerRescueNegativeTestJSON-1447477341 tempest-ServerRescueNegativeTestJSON-1447477341-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7918660', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-15067', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560168', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8783631424624', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8783631008723', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-25199805'] for port, after_delete {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:36:52.302349 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a9d60400-56fd-4840-ae4d-813cd2707883 tempest-ServerRescueNegativeTestJSON-1447477341 tempest-ServerRescueNegativeTestJSON-1447477341-project] Pushing event deleted for resources: {'Port': ['ID=50e9d93b-ad23-4b6b-bdd0-ae5afe6f80ea,revision_number=None']} {{(pid=102992) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 23 19:36:52.310258 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.plugins.ml2.managers [req-62127792-65ee-44ce-bab5-c10689490d23 req-af94735d-6690-48cd-8f10-44dca451ee67 service neutron] Attempting to bind port cde3ee31-252a-4d6a-ab52-e04028f9cab7 on host hv-cinder-81901 for vnic_type normal with profile {{(pid=102993) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 23 19:36:52.312231 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.plugins.ml2.managers [req-62127792-65ee-44ce-bab5-c10689490d23 req-af94735d-6690-48cd-8f10-44dca451ee67 service neutron] Attempting to bind port cde3ee31-252a-4d6a-ab52-e04028f9cab7 by drivers openvswitch,hyperv on host hv-cinder-81901 at level 0 using segments [{'id': '760573d6-1aff-43f3-9bab-dbb5402f9396', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 802, 'network_id': '2096bff1-f35e-4603-897c-41fe38bec144'}] {{(pid=102993) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 23 19:36:52.312231 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-62127792-65ee-44ce-bab5-c10689490d23 req-af94735d-6690-48cd-8f10-44dca451ee67 service neutron] Attempting to bind port cde3ee31-252a-4d6a-ab52-e04028f9cab7 on network 2096bff1-f35e-4603-897c-41fe38bec144 {{(pid=102993) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 23 19:36:52.317609 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-62127792-65ee-44ce-bab5-c10689490d23 req-af94735d-6690-48cd-8f10-44dca451ee67 service neutron] Port cde3ee31-252a-4d6a-ab52-e04028f9cab7 on network 2096bff1-f35e-4603-897c-41fe38bec144 not bound, no agent of type Open vSwitch agent registered on host hv-cinder-81901 {{(pid=102993) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Nov 23 19:36:52.318005 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-62127792-65ee-44ce-bab5-c10689490d23 req-af94735d-6690-48cd-8f10-44dca451ee67 service neutron] Attempting to bind port cde3ee31-252a-4d6a-ab52-e04028f9cab7 on network 2096bff1-f35e-4603-897c-41fe38bec144 {{(pid=102993) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 23 19:36:52.323477 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-62127792-65ee-44ce-bab5-c10689490d23 req-af94735d-6690-48cd-8f10-44dca451ee67 service neutron] Checking agent: {'id': '14e5d049-431d-466a-8d1c-264e5129d376', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-81901', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 23, 19, 31, 29), 'started_at': datetime.datetime(2021, 11, 23, 19, 31, 29), 'heartbeat_timestamp': datetime.datetime(2021, 11, 23, 19, 36, 29), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=102993) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 23 19:36:52.323894 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-62127792-65ee-44ce-bab5-c10689490d23 req-af94735d-6690-48cd-8f10-44dca451ee67 service neutron] Checking segment: {'id': '760573d6-1aff-43f3-9bab-dbb5402f9396', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 802, 'network_id': '2096bff1-f35e-4603-897c-41fe38bec144'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102993) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 23 19:36:52.324295 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-62127792-65ee-44ce-bab5-c10689490d23 req-af94735d-6690-48cd-8f10-44dca451ee67 service neutron] Bound using segment: {'id': '760573d6-1aff-43f3-9bab-dbb5402f9396', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 802, 'network_id': '2096bff1-f35e-4603-897c-41fe38bec144'} {{(pid=102993) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 23 19:36:52.325109 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.plugins.ml2.managers [req-62127792-65ee-44ce-bab5-c10689490d23 req-af94735d-6690-48cd-8f10-44dca451ee67 service neutron] Bound port: cde3ee31-252a-4d6a-ab52-e04028f9cab7, host: hv-cinder-81901, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '760573d6-1aff-43f3-9bab-dbb5402f9396', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 802, 'network_id': '2096bff1-f35e-4603-897c-41fe38bec144'}}] {{(pid=102993) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 23 19:36:52.325639 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [req-62127792-65ee-44ce-bab5-c10689490d23 req-af94735d-6690-48cd-8f10-44dca451ee67 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7921281'] for port, before_update {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:36:52.346931 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.db.l3_dvrscheduler_db [req-786e01a1-ae7f-45f2-af43-2a48fa6f7451 req-a9d60400-56fd-4840-ae4d-813cd2707883 tempest-ServerRescueNegativeTestJSON-1447477341 tempest-ServerRescueNegativeTestJSON-1447477341-project] No DVR routers for this DVR port 50e9d93b-ad23-4b6b-bdd0-ae5afe6f80ea on host hv-cinder-81901 {{(pid=102992) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 23 19:36:52.350228 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [req-786e01a1-ae7f-45f2-af43-2a48fa6f7451 req-a9d60400-56fd-4840-ae4d-813cd2707883 tempest-ServerRescueNegativeTestJSON-1447477341 tempest-ServerRescueNegativeTestJSON-1447477341-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-514902'] for port, before_response {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:36:52.353910 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-786e01a1-ae7f-45f2-af43-2a48fa6f7451 req-a9d60400-56fd-4840-ae4d-813cd2707883 tempest-ServerRescueNegativeTestJSON-1447477341 tempest-ServerRescueNegativeTestJSON-1447477341-project] 10.222.0.41 "DELETE /v2.0/ports/50e9d93b-ad23-4b6b-bdd0-ae5afe6f80ea HTTP/1.1" status: 204 len: 173 time: 0.9820054 Nov 23 19:36:52.354501 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '671f1d44-7752-4a9d-835d-4d76164c900f', 'name': 'network-vif-deleted', 'tag': '50e9d93b-ad23-4b6b-bdd0-ae5afe6f80ea'}] {{(pid=102992) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 23 19:36:52.357063 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.62/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}f86c332b591ae691ababa4b64e0601cbf242a448242f95367ce03daabfb7e1ce" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-32789589-0ed8-4902-a6b3-2fd099f4a659" -d '{"events": [{"server_uuid": "671f1d44-7752-4a9d-835d-4d76164c900f", "name": "network-vif-deleted", "tag": "50e9d93b-ad23-4b6b-bdd0-ae5afe6f80ea"}]}' {{(pid=102992) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 23 19:36:52.395912 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 23 Nov 2021 19:36:52 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-47c51f66-ab19-4f22-85c8-0e310860c6c9 x-openstack-request-id: req-47c51f66-ab19-4f22-85c8-0e310860c6c9 {{(pid=102992) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 23 19:36:52.398578 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "671f1d44-7752-4a9d-835d-4d76164c900f", "name": "network-vif-deleted", "tag": "50e9d93b-ad23-4b6b-bdd0-ae5afe6f80ea", "status": "completed", "code": 200}]} {{(pid=102992) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 23 19:36:52.398578 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.62/compute/v2.1/os-server-external-events used request id req-47c51f66-ab19-4f22-85c8-0e310860c6c9 {{(pid=102992) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 23 19:36:52.398578 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '671f1d44-7752-4a9d-835d-4d76164c900f', 'name': 'network-vif-deleted', 'tag': '50e9d93b-ad23-4b6b-bdd0-ae5afe6f80ea', 'status': 'completed', 'code': 200} Nov 23 19:36:52.399402 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.plugins.ml2.db [req-62127792-65ee-44ce-bab5-c10689490d23 req-af94735d-6690-48cd-8f10-44dca451ee67 service neutron] For port cde3ee31-252a-4d6a-ab52-e04028f9cab7, host hv-cinder-81901, cleared binding levels {{(pid=102993) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 23 19:36:52.402704 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.plugins.ml2.db [req-62127792-65ee-44ce-bab5-c10689490d23 req-af94735d-6690-48cd-8f10-44dca451ee67 service neutron] For port cde3ee31-252a-4d6a-ab52-e04028f9cab7, host hv-cinder-81901, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81901',level=0,port_id=cde3ee31-252a-4d6a-ab52-e04028f9cab7,segment=NetworkSegment(760573d6-1aff-43f3-9bab-dbb5402f9396),segment_id=760573d6-1aff-43f3-9bab-dbb5402f9396)] {{(pid=102993) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 23 19:36:52.483902 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [req-62127792-65ee-44ce-bab5-c10689490d23 req-af94735d-6690-48cd-8f10-44dca451ee67 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7918660', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-15067', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560168', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8783631423946', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8783631008732', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8783631008750', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-17257505'] for port, after_update {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:36:52.531487 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-62127792-65ee-44ce-bab5-c10689490d23 req-af94735d-6690-48cd-8f10-44dca451ee67 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102993) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:36:52.532837 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [req-62127792-65ee-44ce-bab5-c10689490d23 req-af94735d-6690-48cd-8f10-44dca451ee67 service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-514902'] for port, before_response {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:36:52.534881 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-62127792-65ee-44ce-bab5-c10689490d23 req-af94735d-6690-48cd-8f10-44dca451ee67 service neutron] 10.222.0.41 "PUT /v2.0/ports/cde3ee31-252a-4d6a-ab52-e04028f9cab7 HTTP/1.1" status: 200 len: 1098 time: 1.0787084 Nov 23 19:36:52.537263 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '2b4c5734-55b0-47f1-9223-9875c9561c64', 'tag': 'cde3ee31-252a-4d6a-ab52-e04028f9cab7'}] {{(pid=102993) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 23 19:36:52.539904 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.62/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}9b10b92acbee16fb695be1efeed0b68f7c36a5b215ec004a8d9d707fa3d35b2c" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-164eba93-f832-42c2-8a8e-b1ce8f56755a" -d '{"events": [{"name": "network-changed", "server_uuid": "2b4c5734-55b0-47f1-9223-9875c9561c64", "tag": "cde3ee31-252a-4d6a-ab52-e04028f9cab7"}]}' {{(pid=102993) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 23 19:36:52.567376 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-af94735d-6690-48cd-8f10-44dca451ee67 service neutron] Pushing event updated for resources: {'Port': ['ID=cde3ee31-252a-4d6a-ab52-e04028f9cab7,revision_number=3']} {{(pid=102993) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 23 19:36:52.592134 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Tue, 23 Nov 2021 19:36:52 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-163d26d6-970e-4475-b152-7c08bc0c2ebd x-openstack-request-id: req-163d26d6-970e-4475-b152-7c08bc0c2ebd {{(pid=102993) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 23 19:36:52.592500 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "2b4c5734-55b0-47f1-9223-9875c9561c64", "tag": "cde3ee31-252a-4d6a-ab52-e04028f9cab7", "status": "completed", "code": 200}]} {{(pid=102993) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 23 19:36:52.592959 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.62/compute/v2.1/os-server-external-events used request id req-163d26d6-970e-4475-b152-7c08bc0c2ebd {{(pid=102993) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 23 19:36:52.593480 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '2b4c5734-55b0-47f1-9223-9875c9561c64', 'tag': 'cde3ee31-252a-4d6a-ab52-e04028f9cab7', 'status': 'completed', 'code': 200} Nov 23 19:36:52.781375 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ae03e692-949e-4190-8a6e-85d3a8b1f0b8 req-e9a7be3d-efd6-479e-b050-3df72d05fe68 tempest-TestVolumeBootPattern-147141705 tempest-TestVolumeBootPattern-147141705-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102992) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:36:52.783632 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-ae03e692-949e-4190-8a6e-85d3a8b1f0b8 req-e9a7be3d-efd6-479e-b050-3df72d05fe68 tempest-TestVolumeBootPattern-147141705 tempest-TestVolumeBootPattern-147141705-project] 10.222.0.62 "GET /v2.0/ports?device_id=4ee0b7a3-f787-4a7c-816a-71f3a99b7193 HTTP/1.1" status: 200 len: 945 time: 0.0492671 Nov 23 19:36:52.842389 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-ae03e692-949e-4190-8a6e-85d3a8b1f0b8 req-55276902-75b5-44c5-967a-9a54270901e0 tempest-TestVolumeBootPattern-147141705 tempest-TestVolumeBootPattern-147141705-project] 10.222.0.62 "GET /v2.0/security-groups?id=a6e2b133-1a9b-4dde-a188-1ce8bcdb7b5c&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0505884 Nov 23 19:36:53.076513 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1b811e33-6bbd-44ed-94a9-98343aa323bf req-a90f932f-ab00-47ec-8255-fedaf8d94a30 tempest-AttachVolumeShelveTestJSON-1172915835 tempest-AttachVolumeShelveTestJSON-1172915835-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102993) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:36:53.078025 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-1b811e33-6bbd-44ed-94a9-98343aa323bf req-a90f932f-ab00-47ec-8255-fedaf8d94a30 tempest-AttachVolumeShelveTestJSON-1172915835 tempest-AttachVolumeShelveTestJSON-1172915835-project] 10.222.0.62 "GET /v2.0/ports?device_id=85ea3d72-6c17-4ea2-82b7-90cce01633bd HTTP/1.1" status: 200 len: 946 time: 0.0494573 Nov 23 19:36:53.129981 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-1b811e33-6bbd-44ed-94a9-98343aa323bf req-474dcd31-ffcb-4fca-ac85-ed21a795f823 tempest-AttachVolumeShelveTestJSON-1172915835 tempest-AttachVolumeShelveTestJSON-1172915835-project] 10.222.0.62 "GET /v2.0/security-groups?id=f1ca24d9-0a31-470d-a1d5-fa7059df0141&fields=id&fields=name HTTP/1.1" status: 200 len: 311 time: 0.0458751 Nov 23 19:36:53.243940 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c4f3681c-f232-46f7-b0c7-1995bfe57b3a req-8537f63c-f254-4e04-8b60-3603dc579a4b tempest-VolumesNegativeTest-1760818768 tempest-VolumesNegativeTest-1760818768-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102992) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:36:53.247874 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-c4f3681c-f232-46f7-b0c7-1995bfe57b3a req-8537f63c-f254-4e04-8b60-3603dc579a4b tempest-VolumesNegativeTest-1760818768 tempest-VolumesNegativeTest-1760818768-project] 10.222.0.62 "GET /v2.0/ports?device_id=2b4c5734-55b0-47f1-9223-9875c9561c64 HTTP/1.1" status: 200 len: 948 time: 0.0555968 Nov 23 19:36:53.271885 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-de455c3d-3e8c-48e3-9c86-fecd254b6d25 req-b05f0b59-6d63-4226-9b82-416a9689dd40 tempest-ServerRescueNegativeTestJSON-1447477341 tempest-ServerRescueNegativeTestJSON-1447477341-project] 10.222.0.62 "GET /v2.0/ports?device_id=671f1d44-7752-4a9d-835d-4d76164c900f HTTP/1.1" status: 200 len: 210 time: 0.0263784 Nov 23 19:36:53.293254 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-c4f3681c-f232-46f7-b0c7-1995bfe57b3a req-fc7928ad-bf1b-456b-8e85-df2a70b5a4e3 tempest-VolumesNegativeTest-1760818768 tempest-VolumesNegativeTest-1760818768-project] 10.222.0.62 "GET /v2.0/security-groups?id=ac69cba1-f881-4fe2-ba1d-5270c0d54618&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0406296 Nov 23 19:36:53.956526 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-24a98bf9-26a3-40af-99ec-434451fba793 req-26415ddd-15cb-4dc8-8539-f0221027e7dc tempest-TestVolumeBootPattern-147141705 tempest-TestVolumeBootPattern-147141705-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102993) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:36:53.958007 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-24a98bf9-26a3-40af-99ec-434451fba793 req-26415ddd-15cb-4dc8-8539-f0221027e7dc tempest-TestVolumeBootPattern-147141705 tempest-TestVolumeBootPattern-147141705-project] 10.222.0.62 "GET /v2.0/ports?device_id=4ee0b7a3-f787-4a7c-816a-71f3a99b7193 HTTP/1.1" status: 200 len: 945 time: 0.0488036 Nov 23 19:36:54.008031 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-24a98bf9-26a3-40af-99ec-434451fba793 req-59532d5c-7ac2-4304-83e9-9b415c333a01 tempest-TestVolumeBootPattern-147141705 tempest-TestVolumeBootPattern-147141705-project] 10.222.0.62 "GET /v2.0/security-groups?id=a6e2b133-1a9b-4dde-a188-1ce8bcdb7b5c&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0439966 Nov 23 19:36:54.183326 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.wsgi [-] (102993) accepted ('10.222.0.62', 47432) {{(pid=102993) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 23 19:36:54.253989 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-10ea8f2a-b3bd-4def-ab7b-59ed0fb0b6db req-5161bcb4-80e4-4ae3-a8df-0bfa1d5733a3 tempest-AttachVolumeShelveTestJSON-1172915835 tempest-AttachVolumeShelveTestJSON-1172915835-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102992) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:36:54.256991 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-10ea8f2a-b3bd-4def-ab7b-59ed0fb0b6db req-5161bcb4-80e4-4ae3-a8df-0bfa1d5733a3 tempest-AttachVolumeShelveTestJSON-1172915835 tempest-AttachVolumeShelveTestJSON-1172915835-project] 10.222.0.62 "GET /v2.0/ports?device_id=85ea3d72-6c17-4ea2-82b7-90cce01633bd HTTP/1.1" status: 200 len: 946 time: 0.0510476 Nov 23 19:36:54.295919 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-0192afd3-25de-4753-a707-140a306e8e86 admin admin] Publish callbacks [] for security_group, before_create {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:36:54.311557 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-10ea8f2a-b3bd-4def-ab7b-59ed0fb0b6db req-d59b8246-82c1-4a1c-b43f-38a70d8df3bf tempest-AttachVolumeShelveTestJSON-1172915835 tempest-AttachVolumeShelveTestJSON-1172915835-project] 10.222.0.62 "GET /v2.0/security-groups?id=f1ca24d9-0a31-470d-a1d5-fa7059df0141&fields=id&fields=name HTTP/1.1" status: 200 len: 311 time: 0.0437324 Nov 23 19:36:54.383987 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-5ff4a26a-23db-4c2e-857c-000fb68d10f5 req-e932d83d-a604-4035-8423-ef0765f0e477 tempest-ServerRescueNegativeTestJSON-1447477341 tempest-ServerRescueNegativeTestJSON-1447477341-project] 10.222.0.62 "GET /v2.0/ports?device_id=671f1d44-7752-4a9d-835d-4d76164c900f HTTP/1.1" status: 200 len: 210 time: 0.0421395 Nov 23 19:36:54.419322 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-0192afd3-25de-4753-a707-140a306e8e86 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:36:54.444683 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fc44009e-cc4d-4d8d-ba43-b1782877aead req-5330aae5-7289-453c-9176-7750a9f7547e tempest-VolumesNegativeTest-1760818768 tempest-VolumesNegativeTest-1760818768-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102992) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:36:54.446206 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-fc44009e-cc4d-4d8d-ba43-b1782877aead req-5330aae5-7289-453c-9176-7750a9f7547e tempest-VolumesNegativeTest-1760818768 tempest-VolumesNegativeTest-1760818768-project] 10.222.0.62 "GET /v2.0/ports?device_id=2b4c5734-55b0-47f1-9223-9875c9561c64 HTTP/1.1" status: 200 len: 948 time: 0.0664086 Nov 23 19:36:54.484005 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-964b9a40-d645-428e-b982-3c417eed77f9 req-f28d2a57-0e60-4995-a203-285c9328b342 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102993) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:36:54.486515 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-964b9a40-d645-428e-b982-3c417eed77f9 req-f28d2a57-0e60-4995-a203-285c9328b342 service neutron] 10.222.0.41 "GET /v2.0/ports?device_id=85ea3d72-6c17-4ea2-82b7-90cce01633bd HTTP/1.1" status: 200 len: 1099 time: 0.0432119 Nov 23 19:36:54.508197 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-0192afd3-25de-4753-a707-140a306e8e86 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-623933'] for security_group, after_create {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:36:54.523661 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-164eba93-f832-42c2-8a8e-b1ce8f56755a req-539a3a1f-8526-4a9c-95e7-9235b4195bd5 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102992) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:36:54.525155 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-164eba93-f832-42c2-8a8e-b1ce8f56755a req-539a3a1f-8526-4a9c-95e7-9235b4195bd5 service neutron] 10.222.0.41 "GET /v2.0/ports?tenant_id=c52c093db38c40a383ef38ffbc4083a5&device_id=2b4c5734-55b0-47f1-9223-9875c9561c64 HTTP/1.1" status: 200 len: 1101 time: 0.0780878 Nov 23 19:36:54.528911 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-fc44009e-cc4d-4d8d-ba43-b1782877aead req-61341fca-a8a3-4a95-8c1d-d886062b3536 tempest-VolumesNegativeTest-1760818768 tempest-VolumesNegativeTest-1760818768-project] 10.222.0.62 "GET /v2.0/security-groups?id=ac69cba1-f881-4fe2-ba1d-5270c0d54618&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0724676 Nov 23 19:36:54.563600 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-164eba93-f832-42c2-8a8e-b1ce8f56755a req-45ab2436-03ce-4884-8a74-59c55d18a3c4 service neutron] 10.222.0.41 "GET /v2.0/networks?tenant_id=c52c093db38c40a383ef38ffbc4083a5&shared=False HTTP/1.1" status: 200 len: 213 time: 0.0244050 Nov 23 19:36:54.571201 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [None req-0192afd3-25de-4753-a707-140a306e8e86 admin admin] 10.222.0.62 "GET /v2.0/security-groups?tenant_id=f32661d310034ab6ac396f51ae72a846&name=default HTTP/1.1" status: 200 len: 2996 time: 0.3866196 Nov 23 19:36:54.572946 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0192afd3-25de-4753-a707-140a306e8e86 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=b9d33855-6f13-401b-993c-9afaa23efd77,revision_number=1']} {{(pid=102993) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 23 19:36:54.576623 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.wsgi [-] (102993) accepted ('10.222.0.62', 47442) {{(pid=102993) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 23 19:36:54.586593 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-964b9a40-d645-428e-b982-3c417eed77f9 req-98dbb88c-9790-4494-bc17-14f3a62696e9 service neutron] 10.222.0.41 "GET /v2.0/security-groups?id=f1ca24d9-0a31-470d-a1d5-fa7059df0141&fields=id&fields=name HTTP/1.1" status: 200 len: 311 time: 0.0927565 Nov 23 19:36:54.632392 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-68cd5036-3e37-46d7-848f-d9ec11841424 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:36:54.654867 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-68cd5036-3e37-46d7-848f-d9ec11841424 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:36:54.667676 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-164eba93-f832-42c2-8a8e-b1ce8f56755a req-ad2f68a3-de6d-47b5-9a76-9b9bbc952a62 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102992) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:36:54.669196 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-164eba93-f832-42c2-8a8e-b1ce8f56755a req-ad2f68a3-de6d-47b5-9a76-9b9bbc952a62 service neutron] 10.222.0.41 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 870 time: 0.0976391 Nov 23 19:36:54.699447 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.plugins.ml2.db [None req-4bf48ff4-ecfb-4168-8b63-249b8c6e9f04 None None] get_ports_and_sgs() called for port_ids ['50e9d93b-ad23-4b6b-bdd0-ae5afe6f80ea'] {{(pid=102994) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 23 19:36:54.746350 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-68cd5036-3e37-46d7-848f-d9ec11841424 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-623933'] for security_group, after_delete {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:36:54.749029 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-68cd5036-3e37-46d7-848f-d9ec11841424 admin admin] Publish callbacks [] for security_group, before_response {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:36:54.750895 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [None req-68cd5036-3e37-46d7-848f-d9ec11841424 admin admin] 10.222.0.62 "DELETE /v2.0/security-groups/b9d33855-6f13-401b-993c-9afaa23efd77 HTTP/1.1" status: 204 len: 168 time: 0.1724129 Nov 23 19:36:54.759553 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-68cd5036-3e37-46d7-848f-d9ec11841424 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=b9d33855-6f13-401b-993c-9afaa23efd77,revision_number=None']} {{(pid=102993) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 23 19:36:54.878066 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-62127792-65ee-44ce-bab5-c10689490d23 req-e71c8372-a98a-4325-b44b-31aacb507370 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102992) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:36:54.879496 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-62127792-65ee-44ce-bab5-c10689490d23 req-e71c8372-a98a-4325-b44b-31aacb507370 service neutron] 10.222.0.41 "GET /v2.0/ports?tenant_id=c52c093db38c40a383ef38ffbc4083a5&device_id=2b4c5734-55b0-47f1-9223-9875c9561c64 HTTP/1.1" status: 200 len: 1101 time: 0.0414786 Nov 23 19:36:54.926603 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-62127792-65ee-44ce-bab5-c10689490d23 req-ca2129c2-25c4-4f2b-9b77-f07e0570c525 service neutron] 10.222.0.41 "GET /v2.0/floatingips?fixed_ip_address=192.168.233.144&port_id=cde3ee31-252a-4d6a-ab52-e04028f9cab7 HTTP/1.1" status: 200 len: 217 time: 0.0364475 Nov 23 19:36:54.979558 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-62127792-65ee-44ce-bab5-c10689490d23 req-d8bbdf21-483d-4244-9a9b-7d8031d0f973 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102992) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:36:54.981037 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-62127792-65ee-44ce-bab5-c10689490d23 req-d8bbdf21-483d-4244-9a9b-7d8031d0f973 service neutron] 10.222.0.41 "GET /v2.0/subnets?id=2a6b6168-a59d-4c5e-be49-7d9bee937678 HTTP/1.1" status: 200 len: 843 time: 0.0442722 Nov 23 19:36:55.035767 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-62127792-65ee-44ce-bab5-c10689490d23 req-bf1c1fb9-960d-4f46-a4c3-d27837dc427f service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102992) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:36:55.037350 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-62127792-65ee-44ce-bab5-c10689490d23 req-bf1c1fb9-960d-4f46-a4c3-d27837dc427f service neutron] 10.222.0.41 "GET /v2.0/ports?network_id=2096bff1-f35e-4603-897c-41fe38bec144&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1178 time: 0.0472023 Nov 23 19:36:55.132389 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-62127792-65ee-44ce-bab5-c10689490d23 req-9599183e-b64a-44b0-a614-c0374bc2ef73 service neutron] 10.222.0.41 "GET /v2.0/networks/2096bff1-f35e-4603-897c-41fe38bec144?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0853105 Nov 23 19:36:55.132686 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9df9396c-dcc7-4b21-be47-3f5da2e79d5b req-9a6bb63b-c8d9-49bd-8de2-2460a2445823 tempest-TestVolumeBootPattern-147141705 tempest-TestVolumeBootPattern-147141705-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102993) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:36:55.134314 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-9df9396c-dcc7-4b21-be47-3f5da2e79d5b req-9a6bb63b-c8d9-49bd-8de2-2460a2445823 tempest-TestVolumeBootPattern-147141705 tempest-TestVolumeBootPattern-147141705-project] 10.222.0.62 "GET /v2.0/ports?device_id=4ee0b7a3-f787-4a7c-816a-71f3a99b7193 HTTP/1.1" status: 200 len: 945 time: 0.0541818 Nov 23 19:36:55.189601 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-9df9396c-dcc7-4b21-be47-3f5da2e79d5b req-ac1b6af5-4e32-4d1c-94cf-997eabcb39d2 tempest-TestVolumeBootPattern-147141705 tempest-TestVolumeBootPattern-147141705-project] 10.222.0.62 "GET /v2.0/security-groups?id=a6e2b133-1a9b-4dde-a188-1ce8bcdb7b5c&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0491884 Nov 23 19:36:55.233225 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-62127792-65ee-44ce-bab5-c10689490d23 req-b9117728-2538-4ae3-97a7-cbaa54692927 service neutron] 10.222.0.41 "GET /v2.0/networks/2096bff1-f35e-4603-897c-41fe38bec144?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0928221 Nov 23 19:36:55.314800 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.wsgi [-] (102993) accepted ('10.222.0.62', 47452) {{(pid=102993) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 23 19:36:55.329538 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-3002ad71-25ff-492e-a522-4330e042316e admin admin] Publish callbacks [] for security_group, before_create {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:36:55.426420 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-3002ad71-25ff-492e-a522-4330e042316e admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:36:55.445219 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-60d12187-ba85-4c46-9e9c-fa55508e9edd req-1984923f-44c8-498b-ab5c-aaf5209d3dba tempest-AttachVolumeShelveTestJSON-1172915835 tempest-AttachVolumeShelveTestJSON-1172915835-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102992) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:36:55.448678 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-60d12187-ba85-4c46-9e9c-fa55508e9edd req-1984923f-44c8-498b-ab5c-aaf5209d3dba tempest-AttachVolumeShelveTestJSON-1172915835 tempest-AttachVolumeShelveTestJSON-1172915835-project] 10.222.0.62 "GET /v2.0/ports?device_id=85ea3d72-6c17-4ea2-82b7-90cce01633bd HTTP/1.1" status: 200 len: 946 time: 0.0517118 Nov 23 19:36:55.494736 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-3002ad71-25ff-492e-a522-4330e042316e admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-623933'] for security_group, after_create {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:36:55.499609 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-60d12187-ba85-4c46-9e9c-fa55508e9edd req-46cd8832-615f-4268-8bd0-41438ab9cf7c tempest-AttachVolumeShelveTestJSON-1172915835 tempest-AttachVolumeShelveTestJSON-1172915835-project] 10.222.0.62 "GET /v2.0/security-groups?id=f1ca24d9-0a31-470d-a1d5-fa7059df0141&fields=id&fields=name HTTP/1.1" status: 200 len: 311 time: 0.0454764 Nov 23 19:36:55.545915 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-d78111c6-4735-49bd-aaab-881a6e0cce3d req-13465352-ee13-44be-9545-988cb5c16a88 tempest-ServerRescueNegativeTestJSON-1447477341 tempest-ServerRescueNegativeTestJSON-1447477341-project] 10.222.0.62 "GET /v2.0/ports?device_id=671f1d44-7752-4a9d-835d-4d76164c900f HTTP/1.1" status: 200 len: 210 time: 0.0482287 Nov 23 19:36:55.572937 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [None req-3002ad71-25ff-492e-a522-4330e042316e admin admin] 10.222.0.62 "GET /v2.0/security-groups?tenant_id=66a72591d9e14ca484f656947135606a&name=default HTTP/1.1" status: 200 len: 2996 time: 0.2561936 Nov 23 19:36:55.575348 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.wsgi [-] (102992) accepted ('10.222.0.62', 47472) {{(pid=102992) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 23 19:36:55.583070 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3002ad71-25ff-492e-a522-4330e042316e admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=439f4c45-9f63-4007-b559-1be0ea756ba6,revision_number=1']} {{(pid=102993) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 23 19:36:55.676031 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b4195540-b010-4679-9900-5e143046d488 req-4ef8dcf0-2fac-449e-a180-377f5d3bedde tempest-VolumesNegativeTest-1760818768 tempest-VolumesNegativeTest-1760818768-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102993) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:36:55.677448 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-b4195540-b010-4679-9900-5e143046d488 req-4ef8dcf0-2fac-449e-a180-377f5d3bedde tempest-VolumesNegativeTest-1760818768 tempest-VolumesNegativeTest-1760818768-project] 10.222.0.62 "GET /v2.0/ports?device_id=2b4c5734-55b0-47f1-9223-9875c9561c64 HTTP/1.1" status: 200 len: 948 time: 0.0552521 Nov 23 19:36:55.709557 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [None req-de8d4ee1-a54d-46c9-bcf8-42b2b2a27f0c admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:36:55.728660 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-b4195540-b010-4679-9900-5e143046d488 req-f270c3ed-0151-4ff9-a82e-90c1a1523b46 tempest-VolumesNegativeTest-1760818768 tempest-VolumesNegativeTest-1760818768-project] 10.222.0.62 "GET /v2.0/security-groups?id=ac69cba1-f881-4fe2-ba1d-5270c0d54618&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0441329 Nov 23 19:36:55.741537 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ea00a940-d0c0-455b-aac1-6c8c7aae2ffa req-7105859e-5eff-47df-a9b9-b091265ec1df tempest-VolumesSnapshotTestJSON-97879810 tempest-VolumesSnapshotTestJSON-97879810-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=102992) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:36:55.743049 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-ea00a940-d0c0-455b-aac1-6c8c7aae2ffa req-7105859e-5eff-47df-a9b9-b091265ec1df tempest-VolumesSnapshotTestJSON-97879810 tempest-VolumesSnapshotTestJSON-97879810-project] 10.222.0.62 "GET /v2.0/networks?id=6a5d33a0-25a4-4580-ae9f-e7aa9d768182 HTTP/1.1" status: 200 len: 813 time: 0.1605802 Nov 23 19:36:55.753739 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [None req-de8d4ee1-a54d-46c9-bcf8-42b2b2a27f0c admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:36:55.768830 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-ea00a940-d0c0-455b-aac1-6c8c7aae2ffa req-66abadd1-c0aa-49d5-bd69-0e868d3dc712 tempest-VolumesSnapshotTestJSON-97879810 tempest-VolumesSnapshotTestJSON-97879810-project] 10.222.0.62 "GET /v2.0/quotas/766c6a829b9945cfb36bad289566c0ad HTTP/1.1" status: 200 len: 375 time: 0.0177839 Nov 23 19:36:55.814164 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-ea00a940-d0c0-455b-aac1-6c8c7aae2ffa req-73b7e610-add1-4b10-af0b-3a1ca7658539 tempest-VolumesSnapshotTestJSON-97879810 tempest-VolumesSnapshotTestJSON-97879810-project] 10.222.0.62 "GET /v2.0/ports?tenant_id=766c6a829b9945cfb36bad289566c0ad&fields=id HTTP/1.1" status: 200 len: 210 time: 0.0385950 Nov 23 19:36:55.910176 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-ea00a940-d0c0-455b-aac1-6c8c7aae2ffa req-f676a4a2-89b7-4282-9b40-45eebd29e5be service neutron] 10.222.0.62 "GET /v2.0/networks/6a5d33a0-25a4-4580-ae9f-e7aa9d768182?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0878880 Nov 23 19:36:55.924757 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [None req-de8d4ee1-a54d-46c9-bcf8-42b2b2a27f0c admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-623933'] for security_group, after_delete {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:36:55.927511 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [None req-de8d4ee1-a54d-46c9-bcf8-42b2b2a27f0c admin admin] Publish callbacks [] for security_group, before_response {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:36:55.931248 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [None req-de8d4ee1-a54d-46c9-bcf8-42b2b2a27f0c admin admin] 10.222.0.62 "DELETE /v2.0/security-groups/439f4c45-9f63-4007-b559-1be0ea756ba6 HTTP/1.1" status: 204 len: 168 time: 0.3521943 Nov 23 19:36:55.957431 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-de8d4ee1-a54d-46c9-bcf8-42b2b2a27f0c admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=439f4c45-9f63-4007-b559-1be0ea756ba6,revision_number=None']} {{(pid=102992) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 23 19:36:56.008931 dv-cinder-819011-1-iscsi neutron-server[102995]: DEBUG neutron.db.agents_db [None req-84bdc9b2-57ea-4bdb-a245-07c78d37cea8 None None] Agent healthcheck: found 6 active agents {{(pid=102995) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 23 19:36:56.034615 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-ea00a940-d0c0-455b-aac1-6c8c7aae2ffa req-a9120ada-9ddd-4831-b52b-8a25fec541fa service neutron] 10.222.0.62 "GET /v2.0/networks/6a5d33a0-25a4-4580-ae9f-e7aa9d768182?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1183474 Nov 23 19:36:56.338773 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c8e93aed-058a-4c16-bac7-966b05f1cbfa req-17b1bafd-daff-47f5-9141-45b7e9d58300 tempest-TestVolumeBootPattern-147141705 tempest-TestVolumeBootPattern-147141705-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102993) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:36:56.348635 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-c8e93aed-058a-4c16-bac7-966b05f1cbfa req-17b1bafd-daff-47f5-9141-45b7e9d58300 tempest-TestVolumeBootPattern-147141705 tempest-TestVolumeBootPattern-147141705-project] 10.222.0.62 "GET /v2.0/ports?device_id=4ee0b7a3-f787-4a7c-816a-71f3a99b7193 HTTP/1.1" status: 200 len: 945 time: 0.0810304 Nov 23 19:36:56.349307 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-cddb323f-1583-4007-89fa-6eee97538dab req-97e370ab-34c1-4cc1-a2cd-afcab03ff55d tempest-VolumesSnapshotTestJSON-97879810 tempest-VolumesSnapshotTestJSON-97879810-project] 10.222.0.62 "GET /v2.0/ports?device_id=56521436-30ba-4dcc-8272-0fcda3e896b0 HTTP/1.1" status: 200 len: 210 time: 0.0817842 Nov 23 19:36:56.384047 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.plugins.ml2.rpc [None req-4bf48ff4-ecfb-4168-8b63-249b8c6e9f04 None None] Device 1a0a2345-c03d-4159-89a8-35402d8d2448 up at agent hyperv_hv-cinder-81901 {{(pid=102994) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 23 19:36:56.420039 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-c8e93aed-058a-4c16-bac7-966b05f1cbfa req-933ff046-5451-4380-a078-557adf09df18 tempest-TestVolumeBootPattern-147141705 tempest-TestVolumeBootPattern-147141705-project] 10.222.0.62 "GET /v2.0/security-groups?id=a6e2b133-1a9b-4dde-a188-1ce8bcdb7b5c&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0679238 Nov 23 19:36:56.497354 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.db.provisioning_blocks [None req-4bf48ff4-ecfb-4168-8b63-249b8c6e9f04 None None] Provisioning for port 1a0a2345-c03d-4159-89a8-35402d8d2448 completed by entity L2. {{(pid=102994) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 23 19:36:56.503293 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.db.provisioning_blocks [None req-4bf48ff4-ecfb-4168-8b63-249b8c6e9f04 None None] Provisioning complete for port 1a0a2345-c03d-4159-89a8-35402d8d2448 triggered by entity L2. {{(pid=102994) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 23 19:36:56.503751 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron_lib.callbacks.manager [None req-4bf48ff4-ecfb-4168-8b63-249b8c6e9f04 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-8355713'] for port, provisioning_complete {{(pid=102994) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:36:56.588629 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron_lib.callbacks.manager [None req-4bf48ff4-ecfb-4168-8b63-249b8c6e9f04 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7921281'] for port, before_update {{(pid=102994) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:36:56.606738 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.wsgi [-] (102993) accepted ('10.222.0.62', 47522) {{(pid=102993) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 23 19:36:56.619326 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '4ee0b7a3-f787-4a7c-816a-71f3a99b7193', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '1a0a2345-c03d-4159-89a8-35402d8d2448'}] {{(pid=102994) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 23 19:36:56.622391 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.62/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}09a7511da0d2ba1d728b27e36a8467ec5289399952f0059588048a7cb66d3a43" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-8dad6743-27f4-4ac6-9025-d2ca96c58366" -d '{"events": [{"server_uuid": "4ee0b7a3-f787-4a7c-816a-71f3a99b7193", "name": "network-vif-plugged", "status": "completed", "tag": "1a0a2345-c03d-4159-89a8-35402d8d2448"}]}' {{(pid=102994) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 23 19:36:56.638600 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.plugins.ml2.db [None req-4bf48ff4-ecfb-4168-8b63-249b8c6e9f04 None None] For port 1a0a2345-c03d-4159-89a8-35402d8d2448, host hv-cinder-81901, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81901',level=0,port_id=1a0a2345-c03d-4159-89a8-35402d8d2448,segment=NetworkSegment(56316385-5b81-43f5-84db-b708b46f04eb),segment_id=56316385-5b81-43f5-84db-b708b46f04eb)] {{(pid=102994) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 23 19:36:56.666240 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3f3354c0-9459-41ba-be53-8007c3f1a7b0 req-dd1dcd3c-bb9c-4f47-9d6f-8b6b975d7200 tempest-AttachVolumeShelveTestJSON-1172915835 tempest-AttachVolumeShelveTestJSON-1172915835-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102992) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:36:56.679132 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-3f3354c0-9459-41ba-be53-8007c3f1a7b0 req-dd1dcd3c-bb9c-4f47-9d6f-8b6b975d7200 tempest-AttachVolumeShelveTestJSON-1172915835 tempest-AttachVolumeShelveTestJSON-1172915835-project] 10.222.0.62 "GET /v2.0/ports?device_id=85ea3d72-6c17-4ea2-82b7-90cce01633bd HTTP/1.1" status: 200 len: 946 time: 0.0928180 Nov 23 19:36:56.680618 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 23 Nov 2021 19:36:56 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-49f67f43-e9e5-4af0-b526-6eca97d9a2e3 x-openstack-request-id: req-49f67f43-e9e5-4af0-b526-6eca97d9a2e3 {{(pid=102994) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 23 19:36:56.680935 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "4ee0b7a3-f787-4a7c-816a-71f3a99b7193", "name": "network-vif-plugged", "status": "completed", "tag": "1a0a2345-c03d-4159-89a8-35402d8d2448", "code": 200}]} {{(pid=102994) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 23 19:36:56.681365 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.62/compute/v2.1/os-server-external-events used request id req-49f67f43-e9e5-4af0-b526-6eca97d9a2e3 {{(pid=102994) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 23 19:36:56.682225 dv-cinder-819011-1-iscsi neutron-server[102994]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '4ee0b7a3-f787-4a7c-816a-71f3a99b7193', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '1a0a2345-c03d-4159-89a8-35402d8d2448', 'code': 200} Nov 23 19:36:56.684278 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron_lib.callbacks.manager [None req-4bf48ff4-ecfb-4168-8b63-249b8c6e9f04 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7918660', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-15067', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560168', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8783631423946', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8783631008732', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8783631008750'] for port, after_update {{(pid=102994) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:36:56.685274 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.plugins.ml2.rpc [None req-4bf48ff4-ecfb-4168-8b63-249b8c6e9f04 None None] Device 50e9d93b-ad23-4b6b-bdd0-ae5afe6f80ea no longer exists at agent hyperv_hv-cinder-81901 {{(pid=102994) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 23 19:36:56.746291 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.plugins.ml2.plugin [None req-4bf48ff4-ecfb-4168-8b63-249b8c6e9f04 None None] No Port match for: 50e9d93b-ad23-4b6b-bdd0-ae5afe6f80ea {{(pid=102994) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 23 19:36:56.746764 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.plugins.ml2.rpc [None req-4bf48ff4-ecfb-4168-8b63-249b8c6e9f04 None None] Device 50e9d93b-ad23-4b6b-bdd0-ae5afe6f80ea not bound to the agent host hv-cinder-81901 {{(pid=102994) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 23 19:36:56.818452 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-3f3354c0-9459-41ba-be53-8007c3f1a7b0 req-0c57be62-0394-49a9-8d53-f8af83324a46 tempest-AttachVolumeShelveTestJSON-1172915835 tempest-AttachVolumeShelveTestJSON-1172915835-project] 10.222.0.62 "GET /v2.0/security-groups?id=f1ca24d9-0a31-470d-a1d5-fa7059df0141&fields=id&fields=name HTTP/1.1" status: 200 len: 311 time: 0.1380730 Nov 23 19:36:56.821365 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4bf48ff4-ecfb-4168-8b63-249b8c6e9f04 None None] Pushing event updated for resources: {'Port': ['ID=1a0a2345-c03d-4159-89a8-35402d8d2448,revision_number=5']} {{(pid=102994) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 23 19:36:56.941217 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ac7994ff-26cc-4c97-a8fa-dd69790e2a17 req-014a8f95-5a8b-4edd-9ecc-bbd6e77d92a5 tempest-VolumesNegativeTest-1760818768 tempest-VolumesNegativeTest-1760818768-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102993) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:36:56.942725 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-ac7994ff-26cc-4c97-a8fa-dd69790e2a17 req-014a8f95-5a8b-4edd-9ecc-bbd6e77d92a5 tempest-VolumesNegativeTest-1760818768 tempest-VolumesNegativeTest-1760818768-project] 10.222.0.62 "GET /v2.0/ports?device_id=2b4c5734-55b0-47f1-9223-9875c9561c64 HTTP/1.1" status: 200 len: 948 time: 0.0928669 Nov 23 19:36:57.023076 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-ac7994ff-26cc-4c97-a8fa-dd69790e2a17 req-6db1e487-615b-4a5c-a406-649b17e91c4c tempest-VolumesNegativeTest-1760818768 tempest-VolumesNegativeTest-1760818768-project] 10.222.0.62 "GET /v2.0/security-groups?id=ac69cba1-f881-4fe2-ba1d-5270c0d54618&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0734823 Nov 23 19:36:57.162365 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0960dc02-2671-4872-8b5f-f12f80c20c5a req-d3bb2223-97a4-4bd7-bc98-54a0874c1443 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102992) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:36:57.163920 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-0960dc02-2671-4872-8b5f-f12f80c20c5a req-d3bb2223-97a4-4bd7-bc98-54a0874c1443 service neutron] 10.222.0.41 "GET /v2.0/ports?device_id=4ee0b7a3-f787-4a7c-816a-71f3a99b7193 HTTP/1.1" status: 200 len: 1099 time: 0.0476799 Nov 23 19:36:57.225340 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-c3539e72-be4f-4c83-95a3-d75e87759367 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-932931'] for router_interface, before_delete {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:36:57.227822 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-0960dc02-2671-4872-8b5f-f12f80c20c5a req-9a5db10a-ca5c-4f04-925f-3a274d8d80da service neutron] 10.222.0.41 "GET /v2.0/security-groups?id=a6e2b133-1a9b-4dde-a188-1ce8bcdb7b5c&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0515065 Nov 23 19:36:57.461777 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-fe00d8a6-e526-4142-83c1-769725f7eb6d req-985977f0-9779-4598-9ec7-eeaf4f7ac7dc tempest-VolumesSnapshotTestJSON-97879810 tempest-VolumesSnapshotTestJSON-97879810-project] 10.222.0.62 "GET /v2.0/ports?device_id=56521436-30ba-4dcc-8272-0fcda3e896b0 HTTP/1.1" status: 200 len: 210 time: 0.0474193 Nov 23 19:36:57.594963 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.plugins.ml2.plugin [None req-c3539e72-be4f-4c83-95a3-d75e87759367 admin admin] Deleting port 67851a82-183f-4bba-b05f-793c8b4e7ec3 {{(pid=102993) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 23 19:36:57.595541 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-c3539e72-be4f-4c83-95a3-d75e87759367 admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8783631423070'] for port, before_delete {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:36:57.613819 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d4a670d9-7178-46c6-bc74-50699a34dea4 req-8cd68857-18b3-4740-94d8-50f6c8d2f215 tempest-TestVolumeBootPattern-147141705 tempest-TestVolumeBootPattern-147141705-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102993) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:36:57.615276 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-d4a670d9-7178-46c6-bc74-50699a34dea4 req-8cd68857-18b3-4740-94d8-50f6c8d2f215 tempest-TestVolumeBootPattern-147141705 tempest-TestVolumeBootPattern-147141705-project] 10.222.0.62 "GET /v2.0/ports?device_id=4ee0b7a3-f787-4a7c-816a-71f3a99b7193 HTTP/1.1" status: 200 len: 946 time: 0.0709243 Nov 23 19:36:57.715856 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-d4a670d9-7178-46c6-bc74-50699a34dea4 req-42820686-62c6-4fa3-94cc-c180038014d6 tempest-TestVolumeBootPattern-147141705 tempest-TestVolumeBootPattern-147141705-project] 10.222.0.62 "GET /v2.0/security-groups?id=a6e2b133-1a9b-4dde-a188-1ce8bcdb7b5c&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0884972 Nov 23 19:36:57.720845 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.plugins.ml2.db [None req-c3539e72-be4f-4c83-95a3-d75e87759367 admin admin] For port 67851a82-183f-4bba-b05f-793c8b4e7ec3, host dv-cinder-819011-1-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-819011-1-iscsi',level=0,port_id=67851a82-183f-4bba-b05f-793c8b4e7ec3,segment=NetworkSegment(b8302c34-e78d-4c43-9d45-a2604c95a2d2),segment_id=b8302c34-e78d-4c43-9d45-a2604c95a2d2)] {{(pid=102993) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 23 19:36:57.721248 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-c3539e72-be4f-4c83-95a3-d75e87759367 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-927332'] for port, precommit_delete {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:36:57.733860 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.plugins.ml2.plugin [None req-c3539e72-be4f-4c83-95a3-d75e87759367 admin admin] Calling delete_port for 67851a82-183f-4bba-b05f-793c8b4e7ec3 owned by network:router_interface {{(pid=102993) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 23 19:36:57.959707 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e1eef8b1-e9bb-4c03-b95d-78d6542036ef req-4cc9ce0a-492c-46c7-bcaa-4eeec1ad8acf tempest-AttachVolumeShelveTestJSON-1172915835 tempest-AttachVolumeShelveTestJSON-1172915835-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102992) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:36:57.962113 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-e1eef8b1-e9bb-4c03-b95d-78d6542036ef req-4cc9ce0a-492c-46c7-bcaa-4eeec1ad8acf tempest-AttachVolumeShelveTestJSON-1172915835 tempest-AttachVolumeShelveTestJSON-1172915835-project] 10.222.0.62 "GET /v2.0/ports?device_id=85ea3d72-6c17-4ea2-82b7-90cce01633bd HTTP/1.1" status: 200 len: 946 time: 0.0585141 Nov 23 19:36:57.991972 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-c3539e72-be4f-4c83-95a3-d75e87759367 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7918660', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-15067', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560168', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8783631424624', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8783631008723', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-17257496'] for port, after_delete {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:36:58.018764 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c3539e72-be4f-4c83-95a3-d75e87759367 admin admin] Pushing event deleted for resources: {'Port': ['ID=67851a82-183f-4bba-b05f-793c8b4e7ec3,revision_number=None']} {{(pid=102993) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 23 19:36:58.029330 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-e1eef8b1-e9bb-4c03-b95d-78d6542036ef req-1eaa37d3-ba5b-4673-9ece-96b7f2754990 tempest-AttachVolumeShelveTestJSON-1172915835 tempest-AttachVolumeShelveTestJSON-1172915835-project] 10.222.0.62 "GET /v2.0/security-groups?id=f1ca24d9-0a31-470d-a1d5-fa7059df0141&fields=id&fields=name HTTP/1.1" status: 200 len: 311 time: 0.0601790 Nov 23 19:36:58.217331 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-25b8eb7f-cf3d-4a12-bcae-cc8b78c55da6 req-aefe7f14-2a6e-4458-a153-941cc0f79dd4 tempest-VolumesNegativeTest-1760818768 tempest-VolumesNegativeTest-1760818768-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102993) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:36:58.218799 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-25b8eb7f-cf3d-4a12-bcae-cc8b78c55da6 req-aefe7f14-2a6e-4458-a153-941cc0f79dd4 tempest-VolumesNegativeTest-1760818768 tempest-VolumesNegativeTest-1760818768-project] 10.222.0.62 "GET /v2.0/ports?device_id=2b4c5734-55b0-47f1-9223-9875c9561c64 HTTP/1.1" status: 200 len: 948 time: 0.0961502 Nov 23 19:36:58.233393 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-c3539e72-be4f-4c83-95a3-d75e87759367 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-560161', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-933087'] for router_interface, after_delete {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:36:58.310957 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-25b8eb7f-cf3d-4a12-bcae-cc8b78c55da6 req-0ff3ef79-7a58-4e1a-87c5-27f0de581164 tempest-VolumesNegativeTest-1760818768 tempest-VolumesNegativeTest-1760818768-project] 10.222.0.62 "GET /v2.0/security-groups?id=ac69cba1-f881-4fe2-ba1d-5270c0d54618&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0852139 Nov 23 19:36:58.382503 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.plugins.ml2.rpc [None req-4bf48ff4-ecfb-4168-8b63-249b8c6e9f04 None None] Device cde3ee31-252a-4d6a-ab52-e04028f9cab7 details requested by agent hyperv_hv-cinder-81901 with host hv-cinder-81901 {{(pid=102994) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Nov 23 19:36:58.548158 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.plugins.ml2.db [None req-4bf48ff4-ecfb-4168-8b63-249b8c6e9f04 None None] For port cde3ee31-252a-4d6a-ab52-e04028f9cab7, host hv-cinder-81901, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81901',level=0,port_id=cde3ee31-252a-4d6a-ab52-e04028f9cab7,segment=NetworkSegment(760573d6-1aff-43f3-9bab-dbb5402f9396),segment_id=760573d6-1aff-43f3-9bab-dbb5402f9396)] {{(pid=102994) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 23 19:36:58.575204 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.plugins.ml2.rpc [None req-4bf48ff4-ecfb-4168-8b63-249b8c6e9f04 None None] Returning: {'device': 'cde3ee31-252a-4d6a-ab52-e04028f9cab7', 'network_id': '2096bff1-f35e-4603-897c-41fe38bec144', 'port_id': 'cde3ee31-252a-4d6a-ab52-e04028f9cab7', 'mac_address': 'fa:16:3e:56:d7:e3', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 802, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '2a6b6168-a59d-4c5e-be49-7d9bee937678', 'ip_address': '192.168.233.144'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=102994) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Nov 23 19:36:58.606443 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-d755d7c8-c5ea-419a-9438-c1a2cae3ccd7 req-1667cff4-f3eb-47d2-893f-71b6e525ec91 tempest-VolumesSnapshotTestJSON-97879810 tempest-VolumesSnapshotTestJSON-97879810-project] 10.222.0.62 "GET /v2.0/ports?device_id=56521436-30ba-4dcc-8272-0fcda3e896b0 HTTP/1.1" status: 200 len: 210 time: 0.0503809 Nov 23 19:36:58.628034 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron_lib.callbacks.manager [None req-4bf48ff4-ecfb-4168-8b63-249b8c6e9f04 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7921281'] for port, before_update {{(pid=102994) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:36:58.644547 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.notifiers.nova [None req-4bf48ff4-ecfb-4168-8b63-249b8c6e9f04 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id cde3ee31-252a-4d6a-ab52-e04028f9cab7 {{(pid=102994) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 23 19:36:58.665050 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.plugins.ml2.db [None req-4bf48ff4-ecfb-4168-8b63-249b8c6e9f04 None None] For port cde3ee31-252a-4d6a-ab52-e04028f9cab7, host hv-cinder-81901, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81901',level=0,port_id=cde3ee31-252a-4d6a-ab52-e04028f9cab7,segment=NetworkSegment(760573d6-1aff-43f3-9bab-dbb5402f9396),segment_id=760573d6-1aff-43f3-9bab-dbb5402f9396)] {{(pid=102994) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 23 19:36:58.716073 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ea00a940-d0c0-455b-aac1-6c8c7aae2ffa req-552fcc99-bb0e-41c6-8381-e6d14b962bc9 tempest-VolumesSnapshotTestJSON-97879810 tempest-VolumesSnapshotTestJSON-97879810-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=102992) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:36:58.717815 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-ea00a940-d0c0-455b-aac1-6c8c7aae2ffa req-552fcc99-bb0e-41c6-8381-e6d14b962bc9 tempest-VolumesSnapshotTestJSON-97879810 tempest-VolumesSnapshotTestJSON-97879810-project] 10.222.0.41 "GET /v2.0/networks?id=6a5d33a0-25a4-4580-ae9f-e7aa9d768182 HTTP/1.1" status: 200 len: 813 time: 0.1219718 Nov 23 19:36:58.728744 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron_lib.callbacks.manager [None req-4bf48ff4-ecfb-4168-8b63-249b8c6e9f04 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7918660', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-15067', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560168', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8783631423946', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8783631008732', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8783631008750'] for port, after_update {{(pid=102994) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:36:58.731933 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.api.v2.base [req-ea00a940-d0c0-455b-aac1-6c8c7aae2ffa req-39062896-2104-4492-85c2-ef7fa23a5748 tempest-VolumesSnapshotTestJSON-97879810 tempest-VolumesSnapshotTestJSON-97879810-project] Request body: {'port': {'device_id': '56521436-30ba-4dcc-8272-0fcda3e896b0', 'network_id': '6a5d33a0-25a4-4580-ae9f-e7aa9d768182', 'admin_state_up': True, 'tenant_id': '766c6a829b9945cfb36bad289566c0ad'}} {{(pid=102992) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 23 19:36:58.748507 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-c3539e72-be4f-4c83-95a3-d75e87759367 admin admin] Router dcdcae73-a8c6-43f9-b388-80519245de0c has already been hosted by L3 agent 1b20f2c4-70b6-43c3-b9bd-0062cc9e57ac {{(pid=102993) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 23 19:36:58.778709 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4bf48ff4-ecfb-4168-8b63-249b8c6e9f04 None None] Pushing event updated for resources: {'Port': ['ID=cde3ee31-252a-4d6a-ab52-e04028f9cab7,revision_number=4']} {{(pid=102994) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 23 19:36:58.911815 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-ea00a940-d0c0-455b-aac1-6c8c7aae2ffa req-39062896-2104-4492-85c2-ef7fa23a5748 tempest-VolumesSnapshotTestJSON-97879810 tempest-VolumesSnapshotTestJSON-97879810-project] Made reservation on behalf of 766c6a829b9945cfb36bad289566c0ad for: {'port': 1} {{(pid=102992) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 23 19:36:58.915494 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [req-ea00a940-d0c0-455b-aac1-6c8c7aae2ffa req-39062896-2104-4492-85c2-ef7fa23a5748 tempest-VolumesSnapshotTestJSON-97879810 tempest-VolumesSnapshotTestJSON-97879810-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7921281'] for port, before_create {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:36:58.929962 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-03bf329e-c4fa-4bbc-8def-081b3f617175 req-12d05ec3-fa39-4125-b9f1-2b55840fe330 tempest-TestVolumeBootPattern-147141705 tempest-TestVolumeBootPattern-147141705-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102993) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:36:58.934802 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-03bf329e-c4fa-4bbc-8def-081b3f617175 req-12d05ec3-fa39-4125-b9f1-2b55840fe330 tempest-TestVolumeBootPattern-147141705 tempest-TestVolumeBootPattern-147141705-project] 10.222.0.62 "GET /v2.0/ports?device_id=4ee0b7a3-f787-4a7c-816a-71f3a99b7193 HTTP/1.1" status: 200 len: 946 time: 0.1005919 Nov 23 19:36:58.936888 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-c3539e72-be4f-4c83-95a3-d75e87759367 admin admin] Notify agent at l3_agent.dv-cinder-819011-1-iscsi the message routers_updated {{(pid=102993) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 23 19:36:58.948382 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [None req-c3539e72-be4f-4c83-95a3-d75e87759367 admin admin] 10.222.0.62 "PUT /v2.0/routers/dcdcae73-a8c6-43f9-b388-80519245de0c/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 2.3348055 Nov 23 19:36:58.948494 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.wsgi [-] (102992) accepted ('10.222.0.62', 47584) {{(pid=102992) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 23 19:36:58.948839 dv-cinder-819011-1-iscsi neutron-server[102995]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-4142be90-0d2c-49ca-9339-ab2b5aa266e4 None None] Sync routers for ids ['dcdcae73-a8c6-43f9-b388-80519245de0c'] in dv-cinder-819011-1-iscsi {{(pid=102995) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 23 19:36:58.963162 dv-cinder-819011-1-iscsi neutron-server[102995]: DEBUG neutron.db.l3_dvrscheduler_db [None req-4142be90-0d2c-49ca-9339-ab2b5aa266e4 None None] Routers {'dcdcae73-a8c6-43f9-b388-80519245de0c'} bound to L3 agent in host dv-cinder-819011-1-iscsi {{(pid=102995) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 23 19:36:58.969911 dv-cinder-819011-1-iscsi neutron-server[102995]: DEBUG neutron.db.l3_hamode_db [None req-4142be90-0d2c-49ca-9339-ab2b5aa266e4 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-819011-1-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-11-23T19:25:14Z,description=,heartbeat_timestamp=2021-11-23T19:36:44Z,host='dv-cinder-819011-1-iscsi',id=1b20f2c4-70b6-43c3-b9bd-0062cc9e57ac,load=0,resource_versions=,resources_synced=,started_at=2021-11-23T19:25:15Z,topic='l3_agent')) {'router_ids': ['dcdcae73-a8c6-43f9-b388-80519245de0c'], 'active': True} {{(pid=102995) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 23 19:36:58.994381 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-03bf329e-c4fa-4bbc-8def-081b3f617175 req-7644e2cd-008c-467d-b74c-e5d80046e5a7 tempest-TestVolumeBootPattern-147141705 tempest-TestVolumeBootPattern-147141705-project] 10.222.0.62 "GET /v2.0/security-groups?id=a6e2b133-1a9b-4dde-a188-1ce8bcdb7b5c&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0496175 Nov 23 19:36:59.004519 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.plugins.ml2.db [None req-4bf48ff4-ecfb-4168-8b63-249b8c6e9f04 None None] get_ports_and_sgs() called for port_ids ['cde3ee31-252a-4d6a-ab52-e04028f9cab7'] {{(pid=102994) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 23 19:36:59.107523 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron_lib.callbacks.manager [None req-4bf48ff4-ecfb-4168-8b63-249b8c6e9f04 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8783631323329', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7978582'] for agent, after_update {{(pid=102994) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:36:59.186480 dv-cinder-819011-1-iscsi neutron-server[102995]: DEBUG neutron.db.l3_dvr_db [None req-4142be90-0d2c-49ca-9339-ab2b5aa266e4 None None] Set router dcdcae73-a8c6-43f9-b388-80519245de0c gateway port host: dv-cinder-819011-1-iscsi {{(pid=102995) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 23 19:36:59.272388 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d5865676-47cf-4cb2-8cf3-9acc298a1644 req-de57e3f5-c2ea-4916-9d50-d05011169afc tempest-AttachVolumeShelveTestJSON-1172915835 tempest-AttachVolumeShelveTestJSON-1172915835-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102993) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:36:59.274674 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-d5865676-47cf-4cb2-8cf3-9acc298a1644 req-de57e3f5-c2ea-4916-9d50-d05011169afc tempest-AttachVolumeShelveTestJSON-1172915835 tempest-AttachVolumeShelveTestJSON-1172915835-project] 10.222.0.62 "GET /v2.0/ports?device_id=85ea3d72-6c17-4ea2-82b7-90cce01633bd HTTP/1.1" status: 200 len: 946 time: 0.0937340 Nov 23 19:36:59.282817 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [None req-ed0867f6-01d9-478a-9b49-8320b9e8e454 admin admin] Publish callbacks [] for router, before_delete {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:36:59.289560 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.db.db_base_plugin_common [req-ea00a940-d0c0-455b-aac1-6c8c7aae2ffa req-39062896-2104-4492-85c2-ef7fa23a5748 tempest-VolumesSnapshotTestJSON-97879810 tempest-VolumesSnapshotTestJSON-97879810-project] Allocated IP 172.20.0.5 (6a5d33a0-25a4-4580-ae9f-e7aa9d768182/cf93b200-5fcb-4538-8ce7-95612047c22a/cee918cb-f6e3-450a-9a6b-6a6e13f08868) {{(pid=102992) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 23 19:36:59.350516 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-d5865676-47cf-4cb2-8cf3-9acc298a1644 req-9467e92f-9e8b-4b15-ac3a-63ff7ca9030d tempest-AttachVolumeShelveTestJSON-1172915835 tempest-AttachVolumeShelveTestJSON-1172915835-project] 10.222.0.62 "GET /v2.0/security-groups?id=f1ca24d9-0a31-470d-a1d5-fa7059df0141&fields=id&fields=name HTTP/1.1" status: 200 len: 311 time: 0.0682771 Nov 23 19:36:59.361520 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9071e74e-2073-4e20-8144-a8af3939edb4 req-893053d3-2947-4c83-ba5b-d1ed89b6276b tempest-TestVolumeBootPattern-147141705 tempest-TestVolumeBootPattern-147141705-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102992) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:36:59.362713 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-9071e74e-2073-4e20-8144-a8af3939edb4 req-893053d3-2947-4c83-ba5b-d1ed89b6276b tempest-TestVolumeBootPattern-147141705 tempest-TestVolumeBootPattern-147141705-project] 10.222.0.62 "GET /v2.0/ports?device_id=4ee0b7a3-f787-4a7c-816a-71f3a99b7193 HTTP/1.1" status: 200 len: 946 time: 0.2128353 Nov 23 19:36:59.427910 dv-cinder-819011-1-iscsi neutron-server[102995]: DEBUG neutron.db.l3_hamode_db [None req-4142be90-0d2c-49ca-9339-ab2b5aa266e4 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'dcdcae73-a8c6-43f9-b388-80519245de0c', 'name': 'tempest-ServerRescueNegativeTestJSON-1810346202-router', 'tenant_id': 'c15ab51e579448cfb7a4b3e4f8049687', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'a93e254e-aac9-4233-9e4d-4290fd0458e4', 'external_fixed_ips': [{'subnet_id': 'e0b32f3d-83d6-439a-bbed-01df7cf01051', 'ip_address': '172.27.1.194'}], 'enable_snat': True}, 'gw_port_id': 'ccf9cfdb-e164-48bc-b433-5906352d8e1a', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-23T19:33:20Z', 'updated_at': '2021-11-23T19:36:57Z', 'revision_number': 5, 'project_id': 'c15ab51e579448cfb7a4b3e4f8049687', 'gw_port': {'id': 'ccf9cfdb-e164-48bc-b433-5906352d8e1a', 'name': '', 'network_id': 'a93e254e-aac9-4233-9e4d-4290fd0458e4', 'tenant_id': '', 'mac_address': 'fa:16:3e:29:81:78', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'dcdcae73-a8c6-43f9-b388-80519245de0c', 'device_owner': 'network:router_gateway', 'standard_attr_id': 58, 'fixed_ips': [{'subnet_id': 'e0b32f3d-83d6-439a-bbed-01df7cf01051', 'ip_address': '172.27.1.194', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-819011-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-23T19:33:21Z', 'updated_at': '2021-11-23T19:33:28Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'e0b32f3d-83d6-439a-bbed-01df7cf01051', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-819011-1-iscsi'}], 'dv-cinder-819011-1-iscsi', False) {} {{(pid=102995) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 23 19:36:59.459201 dv-cinder-819011-1-iscsi neutron-server[102995]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-4142be90-0d2c-49ca-9339-ab2b5aa266e4 None None] Checking router: dcdcae73-a8c6-43f9-b388-80519245de0c for host: dv-cinder-819011-1-iscsi {{(pid=102995) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 23 19:36:59.470046 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-299e84f4-b12a-4e28-b459-db7a156d3f12 req-0b2a648b-05e6-4493-97d9-2a80e505d06f tempest-VolumesNegativeTest-1760818768 tempest-VolumesNegativeTest-1760818768-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102993) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:36:59.471032 dv-cinder-819011-1-iscsi neutron-server[102995]: DEBUG neutron.db.l3_dvrscheduler_db [None req-4142be90-0d2c-49ca-9339-ab2b5aa266e4 None None] Routers {'dcdcae73-a8c6-43f9-b388-80519245de0c'} bound to L3 agent in host dv-cinder-819011-1-iscsi {{(pid=102995) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 23 19:36:59.471540 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-299e84f4-b12a-4e28-b459-db7a156d3f12 req-0b2a648b-05e6-4493-97d9-2a80e505d06f tempest-VolumesNegativeTest-1760818768 tempest-VolumesNegativeTest-1760818768-project] 10.222.0.62 "GET /v2.0/ports?device_id=2b4c5734-55b0-47f1-9223-9875c9561c64 HTTP/1.1" status: 200 len: 949 time: 0.0512834 Nov 23 19:36:59.478447 dv-cinder-819011-1-iscsi neutron-server[102995]: DEBUG neutron.db.l3_hamode_db [None req-4142be90-0d2c-49ca-9339-ab2b5aa266e4 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-819011-1-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-11-23T19:25:14Z,description=,heartbeat_timestamp=2021-11-23T19:36:44Z,host='dv-cinder-819011-1-iscsi',id=1b20f2c4-70b6-43c3-b9bd-0062cc9e57ac,load=0,resource_versions=,resources_synced=,started_at=2021-11-23T19:25:15Z,topic='l3_agent')) {'router_ids': ['dcdcae73-a8c6-43f9-b388-80519245de0c'], 'active': True} {{(pid=102995) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 23 19:36:59.519716 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [None req-ed0867f6-01d9-478a-9b49-8320b9e8e454 admin admin] Publish callbacks [] for router_gateway, before_delete {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:36:59.525963 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-9071e74e-2073-4e20-8144-a8af3939edb4 req-adb5dca1-d5cb-4494-89b1-061cf188ed8e tempest-TestVolumeBootPattern-147141705 tempest-TestVolumeBootPattern-147141705-project] 10.222.0.62 "GET /v2.0/security-groups?id=a6e2b133-1a9b-4dde-a188-1ce8bcdb7b5c&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1243124 Nov 23 19:36:59.529886 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-299e84f4-b12a-4e28-b459-db7a156d3f12 req-a7f785c8-f7e5-4ed6-a068-6b6d5b1d4e87 tempest-VolumesNegativeTest-1760818768 tempest-VolumesNegativeTest-1760818768-project] 10.222.0.62 "GET /v2.0/security-groups?id=ac69cba1-f881-4fe2-ba1d-5270c0d54618&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0518267 Nov 23 19:36:59.558753 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.wsgi [-] (102993) accepted ('10.222.0.62', 47602) {{(pid=102993) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 23 19:36:59.602866 dv-cinder-819011-1-iscsi neutron-server[102995]: DEBUG neutron.db.l3_dvr_db [None req-4142be90-0d2c-49ca-9339-ab2b5aa266e4 None None] Set router dcdcae73-a8c6-43f9-b388-80519245de0c gateway port host: dv-cinder-819011-1-iscsi {{(pid=102995) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 23 19:36:59.603258 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [req-ea00a940-d0c0-455b-aac1-6c8c7aae2ffa req-39062896-2104-4492-85c2-ef7fa23a5748 tempest-VolumesSnapshotTestJSON-97879810 tempest-VolumesSnapshotTestJSON-97879810-project] Publish callbacks [] for port, precommit_create {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:36:59.712179 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-73540be2-2677-491e-9d26-13eba5ec06ca req-5ff5c444-3f47-4472-875d-34a9cd297c8a tempest-VolumesSnapshotTestJSON-97879810 tempest-VolumesSnapshotTestJSON-97879810-project] 10.222.0.62 "GET /v2.0/ports?device_id=56521436-30ba-4dcc-8272-0fcda3e896b0 HTTP/1.1" status: 200 len: 210 time: 0.0312405 Nov 23 19:36:59.714815 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [req-ea00a940-d0c0-455b-aac1-6c8c7aae2ffa req-39062896-2104-4492-85c2-ef7fa23a5748 tempest-VolumesSnapshotTestJSON-97879810 tempest-VolumesSnapshotTestJSON-97879810-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7918660', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-15067', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560168', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8783631008714', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-25199805'] for port, after_create {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:36:59.773082 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-ea00a940-d0c0-455b-aac1-6c8c7aae2ffa req-39062896-2104-4492-85c2-ef7fa23a5748 tempest-VolumesSnapshotTestJSON-97879810 tempest-VolumesSnapshotTestJSON-97879810-project] Network 6a5d33a0-25a4-4580-ae9f-e7aa9d768182 is already hosted by enough agents. {{(pid=102992) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 23 19:36:59.778505 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.scheduler.base_scheduler [req-ea00a940-d0c0-455b-aac1-6c8c7aae2ffa req-39062896-2104-4492-85c2-ef7fa23a5748 tempest-VolumesSnapshotTestJSON-97879810 tempest-VolumesSnapshotTestJSON-97879810-project] Resources bound (agent type, host, resource id): {{(pid=102992) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 23 19:36:59.785538 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.db.l3_dvrscheduler_db [req-ea00a940-d0c0-455b-aac1-6c8c7aae2ffa req-39062896-2104-4492-85c2-ef7fa23a5748 tempest-VolumesSnapshotTestJSON-97879810 tempest-VolumesSnapshotTestJSON-97879810-project] Received port after_create {{(pid=102992) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 23 19:36:59.789061 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-34b8acbb-4b0a-4950-a13c-02922f779409 tempest-TestVolumeBootPattern-762853593 tempest-TestVolumeBootPattern-762853593-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102993) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:36:59.789523 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-39062896-2104-4492-85c2-ef7fa23a5748 tempest-VolumesSnapshotTestJSON-97879810 tempest-VolumesSnapshotTestJSON-97879810-project] Pushing event updated for resources: {'Port': ['ID=cee918cb-f6e3-450a-9a6b-6a6e13f08868,revision_number=1']} {{(pid=102992) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 23 19:36:59.804336 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [None req-34b8acbb-4b0a-4950-a13c-02922f779409 tempest-TestVolumeBootPattern-762853593 tempest-TestVolumeBootPattern-762853593-project-admin] 10.222.0.62 "GET /v2.0/ports?device_id=4ee0b7a3-f787-4a7c-816a-71f3a99b7193 HTTP/1.1" status: 200 len: 1094 time: 0.2493649 Nov 23 19:36:59.804336 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.wsgi [-] (102993) accepted ('10.222.0.62', 47608) {{(pid=102993) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 23 19:36:59.811367 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.api.v2.base [None req-18247ff2-5611-4847-8a4a-7d229f7efdeb tempest-TestVolumeBootPattern-147141705 tempest-TestVolumeBootPattern-147141705-project] Request body: {'floatingip': {'floating_network_id': 'a93e254e-aac9-4233-9e4d-4290fd0458e4', 'port_id': '1a0a2345-c03d-4159-89a8-35402d8d2448', 'tenant_id': '257b0b2e531441b4bb745e99cfd799f3', 'fixed_ip_address': '172.20.0.14'}} {{(pid=102993) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 23 19:36:59.816551 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.plugins.ml2.plugin [None req-ed0867f6-01d9-478a-9b49-8320b9e8e454 admin admin] Deleting port ccf9cfdb-e164-48bc-b433-5906352d8e1a {{(pid=102992) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 23 19:36:59.816891 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [None req-ed0867f6-01d9-478a-9b49-8320b9e8e454 admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8783631423070'] for port, before_delete {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:36:59.830149 dv-cinder-819011-1-iscsi neutron-server[102995]: DEBUG neutron.db.l3_hamode_db [None req-4142be90-0d2c-49ca-9339-ab2b5aa266e4 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'dcdcae73-a8c6-43f9-b388-80519245de0c', 'name': 'tempest-ServerRescueNegativeTestJSON-1810346202-router', 'tenant_id': 'c15ab51e579448cfb7a4b3e4f8049687', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'a93e254e-aac9-4233-9e4d-4290fd0458e4', 'external_fixed_ips': [{'subnet_id': 'e0b32f3d-83d6-439a-bbed-01df7cf01051', 'ip_address': '172.27.1.194'}], 'enable_snat': True}, 'gw_port_id': 'ccf9cfdb-e164-48bc-b433-5906352d8e1a', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-23T19:33:20Z', 'updated_at': '2021-11-23T19:36:57Z', 'revision_number': 5, 'project_id': 'c15ab51e579448cfb7a4b3e4f8049687', 'gw_port': {'id': 'ccf9cfdb-e164-48bc-b433-5906352d8e1a', 'name': '', 'network_id': 'a93e254e-aac9-4233-9e4d-4290fd0458e4', 'tenant_id': '', 'mac_address': 'fa:16:3e:29:81:78', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'dcdcae73-a8c6-43f9-b388-80519245de0c', 'device_owner': 'network:router_gateway', 'standard_attr_id': 58, 'fixed_ips': [{'subnet_id': 'e0b32f3d-83d6-439a-bbed-01df7cf01051', 'ip_address': '172.27.1.194', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-819011-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-23T19:33:21Z', 'updated_at': '2021-11-23T19:33:28Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'e0b32f3d-83d6-439a-bbed-01df7cf01051', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-819011-1-iscsi'}], 'dv-cinder-819011-1-iscsi', False) {} {{(pid=102995) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 23 19:36:59.857729 dv-cinder-819011-1-iscsi neutron-server[102995]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-4142be90-0d2c-49ca-9339-ab2b5aa266e4 None None] The sync data for ids ['dcdcae73-a8c6-43f9-b388-80519245de0c'] in dv-cinder-819011-1-iscsi is: [{'id': 'dcdcae73-a8c6-43f9-b388-80519245de0c', 'name': 'tempest-ServerRescueNegativeTestJSON-1810346202-router', 'tenant_id': 'c15ab51e579448cfb7a4b3e4f8049687', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'a93e254e-aac9-4233-9e4d-4290fd0458e4', 'external_fixed_ips': [{'subnet_id': 'e0b32f3d-83d6-439a-bbed-01df7cf01051', 'ip_address': '172.27.1.194'}], 'enable_snat': True}, 'gw_port_id': 'ccf9cfdb-e164-48bc-b433-5906352d8e1a', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-23T19:33:20Z', 'updated_at': '2021-11-23T19:36:57Z', 'revision_number': 5, 'project_id': 'c15ab51e579448cfb7a4b3e4f8049687', 'gw_port': {'id': 'ccf9cfdb-e164-48bc-b433-5906352d8e1a', 'name': '', 'network_id': 'a93e254e-aac9-4233-9e4d-4290fd0458e4', 'tenant_id': '', 'mac_address': 'fa:16:3e:29:81:78', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'dcdcae73-a8c6-43f9-b388-80519245de0c', 'device_owner': 'network:router_gateway', 'standard_attr_id': 58, 'fixed_ips': [{'subnet_id': 'e0b32f3d-83d6-439a-bbed-01df7cf01051', 'ip_address': '172.27.1.194', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-819011-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-23T19:33:21Z', 'updated_at': '2021-11-23T19:33:28Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'e0b32f3d-83d6-439a-bbed-01df7cf01051', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-819011-1-iscsi'}] {{(pid=102995) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 23 19:36:59.860385 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ea00a940-d0c0-455b-aac1-6c8c7aae2ffa req-39062896-2104-4492-85c2-ef7fa23a5748 tempest-VolumesSnapshotTestJSON-97879810 tempest-VolumesSnapshotTestJSON-97879810-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=102992) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:36:59.861086 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [req-ea00a940-d0c0-455b-aac1-6c8c7aae2ffa req-39062896-2104-4492-85c2-ef7fa23a5748 tempest-VolumesSnapshotTestJSON-97879810 tempest-VolumesSnapshotTestJSON-97879810-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-514902'] for port, before_response {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:36:59.892826 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-18247ff2-5611-4847-8a4a-7d229f7efdeb tempest-TestVolumeBootPattern-147141705 tempest-TestVolumeBootPattern-147141705-project] Publish callbacks [] for floatingip, before_create {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:36:59.923235 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.plugins.ml2.db [None req-ed0867f6-01d9-478a-9b49-8320b9e8e454 admin admin] For port ccf9cfdb-e164-48bc-b433-5906352d8e1a, host dv-cinder-819011-1-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-819011-1-iscsi',level=0,port_id=ccf9cfdb-e164-48bc-b433-5906352d8e1a,segment=NetworkSegment(3cb5e60b-103a-47d0-a28b-d68e3159d032),segment_id=3cb5e60b-103a-47d0-a28b-d68e3159d032)] {{(pid=102992) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 23 19:36:59.923619 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [None req-ed0867f6-01d9-478a-9b49-8320b9e8e454 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-927332'] for port, precommit_delete {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:36:59.935566 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.plugins.ml2.plugin [None req-ed0867f6-01d9-478a-9b49-8320b9e8e454 admin admin] Calling delete_port for ccf9cfdb-e164-48bc-b433-5906352d8e1a owned by network:router_gateway {{(pid=102992) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 23 19:36:59.950673 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-ea00a940-d0c0-455b-aac1-6c8c7aae2ffa req-39062896-2104-4492-85c2-ef7fa23a5748 tempest-VolumesSnapshotTestJSON-97879810 tempest-VolumesSnapshotTestJSON-97879810-project] 10.222.0.41 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 1.2226210 Nov 23 19:36:59.988104 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.api.v2.base [req-ea00a940-d0c0-455b-aac1-6c8c7aae2ffa req-20e89ba7-b1da-484c-aa52-c104d6250a8d service neutron] Request body: {'port': {'device_id': '56521436-30ba-4dcc-8272-0fcda3e896b0', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-81901'}} {{(pid=102992) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 23 19:36:59.995002 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-18247ff2-5611-4847-8a4a-7d229f7efdeb tempest-TestVolumeBootPattern-147141705 tempest-TestVolumeBootPattern-147141705-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7921281'] for port, before_create {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:37:00.087373 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [req-ea00a940-d0c0-455b-aac1-6c8c7aae2ffa req-20e89ba7-b1da-484c-aa52-c104d6250a8d service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7921281'] for port, before_update {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:37:00.098627 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.db.db_base_plugin_common [None req-18247ff2-5611-4847-8a4a-7d229f7efdeb tempest-TestVolumeBootPattern-147141705 tempest-TestVolumeBootPattern-147141705-project] Allocated IP 172.27.1.101 (a93e254e-aac9-4233-9e4d-4290fd0458e4/e0b32f3d-83d6-439a-bbed-01df7cf01051/8015e531-c494-43e3-ba77-89dce1e50d86) {{(pid=102993) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 23 19:37:00.207865 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-18247ff2-5611-4847-8a4a-7d229f7efdeb tempest-TestVolumeBootPattern-147141705 tempest-TestVolumeBootPattern-147141705-project] Publish callbacks [] for port, precommit_create {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:37:00.300730 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-18247ff2-5611-4847-8a4a-7d229f7efdeb tempest-TestVolumeBootPattern-147141705 tempest-TestVolumeBootPattern-147141705-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7918660', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-15067', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560168', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8783631008714', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-17257496'] for port, after_create {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:37:00.336844 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [None req-ed0867f6-01d9-478a-9b49-8320b9e8e454 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7918660', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-15067', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560168', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8783631424624', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8783631008723', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-25199805'] for port, after_delete {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:37:00.347973 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.plugins.ml2.rpc [None req-eb87b2c3-3339-4249-8b85-e695b5b4e1f9 None None] Device 67851a82-183f-4bba-b05f-793c8b4e7ec3 no longer exists at agent ovs-agent-dv-cinder-819011-1-iscsi {{(pid=102994) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 23 19:37:00.369008 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-18247ff2-5611-4847-8a4a-7d229f7efdeb tempest-TestVolumeBootPattern-147141705 tempest-TestVolumeBootPattern-147141705-project] Pushing event updated for resources: {'Port': ['ID=8015e531-c494-43e3-ba77-89dce1e50d86,revision_number=1']} {{(pid=102993) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 23 19:37:00.373808 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ed0867f6-01d9-478a-9b49-8320b9e8e454 admin admin] Pushing event deleted for resources: {'Port': ['ID=ccf9cfdb-e164-48bc-b433-5906352d8e1a,revision_number=None']} {{(pid=102992) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 23 19:37:00.380027 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-18247ff2-5611-4847-8a4a-7d229f7efdeb tempest-TestVolumeBootPattern-147141705 tempest-TestVolumeBootPattern-147141705-project] Network a93e254e-aac9-4233-9e4d-4290fd0458e4 is already hosted by enough agents. {{(pid=102993) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 23 19:37:00.381963 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.scheduler.base_scheduler [None req-18247ff2-5611-4847-8a4a-7d229f7efdeb tempest-TestVolumeBootPattern-147141705 tempest-TestVolumeBootPattern-147141705-project] Resources bound (agent type, host, resource id): {{(pid=102993) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 23 19:37:00.382997 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.plugins.ml2.plugin [None req-eb87b2c3-3339-4249-8b85-e695b5b4e1f9 None None] No Port match for: 67851a82-183f-4bba-b05f-793c8b4e7ec3 {{(pid=102994) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 23 19:37:00.383828 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.plugins.ml2.rpc [None req-eb87b2c3-3339-4249-8b85-e695b5b4e1f9 None None] Device 67851a82-183f-4bba-b05f-793c8b4e7ec3 not bound to the agent host dv-cinder-819011-1-iscsi {{(pid=102994) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 23 19:37:00.387812 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.db.l3_dvrscheduler_db [None req-18247ff2-5611-4847-8a4a-7d229f7efdeb tempest-TestVolumeBootPattern-147141705 tempest-TestVolumeBootPattern-147141705-project] Received port after_create {{(pid=102993) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 23 19:37:00.399372 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.plugins.ml2.rpc [None req-4bf48ff4-ecfb-4168-8b63-249b8c6e9f04 None None] Device cde3ee31-252a-4d6a-ab52-e04028f9cab7 up at agent hyperv_hv-cinder-81901 {{(pid=102994) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 23 19:37:00.512732 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [None req-ed0867f6-01d9-478a-9b49-8320b9e8e454 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-926585'] for router_gateway, after_delete {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:37:00.516737 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.notifiers.nova [req-ea00a940-d0c0-455b-aac1-6c8c7aae2ffa req-20e89ba7-b1da-484c-aa52-c104d6250a8d service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id cee918cb-f6e3-450a-9a6b-6a6e13f08868 {{(pid=102992) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 23 19:37:00.561745 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [req-ea00a940-d0c0-455b-aac1-6c8c7aae2ffa req-20e89ba7-b1da-484c-aa52-c104d6250a8d service neutron] Publish callbacks [] for port, precommit_update {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:37:00.564639 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.db.provisioning_blocks [None req-4bf48ff4-ecfb-4168-8b63-249b8c6e9f04 None None] Provisioning for port cde3ee31-252a-4d6a-ab52-e04028f9cab7 completed by entity L2. {{(pid=102994) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 23 19:37:00.573533 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.db.provisioning_blocks [None req-4bf48ff4-ecfb-4168-8b63-249b8c6e9f04 None None] Provisioning complete for port cde3ee31-252a-4d6a-ab52-e04028f9cab7 triggered by entity L2. {{(pid=102994) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 23 19:37:00.573533 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron_lib.callbacks.manager [None req-4bf48ff4-ecfb-4168-8b63-249b8c6e9f04 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-8355713'] for port, provisioning_complete {{(pid=102994) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:37:00.642242 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [None req-ed0867f6-01d9-478a-9b49-8320b9e8e454 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-932919', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-13457'] for router, precommit_delete {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:37:00.644669 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.db.provisioning_blocks [req-ea00a940-d0c0-455b-aac1-6c8c7aae2ffa req-20e89ba7-b1da-484c-aa52-c104d6250a8d service neutron] Transition to ACTIVE for port object cee918cb-f6e3-450a-9a6b-6a6e13f08868 will not be triggered until provisioned by entity L2. {{(pid=102992) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 23 19:37:00.646336 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [None req-ed0867f6-01d9-478a-9b49-8320b9e8e454 admin admin] Publish callbacks [] for router_controller, precommit_delete_associations {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:37:00.692787 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron_lib.callbacks.manager [None req-4bf48ff4-ecfb-4168-8b63-249b8c6e9f04 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7921281'] for port, before_update {{(pid=102994) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:37:00.724111 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '2b4c5734-55b0-47f1-9223-9875c9561c64', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'cde3ee31-252a-4d6a-ab52-e04028f9cab7'}] {{(pid=102994) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 23 19:37:00.726438 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.62/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}09a7511da0d2ba1d728b27e36a8467ec5289399952f0059588048a7cb66d3a43" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-d5a5acd1-cb40-41e0-9322-1ae8e3861df9" -d '{"events": [{"server_uuid": "2b4c5734-55b0-47f1-9223-9875c9561c64", "name": "network-vif-plugged", "status": "completed", "tag": "cde3ee31-252a-4d6a-ab52-e04028f9cab7"}]}' {{(pid=102994) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 23 19:37:00.727326 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4a348ef6-be48-462f-b1d6-d3c64f265345 req-92941319-9c01-4558-a0db-917fe6d46f33 tempest-VolumesNegativeTest-1760818768 tempest-VolumesNegativeTest-1760818768-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102993) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:37:00.728911 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-4a348ef6-be48-462f-b1d6-d3c64f265345 req-92941319-9c01-4558-a0db-917fe6d46f33 tempest-VolumesNegativeTest-1760818768 tempest-VolumesNegativeTest-1760818768-project] 10.222.0.62 "GET /v2.0/ports?device_id=2b4c5734-55b0-47f1-9223-9875c9561c64 HTTP/1.1" status: 200 len: 949 time: 0.0947514 Nov 23 19:37:00.744754 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.plugins.ml2.db [None req-4bf48ff4-ecfb-4168-8b63-249b8c6e9f04 None None] For port cde3ee31-252a-4d6a-ab52-e04028f9cab7, host hv-cinder-81901, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81901',level=0,port_id=cde3ee31-252a-4d6a-ab52-e04028f9cab7,segment=NetworkSegment(760573d6-1aff-43f3-9bab-dbb5402f9396),segment_id=760573d6-1aff-43f3-9bab-dbb5402f9396)] {{(pid=102994) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 23 19:37:00.779076 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 23 Nov 2021 19:37:00 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-32285bc4-6019-4fdd-9af2-8a8148d9b296 x-openstack-request-id: req-32285bc4-6019-4fdd-9af2-8a8148d9b296 {{(pid=102994) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 23 19:37:00.779744 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "2b4c5734-55b0-47f1-9223-9875c9561c64", "name": "network-vif-plugged", "status": "completed", "tag": "cde3ee31-252a-4d6a-ab52-e04028f9cab7", "code": 200}]} {{(pid=102994) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 23 19:37:00.780201 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.62/compute/v2.1/os-server-external-events used request id req-32285bc4-6019-4fdd-9af2-8a8148d9b296 {{(pid=102994) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 23 19:37:00.780798 dv-cinder-819011-1-iscsi neutron-server[102994]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '2b4c5734-55b0-47f1-9223-9875c9561c64', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'cde3ee31-252a-4d6a-ab52-e04028f9cab7', 'code': 200} Nov 23 19:37:00.827000 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron_lib.callbacks.manager [None req-4bf48ff4-ecfb-4168-8b63-249b8c6e9f04 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7918660', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-15067', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560168', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8783631423946', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8783631008732', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8783631008750'] for port, after_update {{(pid=102994) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:37:00.897605 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4bf48ff4-ecfb-4168-8b63-249b8c6e9f04 None None] Pushing event updated for resources: {'Port': ['ID=cde3ee31-252a-4d6a-ab52-e04028f9cab7,revision_number=5']} {{(pid=102994) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 23 19:37:00.956879 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-4a348ef6-be48-462f-b1d6-d3c64f265345 req-f23672b8-ec00-4bd6-b539-585ed7d761fc tempest-VolumesNegativeTest-1760818768 tempest-VolumesNegativeTest-1760818768-project] 10.222.0.62 "GET /v2.0/security-groups?id=ac69cba1-f881-4fe2-ba1d-5270c0d54618&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1925361 Nov 23 19:37:01.008298 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-18247ff2-5611-4847-8a4a-7d229f7efdeb tempest-TestVolumeBootPattern-147141705 tempest-TestVolumeBootPattern-147141705-project] Publish callbacks [] for floatingip, precommit_create {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:37:01.026231 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [req-ea00a940-d0c0-455b-aac1-6c8c7aae2ffa req-20e89ba7-b1da-484c-aa52-c104d6250a8d service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7918660', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-15067', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560168', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8783631423946', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8783631008732', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8783631008750', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-25199748'] for port, after_update {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:37:01.100509 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-20e89ba7-b1da-484c-aa52-c104d6250a8d service neutron] Pushing event updated for resources: {'Port': ['ID=cee918cb-f6e3-450a-9a6b-6a6e13f08868,revision_number=2']} {{(pid=102992) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 23 19:37:01.128839 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f937d358-11de-46a3-88e1-b4d3bd84b86f req-477319e8-b3c7-48a5-ad1f-b7de8a68be3b tempest-VolumesSnapshotTestJSON-97879810 tempest-VolumesSnapshotTestJSON-97879810-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102992) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:37:01.130419 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-f937d358-11de-46a3-88e1-b4d3bd84b86f req-477319e8-b3c7-48a5-ad1f-b7de8a68be3b tempest-VolumesSnapshotTestJSON-97879810 tempest-VolumesSnapshotTestJSON-97879810-project] 10.222.0.62 "GET /v2.0/ports?device_id=56521436-30ba-4dcc-8272-0fcda3e896b0 HTTP/1.1" status: 200 len: 943 time: 0.1073291 Nov 23 19:37:01.136132 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-45c31617-9a8a-486a-8128-b8bc86d1b2ae req-6a817cd2-520a-4d1a-a1d7-afcedd67771f service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102993) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:37:01.137641 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-45c31617-9a8a-486a-8128-b8bc86d1b2ae req-6a817cd2-520a-4d1a-a1d7-afcedd67771f service neutron] 10.222.0.41 "GET /v2.0/ports?device_id=2b4c5734-55b0-47f1-9223-9875c9561c64 HTTP/1.1" status: 200 len: 1103 time: 0.0443847 Nov 23 19:37:01.148375 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [None req-ed0867f6-01d9-478a-9b49-8320b9e8e454 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-926715'] for router, after_delete {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:37:01.148898 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-ed0867f6-01d9-478a-9b49-8320b9e8e454 admin admin] Fanout notify agent at l3_agent the message router_deleted on router dcdcae73-a8c6-43f9-b388-80519245de0c {{(pid=102992) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Nov 23 19:37:01.160433 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [None req-ed0867f6-01d9-478a-9b49-8320b9e8e454 admin admin] Publish callbacks [] for router, before_response {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:37:01.164040 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [None req-ed0867f6-01d9-478a-9b49-8320b9e8e454 admin admin] 10.222.0.62 "DELETE /v2.0/routers/dcdcae73-a8c6-43f9-b388-80519245de0c HTTP/1.1" status: 204 len: 168 time: 2.2141137 Nov 23 19:37:01.166166 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.wsgi [-] (102993) accepted ('10.222.0.62', 47626) {{(pid=102993) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 23 19:37:01.183985 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-18247ff2-5611-4847-8a4a-7d229f7efdeb tempest-TestVolumeBootPattern-147141705 tempest-TestVolumeBootPattern-147141705-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7921281'] for port, before_update {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:37:01.244513 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-f937d358-11de-46a3-88e1-b4d3bd84b86f req-05adcc2d-749e-4859-915d-2ffdbdd4f15d tempest-VolumesSnapshotTestJSON-97879810 tempest-VolumesSnapshotTestJSON-97879810-project] 10.222.0.62 "GET /v2.0/security-groups?id=2fd4bf42-f1cd-4ab5-94a3-e2347f7bb016&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0970092 Nov 23 19:37:01.252500 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.plugins.ml2.managers [req-ea00a940-d0c0-455b-aac1-6c8c7aae2ffa req-20e89ba7-b1da-484c-aa52-c104d6250a8d service neutron] Attempting to bind port cee918cb-f6e3-450a-9a6b-6a6e13f08868 on host hv-cinder-81901 for vnic_type normal with profile {{(pid=102992) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 23 19:37:01.252851 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.plugins.ml2.managers [req-ea00a940-d0c0-455b-aac1-6c8c7aae2ffa req-20e89ba7-b1da-484c-aa52-c104d6250a8d service neutron] Attempting to bind port cee918cb-f6e3-450a-9a6b-6a6e13f08868 by drivers openvswitch,hyperv on host hv-cinder-81901 at level 0 using segments [{'id': 'b67642b4-1845-4b49-9392-51fd2c9bc8b8', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 815, 'network_id': '6a5d33a0-25a4-4580-ae9f-e7aa9d768182'}] {{(pid=102992) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 23 19:37:01.253191 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-ea00a940-d0c0-455b-aac1-6c8c7aae2ffa req-20e89ba7-b1da-484c-aa52-c104d6250a8d service neutron] Attempting to bind port cee918cb-f6e3-450a-9a6b-6a6e13f08868 on network 6a5d33a0-25a4-4580-ae9f-e7aa9d768182 {{(pid=102992) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 23 19:37:01.258259 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-ea00a940-d0c0-455b-aac1-6c8c7aae2ffa req-20e89ba7-b1da-484c-aa52-c104d6250a8d service neutron] Port cee918cb-f6e3-450a-9a6b-6a6e13f08868 on network 6a5d33a0-25a4-4580-ae9f-e7aa9d768182 not bound, no agent of type Open vSwitch agent registered on host hv-cinder-81901 {{(pid=102992) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Nov 23 19:37:01.258516 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-ea00a940-d0c0-455b-aac1-6c8c7aae2ffa req-20e89ba7-b1da-484c-aa52-c104d6250a8d service neutron] Attempting to bind port cee918cb-f6e3-450a-9a6b-6a6e13f08868 on network 6a5d33a0-25a4-4580-ae9f-e7aa9d768182 {{(pid=102992) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 23 19:37:01.263429 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-ea00a940-d0c0-455b-aac1-6c8c7aae2ffa req-20e89ba7-b1da-484c-aa52-c104d6250a8d service neutron] Checking agent: {'id': '14e5d049-431d-466a-8d1c-264e5129d376', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-81901', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 23, 19, 31, 29), 'started_at': datetime.datetime(2021, 11, 23, 19, 31, 29), 'heartbeat_timestamp': datetime.datetime(2021, 11, 23, 19, 36, 59), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=102992) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 23 19:37:01.264007 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-ea00a940-d0c0-455b-aac1-6c8c7aae2ffa req-20e89ba7-b1da-484c-aa52-c104d6250a8d service neutron] Checking segment: {'id': 'b67642b4-1845-4b49-9392-51fd2c9bc8b8', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 815, 'network_id': '6a5d33a0-25a4-4580-ae9f-e7aa9d768182'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102992) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 23 19:37:01.264401 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-ea00a940-d0c0-455b-aac1-6c8c7aae2ffa req-20e89ba7-b1da-484c-aa52-c104d6250a8d service neutron] Bound using segment: {'id': 'b67642b4-1845-4b49-9392-51fd2c9bc8b8', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 815, 'network_id': '6a5d33a0-25a4-4580-ae9f-e7aa9d768182'} {{(pid=102992) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 23 19:37:01.264834 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.plugins.ml2.managers [req-ea00a940-d0c0-455b-aac1-6c8c7aae2ffa req-20e89ba7-b1da-484c-aa52-c104d6250a8d service neutron] Bound port: cee918cb-f6e3-450a-9a6b-6a6e13f08868, host: hv-cinder-81901, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': 'b67642b4-1845-4b49-9392-51fd2c9bc8b8', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 815, 'network_id': '6a5d33a0-25a4-4580-ae9f-e7aa9d768182'}}] {{(pid=102992) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 23 19:37:01.265193 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [req-ea00a940-d0c0-455b-aac1-6c8c7aae2ffa req-20e89ba7-b1da-484c-aa52-c104d6250a8d service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7921281'] for port, before_update {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:37:01.266505 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.db.db_base_plugin_v2 [None req-c4aeb41c-6dc9-4b79-8def-d690e380ede9 admin admin] Deleting subnet e4fda56f-85ff-422d-adad-ec00db6378af {{(pid=102993) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Nov 23 19:37:01.278376 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-c4aeb41c-6dc9-4b79-8def-d690e380ede9 admin admin] Publish callbacks [] for subnet, before_delete {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:37:01.303471 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-45c31617-9a8a-486a-8128-b8bc86d1b2ae req-0c14bcc1-6a8f-45f7-97fd-bbf98aa89b8b service neutron] 10.222.0.41 "GET /v2.0/security-groups?id=ac69cba1-f881-4fe2-ba1d-5270c0d54618&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1512399 Nov 23 19:37:01.343020 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.plugins.ml2.db [req-ea00a940-d0c0-455b-aac1-6c8c7aae2ffa req-20e89ba7-b1da-484c-aa52-c104d6250a8d service neutron] For port cee918cb-f6e3-450a-9a6b-6a6e13f08868, host hv-cinder-81901, cleared binding levels {{(pid=102992) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 23 19:37:01.344908 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-c4aeb41c-6dc9-4b79-8def-d690e380ede9 admin admin] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-16914634'] for subnet, precommit_delete_associations {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:37:01.346526 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.plugins.ml2.db [req-ea00a940-d0c0-455b-aac1-6c8c7aae2ffa req-20e89ba7-b1da-484c-aa52-c104d6250a8d service neutron] For port cee918cb-f6e3-450a-9a6b-6a6e13f08868, host hv-cinder-81901, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81901',level=0,port_id=cee918cb-f6e3-450a-9a6b-6a6e13f08868,segment=NetworkSegment(b67642b4-1845-4b49-9392-51fd2c9bc8b8),segment_id=b67642b4-1845-4b49-9392-51fd2c9bc8b8)] {{(pid=102992) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 23 19:37:01.423014 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-c4aeb41c-6dc9-4b79-8def-d690e380ede9 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-7975863'] for subnet, precommit_delete {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:37:01.430320 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [req-ea00a940-d0c0-455b-aac1-6c8c7aae2ffa req-20e89ba7-b1da-484c-aa52-c104d6250a8d service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7918660', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-15067', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560168', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8783631423946', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8783631008732', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8783631008750', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-25199748'] for port, after_update {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:37:01.469765 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ea00a940-d0c0-455b-aac1-6c8c7aae2ffa req-20e89ba7-b1da-484c-aa52-c104d6250a8d service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102992) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:37:01.470362 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [req-ea00a940-d0c0-455b-aac1-6c8c7aae2ffa req-20e89ba7-b1da-484c-aa52-c104d6250a8d service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-514902'] for port, before_response {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:37:01.471878 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-ea00a940-d0c0-455b-aac1-6c8c7aae2ffa req-20e89ba7-b1da-484c-aa52-c104d6250a8d service neutron] 10.222.0.41 "PUT /v2.0/ports/cee918cb-f6e3-450a-9a6b-6a6e13f08868 HTTP/1.1" status: 200 len: 1093 time: 1.4896989 Nov 23 19:37:01.472328 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '56521436-30ba-4dcc-8272-0fcda3e896b0', 'tag': 'cee918cb-f6e3-450a-9a6b-6a6e13f08868'}] {{(pid=102992) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 23 19:37:01.474779 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.62/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}f86c332b591ae691ababa4b64e0601cbf242a448242f95367ce03daabfb7e1ce" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-6bae6cb9-5d11-41f6-85f9-c7d9c8730045" -d '{"events": [{"name": "network-changed", "server_uuid": "56521436-30ba-4dcc-8272-0fcda3e896b0", "tag": "cee918cb-f6e3-450a-9a6b-6a6e13f08868"}]}' {{(pid=102992) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 23 19:37:01.504802 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-20e89ba7-b1da-484c-aa52-c104d6250a8d service neutron] Pushing event updated for resources: {'Port': ['ID=cee918cb-f6e3-450a-9a6b-6a6e13f08868,revision_number=3']} {{(pid=102992) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 23 19:37:01.518618 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-18247ff2-5611-4847-8a4a-7d229f7efdeb tempest-TestVolumeBootPattern-147141705 tempest-TestVolumeBootPattern-147141705-project] Publish callbacks [] for port, precommit_update {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:37:01.526285 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Tue, 23 Nov 2021 19:37:01 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-12a031ea-0716-4cf6-9008-bd13e5aa9fe6 x-openstack-request-id: req-12a031ea-0716-4cf6-9008-bd13e5aa9fe6 {{(pid=102992) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 23 19:37:01.526576 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "56521436-30ba-4dcc-8272-0fcda3e896b0", "tag": "cee918cb-f6e3-450a-9a6b-6a6e13f08868", "status": "completed", "code": 200}]} {{(pid=102992) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 23 19:37:01.526854 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.62/compute/v2.1/os-server-external-events used request id req-12a031ea-0716-4cf6-9008-bd13e5aa9fe6 {{(pid=102992) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 23 19:37:01.527247 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '56521436-30ba-4dcc-8272-0fcda3e896b0', 'tag': 'cee918cb-f6e3-450a-9a6b-6a6e13f08868', 'status': 'completed', 'code': 200} Nov 23 19:37:01.589961 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6bae6cb9-5d11-41f6-85f9-c7d9c8730045 req-f7dda7fe-a35e-4bee-a9f0-27dd72e03ef1 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102992) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:37:01.591436 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-6bae6cb9-5d11-41f6-85f9-c7d9c8730045 req-f7dda7fe-a35e-4bee-a9f0-27dd72e03ef1 service neutron] 10.222.0.41 "GET /v2.0/ports?tenant_id=766c6a829b9945cfb36bad289566c0ad&device_id=56521436-30ba-4dcc-8272-0fcda3e896b0 HTTP/1.1" status: 200 len: 1096 time: 0.0415461 Nov 23 19:37:01.643494 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-18247ff2-5611-4847-8a4a-7d229f7efdeb tempest-TestVolumeBootPattern-147141705 tempest-TestVolumeBootPattern-147141705-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7918660', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-15067', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560168', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8783631423946', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8783631008732', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8783631008750', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-17257505'] for port, after_update {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:37:01.648377 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-c4aeb41c-6dc9-4b79-8def-d690e380ede9 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-7982148', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-554858', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560168', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-17257579', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-17772973'] for subnet, after_delete {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:37:01.693887 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6bae6cb9-5d11-41f6-85f9-c7d9c8730045 req-242a2700-0076-4413-ab75-a09d1241b93f service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102992) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:37:01.695381 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-6bae6cb9-5d11-41f6-85f9-c7d9c8730045 req-242a2700-0076-4413-ab75-a09d1241b93f service neutron] 10.222.0.41 "GET /v2.0/networks?tenant_id=766c6a829b9945cfb36bad289566c0ad&shared=False HTTP/1.1" status: 200 len: 914 time: 0.0953388 Nov 23 19:37:01.702058 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-c4aeb41c-6dc9-4b79-8def-d690e380ede9 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-560186'] for subnet, before_response {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:37:01.705371 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [None req-c4aeb41c-6dc9-4b79-8def-d690e380ede9 admin admin] 10.222.0.62 "DELETE /v2.0/subnets/e4fda56f-85ff-422d-adad-ec00db6378af HTTP/1.1" status: 204 len: 168 time: 0.5382657 Nov 23 19:37:01.706259 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c4aeb41c-6dc9-4b79-8def-d690e380ede9 admin admin] Pushing event deleted for resources: {'Subnet': ['ID=e4fda56f-85ff-422d-adad-ec00db6378af,revision_number=None']} {{(pid=102993) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 23 19:37:01.707976 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.wsgi [-] (102992) accepted ('10.222.0.62', 47630) {{(pid=102992) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 23 19:37:01.747064 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-18247ff2-5611-4847-8a4a-7d229f7efdeb tempest-TestVolumeBootPattern-147141705 tempest-TestVolumeBootPattern-147141705-project] Pushing event updated for resources: {'Port': ['ID=8015e531-c494-43e3-ba77-89dce1e50d86,revision_number=2']} {{(pid=102993) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 23 19:37:01.761475 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-18247ff2-5611-4847-8a4a-7d229f7efdeb tempest-TestVolumeBootPattern-147141705 tempest-TestVolumeBootPattern-147141705-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-926531'] for floatingip, after_create {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:37:01.836562 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [None req-ece889ff-0fa3-4c4f-9a08-074565075a4a admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-8133038'] for network, before_delete {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:37:01.862737 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.db.l3_db [None req-18247ff2-5611-4847-8a4a-7d229f7efdeb tempest-TestVolumeBootPattern-147141705 tempest-TestVolumeBootPattern-147141705-project] Floating IP 58aefccd-9c9d-4966-bba8-80772da95277 associated. External IP: 172.27.1.101, port: 1a0a2345-c03d-4159-89a8-35402d8d2448. Nov 23 19:37:01.886583 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6bae6cb9-5d11-41f6-85f9-c7d9c8730045 req-1e814ce9-f104-41c9-8cdc-e3cd7cecb6f1 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102992) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:37:01.888058 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-6bae6cb9-5d11-41f6-85f9-c7d9c8730045 req-1e814ce9-f104-41c9-8cdc-e3cd7cecb6f1 service neutron] 10.222.0.41 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 870 time: 0.1778834 Nov 23 19:37:01.950658 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [None req-ece889ff-0fa3-4c4f-9a08-074565075a4a admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-7977576', 'neutron.services.segments.db._delete_segments_for_network-8783631323320'] for network, precommit_delete {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:37:01.969563 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.plugins.ml2.rpc [None req-eb87b2c3-3339-4249-8b85-e695b5b4e1f9 None None] Device ccf9cfdb-e164-48bc-b433-5906352d8e1a no longer exists at agent ovs-agent-dv-cinder-819011-1-iscsi {{(pid=102994) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 23 19:37:02.000035 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.plugins.ml2.plugin [None req-eb87b2c3-3339-4249-8b85-e695b5b4e1f9 None None] No Port match for: ccf9cfdb-e164-48bc-b433-5906352d8e1a {{(pid=102994) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 23 19:37:02.000901 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.plugins.ml2.rpc [None req-eb87b2c3-3339-4249-8b85-e695b5b4e1f9 None None] Device ccf9cfdb-e164-48bc-b433-5906352d8e1a not bound to the agent host dv-cinder-819011-1-iscsi {{(pid=102994) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 23 19:37:02.016971 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.services.segments.db [None req-ece889ff-0fa3-4c4f-9a08-074565075a4a admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['07eeb44e-4cdb-4c58-a83d-1dd8ab1ccb8a']}} {{(pid=102992) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 23 19:37:02.028970 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.services.segments.db [None req-ece889ff-0fa3-4c4f-9a08-074565075a4a admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, 'b8302c34-e78d-4c43-9d45-a2604c95a2d2') {'for_net_delete': True} {{(pid=102992) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 23 19:37:02.029260 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.services.segments.db [None req-ece889ff-0fa3-4c4f-9a08-074565075a4a admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, 'b8302c34-e78d-4c43-9d45-a2604c95a2d2') {} {{(pid=102992) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 23 19:37:02.042417 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [None req-ece889ff-0fa3-4c4f-9a08-074565075a4a admin admin] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8783631432524', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-25272530'] for segment, before_delete {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:37:02.050616 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ea00a940-d0c0-455b-aac1-6c8c7aae2ffa req-5c5c1cc1-2b62-470b-b751-082b84713be3 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102992) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:37:02.052102 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-ea00a940-d0c0-455b-aac1-6c8c7aae2ffa req-5c5c1cc1-2b62-470b-b751-082b84713be3 service neutron] 10.222.0.41 "GET /v2.0/ports?tenant_id=766c6a829b9945cfb36bad289566c0ad&device_id=56521436-30ba-4dcc-8272-0fcda3e896b0 HTTP/1.1" status: 200 len: 1096 time: 0.0916338 Nov 23 19:37:02.068775 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [None req-ece889ff-0fa3-4c4f-9a08-074565075a4a admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7982218'] for segment, precommit_delete {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:37:02.116668 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-18247ff2-5611-4847-8a4a-7d229f7efdeb tempest-TestVolumeBootPattern-147141705 tempest-TestVolumeBootPattern-147141705-project] Router 0534bcc4-1e12-4026-90ce-1406543c7662 has already been hosted by L3 agent 1b20f2c4-70b6-43c3-b9bd-0062cc9e57ac {{(pid=102993) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 23 19:37:02.120886 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-ece889ff-0fa3-4c4f-9a08-074565075a4a admin admin] Releasing vlan 821 on physical network physnet1 to pool {{(pid=102992) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Nov 23 19:37:02.121223 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [None req-ece889ff-0fa3-4c4f-9a08-074565075a4a admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7982218', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-25200492'] for segment, after_delete {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:37:02.139595 dv-cinder-819011-1-iscsi neutron-server[102992]: Traceback (most recent call last): Nov 23 19:37:02.139595 dv-cinder-819011-1-iscsi neutron-server[102992]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Nov 23 19:37:02.139595 dv-cinder-819011-1-iscsi neutron-server[102992]: timer() Nov 23 19:37:02.139595 dv-cinder-819011-1-iscsi neutron-server[102992]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 23 19:37:02.139595 dv-cinder-819011-1-iscsi neutron-server[102992]: cb(*args, **kw) Nov 23 19:37:02.139595 dv-cinder-819011-1-iscsi neutron-server[102992]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Nov 23 19:37:02.139595 dv-cinder-819011-1-iscsi neutron-server[102992]: return func(*args, **kwargs) Nov 23 19:37:02.139595 dv-cinder-819011-1-iscsi neutron-server[102992]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 23 19:37:02.139595 dv-cinder-819011-1-iscsi neutron-server[102992]: self._notify() Nov 23 19:37:02.139595 dv-cinder-819011-1-iscsi neutron-server[102992]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 23 19:37:02.139595 dv-cinder-819011-1-iscsi neutron-server[102992]: self.callback(batched_events) Nov 23 19:37:02.139595 dv-cinder-819011-1-iscsi neutron-server[102992]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 23 19:37:02.139595 dv-cinder-819011-1-iscsi neutron-server[102992]: event.method(event) Nov 23 19:37:02.139595 dv-cinder-819011-1-iscsi neutron-server[102992]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Nov 23 19:37:02.139595 dv-cinder-819011-1-iscsi neutron-server[102992]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 23 19:37:02.139595 dv-cinder-819011-1-iscsi neutron-server[102992]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Nov 23 19:37:02.139595 dv-cinder-819011-1-iscsi neutron-server[102992]: aggregate_uuid = self.p_client.list_aggregates( Nov 23 19:37:02.139595 dv-cinder-819011-1-iscsi neutron-server[102992]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Nov 23 19:37:02.139595 dv-cinder-819011-1-iscsi neutron-server[102992]: return f(self, *a, **k) Nov 23 19:37:02.139595 dv-cinder-819011-1-iscsi neutron-server[102992]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 23 19:37:02.139595 dv-cinder-819011-1-iscsi neutron-server[102992]: return self._get(url).json() Nov 23 19:37:02.139595 dv-cinder-819011-1-iscsi neutron-server[102992]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 23 19:37:02.139595 dv-cinder-819011-1-iscsi neutron-server[102992]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 23 19:37:02.139595 dv-cinder-819011-1-iscsi neutron-server[102992]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Nov 23 19:37:02.139595 dv-cinder-819011-1-iscsi neutron-server[102992]: return self.request(url, 'GET', **kwargs) Nov 23 19:37:02.139595 dv-cinder-819011-1-iscsi neutron-server[102992]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Nov 23 19:37:02.139595 dv-cinder-819011-1-iscsi neutron-server[102992]: base_url = self.get_endpoint(auth, allow=allow, Nov 23 19:37:02.139595 dv-cinder-819011-1-iscsi neutron-server[102992]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Nov 23 19:37:02.139595 dv-cinder-819011-1-iscsi neutron-server[102992]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 23 19:37:02.139595 dv-cinder-819011-1-iscsi neutron-server[102992]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Nov 23 19:37:02.139595 dv-cinder-819011-1-iscsi neutron-server[102992]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 23 19:37:02.139595 dv-cinder-819011-1-iscsi neutron-server[102992]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 23 19:37:02.152266 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-ea00a940-d0c0-455b-aac1-6c8c7aae2ffa req-1531dd15-7650-4986-b6b8-bcb5d1c3cb60 service neutron] 10.222.0.41 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.5&port_id=cee918cb-f6e3-450a-9a6b-6a6e13f08868 HTTP/1.1" status: 200 len: 217 time: 0.0810947 Nov 23 19:37:02.245277 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-59efba34-5418-4b21-bd65-aff87b049e75 req-5c662b39-acc7-4b7f-b921-7f8d4b520a93 tempest-VolumesNegativeTest-1760818768 tempest-VolumesNegativeTest-1760818768-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102992) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:37:02.246914 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-59efba34-5418-4b21-bd65-aff87b049e75 req-5c662b39-acc7-4b7f-b921-7f8d4b520a93 tempest-VolumesNegativeTest-1760818768 tempest-VolumesNegativeTest-1760818768-project] 10.222.0.62 "GET /v2.0/ports?device_id=2b4c5734-55b0-47f1-9223-9875c9561c64 HTTP/1.1" status: 200 len: 950 time: 0.1700034 Nov 23 19:37:02.253382 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ea00a940-d0c0-455b-aac1-6c8c7aae2ffa req-e1fcecc5-0a6a-4bf6-af43-0823297ce105 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102992) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:37:02.254882 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-ea00a940-d0c0-455b-aac1-6c8c7aae2ffa req-e1fcecc5-0a6a-4bf6-af43-0823297ce105 service neutron] 10.222.0.41 "GET /v2.0/subnets?id=cf93b200-5fcb-4538-8ce7-95612047c22a HTTP/1.1" status: 200 len: 853 time: 0.0890682 Nov 23 19:37:02.318863 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-ea00a940-d0c0-455b-aac1-6c8c7aae2ffa req-5b3f20f9-7770-4506-9fb4-368eb2055921 service neutron] 10.222.0.41 "GET /v2.0/ports?network_id=6a5d33a0-25a4-4580-ae9f-e7aa9d768182&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0418885 Nov 23 19:37:02.319630 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [None req-ece889ff-0fa3-4c4f-9a08-074565075a4a admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-7977567', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-554949', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560168', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-926557'] for network, after_delete {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:37:02.345715 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [None req-ece889ff-0fa3-4c4f-9a08-074565075a4a admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-560186'] for network, before_response {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:37:02.349896 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [None req-ece889ff-0fa3-4c4f-9a08-074565075a4a admin admin] 10.222.0.62 "DELETE /v2.0/networks/07eeb44e-4cdb-4c58-a83d-1dd8ab1ccb8a HTTP/1.1" status: 204 len: 168 time: 0.6408257 Nov 23 19:37:02.382143 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-59efba34-5418-4b21-bd65-aff87b049e75 req-a4fb5700-95e5-40d7-9920-8150769e00ee tempest-VolumesNegativeTest-1760818768 tempest-VolumesNegativeTest-1760818768-project] 10.222.0.62 "GET /v2.0/security-groups?id=ac69cba1-f881-4fe2-ba1d-5270c0d54618&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1260624 Nov 23 19:37:02.438754 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ece889ff-0fa3-4c4f-9a08-074565075a4a admin admin] Pushing event deleted for resources: {'Network': ['ID=07eeb44e-4cdb-4c58-a83d-1dd8ab1ccb8a,revision_number=None']} {{(pid=102992) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 23 19:37:02.466651 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-ea00a940-d0c0-455b-aac1-6c8c7aae2ffa req-f1d80d54-2b1d-4c34-a133-cbb08370794a service neutron] 10.222.0.41 "GET /v2.0/networks/6a5d33a0-25a4-4580-ae9f-e7aa9d768182?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1359019 Nov 23 19:37:02.522034 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-18247ff2-5611-4847-8a4a-7d229f7efdeb tempest-TestVolumeBootPattern-147141705 tempest-TestVolumeBootPattern-147141705-project] Notify agent at l3_agent.dv-cinder-819011-1-iscsi the message routers_updated {{(pid=102993) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 23 19:37:02.535760 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-9985d9c1-3754-4e77-82bb-cdb99adacb0f None None] Sync routers for ids ['0534bcc4-1e12-4026-90ce-1406543c7662'] in dv-cinder-819011-1-iscsi {{(pid=102994) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 23 19:37:02.546956 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.db.l3_dvrscheduler_db [None req-9985d9c1-3754-4e77-82bb-cdb99adacb0f None None] Routers {'0534bcc4-1e12-4026-90ce-1406543c7662'} bound to L3 agent in host dv-cinder-819011-1-iscsi {{(pid=102994) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 23 19:37:02.547775 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.db.l3_hamode_db [None req-9985d9c1-3754-4e77-82bb-cdb99adacb0f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-819011-1-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-11-23T19:25:14Z,description=,heartbeat_timestamp=2021-11-23T19:36:44Z,host='dv-cinder-819011-1-iscsi',id=1b20f2c4-70b6-43c3-b9bd-0062cc9e57ac,load=0,resource_versions=,resources_synced=,started_at=2021-11-23T19:25:15Z,topic='l3_agent')) {'router_ids': ['0534bcc4-1e12-4026-90ce-1406543c7662'], 'active': True} {{(pid=102994) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 23 19:37:02.555713 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b6a4e9d8-e2de-4bc0-84a9-2011a21f3fe0 req-2a008d8b-47c6-4f54-b2fd-fb175e76acb8 tempest-VolumesSnapshotTestJSON-97879810 tempest-VolumesSnapshotTestJSON-97879810-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102993) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:37:02.557396 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-b6a4e9d8-e2de-4bc0-84a9-2011a21f3fe0 req-2a008d8b-47c6-4f54-b2fd-fb175e76acb8 tempest-VolumesSnapshotTestJSON-97879810 tempest-VolumesSnapshotTestJSON-97879810-project] 10.222.0.62 "GET /v2.0/ports?device_id=56521436-30ba-4dcc-8272-0fcda3e896b0 HTTP/1.1" status: 200 len: 943 time: 0.0911386 Nov 23 19:37:02.572281 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-ea00a940-d0c0-455b-aac1-6c8c7aae2ffa req-80a81441-ac0f-4856-804f-23ed1f3b0ee5 service neutron] 10.222.0.41 "GET /v2.0/networks/6a5d33a0-25a4-4580-ae9f-e7aa9d768182?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0961108 Nov 23 19:37:02.613676 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-b6a4e9d8-e2de-4bc0-84a9-2011a21f3fe0 req-d90b3308-cb8c-4671-a73a-1c16c4832714 tempest-VolumesSnapshotTestJSON-97879810 tempest-VolumesSnapshotTestJSON-97879810-project] 10.222.0.62 "GET /v2.0/security-groups?id=2fd4bf42-f1cd-4ab5-94a3-e2347f7bb016&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0495238 Nov 23 19:37:02.685982 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.db.l3_dvr_db [None req-9985d9c1-3754-4e77-82bb-cdb99adacb0f None None] Set router 0534bcc4-1e12-4026-90ce-1406543c7662 gateway port host: dv-cinder-819011-1-iscsi {{(pid=102994) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 23 19:37:02.713527 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-18247ff2-5611-4847-8a4a-7d229f7efdeb tempest-TestVolumeBootPattern-147141705 tempest-TestVolumeBootPattern-147141705-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-514902'] for floatingip, before_response {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:37:02.749423 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [None req-18247ff2-5611-4847-8a4a-7d229f7efdeb tempest-TestVolumeBootPattern-147141705 tempest-TestVolumeBootPattern-147141705-project] 10.222.0.62 "POST /v2.0/floatingips HTTP/1.1" status: 201 len: 997 time: 2.9355097 Nov 23 19:37:02.749423 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '4ee0b7a3-f787-4a7c-816a-71f3a99b7193', 'tag': '1a0a2345-c03d-4159-89a8-35402d8d2448'}] {{(pid=102993) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 23 19:37:02.749423 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.62/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}9b10b92acbee16fb695be1efeed0b68f7c36a5b215ec004a8d9d707fa3d35b2c" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-556899cb-e719-42e9-aa6b-4ecb50aeac54" -d '{"events": [{"name": "network-changed", "server_uuid": "4ee0b7a3-f787-4a7c-816a-71f3a99b7193", "tag": "1a0a2345-c03d-4159-89a8-35402d8d2448"}]}' {{(pid=102993) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 23 19:37:02.807087 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Tue, 23 Nov 2021 19:37:02 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-ef5edf14-2379-4c5f-9eed-000a573dc895 x-openstack-request-id: req-ef5edf14-2379-4c5f-9eed-000a573dc895 {{(pid=102993) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 23 19:37:02.807643 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "4ee0b7a3-f787-4a7c-816a-71f3a99b7193", "tag": "1a0a2345-c03d-4159-89a8-35402d8d2448", "status": "completed", "code": 200}]} {{(pid=102993) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 23 19:37:02.807908 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.62/compute/v2.1/os-server-external-events used request id req-ef5edf14-2379-4c5f-9eed-000a573dc895 {{(pid=102993) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 23 19:37:02.808315 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '4ee0b7a3-f787-4a7c-816a-71f3a99b7193', 'tag': '1a0a2345-c03d-4159-89a8-35402d8d2448', 'status': 'completed', 'code': 200} Nov 23 19:37:02.864039 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.wsgi [-] (102993) accepted ('10.222.0.62', 47654) {{(pid=102993) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 23 19:37:02.882768 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-556899cb-e719-42e9-aa6b-4ecb50aeac54 req-dcb9e4e2-483f-40f8-ade3-1c5ff818a4fb service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102992) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:37:02.884278 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-556899cb-e719-42e9-aa6b-4ecb50aeac54 req-dcb9e4e2-483f-40f8-ade3-1c5ff818a4fb service neutron] 10.222.0.41 "GET /v2.0/ports?tenant_id=257b0b2e531441b4bb745e99cfd799f3&device_id=4ee0b7a3-f787-4a7c-816a-71f3a99b7193 HTTP/1.1" status: 200 len: 1099 time: 0.0454431 Nov 23 19:37:02.912031 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [None req-7dfd79a5-6c15-4ee4-8cda-a5f469d1c261 admin admin] 10.222.0.62 "GET /v2.0/security-groups?tenant_id=c15ab51e579448cfb7a4b3e4f8049687&name=default HTTP/1.1" status: 200 len: 2992 time: 0.0467370 Nov 23 19:37:02.914099 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.wsgi [-] (102993) accepted ('10.222.0.62', 47656) {{(pid=102993) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 23 19:37:02.963583 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-3adabb59-aad5-48e5-a1b5-ceabbe29b4c4 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:37:02.985729 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-3adabb59-aad5-48e5-a1b5-ceabbe29b4c4 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:37:02.991991 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.db.l3_hamode_db [None req-9985d9c1-3754-4e77-82bb-cdb99adacb0f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '0534bcc4-1e12-4026-90ce-1406543c7662', 'name': 'tempest-TestVolumeBootPattern-84632531-router', 'tenant_id': '257b0b2e531441b4bb745e99cfd799f3', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'a93e254e-aac9-4233-9e4d-4290fd0458e4', 'external_fixed_ips': [{'subnet_id': 'e0b32f3d-83d6-439a-bbed-01df7cf01051', 'ip_address': '172.27.1.154'}], 'enable_snat': True}, 'gw_port_id': 'c7996293-6188-4690-b614-395448e4dc25', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-23T19:35:29Z', 'updated_at': '2021-11-23T19:35:33Z', 'revision_number': 4, 'project_id': '257b0b2e531441b4bb745e99cfd799f3', 'gw_port': {'id': 'c7996293-6188-4690-b614-395448e4dc25', 'name': '', 'network_id': 'a93e254e-aac9-4233-9e4d-4290fd0458e4', 'tenant_id': '', 'mac_address': 'fa:16:3e:52:67:5e', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '0534bcc4-1e12-4026-90ce-1406543c7662', 'device_owner': 'network:router_gateway', 'standard_attr_id': 392, 'fixed_ips': [{'subnet_id': 'e0b32f3d-83d6-439a-bbed-01df7cf01051', 'ip_address': '172.27.1.154', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-819011-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-23T19:35:30Z', 'updated_at': '2021-11-23T19:35:34Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'e0b32f3d-83d6-439a-bbed-01df7cf01051', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-819011-1-iscsi', '_floatingips': [{'id': '58aefccd-9c9d-4966-bba8-80772da95277', 'tenant_id': '257b0b2e531441b4bb745e99cfd799f3', 'floating_ip_address': '172.27.1.101', 'floating_network_id': 'a93e254e-aac9-4233-9e4d-4290fd0458e4', 'router_id': '0534bcc4-1e12-4026-90ce-1406543c7662', 'port_id': '1a0a2345-c03d-4159-89a8-35402d8d2448', 'fixed_ip_address': '172.20.0.14', 'status': 'DOWN', 'standard_attr_id': 475, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '226a519f-5f3e-4d80-bb8a-0e9fc4f64828', 'mac_address': 'fa:16:3e:17:1a:2b', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '4ee0b7a3-f787-4a7c-816a-71f3a99b7193', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-23T19:37:00Z', 'updated_at': '2021-11-23T19:37:00Z', 'revision_number': 0, 'project_id': '257b0b2e531441b4bb745e99cfd799f3', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '854821af-61e0-47e7-a603-95f500a49030', 'name': '', 'network_id': '226a519f-5f3e-4d80-bb8a-0e9fc4f64828', 'tenant_id': '257b0b2e531441b4bb745e99cfd799f3', 'mac_address': 'fa:16:3e:90:11:65', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '0534bcc4-1e12-4026-90ce-1406543c7662', 'device_owner': 'network:router_interface', 'standard_attr_id': 393, 'fixed_ips': [{'subnet_id': '88de785d-c540-4651-af1e-26f27ccaee3c', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-819011-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-23T19:35:32Z', 'updated_at': '2021-11-23T19:35:37Z', 'revision_number': 5, 'project_id': '257b0b2e531441b4bb745e99cfd799f3', 'subnets': [{'id': '88de785d-c540-4651-af1e-26f27ccaee3c', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-819011-1-iscsi', False) {} {{(pid=102994) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 23 19:37:02.997279 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-556899cb-e719-42e9-aa6b-4ecb50aeac54 req-caec6bef-9fbf-4c8d-8af3-f47d8b2b281e service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102992) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:37:02.998833 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-556899cb-e719-42e9-aa6b-4ecb50aeac54 req-caec6bef-9fbf-4c8d-8af3-f47d8b2b281e service neutron] 10.222.0.41 "GET /v2.0/networks?id=226a519f-5f3e-4d80-bb8a-0e9fc4f64828 HTTP/1.1" status: 200 len: 911 time: 0.1053083 Nov 23 19:37:03.020501 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-9985d9c1-3754-4e77-82bb-cdb99adacb0f None None] Checking router: 0534bcc4-1e12-4026-90ce-1406543c7662 for host: dv-cinder-819011-1-iscsi {{(pid=102994) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 23 19:37:03.030362 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.db.l3_dvrscheduler_db [None req-9985d9c1-3754-4e77-82bb-cdb99adacb0f None None] Routers {'0534bcc4-1e12-4026-90ce-1406543c7662'} bound to L3 agent in host dv-cinder-819011-1-iscsi {{(pid=102994) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 23 19:37:03.030966 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.db.l3_hamode_db [None req-9985d9c1-3754-4e77-82bb-cdb99adacb0f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-819011-1-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-11-23T19:25:14Z,description=,heartbeat_timestamp=2021-11-23T19:36:44Z,host='dv-cinder-819011-1-iscsi',id=1b20f2c4-70b6-43c3-b9bd-0062cc9e57ac,load=0,resource_versions=,resources_synced=,started_at=2021-11-23T19:25:15Z,topic='l3_agent')) {'router_ids': ['0534bcc4-1e12-4026-90ce-1406543c7662'], 'active': True} {{(pid=102994) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 23 19:37:03.076294 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-556899cb-e719-42e9-aa6b-4ecb50aeac54 req-3581c552-cf0c-44f4-92e6-cce89bda28b1 service neutron] 10.222.0.41 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.14&port_id=1a0a2345-c03d-4159-89a8-35402d8d2448 HTTP/1.1" status: 200 len: 1000 time: 0.0627484 Nov 23 19:37:03.077433 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-3adabb59-aad5-48e5-a1b5-ceabbe29b4c4 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-623933'] for security_group, after_delete {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:37:03.080249 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-3adabb59-aad5-48e5-a1b5-ceabbe29b4c4 admin admin] Publish callbacks [] for security_group, before_response {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:37:03.081395 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [None req-3adabb59-aad5-48e5-a1b5-ceabbe29b4c4 admin admin] 10.222.0.62 "DELETE /v2.0/security-groups/62a09434-acf0-424f-9001-2c3a78119364 HTTP/1.1" status: 204 len: 168 time: 0.1663806 Nov 23 19:37:03.089781 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3adabb59-aad5-48e5-a1b5-ceabbe29b4c4 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=62a09434-acf0-424f-9001-2c3a78119364,revision_number=None']} {{(pid=102993) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 23 19:37:03.142824 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-556899cb-e719-42e9-aa6b-4ecb50aeac54 req-feb2487a-ff03-47db-8b2f-e7bddd4cd6b2 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102992) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:37:03.144503 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-556899cb-e719-42e9-aa6b-4ecb50aeac54 req-feb2487a-ff03-47db-8b2f-e7bddd4cd6b2 service neutron] 10.222.0.41 "GET /v2.0/subnets?id=88de785d-c540-4651-af1e-26f27ccaee3c HTTP/1.1" status: 200 len: 849 time: 0.0542572 Nov 23 19:37:03.157581 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.db.l3_dvr_db [None req-9985d9c1-3754-4e77-82bb-cdb99adacb0f None None] Set router 0534bcc4-1e12-4026-90ce-1406543c7662 gateway port host: dv-cinder-819011-1-iscsi {{(pid=102994) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 23 19:37:03.197031 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-556899cb-e719-42e9-aa6b-4ecb50aeac54 req-cc5b6465-fa1b-4269-a6ae-94d643baa26f service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102992) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:37:03.199118 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-556899cb-e719-42e9-aa6b-4ecb50aeac54 req-cc5b6465-fa1b-4269-a6ae-94d643baa26f service neutron] 10.222.0.41 "GET /v2.0/ports?network_id=226a519f-5f3e-4d80-bb8a-0e9fc4f64828&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0443609 Nov 23 19:37:03.296161 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-556899cb-e719-42e9-aa6b-4ecb50aeac54 req-169e9e81-80d3-4d2e-96cd-ce5b62811cb8 service neutron] 10.222.0.41 "GET /v2.0/networks/226a519f-5f3e-4d80-bb8a-0e9fc4f64828?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0894215 Nov 23 19:37:03.407625 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-556899cb-e719-42e9-aa6b-4ecb50aeac54 req-9e03e6c5-48c7-45d4-abf5-ee351dec28e7 service neutron] 10.222.0.41 "GET /v2.0/networks/226a519f-5f3e-4d80-bb8a-0e9fc4f64828?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1030419 Nov 23 19:37:03.521573 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.db.l3_hamode_db [None req-9985d9c1-3754-4e77-82bb-cdb99adacb0f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '0534bcc4-1e12-4026-90ce-1406543c7662', 'name': 'tempest-TestVolumeBootPattern-84632531-router', 'tenant_id': '257b0b2e531441b4bb745e99cfd799f3', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'a93e254e-aac9-4233-9e4d-4290fd0458e4', 'external_fixed_ips': [{'subnet_id': 'e0b32f3d-83d6-439a-bbed-01df7cf01051', 'ip_address': '172.27.1.154'}], 'enable_snat': True}, 'gw_port_id': 'c7996293-6188-4690-b614-395448e4dc25', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-23T19:35:29Z', 'updated_at': '2021-11-23T19:35:33Z', 'revision_number': 4, 'project_id': '257b0b2e531441b4bb745e99cfd799f3', 'gw_port': {'id': 'c7996293-6188-4690-b614-395448e4dc25', 'name': '', 'network_id': 'a93e254e-aac9-4233-9e4d-4290fd0458e4', 'tenant_id': '', 'mac_address': 'fa:16:3e:52:67:5e', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '0534bcc4-1e12-4026-90ce-1406543c7662', 'device_owner': 'network:router_gateway', 'standard_attr_id': 392, 'fixed_ips': [{'subnet_id': 'e0b32f3d-83d6-439a-bbed-01df7cf01051', 'ip_address': '172.27.1.154', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-819011-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-23T19:35:30Z', 'updated_at': '2021-11-23T19:35:34Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'e0b32f3d-83d6-439a-bbed-01df7cf01051', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-819011-1-iscsi', '_floatingips': [{'id': '58aefccd-9c9d-4966-bba8-80772da95277', 'tenant_id': '257b0b2e531441b4bb745e99cfd799f3', 'floating_ip_address': '172.27.1.101', 'floating_network_id': 'a93e254e-aac9-4233-9e4d-4290fd0458e4', 'router_id': '0534bcc4-1e12-4026-90ce-1406543c7662', 'port_id': '1a0a2345-c03d-4159-89a8-35402d8d2448', 'fixed_ip_address': '172.20.0.14', 'status': 'DOWN', 'standard_attr_id': 475, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '226a519f-5f3e-4d80-bb8a-0e9fc4f64828', 'mac_address': 'fa:16:3e:17:1a:2b', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '4ee0b7a3-f787-4a7c-816a-71f3a99b7193', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-23T19:37:00Z', 'updated_at': '2021-11-23T19:37:00Z', 'revision_number': 0, 'project_id': '257b0b2e531441b4bb745e99cfd799f3', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '854821af-61e0-47e7-a603-95f500a49030', 'name': '', 'network_id': '226a519f-5f3e-4d80-bb8a-0e9fc4f64828', 'tenant_id': '257b0b2e531441b4bb745e99cfd799f3', 'mac_address': 'fa:16:3e:90:11:65', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '0534bcc4-1e12-4026-90ce-1406543c7662', 'device_owner': 'network:router_interface', 'standard_attr_id': 393, 'fixed_ips': [{'subnet_id': '88de785d-c540-4651-af1e-26f27ccaee3c', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-819011-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-23T19:35:32Z', 'updated_at': '2021-11-23T19:35:37Z', 'revision_number': 5, 'project_id': '257b0b2e531441b4bb745e99cfd799f3', 'subnets': [{'id': '88de785d-c540-4651-af1e-26f27ccaee3c', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-819011-1-iscsi', False) {} {{(pid=102994) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 23 19:37:03.522832 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4a11c072-e184-4e77-882a-c71765e012f6 req-8cf042f2-1eba-45ac-ad4b-5a834af32d3e tempest-VolumesNegativeTest-1760818768 tempest-VolumesNegativeTest-1760818768-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102993) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:37:03.524608 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-4a11c072-e184-4e77-882a-c71765e012f6 req-8cf042f2-1eba-45ac-ad4b-5a834af32d3e tempest-VolumesNegativeTest-1760818768 tempest-VolumesNegativeTest-1760818768-project] 10.222.0.62 "GET /v2.0/ports?device_id=2b4c5734-55b0-47f1-9223-9875c9561c64 HTTP/1.1" status: 200 len: 950 time: 0.0568085 Nov 23 19:37:03.552223 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-9985d9c1-3754-4e77-82bb-cdb99adacb0f None None] The sync data for ids ['0534bcc4-1e12-4026-90ce-1406543c7662'] in dv-cinder-819011-1-iscsi is: [{'id': '0534bcc4-1e12-4026-90ce-1406543c7662', 'name': 'tempest-TestVolumeBootPattern-84632531-router', 'tenant_id': '257b0b2e531441b4bb745e99cfd799f3', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'a93e254e-aac9-4233-9e4d-4290fd0458e4', 'external_fixed_ips': [{'subnet_id': 'e0b32f3d-83d6-439a-bbed-01df7cf01051', 'ip_address': '172.27.1.154'}], 'enable_snat': True}, 'gw_port_id': 'c7996293-6188-4690-b614-395448e4dc25', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-23T19:35:29Z', 'updated_at': '2021-11-23T19:35:33Z', 'revision_number': 4, 'project_id': '257b0b2e531441b4bb745e99cfd799f3', 'gw_port': {'id': 'c7996293-6188-4690-b614-395448e4dc25', 'name': '', 'network_id': 'a93e254e-aac9-4233-9e4d-4290fd0458e4', 'tenant_id': '', 'mac_address': 'fa:16:3e:52:67:5e', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '0534bcc4-1e12-4026-90ce-1406543c7662', 'device_owner': 'network:router_gateway', 'standard_attr_id': 392, 'fixed_ips': [{'subnet_id': 'e0b32f3d-83d6-439a-bbed-01df7cf01051', 'ip_address': '172.27.1.154', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-819011-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-23T19:35:30Z', 'updated_at': '2021-11-23T19:35:34Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'e0b32f3d-83d6-439a-bbed-01df7cf01051', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-819011-1-iscsi', '_floatingips': [{'id': '58aefccd-9c9d-4966-bba8-80772da95277', 'tenant_id': '257b0b2e531441b4bb745e99cfd799f3', 'floating_ip_address': '172.27.1.101', 'floating_network_id': 'a93e254e-aac9-4233-9e4d-4290fd0458e4', 'router_id': '0534bcc4-1e12-4026-90ce-1406543c7662', 'port_id': '1a0a2345-c03d-4159-89a8-35402d8d2448', 'fixed_ip_address': '172.20.0.14', 'status': 'DOWN', 'standard_attr_id': 475, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '226a519f-5f3e-4d80-bb8a-0e9fc4f64828', 'mac_address': 'fa:16:3e:17:1a:2b', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '4ee0b7a3-f787-4a7c-816a-71f3a99b7193', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-23T19:37:00Z', 'updated_at': '2021-11-23T19:37:00Z', 'revision_number': 0, 'project_id': '257b0b2e531441b4bb745e99cfd799f3', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '854821af-61e0-47e7-a603-95f500a49030', 'name': '', 'network_id': '226a519f-5f3e-4d80-bb8a-0e9fc4f64828', 'tenant_id': '257b0b2e531441b4bb745e99cfd799f3', 'mac_address': 'fa:16:3e:90:11:65', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '0534bcc4-1e12-4026-90ce-1406543c7662', 'device_owner': 'network:router_interface', 'standard_attr_id': 393, 'fixed_ips': [{'subnet_id': '88de785d-c540-4651-af1e-26f27ccaee3c', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-819011-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-23T19:35:32Z', 'updated_at': '2021-11-23T19:35:37Z', 'revision_number': 5, 'project_id': '257b0b2e531441b4bb745e99cfd799f3', 'subnets': [{'id': '88de785d-c540-4651-af1e-26f27ccaee3c', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=102994) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 23 19:37:03.582735 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-4a11c072-e184-4e77-882a-c71765e012f6 req-c8004937-b5f9-49a2-9af9-d301ee67f959 tempest-VolumesNegativeTest-1760818768 tempest-VolumesNegativeTest-1760818768-project] 10.222.0.62 "GET /v2.0/security-groups?id=ac69cba1-f881-4fe2-ba1d-5270c0d54618&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0517292 Nov 23 19:37:03.755137 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-441e0183-6aeb-4cc5-8d43-e37636784e7b req-4df73c10-0446-49c3-af64-b0b3bd0dceb3 tempest-VolumesSnapshotTestJSON-97879810 tempest-VolumesSnapshotTestJSON-97879810-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102993) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:37:03.756686 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-441e0183-6aeb-4cc5-8d43-e37636784e7b req-4df73c10-0446-49c3-af64-b0b3bd0dceb3 tempest-VolumesSnapshotTestJSON-97879810 tempest-VolumesSnapshotTestJSON-97879810-project] 10.222.0.62 "GET /v2.0/ports?device_id=56521436-30ba-4dcc-8272-0fcda3e896b0 HTTP/1.1" status: 200 len: 943 time: 0.0575156 Nov 23 19:37:03.821581 dv-cinder-819011-1-iscsi neutron-server[102995]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-dc90c3d6-c0f7-4538-b930-04c1cb99820c None None] New status for floating IP 58aefccd-9c9d-4966-bba8-80772da95277: ACTIVE {{(pid=102995) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Nov 23 19:37:03.841131 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-441e0183-6aeb-4cc5-8d43-e37636784e7b req-944c5f8f-3d01-4d91-bb4c-0cbc2c14f02f tempest-VolumesSnapshotTestJSON-97879810 tempest-VolumesSnapshotTestJSON-97879810-project] 10.222.0.62 "GET /v2.0/security-groups?id=2fd4bf42-f1cd-4ab5-94a3-e2347f7bb016&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0778606 Nov 23 19:37:04.063137 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9a9eddcd-6e97-42e9-8c4a-4bc967c4775f req-407241a5-790f-4bbf-a719-ffafbadb26ff tempest-VolumesNegativeTest-1760818768 tempest-VolumesNegativeTest-1760818768-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102993) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:37:04.064827 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-9a9eddcd-6e97-42e9-8c4a-4bc967c4775f req-407241a5-790f-4bbf-a719-ffafbadb26ff tempest-VolumesNegativeTest-1760818768 tempest-VolumesNegativeTest-1760818768-project] 10.222.0.62 "GET /v2.0/ports?device_id=2b4c5734-55b0-47f1-9223-9875c9561c64 HTTP/1.1" status: 200 len: 950 time: 0.0584116 Nov 23 19:37:04.116669 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-9a9eddcd-6e97-42e9-8c4a-4bc967c4775f req-f9b3e11b-e060-4c50-9f5b-7173d5f196a0 tempest-VolumesNegativeTest-1760818768 tempest-VolumesNegativeTest-1760818768-project] 10.222.0.62 "GET /v2.0/security-groups?id=ac69cba1-f881-4fe2-ba1d-5270c0d54618&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0453889 Nov 23 19:37:04.204702 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.wsgi [-] (102993) accepted ('10.222.0.62', 47696) {{(pid=102993) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 23 19:37:04.299894 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.api.v2.base [None req-64f0ef9e-055a-456a-96da-25fe95b1038a admin admin] Request body: {'network': {'name': 'tempest-AttachVolumeTestJSON-1672505821-network', 'tenant_id': 'c9d53f0599374b679185cc73383b417c'}} {{(pid=102993) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 23 19:37:04.385530 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-64f0ef9e-055a-456a-96da-25fe95b1038a admin admin] Made reservation on behalf of c9d53f0599374b679185cc73383b417c for: {'network': 1} {{(pid=102993) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 23 19:37:04.387796 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-64f0ef9e-055a-456a-96da-25fe95b1038a admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7921281'] for network, before_create {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:37:04.397538 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-64f0ef9e-055a-456a-96da-25fe95b1038a admin admin] Publish callbacks [] for security_group, before_create {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:37:04.478298 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-64f0ef9e-055a-456a-96da-25fe95b1038a admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:37:04.556681 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-64f0ef9e-055a-456a-96da-25fe95b1038a admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-623933'] for security_group, after_create {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:37:04.582974 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-64f0ef9e-055a-456a-96da-25fe95b1038a admin admin] vlan segment allocate from pool success with {'vlan_id': 824, 'physical_network': 'physnet1'} {{(pid=102993) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 23 19:37:04.592368 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-64f0ef9e-055a-456a-96da-25fe95b1038a admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=3c646d5d-3feb-4f6d-b5a1-38e2b7bb59fa,revision_number=1']} {{(pid=102993) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 23 19:37:04.600856 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-64f0ef9e-055a-456a-96da-25fe95b1038a admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7982218'] for segment, precommit_create {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:37:04.600959 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.db.segments_db [None req-64f0ef9e-055a-456a-96da-25fe95b1038a admin admin] Added segment 1a7bcd69-381b-4068-88df-df74b53e9d61 of type vlan for network 41fa5020-8aad-49ce-b2a6-39d87c9e6042 Nov 23 19:37:04.643879 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-64f0ef9e-055a-456a-96da-25fe95b1038a admin admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8783630993713'] for network, precommit_create {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:37:04.722578 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-64f0ef9e-055a-456a-96da-25fe95b1038a admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-554949', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560168'] for network, after_create {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:37:04.723568 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-64f0ef9e-055a-456a-96da-25fe95b1038a admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102993) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:37:04.724159 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-64f0ef9e-055a-456a-96da-25fe95b1038a admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-560186'] for network, before_response {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:37:04.783043 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-64f0ef9e-055a-456a-96da-25fe95b1038a admin admin] Pushing event updated for resources: {'Network': ['ID=41fa5020-8aad-49ce-b2a6-39d87c9e6042,revision_number=1']} {{(pid=102993) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 23 19:37:04.793357 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.plugins.ml2.rpc [None req-eb87b2c3-3339-4249-8b85-e695b5b4e1f9 None None] Network 41fa5020-8aad-49ce-b2a6-39d87c9e6042 details requested by agent ovs-agent-dv-cinder-819011-1-iscsi with host dv-cinder-819011-1-iscsi {{(pid=102994) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Nov 23 19:37:04.817188 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [None req-64f0ef9e-055a-456a-96da-25fe95b1038a admin admin] 10.222.0.62 "POST /v2.0/networks HTTP/1.1" status: 201 len: 884 time: 0.6112332 Nov 23 19:37:04.820096 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.wsgi [-] (102993) accepted ('10.222.0.62', 47704) {{(pid=102993) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 23 19:37:04.825072 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.api.v2.base [None req-85429558-98a5-4432-b070-a07679cf9a27 admin admin] Request body: {'subnet': {'network_id': '41fa5020-8aad-49ce-b2a6-39d87c9e6042', 'cidr': '172.20.0.0/28', 'name': 'tempest-AttachVolumeTestJSON-1672505821-subnet', 'tenant_id': 'c9d53f0599374b679185cc73383b417c', 'enable_dhcp': True, 'ip_version': 4}} {{(pid=102993) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 23 19:37:04.905714 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-85429558-98a5-4432-b070-a07679cf9a27 admin admin] Made reservation on behalf of c9d53f0599374b679185cc73383b417c for: {'subnet': 1} {{(pid=102993) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 23 19:37:04.908439 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-85429558-98a5-4432-b070-a07679cf9a27 admin admin] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-17772934'] for subnet, before_create {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:37:04.962340 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-148c92df-960e-4adc-843a-f97fee7e298f req-e75d7b4d-4cb2-4dd0-94ff-e7a2f5895ed8 tempest-VolumesSnapshotTestJSON-97879810 tempest-VolumesSnapshotTestJSON-97879810-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102992) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:37:04.964438 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-148c92df-960e-4adc-843a-f97fee7e298f req-e75d7b4d-4cb2-4dd0-94ff-e7a2f5895ed8 tempest-VolumesSnapshotTestJSON-97879810 tempest-VolumesSnapshotTestJSON-97879810-project] 10.222.0.62 "GET /v2.0/ports?device_id=56521436-30ba-4dcc-8272-0fcda3e896b0 HTTP/1.1" status: 200 len: 943 time: 0.0499539 Nov 23 19:37:05.012860 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-148c92df-960e-4adc-843a-f97fee7e298f req-4683dae4-665c-470b-87cb-28bdeb0acdbf tempest-VolumesSnapshotTestJSON-97879810 tempest-VolumesSnapshotTestJSON-97879810-project] 10.222.0.62 "GET /v2.0/security-groups?id=2fd4bf42-f1cd-4ab5-94a3-e2347f7bb016&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0423925 Nov 23 19:37:05.157095 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-85429558-98a5-4432-b070-a07679cf9a27 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-554858', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560168', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-17257652', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-17772948'] for subnet, after_create {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:37:05.237176 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-85429558-98a5-4432-b070-a07679cf9a27 admin admin] Pushing event updated for resources: {'Subnet': ['ID=8f74a1ae-f892-4057-89a5-ca78a259b1bd,revision_number=0']} {{(pid=102993) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 23 19:37:05.261308 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-85429558-98a5-4432-b070-a07679cf9a27 admin admin] Checking segment: {'id': '1a7bcd69-381b-4068-88df-df74b53e9d61', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 824, 'network_id': '41fa5020-8aad-49ce-b2a6-39d87c9e6042'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102993) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 23 19:37:05.261685 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-85429558-98a5-4432-b070-a07679cf9a27 admin admin] Network hostable DHCP agents. Network: 41fa5020-8aad-49ce-b2a6-39d87c9e6042, hostable agents: ['e51c95c7-6a36-4263-ba47-1839054f3e7a'], hosted agents: [] {{(pid=102993) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 23 19:37:05.272093 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ffc6c9db-b8b4-4e0a-b399-f5945be4d452 req-830d0d78-7b94-46ac-af01-9155e45d297d tempest-VolumesNegativeTest-1760818768 tempest-VolumesNegativeTest-1760818768-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102993) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:37:05.273592 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-ffc6c9db-b8b4-4e0a-b399-f5945be4d452 req-830d0d78-7b94-46ac-af01-9155e45d297d tempest-VolumesNegativeTest-1760818768 tempest-VolumesNegativeTest-1760818768-project] 10.222.0.62 "GET /v2.0/ports?device_id=2b4c5734-55b0-47f1-9223-9875c9561c64 HTTP/1.1" status: 200 len: 950 time: 0.0797782 Nov 23 19:37:05.326487 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-ffc6c9db-b8b4-4e0a-b399-f5945be4d452 req-3b8b0a2f-d624-448d-a42e-c72da8811deb tempest-VolumesNegativeTest-1760818768 tempest-VolumesNegativeTest-1760818768-project] 10.222.0.62 "GET /v2.0/security-groups?id=ac69cba1-f881-4fe2-ba1d-5270c0d54618&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0467005 Nov 23 19:37:05.563221 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-85429558-98a5-4432-b070-a07679cf9a27 admin admin] Network 41fa5020-8aad-49ce-b2a6-39d87c9e6042 is scheduled to be hosted by DHCP agent e51c95c7-6a36-4263-ba47-1839054f3e7a with binding_index 1 {{(pid=102993) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 23 19:37:05.567190 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ea5c263d-6510-45a0-b8c5-161a3819536d req-0a20747f-df53-4cac-89b8-435571331240 tempest-VolumesNegativeTest-1760818768 tempest-VolumesNegativeTest-1760818768-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102992) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:37:05.567190 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-ea5c263d-6510-45a0-b8c5-161a3819536d req-0a20747f-df53-4cac-89b8-435571331240 tempest-VolumesNegativeTest-1760818768 tempest-VolumesNegativeTest-1760818768-project] 10.222.0.41 "GET /v2.0/ports?device_id=2b4c5734-55b0-47f1-9223-9875c9561c64 HTTP/1.1" status: 200 len: 950 time: 0.0551240 Nov 23 19:37:05.661173 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.scheduler.base_scheduler [None req-85429558-98a5-4432-b070-a07679cf9a27 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-819011-1-iscsi, 41fa5020-8aad-49ce-b2a6-39d87c9e6042) {{(pid=102993) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 23 19:37:05.667972 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.plugins.ml2.plugin [req-ea5c263d-6510-45a0-b8c5-161a3819536d req-c99cd9e2-5844-4ab1-9247-41ff5977a190 tempest-VolumesNegativeTest-1760818768 tempest-VolumesNegativeTest-1760818768-project] Deleting port cde3ee31-252a-4d6a-ab52-e04028f9cab7 {{(pid=102992) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 23 19:37:05.667972 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [req-ea5c263d-6510-45a0-b8c5-161a3819536d req-c99cd9e2-5844-4ab1-9247-41ff5977a190 tempest-VolumesNegativeTest-1760818768 tempest-VolumesNegativeTest-1760818768-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8783631423070'] for port, before_delete {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:37:05.679366 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-85429558-98a5-4432-b070-a07679cf9a27 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=102993) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:37:05.680996 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-85429558-98a5-4432-b070-a07679cf9a27 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-560186'] for subnet, before_response {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:37:05.689194 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-b735aa2e-7eb0-4dc3-bfbf-6cc0a8e67359 None None] Network 41fa5020-8aad-49ce-b2a6-39d87c9e6042 requested from dv-cinder-819011-1-iscsi {{(pid=102994) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 23 19:37:05.787647 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.plugins.ml2.db [req-ea5c263d-6510-45a0-b8c5-161a3819536d req-c99cd9e2-5844-4ab1-9247-41ff5977a190 tempest-VolumesNegativeTest-1760818768 tempest-VolumesNegativeTest-1760818768-project] For port cde3ee31-252a-4d6a-ab52-e04028f9cab7, host hv-cinder-81901, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81901',level=0,port_id=cde3ee31-252a-4d6a-ab52-e04028f9cab7,segment=NetworkSegment(760573d6-1aff-43f3-9bab-dbb5402f9396),segment_id=760573d6-1aff-43f3-9bab-dbb5402f9396)] {{(pid=102992) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 23 19:37:05.788213 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [req-ea5c263d-6510-45a0-b8c5-161a3819536d req-c99cd9e2-5844-4ab1-9247-41ff5977a190 tempest-VolumesNegativeTest-1760818768 tempest-VolumesNegativeTest-1760818768-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-927332'] for port, precommit_delete {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:37:05.800289 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [None req-85429558-98a5-4432-b070-a07679cf9a27 admin admin] 10.222.0.62 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 847 time: 0.9790154 Nov 23 19:37:05.807687 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.wsgi [-] (102993) accepted ('10.222.0.62', 47716) {{(pid=102993) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 23 19:37:05.807687 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.api.v2.base [None req-86e03321-9ece-4e7a-a50a-378429e4023b admin admin] Request body: {'router': {'name': 'tempest-AttachVolumeTestJSON-1672505821-router', 'tenant_id': 'c9d53f0599374b679185cc73383b417c', 'external_gateway_info': {'network_id': 'a93e254e-aac9-4233-9e4d-4290fd0458e4'}}} {{(pid=102993) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 23 19:37:05.810785 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.plugins.ml2.plugin [req-ea5c263d-6510-45a0-b8c5-161a3819536d req-c99cd9e2-5844-4ab1-9247-41ff5977a190 tempest-VolumesNegativeTest-1760818768 tempest-VolumesNegativeTest-1760818768-project] Calling delete_port for cde3ee31-252a-4d6a-ab52-e04028f9cab7 owned by compute:nova {{(pid=102992) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 23 19:37:05.888549 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-86e03321-9ece-4e7a-a50a-378429e4023b admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-933550', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-13503'] for router, before_create {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:37:05.890339 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-86e03321-9ece-4e7a-a50a-378429e4023b admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-933038', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-927700', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-622769', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-13448'] for router, precommit_create {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:37:05.901763 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-2e63f8b2-23a3-4c97-a024-8a326243f7ca None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp8353ff9b-e01d-5e31-ab2d-60a764783255-41fa5020-8aad-49ce-b2a6-39d87c9e6042', 'network_id': '41fa5020-8aad-49ce-b2a6-39d87c9e6042', 'tenant_id': 'c9d53f0599374b679185cc73383b417c', 'fixed_ips': [{'subnet_id': '8f74a1ae-f892-4057-89a5-ca78a259b1bd'}]}} from dv-cinder-819011-1-iscsi. {{(pid=102994) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:285}} Nov 23 19:37:05.902649 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron_lib.callbacks.manager [None req-2e63f8b2-23a3-4c97-a024-8a326243f7ca None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7921281'] for port, before_create {{(pid=102994) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:37:05.968923 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-86e03321-9ece-4e7a-a50a-378429e4023b admin admin] Publish callbacks [] for router_controller, precommit_add_association {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:37:06.076913 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [req-ea5c263d-6510-45a0-b8c5-161a3819536d req-c99cd9e2-5844-4ab1-9247-41ff5977a190 tempest-VolumesNegativeTest-1760818768 tempest-VolumesNegativeTest-1760818768-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7918660', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-15067', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560168', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8783631424624', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8783631008723', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-25199805'] for port, after_delete {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:37:06.092561 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.plugins.ml2.db [None req-4bf48ff4-ecfb-4168-8b63-249b8c6e9f04 None None] get_ports_and_sgs() called for port_ids ['cde3ee31-252a-4d6a-ab52-e04028f9cab7'] {{(pid=102994) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 23 19:37:06.117297 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.db.db_base_plugin_common [None req-2e63f8b2-23a3-4c97-a024-8a326243f7ca None None] Allocated IP 172.20.0.2 (41fa5020-8aad-49ce-b2a6-39d87c9e6042/8f74a1ae-f892-4057-89a5-ca78a259b1bd/bf436721-5360-4dc2-99d4-f32fd359b0fe) {{(pid=102994) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 23 19:37:06.191297 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c99cd9e2-5844-4ab1-9247-41ff5977a190 tempest-VolumesNegativeTest-1760818768 tempest-VolumesNegativeTest-1760818768-project] Pushing event deleted for resources: {'Port': ['ID=cde3ee31-252a-4d6a-ab52-e04028f9cab7,revision_number=None']} {{(pid=102992) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 23 19:37:06.253599 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-86e03321-9ece-4e7a-a50a-378429e4023b admin admin] Publish callbacks [] for router_gateway, precommit_update {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:37:06.280901 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.db.l3_dvrscheduler_db [req-ea5c263d-6510-45a0-b8c5-161a3819536d req-c99cd9e2-5844-4ab1-9247-41ff5977a190 tempest-VolumesNegativeTest-1760818768 tempest-VolumesNegativeTest-1760818768-project] No DVR routers for this DVR port cde3ee31-252a-4d6a-ab52-e04028f9cab7 on host hv-cinder-81901 {{(pid=102992) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 23 19:37:06.285204 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [req-ea5c263d-6510-45a0-b8c5-161a3819536d req-c99cd9e2-5844-4ab1-9247-41ff5977a190 tempest-VolumesNegativeTest-1760818768 tempest-VolumesNegativeTest-1760818768-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-514902'] for port, before_response {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:37:06.288823 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-ea5c263d-6510-45a0-b8c5-161a3819536d req-c99cd9e2-5844-4ab1-9247-41ff5977a190 tempest-VolumesNegativeTest-1760818768 tempest-VolumesNegativeTest-1760818768-project] 10.222.0.41 "DELETE /v2.0/ports/cde3ee31-252a-4d6a-ab52-e04028f9cab7 HTTP/1.1" status: 204 len: 173 time: 0.7160883 Nov 23 19:37:06.293837 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '2b4c5734-55b0-47f1-9223-9875c9561c64', 'name': 'network-vif-deleted', 'tag': 'cde3ee31-252a-4d6a-ab52-e04028f9cab7'}] {{(pid=102992) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 23 19:37:06.293837 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.62/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}f86c332b591ae691ababa4b64e0601cbf242a448242f95367ce03daabfb7e1ce" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-855c00d2-6765-4da8-a7b5-067bb05fb678" -d '{"events": [{"server_uuid": "2b4c5734-55b0-47f1-9223-9875c9561c64", "name": "network-vif-deleted", "tag": "cde3ee31-252a-4d6a-ab52-e04028f9cab7"}]}' {{(pid=102992) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 23 19:37:06.310727 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bce8a0b6-8083-4a90-8d2f-a14a922e87e2 req-0e82d480-e87c-426a-bb54-748bade82237 tempest-VolumesSnapshotTestJSON-97879810 tempest-VolumesSnapshotTestJSON-97879810-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102992) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:37:06.313224 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-bce8a0b6-8083-4a90-8d2f-a14a922e87e2 req-0e82d480-e87c-426a-bb54-748bade82237 tempest-VolumesSnapshotTestJSON-97879810 tempest-VolumesSnapshotTestJSON-97879810-project] 10.222.0.62 "GET /v2.0/ports?device_id=56521436-30ba-4dcc-8272-0fcda3e896b0 HTTP/1.1" status: 200 len: 943 time: 0.1823616 Nov 23 19:37:06.336455 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron_lib.callbacks.manager [None req-2e63f8b2-23a3-4c97-a024-8a326243f7ca None None] Publish callbacks [] for port, precommit_create {{(pid=102994) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:37:06.357642 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 23 Nov 2021 19:37:06 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-a904ae7a-99e9-4e67-9562-7dc4af98af63 x-openstack-request-id: req-a904ae7a-99e9-4e67-9562-7dc4af98af63 {{(pid=102992) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 23 19:37:06.357979 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "2b4c5734-55b0-47f1-9223-9875c9561c64", "name": "network-vif-deleted", "tag": "cde3ee31-252a-4d6a-ab52-e04028f9cab7", "status": "completed", "code": 200}]} {{(pid=102992) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 23 19:37:06.358246 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.62/compute/v2.1/os-server-external-events used request id req-a904ae7a-99e9-4e67-9562-7dc4af98af63 {{(pid=102992) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 23 19:37:06.358696 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '2b4c5734-55b0-47f1-9223-9875c9561c64', 'name': 'network-vif-deleted', 'tag': 'cde3ee31-252a-4d6a-ab52-e04028f9cab7', 'status': 'completed', 'code': 200} Nov 23 19:37:06.402498 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-bce8a0b6-8083-4a90-8d2f-a14a922e87e2 req-dee3f9ea-dc88-4717-84e5-ef458f684ebd tempest-VolumesSnapshotTestJSON-97879810 tempest-VolumesSnapshotTestJSON-97879810-project] 10.222.0.62 "GET /v2.0/security-groups?id=2fd4bf42-f1cd-4ab5-94a3-e2347f7bb016&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0798717 Nov 23 19:37:06.424428 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.plugins.ml2.rpc [None req-4bf48ff4-ecfb-4168-8b63-249b8c6e9f04 None None] Device cee918cb-f6e3-450a-9a6b-6a6e13f08868 details requested by agent hyperv_hv-cinder-81901 with host hv-cinder-81901 {{(pid=102994) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Nov 23 19:37:06.467563 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron_lib.callbacks.manager [None req-2e63f8b2-23a3-4c97-a024-8a326243f7ca None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7918660', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-15067', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560168', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8783631008714'] for port, after_create {{(pid=102994) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:37:06.571404 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-edf1c211-6ca3-410a-9de0-23d3453c4285 req-f6a25af2-7b65-4321-8f7c-f527efbc465b tempest-VolumesNegativeTest-1760818768 tempest-VolumesNegativeTest-1760818768-project] 10.222.0.62 "GET /v2.0/ports?device_id=2b4c5734-55b0-47f1-9223-9875c9561c64 HTTP/1.1" status: 200 len: 210 time: 0.0299048 Nov 23 19:37:06.584055 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-2e63f8b2-23a3-4c97-a024-8a326243f7ca None None] Network 41fa5020-8aad-49ce-b2a6-39d87c9e6042 is already hosted by enough agents. {{(pid=102994) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 23 19:37:06.590716 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.scheduler.base_scheduler [None req-2e63f8b2-23a3-4c97-a024-8a326243f7ca None None] Resources bound (agent type, host, resource id): {{(pid=102994) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 23 19:37:06.597352 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.db.l3_dvrscheduler_db [None req-2e63f8b2-23a3-4c97-a024-8a326243f7ca None None] Received port after_create {{(pid=102994) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 23 19:37:06.604460 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2e63f8b2-23a3-4c97-a024-8a326243f7ca None None] Pushing event updated for resources: {'Port': ['ID=bf436721-5360-4dc2-99d4-f32fd359b0fe,revision_number=1']} {{(pid=102994) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 23 19:37:06.616941 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-86e03321-9ece-4e7a-a50a-378429e4023b admin admin] Publish callbacks [] for router_gateway, before_create {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:37:06.636975 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-86e03321-9ece-4e7a-a50a-378429e4023b admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7921281'] for port, before_create {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:37:06.640017 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.plugins.ml2.db [None req-4bf48ff4-ecfb-4168-8b63-249b8c6e9f04 None None] For port cee918cb-f6e3-450a-9a6b-6a6e13f08868, host hv-cinder-81901, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81901',level=0,port_id=cee918cb-f6e3-450a-9a6b-6a6e13f08868,segment=NetworkSegment(b67642b4-1845-4b49-9392-51fd2c9bc8b8),segment_id=b67642b4-1845-4b49-9392-51fd2c9bc8b8)] {{(pid=102994) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 23 19:37:06.672217 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.plugins.ml2.rpc [None req-4bf48ff4-ecfb-4168-8b63-249b8c6e9f04 None None] Returning: {'device': 'cee918cb-f6e3-450a-9a6b-6a6e13f08868', 'network_id': '6a5d33a0-25a4-4580-ae9f-e7aa9d768182', 'port_id': 'cee918cb-f6e3-450a-9a6b-6a6e13f08868', 'mac_address': 'fa:16:3e:ca:24:08', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 815, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'cf93b200-5fcb-4538-8ce7-95612047c22a', 'ip_address': '172.20.0.5'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=102994) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Nov 23 19:37:06.678260 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.plugins.ml2.managers [None req-2e63f8b2-23a3-4c97-a024-8a326243f7ca None None] Attempting to bind port bf436721-5360-4dc2-99d4-f32fd359b0fe on host dv-cinder-819011-1-iscsi for vnic_type normal with profile {{(pid=102994) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 23 19:37:06.678635 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.plugins.ml2.managers [None req-2e63f8b2-23a3-4c97-a024-8a326243f7ca None None] Attempting to bind port bf436721-5360-4dc2-99d4-f32fd359b0fe by drivers openvswitch,hyperv on host dv-cinder-819011-1-iscsi at level 0 using segments [{'id': '1a7bcd69-381b-4068-88df-df74b53e9d61', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 824, 'network_id': '41fa5020-8aad-49ce-b2a6-39d87c9e6042'}] {{(pid=102994) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 23 19:37:06.679001 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-2e63f8b2-23a3-4c97-a024-8a326243f7ca None None] Attempting to bind port bf436721-5360-4dc2-99d4-f32fd359b0fe on network 41fa5020-8aad-49ce-b2a6-39d87c9e6042 {{(pid=102994) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 23 19:37:06.686756 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-2e63f8b2-23a3-4c97-a024-8a326243f7ca None None] Checking agent: {'id': '668c8953-047c-499e-8c0d-db838fac1668', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-819011-1-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 23, 19, 25, 17), 'started_at': datetime.datetime(2021, 11, 23, 19, 25, 47), 'heartbeat_timestamp': datetime.datetime(2021, 11, 23, 19, 36, 47), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-819011-1-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=102994) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 23 19:37:06.690097 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-2e63f8b2-23a3-4c97-a024-8a326243f7ca None None] Checking segment: {'id': '1a7bcd69-381b-4068-88df-df74b53e9d61', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 824, 'network_id': '41fa5020-8aad-49ce-b2a6-39d87c9e6042'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102994) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 23 19:37:06.690097 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron_lib.callbacks.manager [None req-2e63f8b2-23a3-4c97-a024-8a326243f7ca None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=102994) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:37:06.690097 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-2e63f8b2-23a3-4c97-a024-8a326243f7ca None None] Bound using segment: {'id': '1a7bcd69-381b-4068-88df-df74b53e9d61', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 824, 'network_id': '41fa5020-8aad-49ce-b2a6-39d87c9e6042'} {{(pid=102994) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 23 19:37:06.690097 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.plugins.ml2.managers [None req-2e63f8b2-23a3-4c97-a024-8a326243f7ca None None] Bound port: bf436721-5360-4dc2-99d4-f32fd359b0fe, host: dv-cinder-819011-1-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '1a7bcd69-381b-4068-88df-df74b53e9d61', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 824, 'network_id': '41fa5020-8aad-49ce-b2a6-39d87c9e6042'}}] {{(pid=102994) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 23 19:37:06.690097 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron_lib.callbacks.manager [None req-2e63f8b2-23a3-4c97-a024-8a326243f7ca None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7921281'] for port, before_update {{(pid=102994) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:37:06.732450 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron_lib.callbacks.manager [None req-4bf48ff4-ecfb-4168-8b63-249b8c6e9f04 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7921281'] for port, before_update {{(pid=102994) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:37:06.747917 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.db.db_base_plugin_common [None req-86e03321-9ece-4e7a-a50a-378429e4023b admin admin] Allocated IP 172.27.1.34 (a93e254e-aac9-4233-9e4d-4290fd0458e4/e0b32f3d-83d6-439a-bbed-01df7cf01051/41109199-34e8-4da6-963c-4a47600cb432) {{(pid=102993) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 23 19:37:06.768360 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.notifiers.nova [None req-4bf48ff4-ecfb-4168-8b63-249b8c6e9f04 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id cee918cb-f6e3-450a-9a6b-6a6e13f08868 {{(pid=102994) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 23 19:37:06.806505 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.plugins.ml2.db [None req-2e63f8b2-23a3-4c97-a024-8a326243f7ca None None] For port bf436721-5360-4dc2-99d4-f32fd359b0fe, host dv-cinder-819011-1-iscsi, cleared binding levels {{(pid=102994) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 23 19:37:06.809526 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.plugins.ml2.db [None req-4bf48ff4-ecfb-4168-8b63-249b8c6e9f04 None None] For port cee918cb-f6e3-450a-9a6b-6a6e13f08868, host hv-cinder-81901, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81901',level=0,port_id=cee918cb-f6e3-450a-9a6b-6a6e13f08868,segment=NetworkSegment(b67642b4-1845-4b49-9392-51fd2c9bc8b8),segment_id=b67642b4-1845-4b49-9392-51fd2c9bc8b8)] {{(pid=102994) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 23 19:37:06.819164 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.plugins.ml2.db [None req-2e63f8b2-23a3-4c97-a024-8a326243f7ca None None] For port bf436721-5360-4dc2-99d4-f32fd359b0fe, host dv-cinder-819011-1-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-819011-1-iscsi',level=0,port_id=bf436721-5360-4dc2-99d4-f32fd359b0fe,segment=NetworkSegment(1a7bcd69-381b-4068-88df-df74b53e9d61),segment_id=1a7bcd69-381b-4068-88df-df74b53e9d61)] {{(pid=102994) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 23 19:37:06.849894 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-86e03321-9ece-4e7a-a50a-378429e4023b admin admin] Publish callbacks [] for port, precommit_create {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:37:06.859830 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron_lib.callbacks.manager [None req-4bf48ff4-ecfb-4168-8b63-249b8c6e9f04 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7918660', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-15067', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560168', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8783631423946', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8783631008732', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8783631008750'] for port, after_update {{(pid=102994) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:37:06.886735 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron_lib.callbacks.manager [None req-2e63f8b2-23a3-4c97-a024-8a326243f7ca None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7918660', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-15067', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560168', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8783631423946', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8783631008732', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8783631008750'] for port, after_update {{(pid=102994) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:37:06.923876 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4bf48ff4-ecfb-4168-8b63-249b8c6e9f04 None None] Pushing event updated for resources: {'Port': ['ID=cee918cb-f6e3-450a-9a6b-6a6e13f08868,revision_number=4']} {{(pid=102994) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 23 19:37:06.968658 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-86e03321-9ece-4e7a-a50a-378429e4023b admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7918660', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-15067', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560168', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8783631008714', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-17257496'] for port, after_create {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:37:06.974283 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2e63f8b2-23a3-4c97-a024-8a326243f7ca None None] Pushing event updated for resources: {'Port': ['ID=bf436721-5360-4dc2-99d4-f32fd359b0fe,revision_number=2']} {{(pid=102994) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 23 19:37:07.005324 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-86e03321-9ece-4e7a-a50a-378429e4023b admin admin] Network a93e254e-aac9-4233-9e4d-4290fd0458e4 is already hosted by enough agents. {{(pid=102993) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 23 19:37:07.008233 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.scheduler.base_scheduler [None req-86e03321-9ece-4e7a-a50a-378429e4023b admin admin] Resources bound (agent type, host, resource id): {{(pid=102993) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 23 19:37:07.011716 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.db.l3_dvrscheduler_db [None req-86e03321-9ece-4e7a-a50a-378429e4023b admin admin] Received port after_create {{(pid=102993) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 23 19:37:07.054802 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-86e03321-9ece-4e7a-a50a-378429e4023b admin admin] Pushing event updated for resources: {'Port': ['ID=41109199-34e8-4da6-963c-4a47600cb432,revision_number=1']} {{(pid=102993) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 23 19:37:07.128047 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.plugins.ml2.db [None req-4bf48ff4-ecfb-4168-8b63-249b8c6e9f04 None None] get_ports_and_sgs() called for port_ids ['cee918cb-f6e3-450a-9a6b-6a6e13f08868'] {{(pid=102994) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 23 19:37:07.365436 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-86e03321-9ece-4e7a-a50a-378429e4023b admin admin] Publish callbacks [] for router_gateway, after_create {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:37:07.543285 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-47d7b9f4-d9b4-418e-87be-02cfed30b5ad req-5126c67b-4687-42ca-bf11-8d9768f04cf4 tempest-VolumesSnapshotTestJSON-97879810 tempest-VolumesSnapshotTestJSON-97879810-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102992) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:37:07.545349 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-47d7b9f4-d9b4-418e-87be-02cfed30b5ad req-5126c67b-4687-42ca-bf11-8d9768f04cf4 tempest-VolumesSnapshotTestJSON-97879810 tempest-VolumesSnapshotTestJSON-97879810-project] 10.222.0.62 "GET /v2.0/ports?device_id=56521436-30ba-4dcc-8272-0fcda3e896b0 HTTP/1.1" status: 200 len: 944 time: 0.0549507 Nov 23 19:37:07.566466 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-86e03321-9ece-4e7a-a50a-378429e4023b admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-932875', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-926501'] for router, after_create {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:37:07.594753 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-47d7b9f4-d9b4-418e-87be-02cfed30b5ad req-19abffc3-bed6-4b88-8d4c-5a8db4b9cac3 tempest-VolumesSnapshotTestJSON-97879810 tempest-VolumesSnapshotTestJSON-97879810-project] 10.222.0.62 "GET /v2.0/security-groups?id=2fd4bf42-f1cd-4ab5-94a3-e2347f7bb016&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0426731 Nov 23 19:37:07.769387 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-86e03321-9ece-4e7a-a50a-378429e4023b admin admin] Router c925adea-d520-48c2-a2b3-fdb5661aaf95 is scheduled to L3 agent 1b20f2c4-70b6-43c3-b9bd-0062cc9e57ac with binding_index 1 {{(pid=102993) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Nov 23 19:37:07.888743 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-86e03321-9ece-4e7a-a50a-378429e4023b admin admin] Notify agent at l3_agent.dv-cinder-819011-1-iscsi the message routers_updated {{(pid=102993) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 23 19:37:07.902621 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-fd9339e8-9ff9-4ea6-90d7-7e834e25b943 None None] Sync routers for ids ['c925adea-d520-48c2-a2b3-fdb5661aaf95'] in dv-cinder-819011-1-iscsi {{(pid=102994) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 23 19:37:07.913566 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.db.l3_dvrscheduler_db [None req-fd9339e8-9ff9-4ea6-90d7-7e834e25b943 None None] Routers {'c925adea-d520-48c2-a2b3-fdb5661aaf95'} bound to L3 agent in host dv-cinder-819011-1-iscsi {{(pid=102994) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 23 19:37:07.914968 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.db.l3_hamode_db [None req-fd9339e8-9ff9-4ea6-90d7-7e834e25b943 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-819011-1-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-11-23T19:25:14Z,description=,heartbeat_timestamp=2021-11-23T19:36:44Z,host='dv-cinder-819011-1-iscsi',id=1b20f2c4-70b6-43c3-b9bd-0062cc9e57ac,load=0,resource_versions=,resources_synced=,started_at=2021-11-23T19:25:15Z,topic='l3_agent')) {'router_ids': ['c925adea-d520-48c2-a2b3-fdb5661aaf95'], 'active': True} {{(pid=102994) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 23 19:37:07.965436 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-86e03321-9ece-4e7a-a50a-378429e4023b admin admin] Publish callbacks [] for router, before_response {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:37:07.969757 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.wsgi [-] (102992) accepted ('10.222.0.62', 47748) {{(pid=102992) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 23 19:37:07.970101 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [None req-86e03321-9ece-4e7a-a50a-378429e4023b admin admin] 10.222.0.62 "POST /v2.0/routers HTTP/1.1" status: 201 len: 922 time: 2.1660557 Nov 23 19:37:08.024461 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-573b98dc-a9ae-4670-a90c-0e63b179c5ec None None] Network 41fa5020-8aad-49ce-b2a6-39d87c9e6042 requested from dv-cinder-819011-1-iscsi {{(pid=102994) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 23 19:37:08.053740 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.plugins.ml2.rpc [None req-eb87b2c3-3339-4249-8b85-e695b5b4e1f9 None None] Device bf436721-5360-4dc2-99d4-f32fd359b0fe up at agent ovs-agent-dv-cinder-819011-1-iscsi {{(pid=102994) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 23 19:37:08.138611 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.db.l3_dvr_db [None req-fd9339e8-9ff9-4ea6-90d7-7e834e25b943 None None] Set router c925adea-d520-48c2-a2b3-fdb5661aaf95 gateway port host: dv-cinder-819011-1-iscsi {{(pid=102994) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 23 19:37:08.225709 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.db.provisioning_blocks [None req-20e151dc-dbe1-4cb2-bcc3-0dc267cfb86f None None] Provisioning complete for port bf436721-5360-4dc2-99d4-f32fd359b0fe triggered by entity DHCP. {{(pid=102994) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 23 19:37:08.226074 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron_lib.callbacks.manager [None req-20e151dc-dbe1-4cb2-bcc3-0dc267cfb86f None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-8355713'] for port, provisioning_complete {{(pid=102994) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:37:08.356747 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.db.provisioning_blocks [None req-eb87b2c3-3339-4249-8b85-e695b5b4e1f9 None None] Provisioning complete for port bf436721-5360-4dc2-99d4-f32fd359b0fe triggered by entity L2. {{(pid=102994) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 23 19:37:08.357118 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron_lib.callbacks.manager [None req-eb87b2c3-3339-4249-8b85-e695b5b4e1f9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-8355713'] for port, provisioning_complete {{(pid=102994) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:37:08.427177 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [None req-33fb0d46-62b3-46f6-9426-c842aac01612 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7921281'] for port, before_create {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:37:08.515008 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.plugins.ml2.rpc [None req-4bf48ff4-ecfb-4168-8b63-249b8c6e9f04 None None] Device cee918cb-f6e3-450a-9a6b-6a6e13f08868 up at agent hyperv_hv-cinder-81901 {{(pid=102994) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 23 19:37:08.610412 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.db.db_base_plugin_common [None req-33fb0d46-62b3-46f6-9426-c842aac01612 admin admin] Allocated IP 172.20.0.1 (41fa5020-8aad-49ce-b2a6-39d87c9e6042/8f74a1ae-f892-4057-89a5-ca78a259b1bd/75766f49-5d4b-4c87-b9ea-e4dd672df213) {{(pid=102992) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 23 19:37:08.688424 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron_lib.callbacks.manager [None req-20e151dc-dbe1-4cb2-bcc3-0dc267cfb86f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7921281'] for port, before_update {{(pid=102994) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:37:08.768029 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [None req-33fb0d46-62b3-46f6-9426-c842aac01612 admin admin] Publish callbacks [] for port, precommit_create {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:37:08.781178 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.plugins.ml2.db [None req-20e151dc-dbe1-4cb2-bcc3-0dc267cfb86f None None] For port bf436721-5360-4dc2-99d4-f32fd359b0fe, host dv-cinder-819011-1-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-819011-1-iscsi',level=0,port_id=bf436721-5360-4dc2-99d4-f32fd359b0fe,segment=NetworkSegment(1a7bcd69-381b-4068-88df-df74b53e9d61),segment_id=1a7bcd69-381b-4068-88df-df74b53e9d61)] {{(pid=102994) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 23 19:37:08.784081 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron_lib.callbacks.manager [None req-eb87b2c3-3339-4249-8b85-e695b5b4e1f9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7921281'] for port, before_update {{(pid=102994) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:37:08.788937 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c9ec5586-dca6-4174-a284-d097637e3c18 req-c5beeabe-725d-487a-84bd-a18e7571827d tempest-VolumesSnapshotTestJSON-97879810 tempest-VolumesSnapshotTestJSON-97879810-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102992) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:37:08.788937 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-c9ec5586-dca6-4174-a284-d097637e3c18 req-c5beeabe-725d-487a-84bd-a18e7571827d tempest-VolumesSnapshotTestJSON-97879810 tempest-VolumesSnapshotTestJSON-97879810-project] 10.222.0.62 "GET /v2.0/ports?device_id=56521436-30ba-4dcc-8272-0fcda3e896b0 HTTP/1.1" status: 200 len: 944 time: 0.0983331 Nov 23 19:37:08.795695 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.db.l3_hamode_db [None req-fd9339e8-9ff9-4ea6-90d7-7e834e25b943 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'c925adea-d520-48c2-a2b3-fdb5661aaf95', 'name': 'tempest-AttachVolumeTestJSON-1672505821-router', 'tenant_id': 'c9d53f0599374b679185cc73383b417c', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'a93e254e-aac9-4233-9e4d-4290fd0458e4', 'external_fixed_ips': [{'subnet_id': 'e0b32f3d-83d6-439a-bbed-01df7cf01051', 'ip_address': '172.27.1.34'}], 'enable_snat': True}, 'gw_port_id': '41109199-34e8-4da6-963c-4a47600cb432', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-23T19:37:05Z', 'updated_at': '2021-11-23T19:37:07Z', 'revision_number': 3, 'project_id': 'c9d53f0599374b679185cc73383b417c', 'gw_port': {'id': '41109199-34e8-4da6-963c-4a47600cb432', 'name': '', 'network_id': 'a93e254e-aac9-4233-9e4d-4290fd0458e4', 'tenant_id': '', 'mac_address': 'fa:16:3e:52:78:cc', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'c925adea-d520-48c2-a2b3-fdb5661aaf95', 'device_owner': 'network:router_gateway', 'standard_attr_id': 486, 'fixed_ips': [{'subnet_id': 'e0b32f3d-83d6-439a-bbed-01df7cf01051', 'ip_address': '172.27.1.34', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-23T19:37:06Z', 'updated_at': '2021-11-23T19:37:06Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': 'e0b32f3d-83d6-439a-bbed-01df7cf01051', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-819011-1-iscsi'}], 'dv-cinder-819011-1-iscsi', False) {} {{(pid=102994) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 23 19:37:08.847977 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.db.provisioning_blocks [None req-4bf48ff4-ecfb-4168-8b63-249b8c6e9f04 None None] Provisioning for port cee918cb-f6e3-450a-9a6b-6a6e13f08868 completed by entity L2. {{(pid=102994) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 23 19:37:08.859845 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-fd9339e8-9ff9-4ea6-90d7-7e834e25b943 None None] Checking router: c925adea-d520-48c2-a2b3-fdb5661aaf95 for host: dv-cinder-819011-1-iscsi {{(pid=102994) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 23 19:37:08.860403 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-fd9339e8-9ff9-4ea6-90d7-7e834e25b943 None None] Updating router c925adea-d520-48c2-a2b3-fdb5661aaf95 port 41109199-34e8-4da6-963c-4a47600cb432 binding host dv-cinder-819011-1-iscsi {{(pid=102994) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Nov 23 19:37:08.880581 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-c9ec5586-dca6-4174-a284-d097637e3c18 req-b7c482b6-66cf-4105-b731-d77d2cc1a458 tempest-VolumesSnapshotTestJSON-97879810 tempest-VolumesSnapshotTestJSON-97879810-project] 10.222.0.62 "GET /v2.0/security-groups?id=2fd4bf42-f1cd-4ab5-94a3-e2347f7bb016&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0861053 Nov 23 19:37:08.906251 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.db.provisioning_blocks [None req-4bf48ff4-ecfb-4168-8b63-249b8c6e9f04 None None] Provisioning complete for port cee918cb-f6e3-450a-9a6b-6a6e13f08868 triggered by entity L2. {{(pid=102994) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 23 19:37:08.906251 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron_lib.callbacks.manager [None req-4bf48ff4-ecfb-4168-8b63-249b8c6e9f04 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-8355713'] for port, provisioning_complete {{(pid=102994) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:37:08.922751 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron_lib.callbacks.manager [None req-20e151dc-dbe1-4cb2-bcc3-0dc267cfb86f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7918660', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-15067', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560168', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8783631423946', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8783631008732', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8783631008750'] for port, after_update {{(pid=102994) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:37:08.972949 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [None req-33fb0d46-62b3-46f6-9426-c842aac01612 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7918660', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-15067', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560168', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8783631008714', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-25199805'] for port, after_create {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:37:08.995998 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron_lib.callbacks.manager [None req-fd9339e8-9ff9-4ea6-90d7-7e834e25b943 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7921281'] for port, before_update {{(pid=102994) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:37:09.012353 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-33fb0d46-62b3-46f6-9426-c842aac01612 admin admin] Network 41fa5020-8aad-49ce-b2a6-39d87c9e6042 is already hosted by enough agents. {{(pid=102992) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 23 19:37:09.015638 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.scheduler.base_scheduler [None req-33fb0d46-62b3-46f6-9426-c842aac01612 admin admin] Resources bound (agent type, host, resource id): {{(pid=102992) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 23 19:37:09.023149 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.db.l3_dvrscheduler_db [None req-33fb0d46-62b3-46f6-9426-c842aac01612 admin admin] Received port after_create {{(pid=102992) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 23 19:37:09.056340 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron_lib.db.api [None req-eb87b2c3-3339-4249-8b85-e695b5b4e1f9 None None] Retry wrapper got retriable exception: UPDATE statement on table 'standardattributes' expected to update 1 row(s); 0 were matched. {{(pid=102994) wrapped /usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py:183}} Nov 23 19:37:09.056839 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG oslo_db.api [None req-eb87b2c3-3339-4249-8b85-e695b5b4e1f9 None None] Performing DB retry for function neutron.plugins.ml2.plugin.Ml2Plugin.update_port_statuses {{(pid=102994) wrapper /usr/local/lib/python3.8/dist-packages/oslo_db/api.py:155}} Nov 23 19:37:09.058499 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-33fb0d46-62b3-46f6-9426-c842aac01612 admin admin] Pushing event updated for resources: {'Port': ['ID=75766f49-5d4b-4c87-b9ea-e4dd672df213,revision_number=1']} {{(pid=102992) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 23 19:37:09.077687 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [None req-33fb0d46-62b3-46f6-9426-c842aac01612 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-926676'] for router_interface, before_create {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:37:09.085470 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-20e151dc-dbe1-4cb2-bcc3-0dc267cfb86f None None] Pushing event updated for resources: {'Port': ['ID=bf436721-5360-4dc2-99d4-f32fd359b0fe,revision_number=3']} {{(pid=102994) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 23 19:37:09.157939 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.db.provisioning_blocks [None req-cc66ae27-d996-450b-b2d1-b9e9a3a2749c None None] Provisioning complete for port bf436721-5360-4dc2-99d4-f32fd359b0fe triggered by entity DHCP. {{(pid=102994) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 23 19:37:09.158669 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron_lib.callbacks.manager [None req-cc66ae27-d996-450b-b2d1-b9e9a3a2749c None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-8355713'] for port, provisioning_complete {{(pid=102994) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:37:09.259490 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron_lib.callbacks.manager [None req-4bf48ff4-ecfb-4168-8b63-249b8c6e9f04 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7921281'] for port, before_update {{(pid=102994) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:37:09.307357 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [None req-33fb0d46-62b3-46f6-9426-c842aac01612 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7921281'] for port, before_update {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:37:09.308869 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '56521436-30ba-4dcc-8272-0fcda3e896b0', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'cee918cb-f6e3-450a-9a6b-6a6e13f08868'}] {{(pid=102994) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 23 19:37:09.311230 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.62/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}09a7511da0d2ba1d728b27e36a8467ec5289399952f0059588048a7cb66d3a43" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-c5bcb943-09c0-4f57-93a9-308fc904c792" -d '{"events": [{"server_uuid": "56521436-30ba-4dcc-8272-0fcda3e896b0", "name": "network-vif-plugged", "status": "completed", "tag": "cee918cb-f6e3-450a-9a6b-6a6e13f08868"}]}' {{(pid=102994) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 23 19:37:09.363280 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.plugins.ml2.db [None req-4bf48ff4-ecfb-4168-8b63-249b8c6e9f04 None None] For port cee918cb-f6e3-450a-9a6b-6a6e13f08868, host hv-cinder-81901, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81901',level=0,port_id=cee918cb-f6e3-450a-9a6b-6a6e13f08868,segment=NetworkSegment(b67642b4-1845-4b49-9392-51fd2c9bc8b8),segment_id=b67642b4-1845-4b49-9392-51fd2c9bc8b8)] {{(pid=102994) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 23 19:37:09.384846 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 23 Nov 2021 19:37:09 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-74da77f6-8362-4fbc-8594-ddc3bb92b9b3 x-openstack-request-id: req-74da77f6-8362-4fbc-8594-ddc3bb92b9b3 {{(pid=102994) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 23 19:37:09.385285 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "56521436-30ba-4dcc-8272-0fcda3e896b0", "name": "network-vif-plugged", "status": "completed", "tag": "cee918cb-f6e3-450a-9a6b-6a6e13f08868", "code": 200}]} {{(pid=102994) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 23 19:37:09.385671 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.62/compute/v2.1/os-server-external-events used request id req-74da77f6-8362-4fbc-8594-ddc3bb92b9b3 {{(pid=102994) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 23 19:37:09.386291 dv-cinder-819011-1-iscsi neutron-server[102994]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '56521436-30ba-4dcc-8272-0fcda3e896b0', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'cee918cb-f6e3-450a-9a6b-6a6e13f08868', 'code': 200} Nov 23 19:37:09.439067 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron_lib.callbacks.manager [None req-4bf48ff4-ecfb-4168-8b63-249b8c6e9f04 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7918660', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-15067', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560168', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8783631423946', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8783631008732', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8783631008750'] for port, after_update {{(pid=102994) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:37:09.440039 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.plugins.ml2.rpc [None req-4bf48ff4-ecfb-4168-8b63-249b8c6e9f04 None None] Device cde3ee31-252a-4d6a-ab52-e04028f9cab7 no longer exists at agent hyperv_hv-cinder-81901 {{(pid=102994) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 23 19:37:09.494210 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [None req-33fb0d46-62b3-46f6-9426-c842aac01612 admin admin] Publish callbacks [] for port, precommit_update {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:37:09.495034 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.plugins.ml2.plugin [None req-4bf48ff4-ecfb-4168-8b63-249b8c6e9f04 None None] No Port match for: cde3ee31-252a-4d6a-ab52-e04028f9cab7 {{(pid=102994) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 23 19:37:09.495389 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.plugins.ml2.rpc [None req-4bf48ff4-ecfb-4168-8b63-249b8c6e9f04 None None] Device cde3ee31-252a-4d6a-ab52-e04028f9cab7 not bound to the agent host hv-cinder-81901 {{(pid=102994) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 23 19:37:09.558142 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4bf48ff4-ecfb-4168-8b63-249b8c6e9f04 None None] Pushing event updated for resources: {'Port': ['ID=cee918cb-f6e3-450a-9a6b-6a6e13f08868,revision_number=5']} {{(pid=102994) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 23 19:37:09.596651 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron_lib.callbacks.manager [None req-fd9339e8-9ff9-4ea6-90d7-7e834e25b943 None None] Publish callbacks [] for port, precommit_update {{(pid=102994) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:37:09.602380 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [None req-33fb0d46-62b3-46f6-9426-c842aac01612 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7918660', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-15067', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560168', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8783631423946', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8783631008732', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8783631008750', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-25199748'] for port, after_update {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:37:09.620086 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.db.provisioning_blocks [None req-9449c933-9047-42c7-87b0-5375efe13936 None None] Provisioning complete for port 75766f49-5d4b-4c87-b9ea-e4dd672df213 triggered by entity DHCP. {{(pid=102994) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 23 19:37:09.620577 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron_lib.callbacks.manager [None req-9449c933-9047-42c7-87b0-5375efe13936 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-8355713'] for port, provisioning_complete {{(pid=102994) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:37:09.662652 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.plugins.ml2.plugin [None req-9449c933-9047-42c7-87b0-5375efe13936 None None] Port 75766f49-5d4b-4c87-b9ea-e4dd672df213 cannot update to ACTIVE because it is not bound. {{(pid=102994) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 23 19:37:09.676978 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron_lib.callbacks.manager [None req-fd9339e8-9ff9-4ea6-90d7-7e834e25b943 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7918660', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-15067', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560168', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8783631423946', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8783631008732', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8783631008750'] for port, after_update {{(pid=102994) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:37:09.700401 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [None req-33fb0d46-62b3-46f6-9426-c842aac01612 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-553426', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-932964'] for router_interface, after_create {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:37:09.702410 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-33fb0d46-62b3-46f6-9426-c842aac01612 admin admin] Pushing event updated for resources: {'Port': ['ID=75766f49-5d4b-4c87-b9ea-e4dd672df213,revision_number=2']} {{(pid=102992) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 23 19:37:09.720883 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-da324713-863c-4678-8b07-c03b044b7091 req-4bb6afc2-bb96-4a88-8783-4497549ed74d service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102992) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:37:09.727444 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-da324713-863c-4678-8b07-c03b044b7091 req-4bb6afc2-bb96-4a88-8783-4497549ed74d service neutron] 10.222.0.41 "GET /v2.0/ports?device_id=56521436-30ba-4dcc-8272-0fcda3e896b0 HTTP/1.1" status: 200 len: 1098 time: 0.0771582 Nov 23 19:37:09.733463 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.plugins.ml2.managers [None req-fd9339e8-9ff9-4ea6-90d7-7e834e25b943 None None] Attempting to bind port 41109199-34e8-4da6-963c-4a47600cb432 on host dv-cinder-819011-1-iscsi for vnic_type normal with profile {{(pid=102994) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 23 19:37:09.735334 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.plugins.ml2.managers [None req-fd9339e8-9ff9-4ea6-90d7-7e834e25b943 None None] Attempting to bind port 41109199-34e8-4da6-963c-4a47600cb432 by drivers openvswitch,hyperv on host dv-cinder-819011-1-iscsi at level 0 using segments [{'id': '3cb5e60b-103a-47d0-a28b-d68e3159d032', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'a93e254e-aac9-4233-9e4d-4290fd0458e4'}] {{(pid=102994) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 23 19:37:09.735723 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-fd9339e8-9ff9-4ea6-90d7-7e834e25b943 None None] Attempting to bind port 41109199-34e8-4da6-963c-4a47600cb432 on network a93e254e-aac9-4233-9e4d-4290fd0458e4 {{(pid=102994) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 23 19:37:09.751128 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-fd9339e8-9ff9-4ea6-90d7-7e834e25b943 None None] Checking agent: {'id': '668c8953-047c-499e-8c0d-db838fac1668', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-819011-1-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 23, 19, 25, 17), 'started_at': datetime.datetime(2021, 11, 23, 19, 25, 47), 'heartbeat_timestamp': datetime.datetime(2021, 11, 23, 19, 36, 47), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-819011-1-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=102994) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 23 19:37:09.752434 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-fd9339e8-9ff9-4ea6-90d7-7e834e25b943 None None] Checking segment: {'id': '3cb5e60b-103a-47d0-a28b-d68e3159d032', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'a93e254e-aac9-4233-9e4d-4290fd0458e4'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102994) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 23 19:37:09.753345 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron_lib.callbacks.manager [None req-fd9339e8-9ff9-4ea6-90d7-7e834e25b943 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=102994) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:37:09.755096 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-fd9339e8-9ff9-4ea6-90d7-7e834e25b943 None None] Bound using segment: {'id': '3cb5e60b-103a-47d0-a28b-d68e3159d032', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'a93e254e-aac9-4233-9e4d-4290fd0458e4'} {{(pid=102994) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 23 19:37:09.755844 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.plugins.ml2.managers [None req-fd9339e8-9ff9-4ea6-90d7-7e834e25b943 None None] Bound port: 41109199-34e8-4da6-963c-4a47600cb432, host: dv-cinder-819011-1-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '3cb5e60b-103a-47d0-a28b-d68e3159d032', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'a93e254e-aac9-4233-9e4d-4290fd0458e4'}}] {{(pid=102994) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 23 19:37:09.756422 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron_lib.callbacks.manager [None req-fd9339e8-9ff9-4ea6-90d7-7e834e25b943 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7921281'] for port, before_update {{(pid=102994) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:37:09.787567 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-26e75099-4e47-4057-99b9-b3ea38d92166 None None] Pushing event updated for resources: {'Port': ['ID=41109199-34e8-4da6-963c-4a47600cb432,revision_number=2']} {{(pid=102994) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 23 19:37:09.819039 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-da324713-863c-4678-8b07-c03b044b7091 req-f3d809a0-b55d-4857-a900-1f21f8856303 service neutron] 10.222.0.41 "GET /v2.0/security-groups?id=2fd4bf42-f1cd-4ab5-94a3-e2347f7bb016&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0872190 Nov 23 19:37:09.828775 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.plugins.ml2.db [None req-fd9339e8-9ff9-4ea6-90d7-7e834e25b943 None None] For port 41109199-34e8-4da6-963c-4a47600cb432, host dv-cinder-819011-1-iscsi, cleared binding levels {{(pid=102994) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 23 19:37:09.833205 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.plugins.ml2.db [None req-fd9339e8-9ff9-4ea6-90d7-7e834e25b943 None None] For port 41109199-34e8-4da6-963c-4a47600cb432, host dv-cinder-819011-1-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-819011-1-iscsi',level=0,port_id=41109199-34e8-4da6-963c-4a47600cb432,segment=NetworkSegment(3cb5e60b-103a-47d0-a28b-d68e3159d032),segment_id=3cb5e60b-103a-47d0-a28b-d68e3159d032)] {{(pid=102994) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 23 19:37:09.840499 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-33fb0d46-62b3-46f6-9426-c842aac01612 admin admin] Network 41fa5020-8aad-49ce-b2a6-39d87c9e6042 is already hosted by enough agents. {{(pid=102992) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 23 19:37:09.841897 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.scheduler.base_scheduler [None req-33fb0d46-62b3-46f6-9426-c842aac01612 admin admin] Resources bound (agent type, host, resource id): {{(pid=102992) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 23 19:37:09.928801 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron_lib.callbacks.manager [None req-fd9339e8-9ff9-4ea6-90d7-7e834e25b943 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7918660', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-15067', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560168', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8783631423946', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8783631008732', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8783631008750'] for port, after_update {{(pid=102994) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:37:09.986503 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-33fb0d46-62b3-46f6-9426-c842aac01612 admin admin] Router c925adea-d520-48c2-a2b3-fdb5661aaf95 has already been hosted by L3 agent 1b20f2c4-70b6-43c3-b9bd-0062cc9e57ac {{(pid=102992) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 23 19:37:10.011652 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.db.l3_dvrscheduler_db [None req-fd9339e8-9ff9-4ea6-90d7-7e834e25b943 None None] Routers {'c925adea-d520-48c2-a2b3-fdb5661aaf95'} bound to L3 agent in host dv-cinder-819011-1-iscsi {{(pid=102994) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 23 19:37:10.013143 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.db.l3_hamode_db [None req-fd9339e8-9ff9-4ea6-90d7-7e834e25b943 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-819011-1-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-11-23T19:25:14Z,description=,heartbeat_timestamp=2021-11-23T19:36:44Z,host='dv-cinder-819011-1-iscsi',id=1b20f2c4-70b6-43c3-b9bd-0062cc9e57ac,load=0,resource_versions=,resources_synced=,started_at=2021-11-23T19:25:15Z,topic='l3_agent')) {'router_ids': ['c925adea-d520-48c2-a2b3-fdb5661aaf95'], 'active': True} {{(pid=102994) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 23 19:37:10.022278 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-26e75099-4e47-4057-99b9-b3ea38d92166 None None] Pushing event updated for resources: {'Port': ['ID=41109199-34e8-4da6-963c-4a47600cb432,revision_number=3']} {{(pid=102994) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 23 19:37:10.070901 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.plugins.ml2.rpc [None req-eb87b2c3-3339-4249-8b85-e695b5b4e1f9 None None] Device bf436721-5360-4dc2-99d4-f32fd359b0fe up at agent ovs-agent-dv-cinder-819011-1-iscsi {{(pid=102994) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 23 19:37:10.137808 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2c29bb41-447a-45b7-bba8-dc515149c226 req-37fc4ad1-da6d-4793-942b-c8022f0b5618 tempest-VolumesSnapshotTestJSON-97879810 tempest-VolumesSnapshotTestJSON-97879810-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102992) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:37:10.139324 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-2c29bb41-447a-45b7-bba8-dc515149c226 req-37fc4ad1-da6d-4793-942b-c8022f0b5618 tempest-VolumesSnapshotTestJSON-97879810 tempest-VolumesSnapshotTestJSON-97879810-project] 10.222.0.62 "GET /v2.0/ports?device_id=56521436-30ba-4dcc-8272-0fcda3e896b0 HTTP/1.1" status: 200 len: 945 time: 0.1414709 Nov 23 19:37:10.171707 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.db.provisioning_blocks [None req-29e69486-698b-4d1b-90d0-44c5678ae093 None None] Provisioning complete for port 75766f49-5d4b-4c87-b9ea-e4dd672df213 triggered by entity DHCP. {{(pid=102994) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 23 19:37:10.172112 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron_lib.callbacks.manager [None req-29e69486-698b-4d1b-90d0-44c5678ae093 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-8355713'] for port, provisioning_complete {{(pid=102994) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:37:10.217858 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-33fb0d46-62b3-46f6-9426-c842aac01612 admin admin] Notify agent at l3_agent.dv-cinder-819011-1-iscsi the message routers_updated {{(pid=102992) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 23 19:37:10.228913 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.db.l3_dvr_db [None req-fd9339e8-9ff9-4ea6-90d7-7e834e25b943 None None] Set router c925adea-d520-48c2-a2b3-fdb5661aaf95 gateway port host: dv-cinder-819011-1-iscsi {{(pid=102994) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 23 19:37:10.229938 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [None req-33fb0d46-62b3-46f6-9426-c842aac01612 admin admin] 10.222.0.62 "PUT /v2.0/routers/c925adea-d520-48c2-a2b3-fdb5661aaf95/add_router_interface HTTP/1.1" status: 200 len: 503 time: 2.2588315 Nov 23 19:37:10.239380 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-2c29bb41-447a-45b7-bba8-dc515149c226 req-a00ed604-0ba4-40fa-8951-58ae58166cb7 tempest-VolumesSnapshotTestJSON-97879810 tempest-VolumesSnapshotTestJSON-97879810-project] 10.222.0.62 "GET /v2.0/security-groups?id=2fd4bf42-f1cd-4ab5-94a3-e2347f7bb016&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0735488 Nov 23 19:37:10.259015 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.plugins.ml2.plugin [None req-29e69486-698b-4d1b-90d0-44c5678ae093 None None] Port 75766f49-5d4b-4c87-b9ea-e4dd672df213 cannot update to ACTIVE because it is not bound. {{(pid=102994) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 23 19:37:10.275335 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.db.provisioning_blocks [None req-eb87b2c3-3339-4249-8b85-e695b5b4e1f9 None None] Provisioning complete for port bf436721-5360-4dc2-99d4-f32fd359b0fe triggered by entity L2. {{(pid=102994) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 23 19:37:10.275335 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron_lib.callbacks.manager [None req-eb87b2c3-3339-4249-8b85-e695b5b4e1f9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-8355713'] for port, provisioning_complete {{(pid=102994) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:37:10.305009 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.wsgi [-] (102992) accepted ('10.222.0.62', 47872) {{(pid=102992) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 23 19:37:10.431268 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [None req-bfaca32f-904d-44eb-844b-46303bc1770f admin admin] Publish callbacks [] for security_group, before_create {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:37:10.513044 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [None req-bfaca32f-904d-44eb-844b-46303bc1770f admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:37:10.644700 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.db.l3_hamode_db [None req-fd9339e8-9ff9-4ea6-90d7-7e834e25b943 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'c925adea-d520-48c2-a2b3-fdb5661aaf95', 'name': 'tempest-AttachVolumeTestJSON-1672505821-router', 'tenant_id': 'c9d53f0599374b679185cc73383b417c', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'a93e254e-aac9-4233-9e4d-4290fd0458e4', 'external_fixed_ips': [{'subnet_id': 'e0b32f3d-83d6-439a-bbed-01df7cf01051', 'ip_address': '172.27.1.34'}], 'enable_snat': True}, 'gw_port_id': '41109199-34e8-4da6-963c-4a47600cb432', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-23T19:37:05Z', 'updated_at': '2021-11-23T19:37:09Z', 'revision_number': 4, 'project_id': 'c9d53f0599374b679185cc73383b417c', 'gw_port': {'id': '41109199-34e8-4da6-963c-4a47600cb432', 'name': '', 'network_id': 'a93e254e-aac9-4233-9e4d-4290fd0458e4', 'tenant_id': '', 'mac_address': 'fa:16:3e:52:78:cc', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'c925adea-d520-48c2-a2b3-fdb5661aaf95', 'device_owner': 'network:router_gateway', 'standard_attr_id': 486, 'fixed_ips': [{'subnet_id': 'e0b32f3d-83d6-439a-bbed-01df7cf01051', 'ip_address': '172.27.1.34', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-819011-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-23T19:37:06Z', 'updated_at': '2021-11-23T19:37:09Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'e0b32f3d-83d6-439a-bbed-01df7cf01051', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-819011-1-iscsi', '_interfaces': [{'id': '75766f49-5d4b-4c87-b9ea-e4dd672df213', 'name': '', 'network_id': '41fa5020-8aad-49ce-b2a6-39d87c9e6042', 'tenant_id': 'c9d53f0599374b679185cc73383b417c', 'mac_address': 'fa:16:3e:31:a3:fa', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'c925adea-d520-48c2-a2b3-fdb5661aaf95', 'device_owner': 'network:router_interface', 'standard_attr_id': 487, 'fixed_ips': [{'subnet_id': '8f74a1ae-f892-4057-89a5-ca78a259b1bd', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-23T19:37:08Z', 'updated_at': '2021-11-23T19:37:09Z', 'revision_number': 2, 'project_id': 'c9d53f0599374b679185cc73383b417c', 'subnets': [{'id': '8f74a1ae-f892-4057-89a5-ca78a259b1bd', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-819011-1-iscsi', False) {} {{(pid=102994) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 23 19:37:10.646392 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [None req-bfaca32f-904d-44eb-844b-46303bc1770f admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-623933'] for security_group, after_create {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:37:10.676785 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-fd9339e8-9ff9-4ea6-90d7-7e834e25b943 None None] The sync data for ids ['c925adea-d520-48c2-a2b3-fdb5661aaf95'] in dv-cinder-819011-1-iscsi is: [{'id': 'c925adea-d520-48c2-a2b3-fdb5661aaf95', 'name': 'tempest-AttachVolumeTestJSON-1672505821-router', 'tenant_id': 'c9d53f0599374b679185cc73383b417c', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'a93e254e-aac9-4233-9e4d-4290fd0458e4', 'external_fixed_ips': [{'subnet_id': 'e0b32f3d-83d6-439a-bbed-01df7cf01051', 'ip_address': '172.27.1.34'}], 'enable_snat': True}, 'gw_port_id': '41109199-34e8-4da6-963c-4a47600cb432', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-23T19:37:05Z', 'updated_at': '2021-11-23T19:37:09Z', 'revision_number': 4, 'project_id': 'c9d53f0599374b679185cc73383b417c', 'gw_port': {'id': '41109199-34e8-4da6-963c-4a47600cb432', 'name': '', 'network_id': 'a93e254e-aac9-4233-9e4d-4290fd0458e4', 'tenant_id': '', 'mac_address': 'fa:16:3e:52:78:cc', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'c925adea-d520-48c2-a2b3-fdb5661aaf95', 'device_owner': 'network:router_gateway', 'standard_attr_id': 486, 'fixed_ips': [{'subnet_id': 'e0b32f3d-83d6-439a-bbed-01df7cf01051', 'ip_address': '172.27.1.34', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-819011-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-23T19:37:06Z', 'updated_at': '2021-11-23T19:37:09Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'e0b32f3d-83d6-439a-bbed-01df7cf01051', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-819011-1-iscsi', '_interfaces': [{'id': '75766f49-5d4b-4c87-b9ea-e4dd672df213', 'name': '', 'network_id': '41fa5020-8aad-49ce-b2a6-39d87c9e6042', 'tenant_id': 'c9d53f0599374b679185cc73383b417c', 'mac_address': 'fa:16:3e:31:a3:fa', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'c925adea-d520-48c2-a2b3-fdb5661aaf95', 'device_owner': 'network:router_interface', 'standard_attr_id': 487, 'fixed_ips': [{'subnet_id': '8f74a1ae-f892-4057-89a5-ca78a259b1bd', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-23T19:37:08Z', 'updated_at': '2021-11-23T19:37:09Z', 'revision_number': 2, 'project_id': 'c9d53f0599374b679185cc73383b417c', 'subnets': [{'id': '8f74a1ae-f892-4057-89a5-ca78a259b1bd', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=102994) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 23 19:37:10.689080 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [None req-bfaca32f-904d-44eb-844b-46303bc1770f admin admin] 10.222.0.62 "GET /v2.0/security-groups?tenant_id=181e7185ccb14524ac255699a5b5d007&name=default HTTP/1.1" status: 200 len: 2996 time: 0.3829453 Nov 23 19:37:10.689988 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bfaca32f-904d-44eb-844b-46303bc1770f admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=aa03b82b-8ac3-4bb6-94f1-25abb3e0f7e9,revision_number=1']} {{(pid=102992) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 23 19:37:10.692503 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.wsgi [-] (102993) accepted ('10.222.0.62', 47898) {{(pid=102993) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 23 19:37:10.749457 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-2db94429-4204-42e5-bd21-eec990ce879e admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:37:10.757050 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.wsgi [-] (102992) accepted ('10.222.0.62', 47908) {{(pid=102992) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 23 19:37:10.765111 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.api.v2.base [None req-84b003ff-7c8e-455b-9c0c-1201379bf64d tempest-AttachVolumeTestJSON-1120920040 tempest-AttachVolumeTestJSON-1120920040-project] Request body: {'security_group': {'name': 'tempest-securitygroup--233182798', 'description': 'tempest-description--332570843'}} {{(pid=102992) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 23 19:37:10.786630 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-2db94429-4204-42e5-bd21-eec990ce879e admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:37:10.842639 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [None req-84b003ff-7c8e-455b-9c0c-1201379bf64d tempest-AttachVolumeTestJSON-1120920040 tempest-AttachVolumeTestJSON-1120920040-project] Publish callbacks [] for security_group, before_create {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:37:10.882352 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-2db94429-4204-42e5-bd21-eec990ce879e admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-623933'] for security_group, after_delete {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:37:10.885757 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-2db94429-4204-42e5-bd21-eec990ce879e admin admin] Publish callbacks [] for security_group, before_response {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:37:10.887217 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [None req-2db94429-4204-42e5-bd21-eec990ce879e admin admin] 10.222.0.62 "DELETE /v2.0/security-groups/aa03b82b-8ac3-4bb6-94f1-25abb3e0f7e9 HTTP/1.1" status: 204 len: 168 time: 0.1937773 Nov 23 19:37:10.897546 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2db94429-4204-42e5-bd21-eec990ce879e admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=aa03b82b-8ac3-4bb6-94f1-25abb3e0f7e9,revision_number=None']} {{(pid=102993) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 23 19:37:11.010961 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [None req-84b003ff-7c8e-455b-9c0c-1201379bf64d tempest-AttachVolumeTestJSON-1120920040 tempest-AttachVolumeTestJSON-1120920040-project] Publish callbacks [] for security_group, precommit_create {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:37:11.077039 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [None req-84b003ff-7c8e-455b-9c0c-1201379bf64d tempest-AttachVolumeTestJSON-1120920040 tempest-AttachVolumeTestJSON-1120920040-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-623933'] for security_group, after_create {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:37:11.109103 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-84b003ff-7c8e-455b-9c0c-1201379bf64d tempest-AttachVolumeTestJSON-1120920040 tempest-AttachVolumeTestJSON-1120920040-project] Pushing event updated for resources: {'SecurityGroup': ['ID=f8cf4027-ad94-4b78-b429-c3f2d7f9d324,revision_number=1']} {{(pid=102992) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 23 19:37:11.181515 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [None req-84b003ff-7c8e-455b-9c0c-1201379bf64d tempest-AttachVolumeTestJSON-1120920040 tempest-AttachVolumeTestJSON-1120920040-project] Publish callbacks [] for security_group, before_response {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:37:11.184265 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [None req-84b003ff-7c8e-455b-9c0c-1201379bf64d tempest-AttachVolumeTestJSON-1120920040 tempest-AttachVolumeTestJSON-1120920040-project] 10.222.0.62 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1795 time: 0.4255524 Nov 23 19:37:11.189674 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.wsgi [-] (102992) accepted ('10.222.0.62', 47940) {{(pid=102992) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 23 19:37:11.197296 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.api.v2.base [None req-da4faccf-6592-437f-ae45-36cff88767dc tempest-AttachVolumeTestJSON-1120920040 tempest-AttachVolumeTestJSON-1120920040-project] Request body: {'security_group_rule': {'security_group_id': 'f8cf4027-ad94-4b78-b429-c3f2d7f9d324', 'protocol': 'tcp', 'ethertype': 'IPv4', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'ingress'}} {{(pid=102992) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 23 19:37:11.312804 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [None req-da4faccf-6592-437f-ae45-36cff88767dc tempest-AttachVolumeTestJSON-1120920040 tempest-AttachVolumeTestJSON-1120920040-project] Publish callbacks [] for security_group_rule, before_create {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:37:11.397439 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [None req-da4faccf-6592-437f-ae45-36cff88767dc tempest-AttachVolumeTestJSON-1120920040 tempest-AttachVolumeTestJSON-1120920040-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:37:11.409343 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e828e8e2-f52d-4c86-9c4c-db2fd437f9eb req-6f712c98-e15d-4075-b9c2-0e4e5eb4fd31 tempest-VolumesSnapshotTestJSON-97879810 tempest-VolumesSnapshotTestJSON-97879810-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102992) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:37:11.410922 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-e828e8e2-f52d-4c86-9c4c-db2fd437f9eb req-6f712c98-e15d-4075-b9c2-0e4e5eb4fd31 tempest-VolumesSnapshotTestJSON-97879810 tempest-VolumesSnapshotTestJSON-97879810-project] 10.222.0.62 "GET /v2.0/ports?device_id=56521436-30ba-4dcc-8272-0fcda3e896b0 HTTP/1.1" status: 200 len: 945 time: 0.0865521 Nov 23 19:37:11.462602 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [None req-da4faccf-6592-437f-ae45-36cff88767dc tempest-AttachVolumeTestJSON-1120920040 tempest-AttachVolumeTestJSON-1120920040-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-601991'] for security_group_rule, after_create {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:37:11.474940 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-e828e8e2-f52d-4c86-9c4c-db2fd437f9eb req-fcce7984-ddc4-480c-bf97-e399f85b3c31 tempest-VolumesSnapshotTestJSON-97879810 tempest-VolumesSnapshotTestJSON-97879810-project] 10.222.0.62 "GET /v2.0/security-groups?id=2fd4bf42-f1cd-4ab5-94a3-e2347f7bb016&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0577857 Nov 23 19:37:11.486465 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-da4faccf-6592-437f-ae45-36cff88767dc tempest-AttachVolumeTestJSON-1120920040 tempest-AttachVolumeTestJSON-1120920040-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=417d4b91-261b-4593-a2d4-e5125b1166b1,revision_number=0']} {{(pid=102992) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 23 19:37:11.598866 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [None req-da4faccf-6592-437f-ae45-36cff88767dc tempest-AttachVolumeTestJSON-1120920040 tempest-AttachVolumeTestJSON-1120920040-project] Publish callbacks [] for security_group_rule, before_response {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:37:11.600198 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [None req-da4faccf-6592-437f-ae45-36cff88767dc tempest-AttachVolumeTestJSON-1120920040 tempest-AttachVolumeTestJSON-1120920040-project] 10.222.0.62 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 764 time: 0.4089129 Nov 23 19:37:11.602908 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.wsgi [-] (102992) accepted ('10.222.0.62', 47954) {{(pid=102992) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 23 19:37:11.607444 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.api.v2.base [None req-38bca950-e403-48c0-b7bf-641561716a8c tempest-AttachVolumeTestJSON-1120920040 tempest-AttachVolumeTestJSON-1120920040-project] Request body: {'security_group_rule': {'security_group_id': 'f8cf4027-ad94-4b78-b429-c3f2d7f9d324', 'protocol': 'icmp', 'ethertype': 'IPv4', 'direction': 'ingress'}} {{(pid=102992) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 23 19:37:11.682539 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [None req-38bca950-e403-48c0-b7bf-641561716a8c tempest-AttachVolumeTestJSON-1120920040 tempest-AttachVolumeTestJSON-1120920040-project] Publish callbacks [] for security_group_rule, before_create {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:37:11.696069 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.wsgi [-] (102993) accepted ('10.222.0.62', 47956) {{(pid=102993) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 23 19:37:11.711199 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron_lib.callbacks.manager [None req-bc54fdd4-11fd-4211-9500-774085abd810 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8783631323329', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7978582'] for agent, after_update {{(pid=102994) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:37:11.716330 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-eeadf89b-9b75-495f-9c7d-96dbbf0c7fee admin admin] Publish callbacks [] for security_group, before_create {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:37:11.846278 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-eeadf89b-9b75-495f-9c7d-96dbbf0c7fee admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:37:11.920819 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-eeadf89b-9b75-495f-9c7d-96dbbf0c7fee admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-623933'] for security_group, after_create {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:37:11.968621 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-eeadf89b-9b75-495f-9c7d-96dbbf0c7fee admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=bada5124-dde1-4759-9cf0-7755bd183057,revision_number=1']} {{(pid=102993) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 23 19:37:12.027030 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [None req-eeadf89b-9b75-495f-9c7d-96dbbf0c7fee admin admin] 10.222.0.62 "GET /v2.0/security-groups?tenant_id=3487b5a8b47f470e9d61ce3010d4b62f&name=default HTTP/1.1" status: 200 len: 2996 time: 0.3290625 Nov 23 19:37:12.029533 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.wsgi [-] (102993) accepted ('10.222.0.62', 47982) {{(pid=102993) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 23 19:37:12.046289 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [None req-38bca950-e403-48c0-b7bf-641561716a8c tempest-AttachVolumeTestJSON-1120920040 tempest-AttachVolumeTestJSON-1120920040-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:37:12.075067 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.plugins.ml2.rpc [None req-eb87b2c3-3339-4249-8b85-e695b5b4e1f9 None None] Device 41109199-34e8-4da6-963c-4a47600cb432 up at agent ovs-agent-dv-cinder-819011-1-iscsi {{(pid=102994) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 23 19:37:12.129477 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-f9764ca2-808f-4227-b540-b6036b505fcf admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:37:12.150436 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.db.provisioning_blocks [None req-eb87b2c3-3339-4249-8b85-e695b5b4e1f9 None None] Provisioning complete for port 41109199-34e8-4da6-963c-4a47600cb432 triggered by entity L2. {{(pid=102994) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 23 19:37:12.150977 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron_lib.callbacks.manager [None req-eb87b2c3-3339-4249-8b85-e695b5b4e1f9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-8355713'] for port, provisioning_complete {{(pid=102994) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:37:12.161322 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-f9764ca2-808f-4227-b540-b6036b505fcf admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:37:12.162567 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [None req-38bca950-e403-48c0-b7bf-641561716a8c tempest-AttachVolumeTestJSON-1120920040 tempest-AttachVolumeTestJSON-1120920040-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-601991'] for security_group_rule, after_create {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:37:12.183854 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-38bca950-e403-48c0-b7bf-641561716a8c tempest-AttachVolumeTestJSON-1120920040 tempest-AttachVolumeTestJSON-1120920040-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=412596d4-5604-41a1-9a27-49fa69fef0dc,revision_number=0']} {{(pid=102992) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 23 19:37:12.287525 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron_lib.callbacks.manager [None req-eb87b2c3-3339-4249-8b85-e695b5b4e1f9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7921281'] for port, before_update {{(pid=102994) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:37:12.305855 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-f9764ca2-808f-4227-b540-b6036b505fcf admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-623933'] for security_group, after_delete {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:37:12.307750 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [None req-38bca950-e403-48c0-b7bf-641561716a8c tempest-AttachVolumeTestJSON-1120920040 tempest-AttachVolumeTestJSON-1120920040-project] Publish callbacks [] for security_group_rule, before_response {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:37:12.308412 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-f9764ca2-808f-4227-b540-b6036b505fcf admin admin] Publish callbacks [] for security_group, before_response {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:37:12.309121 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [None req-38bca950-e403-48c0-b7bf-641561716a8c tempest-AttachVolumeTestJSON-1120920040 tempest-AttachVolumeTestJSON-1120920040-project] 10.222.0.62 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 769 time: 0.7051795 Nov 23 19:37:12.315705 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.wsgi [-] (102992) accepted ('10.222.0.62', 47994) {{(pid=102992) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 23 19:37:12.315865 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [None req-f9764ca2-808f-4227-b540-b6036b505fcf admin admin] 10.222.0.62 "DELETE /v2.0/security-groups/bada5124-dde1-4759-9cf0-7755bd183057 HTTP/1.1" status: 204 len: 168 time: 0.2824726 Nov 23 19:37:12.317933 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.plugins.ml2.db [None req-eb87b2c3-3339-4249-8b85-e695b5b4e1f9 None None] For port 41109199-34e8-4da6-963c-4a47600cb432, host dv-cinder-819011-1-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-819011-1-iscsi',level=0,port_id=41109199-34e8-4da6-963c-4a47600cb432,segment=NetworkSegment(3cb5e60b-103a-47d0-a28b-d68e3159d032),segment_id=3cb5e60b-103a-47d0-a28b-d68e3159d032)] {{(pid=102994) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 23 19:37:12.322704 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.api.v2.base [None req-36f2034d-d09f-4db1-9eea-02d5da108544 tempest-AttachVolumeTestJSON-1120920040 tempest-AttachVolumeTestJSON-1120920040-project] Request body: {'floatingip': {'floating_network_id': 'a93e254e-aac9-4233-9e4d-4290fd0458e4'}} {{(pid=102992) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 23 19:37:12.325850 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f9764ca2-808f-4227-b540-b6036b505fcf admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=bada5124-dde1-4759-9cf0-7755bd183057,revision_number=None']} {{(pid=102993) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 23 19:37:12.397160 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron_lib.callbacks.manager [None req-eb87b2c3-3339-4249-8b85-e695b5b4e1f9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7918660', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-15067', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560168', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8783631423946', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8783631008732', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8783631008750'] for port, after_update {{(pid=102994) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:37:12.454629 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [None req-36f2034d-d09f-4db1-9eea-02d5da108544 tempest-AttachVolumeTestJSON-1120920040 tempest-AttachVolumeTestJSON-1120920040-project] Publish callbacks [] for floatingip, before_create {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:37:12.483085 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-eb87b2c3-3339-4249-8b85-e695b5b4e1f9 None None] Pushing event updated for resources: {'Port': ['ID=41109199-34e8-4da6-963c-4a47600cb432,revision_number=4']} {{(pid=102994) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 23 19:37:12.565490 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [None req-36f2034d-d09f-4db1-9eea-02d5da108544 tempest-AttachVolumeTestJSON-1120920040 tempest-AttachVolumeTestJSON-1120920040-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7921281'] for port, before_create {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:37:12.679622 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.db.db_base_plugin_common [None req-36f2034d-d09f-4db1-9eea-02d5da108544 tempest-AttachVolumeTestJSON-1120920040 tempest-AttachVolumeTestJSON-1120920040-project] Allocated IP 172.27.1.128 (a93e254e-aac9-4233-9e4d-4290fd0458e4/e0b32f3d-83d6-439a-bbed-01df7cf01051/7e010f5c-586e-471a-bb46-61c29dd85a61) {{(pid=102992) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 23 19:37:12.813017 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [None req-36f2034d-d09f-4db1-9eea-02d5da108544 tempest-AttachVolumeTestJSON-1120920040 tempest-AttachVolumeTestJSON-1120920040-project] Publish callbacks [] for port, precommit_create {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:37:12.928438 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [None req-36f2034d-d09f-4db1-9eea-02d5da108544 tempest-AttachVolumeTestJSON-1120920040 tempest-AttachVolumeTestJSON-1120920040-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7918660', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-15067', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560168', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8783631008714', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-25199805'] for port, after_create {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:37:12.967170 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-36f2034d-d09f-4db1-9eea-02d5da108544 tempest-AttachVolumeTestJSON-1120920040 tempest-AttachVolumeTestJSON-1120920040-project] Network a93e254e-aac9-4233-9e4d-4290fd0458e4 is already hosted by enough agents. {{(pid=102992) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 23 19:37:12.973391 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.scheduler.base_scheduler [None req-36f2034d-d09f-4db1-9eea-02d5da108544 tempest-AttachVolumeTestJSON-1120920040 tempest-AttachVolumeTestJSON-1120920040-project] Resources bound (agent type, host, resource id): {{(pid=102992) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 23 19:37:12.980352 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.db.l3_dvrscheduler_db [None req-36f2034d-d09f-4db1-9eea-02d5da108544 tempest-AttachVolumeTestJSON-1120920040 tempest-AttachVolumeTestJSON-1120920040-project] Received port after_create {{(pid=102992) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 23 19:37:13.006811 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-36f2034d-d09f-4db1-9eea-02d5da108544 tempest-AttachVolumeTestJSON-1120920040 tempest-AttachVolumeTestJSON-1120920040-project] Pushing event updated for resources: {'Port': ['ID=7e010f5c-586e-471a-bb46-61c29dd85a61,revision_number=1']} {{(pid=102992) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 23 19:37:13.127847 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [None req-36f2034d-d09f-4db1-9eea-02d5da108544 tempest-AttachVolumeTestJSON-1120920040 tempest-AttachVolumeTestJSON-1120920040-project] Publish callbacks [] for floatingip, precommit_create {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:37:13.226460 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [None req-36f2034d-d09f-4db1-9eea-02d5da108544 tempest-AttachVolumeTestJSON-1120920040 tempest-AttachVolumeTestJSON-1120920040-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7921281'] for port, before_update {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:37:13.263939 dv-cinder-819011-1-iscsi neutron-server[102995]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-9909468e-beaf-411e-8c6f-062f7ff1955f None None] Sync routers for ids ['c925adea-d520-48c2-a2b3-fdb5661aaf95'] in dv-cinder-819011-1-iscsi {{(pid=102995) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 23 19:37:13.274710 dv-cinder-819011-1-iscsi neutron-server[102995]: DEBUG neutron.db.l3_dvrscheduler_db [None req-9909468e-beaf-411e-8c6f-062f7ff1955f None None] Routers {'c925adea-d520-48c2-a2b3-fdb5661aaf95'} bound to L3 agent in host dv-cinder-819011-1-iscsi {{(pid=102995) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 23 19:37:13.275344 dv-cinder-819011-1-iscsi neutron-server[102995]: DEBUG neutron.db.l3_hamode_db [None req-9909468e-beaf-411e-8c6f-062f7ff1955f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-819011-1-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-11-23T19:25:14Z,description=,heartbeat_timestamp=2021-11-23T19:36:44Z,host='dv-cinder-819011-1-iscsi',id=1b20f2c4-70b6-43c3-b9bd-0062cc9e57ac,load=0,resource_versions=,resources_synced=,started_at=2021-11-23T19:25:15Z,topic='l3_agent')) {'router_ids': ['c925adea-d520-48c2-a2b3-fdb5661aaf95'], 'active': True} {{(pid=102995) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 23 19:37:13.386906 dv-cinder-819011-1-iscsi neutron-server[102995]: DEBUG neutron.db.l3_dvr_db [None req-9909468e-beaf-411e-8c6f-062f7ff1955f None None] Set router c925adea-d520-48c2-a2b3-fdb5661aaf95 gateway port host: dv-cinder-819011-1-iscsi {{(pid=102995) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 23 19:37:13.408738 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [None req-36f2034d-d09f-4db1-9eea-02d5da108544 tempest-AttachVolumeTestJSON-1120920040 tempest-AttachVolumeTestJSON-1120920040-project] Publish callbacks [] for port, precommit_update {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:37:13.471437 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [None req-36f2034d-d09f-4db1-9eea-02d5da108544 tempest-AttachVolumeTestJSON-1120920040 tempest-AttachVolumeTestJSON-1120920040-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7918660', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-15067', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560168', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8783631423946', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8783631008732', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8783631008750', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-25199748'] for port, after_update {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:37:13.515021 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.wsgi [-] (102993) accepted ('10.222.0.62', 48056) {{(pid=102993) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 23 19:37:13.569047 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-36f2034d-d09f-4db1-9eea-02d5da108544 tempest-AttachVolumeTestJSON-1120920040 tempest-AttachVolumeTestJSON-1120920040-project] Pushing event updated for resources: {'Port': ['ID=7e010f5c-586e-471a-bb46-61c29dd85a61,revision_number=2']} {{(pid=102992) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 23 19:37:13.586032 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [None req-36f2034d-d09f-4db1-9eea-02d5da108544 tempest-AttachVolumeTestJSON-1120920040 tempest-AttachVolumeTestJSON-1120920040-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-926531'] for floatingip, after_create {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:37:13.605564 dv-cinder-819011-1-iscsi neutron-server[102995]: DEBUG neutron.db.l3_hamode_db [None req-9909468e-beaf-411e-8c6f-062f7ff1955f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'c925adea-d520-48c2-a2b3-fdb5661aaf95', 'name': 'tempest-AttachVolumeTestJSON-1672505821-router', 'tenant_id': 'c9d53f0599374b679185cc73383b417c', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'a93e254e-aac9-4233-9e4d-4290fd0458e4', 'external_fixed_ips': [{'subnet_id': 'e0b32f3d-83d6-439a-bbed-01df7cf01051', 'ip_address': '172.27.1.34'}], 'enable_snat': True}, 'gw_port_id': '41109199-34e8-4da6-963c-4a47600cb432', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-23T19:37:05Z', 'updated_at': '2021-11-23T19:37:09Z', 'revision_number': 4, 'project_id': 'c9d53f0599374b679185cc73383b417c', 'gw_port': {'id': '41109199-34e8-4da6-963c-4a47600cb432', 'name': '', 'network_id': 'a93e254e-aac9-4233-9e4d-4290fd0458e4', 'tenant_id': '', 'mac_address': 'fa:16:3e:52:78:cc', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'c925adea-d520-48c2-a2b3-fdb5661aaf95', 'device_owner': 'network:router_gateway', 'standard_attr_id': 486, 'fixed_ips': [{'subnet_id': 'e0b32f3d-83d6-439a-bbed-01df7cf01051', 'ip_address': '172.27.1.34', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-819011-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-23T19:37:06Z', 'updated_at': '2021-11-23T19:37:12Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'e0b32f3d-83d6-439a-bbed-01df7cf01051', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-819011-1-iscsi', '_interfaces': [{'id': '75766f49-5d4b-4c87-b9ea-e4dd672df213', 'name': '', 'network_id': '41fa5020-8aad-49ce-b2a6-39d87c9e6042', 'tenant_id': 'c9d53f0599374b679185cc73383b417c', 'mac_address': 'fa:16:3e:31:a3:fa', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'c925adea-d520-48c2-a2b3-fdb5661aaf95', 'device_owner': 'network:router_interface', 'standard_attr_id': 487, 'fixed_ips': [{'subnet_id': '8f74a1ae-f892-4057-89a5-ca78a259b1bd', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-23T19:37:08Z', 'updated_at': '2021-11-23T19:37:09Z', 'revision_number': 2, 'project_id': 'c9d53f0599374b679185cc73383b417c', 'subnets': [{'id': '8f74a1ae-f892-4057-89a5-ca78a259b1bd', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-819011-1-iscsi', False) {} {{(pid=102995) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 23 19:37:13.633026 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.api.v2.base [None req-7b448694-b745-460f-92f2-b3d42f31ea66 admin admin] Request body: {'network': {'name': 'tempest-TestShelveInstance-670557749-network', 'tenant_id': '35f8a5017a27449084aabd12f27f5a8a'}} {{(pid=102993) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 23 19:37:13.633353 dv-cinder-819011-1-iscsi neutron-server[102995]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-9909468e-beaf-411e-8c6f-062f7ff1955f None None] Checking router: c925adea-d520-48c2-a2b3-fdb5661aaf95 for host: dv-cinder-819011-1-iscsi {{(pid=102995) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 23 19:37:13.633744 dv-cinder-819011-1-iscsi neutron-server[102995]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-9909468e-beaf-411e-8c6f-062f7ff1955f None None] Updating router c925adea-d520-48c2-a2b3-fdb5661aaf95 port 75766f49-5d4b-4c87-b9ea-e4dd672df213 binding host dv-cinder-819011-1-iscsi {{(pid=102995) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Nov 23 19:37:13.658954 dv-cinder-819011-1-iscsi neutron-server[102995]: DEBUG neutron_lib.callbacks.manager [None req-9909468e-beaf-411e-8c6f-062f7ff1955f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7921281'] for port, before_update {{(pid=102995) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:37:13.666921 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [None req-36f2034d-d09f-4db1-9eea-02d5da108544 tempest-AttachVolumeTestJSON-1120920040 tempest-AttachVolumeTestJSON-1120920040-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-514902'] for floatingip, before_response {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:37:13.668177 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [None req-36f2034d-d09f-4db1-9eea-02d5da108544 tempest-AttachVolumeTestJSON-1120920040 tempest-AttachVolumeTestJSON-1120920040-project] 10.222.0.62 "POST /v2.0/floatingips HTTP/1.1" status: 201 len: 693 time: 1.3551300 Nov 23 19:37:13.750311 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-7b448694-b745-460f-92f2-b3d42f31ea66 admin admin] Made reservation on behalf of 35f8a5017a27449084aabd12f27f5a8a for: {'network': 1} {{(pid=102993) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 23 19:37:13.753253 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-7b448694-b745-460f-92f2-b3d42f31ea66 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7921281'] for network, before_create {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:37:13.762675 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-7b448694-b745-460f-92f2-b3d42f31ea66 admin admin] Publish callbacks [] for security_group, before_create {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:37:13.865472 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-7b448694-b745-460f-92f2-b3d42f31ea66 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:37:13.882011 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-8b7ce163-367c-48b4-ad80-743b82d2d05c req-a67ffd07-8767-4da1-83fd-cadaacb24708 tempest-AttachVolumeTestJSON-1120920040 tempest-AttachVolumeTestJSON-1120920040-project] 10.222.0.62 "GET /v2.0/security-groups?name=tempest-securitygroup--233182798&fields=id&tenant_id=c9d53f0599374b679185cc73383b417c HTTP/1.1" status: 200 len: 267 time: 0.0488899 Nov 23 19:37:13.927819 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-7b448694-b745-460f-92f2-b3d42f31ea66 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-623933'] for security_group, after_create {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:37:13.952079 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-7b448694-b745-460f-92f2-b3d42f31ea66 admin admin] vlan segment allocate from pool success with {'vlan_id': 817, 'physical_network': 'physnet1'} {{(pid=102993) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 23 19:37:13.977205 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7b448694-b745-460f-92f2-b3d42f31ea66 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=8bd676d5-ea27-4894-87a8-c1188d878c74,revision_number=1']} {{(pid=102993) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 23 19:37:13.982266 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-7b448694-b745-460f-92f2-b3d42f31ea66 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7982218'] for segment, precommit_create {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:37:13.982798 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.db.segments_db [None req-7b448694-b745-460f-92f2-b3d42f31ea66 admin admin] Added segment 5c30b9a1-7b41-4664-aa24-084baf66a2d5 of type vlan for network 87e46ab6-0f90-430f-930f-9ea1580c04c3 Nov 23 19:37:13.999927 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8b7ce163-367c-48b4-ad80-743b82d2d05c req-bf0be39d-c050-4df7-a625-6278c2eeac56 tempest-AttachVolumeTestJSON-1120920040 tempest-AttachVolumeTestJSON-1120920040-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=102992) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:37:14.002052 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-8b7ce163-367c-48b4-ad80-743b82d2d05c req-bf0be39d-c050-4df7-a625-6278c2eeac56 tempest-AttachVolumeTestJSON-1120920040 tempest-AttachVolumeTestJSON-1120920040-project] 10.222.0.62 "GET /v2.0/networks?id=41fa5020-8aad-49ce-b2a6-39d87c9e6042 HTTP/1.1" status: 200 len: 811 time: 0.1132231 Nov 23 19:37:14.021811 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-8b7ce163-367c-48b4-ad80-743b82d2d05c req-33f6ea8c-434e-483c-a348-135208f5badf tempest-AttachVolumeTestJSON-1120920040 tempest-AttachVolumeTestJSON-1120920040-project] 10.222.0.62 "GET /v2.0/quotas/c9d53f0599374b679185cc73383b417c HTTP/1.1" status: 200 len: 375 time: 0.0112813 Nov 23 19:37:14.036717 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-7b448694-b745-460f-92f2-b3d42f31ea66 admin admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8783630993713'] for network, precommit_create {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:37:14.036906 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.plugins.ml2.rpc [None req-eb87b2c3-3339-4249-8b85-e695b5b4e1f9 None None] Device 41109199-34e8-4da6-963c-4a47600cb432 up at agent ovs-agent-dv-cinder-819011-1-iscsi {{(pid=102994) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 23 19:37:14.047405 dv-cinder-819011-1-iscsi neutron-server[102995]: DEBUG neutron_lib.callbacks.manager [None req-9909468e-beaf-411e-8c6f-062f7ff1955f None None] Publish callbacks [] for port, precommit_update {{(pid=102995) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:37:14.087477 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-8b7ce163-367c-48b4-ad80-743b82d2d05c req-fec5dd0a-69ac-443c-abce-f936a321ef1f tempest-AttachVolumeTestJSON-1120920040 tempest-AttachVolumeTestJSON-1120920040-project] 10.222.0.62 "GET /v2.0/ports?tenant_id=c9d53f0599374b679185cc73383b417c&fields=id HTTP/1.1" status: 200 len: 302 time: 0.0595934 Nov 23 19:37:14.089311 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.db.provisioning_blocks [None req-eb87b2c3-3339-4249-8b85-e695b5b4e1f9 None None] Provisioning complete for port 41109199-34e8-4da6-963c-4a47600cb432 triggered by entity L2. {{(pid=102994) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 23 19:37:14.089720 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron_lib.callbacks.manager [None req-eb87b2c3-3339-4249-8b85-e695b5b4e1f9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-8355713'] for port, provisioning_complete {{(pid=102994) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:37:14.099972 dv-cinder-819011-1-iscsi neutron-server[102995]: DEBUG neutron_lib.callbacks.manager [None req-9909468e-beaf-411e-8c6f-062f7ff1955f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7918660', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-15067', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560168', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8783631423946', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8783631008732', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8783631008750'] for port, after_update {{(pid=102995) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:37:14.122507 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-7b448694-b745-460f-92f2-b3d42f31ea66 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-554949', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560168'] for network, after_create {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:37:14.123399 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-7b448694-b745-460f-92f2-b3d42f31ea66 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102993) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:37:14.124073 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-7b448694-b745-460f-92f2-b3d42f31ea66 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-560186'] for network, before_response {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:37:14.143206 dv-cinder-819011-1-iscsi neutron-server[102995]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d67f6933-017d-4d95-abe1-01d9abeed9fd None None] Pushing event updated for resources: {'Port': ['ID=75766f49-5d4b-4c87-b9ea-e4dd672df213,revision_number=3']} {{(pid=102995) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 23 19:37:14.195911 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7b448694-b745-460f-92f2-b3d42f31ea66 admin admin] Pushing event updated for resources: {'Network': ['ID=87e46ab6-0f90-430f-930f-9ea1580c04c3,revision_number=1']} {{(pid=102993) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 23 19:37:14.209880 dv-cinder-819011-1-iscsi neutron-server[102995]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d67f6933-017d-4d95-abe1-01d9abeed9fd None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-819011-1-iscsi {{(pid=102995) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 23 19:37:14.210321 dv-cinder-819011-1-iscsi neutron-server[102995]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d67f6933-017d-4d95-abe1-01d9abeed9fd None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-819011-1-iscsi {{(pid=102995) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 23 19:37:14.210603 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.plugins.ml2.rpc [None req-eb87b2c3-3339-4249-8b85-e695b5b4e1f9 None None] Network 87e46ab6-0f90-430f-930f-9ea1580c04c3 details requested by agent ovs-agent-dv-cinder-819011-1-iscsi with host dv-cinder-819011-1-iscsi {{(pid=102994) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Nov 23 19:37:14.210718 dv-cinder-819011-1-iscsi neutron-server[102995]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d67f6933-017d-4d95-abe1-01d9abeed9fd None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-819011-1-iscsi {{(pid=102995) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 23 19:37:14.211132 dv-cinder-819011-1-iscsi neutron-server[102995]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d67f6933-017d-4d95-abe1-01d9abeed9fd None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-819011-1-iscsi {{(pid=102995) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 23 19:37:14.211533 dv-cinder-819011-1-iscsi neutron-server[102995]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d67f6933-017d-4d95-abe1-01d9abeed9fd None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-819011-1-iscsi {{(pid=102995) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 23 19:37:14.211928 dv-cinder-819011-1-iscsi neutron-server[102995]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d67f6933-017d-4d95-abe1-01d9abeed9fd None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-819011-1-iscsi {{(pid=102995) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 23 19:37:14.212380 dv-cinder-819011-1-iscsi neutron-server[102995]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d67f6933-017d-4d95-abe1-01d9abeed9fd None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-819011-1-iscsi {{(pid=102995) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 23 19:37:14.212712 dv-cinder-819011-1-iscsi neutron-server[102995]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d67f6933-017d-4d95-abe1-01d9abeed9fd None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-819011-1-iscsi {{(pid=102995) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 23 19:37:14.213242 dv-cinder-819011-1-iscsi neutron-server[102995]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d67f6933-017d-4d95-abe1-01d9abeed9fd None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-819011-1-iscsi {{(pid=102995) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 23 19:37:14.213756 dv-cinder-819011-1-iscsi neutron-server[102995]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d67f6933-017d-4d95-abe1-01d9abeed9fd None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-819011-1-iscsi {{(pid=102995) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 23 19:37:14.214293 dv-cinder-819011-1-iscsi neutron-server[102995]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d67f6933-017d-4d95-abe1-01d9abeed9fd None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-819011-1-iscsi {{(pid=102995) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 23 19:37:14.214808 dv-cinder-819011-1-iscsi neutron-server[102995]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d67f6933-017d-4d95-abe1-01d9abeed9fd None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-819011-1-iscsi {{(pid=102995) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 23 19:37:14.216142 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-8b7ce163-367c-48b4-ad80-743b82d2d05c req-28e26572-9281-4991-8e09-9271fb69235c service neutron] 10.222.0.62 "GET /v2.0/networks/41fa5020-8aad-49ce-b2a6-39d87c9e6042?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1167290 Nov 23 19:37:14.228248 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [None req-7b448694-b745-460f-92f2-b3d42f31ea66 admin admin] 10.222.0.62 "POST /v2.0/networks HTTP/1.1" status: 201 len: 881 time: 0.7106006 Nov 23 19:37:14.229167 dv-cinder-819011-1-iscsi neutron-server[102995]: DEBUG neutron.plugins.ml2.managers [None req-9909468e-beaf-411e-8c6f-062f7ff1955f None None] Attempting to bind port 75766f49-5d4b-4c87-b9ea-e4dd672df213 on host dv-cinder-819011-1-iscsi for vnic_type normal with profile {{(pid=102995) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 23 19:37:14.229816 dv-cinder-819011-1-iscsi neutron-server[102995]: DEBUG neutron.plugins.ml2.managers [None req-9909468e-beaf-411e-8c6f-062f7ff1955f None None] Attempting to bind port 75766f49-5d4b-4c87-b9ea-e4dd672df213 by drivers openvswitch,hyperv on host dv-cinder-819011-1-iscsi at level 0 using segments [{'id': '1a7bcd69-381b-4068-88df-df74b53e9d61', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 824, 'network_id': '41fa5020-8aad-49ce-b2a6-39d87c9e6042'}] {{(pid=102995) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 23 19:37:14.230812 dv-cinder-819011-1-iscsi neutron-server[102995]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-9909468e-beaf-411e-8c6f-062f7ff1955f None None] Attempting to bind port 75766f49-5d4b-4c87-b9ea-e4dd672df213 on network 41fa5020-8aad-49ce-b2a6-39d87c9e6042 {{(pid=102995) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 23 19:37:14.231038 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.wsgi [-] (102993) accepted ('10.222.0.62', 48072) {{(pid=102993) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 23 19:37:14.237849 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.api.v2.base [None req-fed7672b-15c8-4ed2-af53-83eb55c522f6 admin admin] Request body: {'subnet': {'network_id': '87e46ab6-0f90-430f-930f-9ea1580c04c3', 'cidr': '172.20.0.0/28', 'name': 'tempest-TestShelveInstance-670557749-subnet', 'tenant_id': '35f8a5017a27449084aabd12f27f5a8a', 'ip_version': 4}} {{(pid=102993) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 23 19:37:14.238662 dv-cinder-819011-1-iscsi neutron-server[102995]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-9909468e-beaf-411e-8c6f-062f7ff1955f None None] Checking agent: {'id': '668c8953-047c-499e-8c0d-db838fac1668', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-819011-1-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 23, 19, 25, 17), 'started_at': datetime.datetime(2021, 11, 23, 19, 25, 47), 'heartbeat_timestamp': datetime.datetime(2021, 11, 23, 19, 36, 47), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-819011-1-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=102995) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 23 19:37:14.239334 dv-cinder-819011-1-iscsi neutron-server[102995]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-9909468e-beaf-411e-8c6f-062f7ff1955f None None] Checking segment: {'id': '1a7bcd69-381b-4068-88df-df74b53e9d61', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 824, 'network_id': '41fa5020-8aad-49ce-b2a6-39d87c9e6042'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102995) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 23 19:37:14.239949 dv-cinder-819011-1-iscsi neutron-server[102995]: DEBUG neutron_lib.callbacks.manager [None req-9909468e-beaf-411e-8c6f-062f7ff1955f None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=102995) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:37:14.240754 dv-cinder-819011-1-iscsi neutron-server[102995]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-9909468e-beaf-411e-8c6f-062f7ff1955f None None] Bound using segment: {'id': '1a7bcd69-381b-4068-88df-df74b53e9d61', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 824, 'network_id': '41fa5020-8aad-49ce-b2a6-39d87c9e6042'} {{(pid=102995) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 23 19:37:14.241480 dv-cinder-819011-1-iscsi neutron-server[102995]: DEBUG neutron.plugins.ml2.managers [None req-9909468e-beaf-411e-8c6f-062f7ff1955f None None] Bound port: 75766f49-5d4b-4c87-b9ea-e4dd672df213, host: dv-cinder-819011-1-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '1a7bcd69-381b-4068-88df-df74b53e9d61', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 824, 'network_id': '41fa5020-8aad-49ce-b2a6-39d87c9e6042'}}] {{(pid=102995) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 23 19:37:14.242742 dv-cinder-819011-1-iscsi neutron-server[102995]: DEBUG neutron_lib.callbacks.manager [None req-9909468e-beaf-411e-8c6f-062f7ff1955f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7921281'] for port, before_update {{(pid=102995) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:37:14.297075 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron_lib.callbacks.manager [None req-cee08a51-f162-48ce-b984-9492c6d000f9 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8783631323329', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7978582'] for agent, after_update {{(pid=102994) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:37:14.318750 dv-cinder-819011-1-iscsi neutron-server[102995]: DEBUG neutron.plugins.ml2.db [None req-9909468e-beaf-411e-8c6f-062f7ff1955f None None] For port 75766f49-5d4b-4c87-b9ea-e4dd672df213, host dv-cinder-819011-1-iscsi, cleared binding levels {{(pid=102995) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 23 19:37:14.324360 dv-cinder-819011-1-iscsi neutron-server[102995]: DEBUG neutron.plugins.ml2.db [None req-9909468e-beaf-411e-8c6f-062f7ff1955f None None] For port 75766f49-5d4b-4c87-b9ea-e4dd672df213, host dv-cinder-819011-1-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-819011-1-iscsi',level=0,port_id=75766f49-5d4b-4c87-b9ea-e4dd672df213,segment=NetworkSegment(1a7bcd69-381b-4068-88df-df74b53e9d61),segment_id=1a7bcd69-381b-4068-88df-df74b53e9d61)] {{(pid=102995) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 23 19:37:14.336028 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-fed7672b-15c8-4ed2-af53-83eb55c522f6 admin admin] Made reservation on behalf of 35f8a5017a27449084aabd12f27f5a8a for: {'subnet': 1} {{(pid=102993) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 23 19:37:14.339418 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-fed7672b-15c8-4ed2-af53-83eb55c522f6 admin admin] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-17772934'] for subnet, before_create {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:37:14.362390 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-8b7ce163-367c-48b4-ad80-743b82d2d05c req-345bcd63-5647-4052-b6b4-dd2983990ceb service neutron] 10.222.0.62 "GET /v2.0/networks/41fa5020-8aad-49ce-b2a6-39d87c9e6042?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1305120 Nov 23 19:37:14.391026 dv-cinder-819011-1-iscsi neutron-server[102995]: DEBUG neutron_lib.callbacks.manager [None req-9909468e-beaf-411e-8c6f-062f7ff1955f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7918660', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-15067', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560168', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8783631423946', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8783631008732', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8783631008750'] for port, after_update {{(pid=102995) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:37:14.417507 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.db.provisioning_blocks [None req-cad492f6-d84e-4288-b355-196390e51b6c None None] Provisioning complete for port 75766f49-5d4b-4c87-b9ea-e4dd672df213 triggered by entity DHCP. {{(pid=102994) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 23 19:37:14.418416 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron_lib.callbacks.manager [None req-cad492f6-d84e-4288-b355-196390e51b6c None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-8355713'] for port, provisioning_complete {{(pid=102994) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:37:14.474160 dv-cinder-819011-1-iscsi neutron-server[102995]: DEBUG neutron.db.l3_dvrscheduler_db [None req-9909468e-beaf-411e-8c6f-062f7ff1955f None None] Routers {'c925adea-d520-48c2-a2b3-fdb5661aaf95'} bound to L3 agent in host dv-cinder-819011-1-iscsi {{(pid=102995) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 23 19:37:14.480386 dv-cinder-819011-1-iscsi neutron-server[102995]: DEBUG neutron.db.l3_hamode_db [None req-9909468e-beaf-411e-8c6f-062f7ff1955f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-819011-1-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-11-23T19:25:14Z,description=,heartbeat_timestamp=2021-11-23T19:37:14Z,host='dv-cinder-819011-1-iscsi',id=1b20f2c4-70b6-43c3-b9bd-0062cc9e57ac,load=0,resource_versions=,resources_synced=,started_at=2021-11-23T19:25:15Z,topic='l3_agent')) {'router_ids': ['c925adea-d520-48c2-a2b3-fdb5661aaf95'], 'active': True} {{(pid=102995) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 23 19:37:14.539285 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron_lib.callbacks.manager [None req-cad492f6-d84e-4288-b355-196390e51b6c None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7921281'] for port, before_update {{(pid=102994) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:37:14.605965 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.plugins.ml2.db [None req-cad492f6-d84e-4288-b355-196390e51b6c None None] For port 75766f49-5d4b-4c87-b9ea-e4dd672df213, host dv-cinder-819011-1-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-819011-1-iscsi',level=0,port_id=75766f49-5d4b-4c87-b9ea-e4dd672df213,segment=NetworkSegment(1a7bcd69-381b-4068-88df-df74b53e9d61),segment_id=1a7bcd69-381b-4068-88df-df74b53e9d61)] {{(pid=102994) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 23 19:37:14.629533 dv-cinder-819011-1-iscsi neutron-server[102995]: DEBUG neutron.db.l3_dvr_db [None req-9909468e-beaf-411e-8c6f-062f7ff1955f None None] Set router c925adea-d520-48c2-a2b3-fdb5661aaf95 gateway port host: dv-cinder-819011-1-iscsi {{(pid=102995) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 23 19:37:14.671699 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron_lib.callbacks.manager [None req-cad492f6-d84e-4288-b355-196390e51b6c None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7918660', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-15067', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560168', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8783631423946', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8783631008732', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8783631008750'] for port, after_update {{(pid=102994) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:37:14.732653 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-e64079bf-afa2-4ead-93d6-7d04e5a9e399 req-5bedc507-cdce-497a-b654-a9bc8243b890 tempest-AttachVolumeTestJSON-1120920040 tempest-AttachVolumeTestJSON-1120920040-project] 10.222.0.62 "GET /v2.0/ports?device_id=029fedce-3168-4d1d-992e-a9466fe3e886 HTTP/1.1" status: 200 len: 210 time: 0.0367119 Nov 23 19:37:14.741323 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-fed7672b-15c8-4ed2-af53-83eb55c522f6 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-554858', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560168', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-17257652', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-17772948'] for subnet, after_create {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:37:14.763321 dv-cinder-819011-1-iscsi neutron-server[102995]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d67f6933-017d-4d95-abe1-01d9abeed9fd None None] Pushing event updated for resources: {'Port': ['ID=75766f49-5d4b-4c87-b9ea-e4dd672df213,revision_number=4']} {{(pid=102995) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 23 19:37:14.763424 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cad492f6-d84e-4288-b355-196390e51b6c None None] Pushing event updated for resources: {'Port': ['ID=75766f49-5d4b-4c87-b9ea-e4dd672df213,revision_number=5']} {{(pid=102994) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 23 19:37:14.814589 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.db.provisioning_blocks [None req-abedf5e2-4117-48cd-bd04-08318c9b2df7 None None] Provisioning complete for port 75766f49-5d4b-4c87-b9ea-e4dd672df213 triggered by entity DHCP. {{(pid=102994) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 23 19:37:14.817163 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron_lib.callbacks.manager [None req-abedf5e2-4117-48cd-bd04-08318c9b2df7 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-8355713'] for port, provisioning_complete {{(pid=102994) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:37:14.825033 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fed7672b-15c8-4ed2-af53-83eb55c522f6 admin admin] Pushing event updated for resources: {'Subnet': ['ID=afa5bc59-f70c-409d-8c15-be2dcdce66a3,revision_number=0']} {{(pid=102993) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 23 19:37:14.834957 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-fed7672b-15c8-4ed2-af53-83eb55c522f6 admin admin] Checking segment: {'id': '5c30b9a1-7b41-4664-aa24-084baf66a2d5', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 817, 'network_id': '87e46ab6-0f90-430f-930f-9ea1580c04c3'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102993) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 23 19:37:14.835374 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-fed7672b-15c8-4ed2-af53-83eb55c522f6 admin admin] Network hostable DHCP agents. Network: 87e46ab6-0f90-430f-930f-9ea1580c04c3, hostable agents: ['e51c95c7-6a36-4263-ba47-1839054f3e7a'], hosted agents: [] {{(pid=102993) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 23 19:37:14.905806 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.wsgi [-] (102992) accepted ('10.222.0.62', 48090) {{(pid=102992) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 23 19:37:14.910421 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-fed7672b-15c8-4ed2-af53-83eb55c522f6 admin admin] Network 87e46ab6-0f90-430f-930f-9ea1580c04c3 is scheduled to be hosted by DHCP agent e51c95c7-6a36-4263-ba47-1839054f3e7a with binding_index 1 {{(pid=102993) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 23 19:37:14.935337 dv-cinder-819011-1-iscsi neutron-server[102995]: DEBUG neutron.db.l3_hamode_db [None req-9909468e-beaf-411e-8c6f-062f7ff1955f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'c925adea-d520-48c2-a2b3-fdb5661aaf95', 'name': 'tempest-AttachVolumeTestJSON-1672505821-router', 'tenant_id': 'c9d53f0599374b679185cc73383b417c', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'a93e254e-aac9-4233-9e4d-4290fd0458e4', 'external_fixed_ips': [{'subnet_id': 'e0b32f3d-83d6-439a-bbed-01df7cf01051', 'ip_address': '172.27.1.34'}], 'enable_snat': True}, 'gw_port_id': '41109199-34e8-4da6-963c-4a47600cb432', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-23T19:37:05Z', 'updated_at': '2021-11-23T19:37:09Z', 'revision_number': 4, 'project_id': 'c9d53f0599374b679185cc73383b417c', 'gw_port': {'id': '41109199-34e8-4da6-963c-4a47600cb432', 'name': '', 'network_id': 'a93e254e-aac9-4233-9e4d-4290fd0458e4', 'tenant_id': '', 'mac_address': 'fa:16:3e:52:78:cc', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'c925adea-d520-48c2-a2b3-fdb5661aaf95', 'device_owner': 'network:router_gateway', 'standard_attr_id': 486, 'fixed_ips': [{'subnet_id': 'e0b32f3d-83d6-439a-bbed-01df7cf01051', 'ip_address': '172.27.1.34', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-819011-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-23T19:37:06Z', 'updated_at': '2021-11-23T19:37:12Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'e0b32f3d-83d6-439a-bbed-01df7cf01051', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-819011-1-iscsi', '_interfaces': [{'id': '75766f49-5d4b-4c87-b9ea-e4dd672df213', 'name': '', 'network_id': '41fa5020-8aad-49ce-b2a6-39d87c9e6042', 'tenant_id': 'c9d53f0599374b679185cc73383b417c', 'mac_address': 'fa:16:3e:31:a3:fa', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'c925adea-d520-48c2-a2b3-fdb5661aaf95', 'device_owner': 'network:router_interface', 'standard_attr_id': 487, 'fixed_ips': [{'subnet_id': '8f74a1ae-f892-4057-89a5-ca78a259b1bd', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-819011-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-23T19:37:08Z', 'updated_at': '2021-11-23T19:37:14Z', 'revision_number': 4, 'project_id': 'c9d53f0599374b679185cc73383b417c', 'subnets': [{'id': '8f74a1ae-f892-4057-89a5-ca78a259b1bd', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-819011-1-iscsi', False) {} {{(pid=102995) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 23 19:37:14.967751 dv-cinder-819011-1-iscsi neutron-server[102995]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-9909468e-beaf-411e-8c6f-062f7ff1955f None None] The sync data for ids ['c925adea-d520-48c2-a2b3-fdb5661aaf95'] in dv-cinder-819011-1-iscsi is: [{'id': 'c925adea-d520-48c2-a2b3-fdb5661aaf95', 'name': 'tempest-AttachVolumeTestJSON-1672505821-router', 'tenant_id': 'c9d53f0599374b679185cc73383b417c', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'a93e254e-aac9-4233-9e4d-4290fd0458e4', 'external_fixed_ips': [{'subnet_id': 'e0b32f3d-83d6-439a-bbed-01df7cf01051', 'ip_address': '172.27.1.34'}], 'enable_snat': True}, 'gw_port_id': '41109199-34e8-4da6-963c-4a47600cb432', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-23T19:37:05Z', 'updated_at': '2021-11-23T19:37:09Z', 'revision_number': 4, 'project_id': 'c9d53f0599374b679185cc73383b417c', 'gw_port': {'id': '41109199-34e8-4da6-963c-4a47600cb432', 'name': '', 'network_id': 'a93e254e-aac9-4233-9e4d-4290fd0458e4', 'tenant_id': '', 'mac_address': 'fa:16:3e:52:78:cc', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'c925adea-d520-48c2-a2b3-fdb5661aaf95', 'device_owner': 'network:router_gateway', 'standard_attr_id': 486, 'fixed_ips': [{'subnet_id': 'e0b32f3d-83d6-439a-bbed-01df7cf01051', 'ip_address': '172.27.1.34', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-819011-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-23T19:37:06Z', 'updated_at': '2021-11-23T19:37:12Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'e0b32f3d-83d6-439a-bbed-01df7cf01051', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-819011-1-iscsi', '_interfaces': [{'id': '75766f49-5d4b-4c87-b9ea-e4dd672df213', 'name': '', 'network_id': '41fa5020-8aad-49ce-b2a6-39d87c9e6042', 'tenant_id': 'c9d53f0599374b679185cc73383b417c', 'mac_address': 'fa:16:3e:31:a3:fa', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'c925adea-d520-48c2-a2b3-fdb5661aaf95', 'device_owner': 'network:router_interface', 'standard_attr_id': 487, 'fixed_ips': [{'subnet_id': '8f74a1ae-f892-4057-89a5-ca78a259b1bd', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-819011-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-23T19:37:08Z', 'updated_at': '2021-11-23T19:37:14Z', 'revision_number': 4, 'project_id': 'c9d53f0599374b679185cc73383b417c', 'subnets': [{'id': '8f74a1ae-f892-4057-89a5-ca78a259b1bd', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=102995) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 23 19:37:15.007698 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.scheduler.base_scheduler [None req-fed7672b-15c8-4ed2-af53-83eb55c522f6 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-819011-1-iscsi, 87e46ab6-0f90-430f-930f-9ea1580c04c3) {{(pid=102993) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 23 19:37:15.018049 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-855a5eb1-31df-4b38-8044-ba2ab1315824 None None] Network 87e46ab6-0f90-430f-930f-9ea1580c04c3 requested from dv-cinder-819011-1-iscsi {{(pid=102994) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 23 19:37:15.018378 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-fed7672b-15c8-4ed2-af53-83eb55c522f6 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=102993) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:37:15.020520 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-fed7672b-15c8-4ed2-af53-83eb55c522f6 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-560186'] for subnet, before_response {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:37:15.059499 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [None req-0d075842-0a24-4e66-94a0-5b913edf259c admin admin] 10.222.0.62 "GET /v2.0/security-groups?tenant_id=c52c093db38c40a383ef38ffbc4083a5&name=default HTTP/1.1" status: 200 len: 2996 time: 0.1502762 Nov 23 19:37:15.059757 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.wsgi [-] (102992) accepted ('10.222.0.62', 48094) {{(pid=102992) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 23 19:37:15.091037 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron_lib.callbacks.manager [None req-8346ef05-f685-4c3d-af3d-a159b683bec2 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8783631323329', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7978582'] for agent, after_update {{(pid=102994) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:37:15.111408 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [None req-fed7672b-15c8-4ed2-af53-83eb55c522f6 admin admin] 10.222.0.62 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 844 time: 0.8759460 Nov 23 19:37:15.114110 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.wsgi [-] (102993) accepted ('10.222.0.62', 48096) {{(pid=102993) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 23 19:37:15.118444 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.api.v2.base [None req-8576a436-33df-4958-a929-17d3bb329f87 admin admin] Request body: {'router': {'name': 'tempest-TestShelveInstance-670557749-router', 'tenant_id': '35f8a5017a27449084aabd12f27f5a8a', 'external_gateway_info': {'network_id': 'a93e254e-aac9-4233-9e4d-4290fd0458e4'}}} {{(pid=102993) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 23 19:37:15.135007 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [None req-f0e74b98-fe23-471e-97d1-ee33d01737bc admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:37:15.163942 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [None req-f0e74b98-fe23-471e-97d1-ee33d01737bc admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:37:15.201840 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-7f906947-84d0-48e7-9c2a-de1dbf3fa9f8 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp8353ff9b-e01d-5e31-ab2d-60a764783255-87e46ab6-0f90-430f-930f-9ea1580c04c3', 'network_id': '87e46ab6-0f90-430f-930f-9ea1580c04c3', 'tenant_id': '35f8a5017a27449084aabd12f27f5a8a', 'fixed_ips': [{'subnet_id': 'afa5bc59-f70c-409d-8c15-be2dcdce66a3'}]}} from dv-cinder-819011-1-iscsi. {{(pid=102994) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:285}} Nov 23 19:37:15.202857 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron_lib.callbacks.manager [None req-7f906947-84d0-48e7-9c2a-de1dbf3fa9f8 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7921281'] for port, before_create {{(pid=102994) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:37:15.225115 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-8576a436-33df-4958-a929-17d3bb329f87 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-933550', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-13503'] for router, before_create {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:37:15.226952 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-8576a436-33df-4958-a929-17d3bb329f87 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-933038', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-927700', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-622769', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-13448'] for router, precommit_create {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:37:15.288687 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-8576a436-33df-4958-a929-17d3bb329f87 admin admin] Publish callbacks [] for router_controller, precommit_add_association {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:37:15.304821 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [None req-f0e74b98-fe23-471e-97d1-ee33d01737bc admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-623933'] for security_group, after_delete {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:37:15.307669 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [None req-f0e74b98-fe23-471e-97d1-ee33d01737bc admin admin] Publish callbacks [] for security_group, before_response {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:37:15.309823 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [None req-f0e74b98-fe23-471e-97d1-ee33d01737bc admin admin] 10.222.0.62 "DELETE /v2.0/security-groups/ac69cba1-f881-4fe2-ba1d-5270c0d54618 HTTP/1.1" status: 204 len: 168 time: 0.2481575 Nov 23 19:37:15.323823 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f0e74b98-fe23-471e-97d1-ee33d01737bc admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=ac69cba1-f881-4fe2-ba1d-5270c0d54618,revision_number=None']} {{(pid=102992) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 23 19:37:15.386175 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.db.db_base_plugin_common [None req-7f906947-84d0-48e7-9c2a-de1dbf3fa9f8 None None] Allocated IP 172.20.0.2 (87e46ab6-0f90-430f-930f-9ea1580c04c3/afa5bc59-f70c-409d-8c15-be2dcdce66a3/be8d3464-418e-47d4-85c9-a0e4ae74df89) {{(pid=102994) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 23 19:37:15.514427 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-8576a436-33df-4958-a929-17d3bb329f87 admin admin] Publish callbacks [] for router_gateway, precommit_update {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:37:15.579369 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron_lib.callbacks.manager [None req-7f906947-84d0-48e7-9c2a-de1dbf3fa9f8 None None] Publish callbacks [] for port, precommit_create {{(pid=102994) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:37:15.647057 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron_lib.callbacks.manager [None req-7f906947-84d0-48e7-9c2a-de1dbf3fa9f8 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7918660', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-15067', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560168', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8783631008714'] for port, after_create {{(pid=102994) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:37:15.706574 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-7f906947-84d0-48e7-9c2a-de1dbf3fa9f8 None None] Network 87e46ab6-0f90-430f-930f-9ea1580c04c3 is already hosted by enough agents. {{(pid=102994) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 23 19:37:15.710133 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.scheduler.base_scheduler [None req-7f906947-84d0-48e7-9c2a-de1dbf3fa9f8 None None] Resources bound (agent type, host, resource id): {{(pid=102994) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 23 19:37:15.718441 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.db.l3_dvrscheduler_db [None req-7f906947-84d0-48e7-9c2a-de1dbf3fa9f8 None None] Received port after_create {{(pid=102994) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 23 19:37:15.729817 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7f906947-84d0-48e7-9c2a-de1dbf3fa9f8 None None] Pushing event updated for resources: {'Port': ['ID=be8d3464-418e-47d4-85c9-a0e4ae74df89,revision_number=1']} {{(pid=102994) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 23 19:37:15.789613 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.plugins.ml2.managers [None req-7f906947-84d0-48e7-9c2a-de1dbf3fa9f8 None None] Attempting to bind port be8d3464-418e-47d4-85c9-a0e4ae74df89 on host dv-cinder-819011-1-iscsi for vnic_type normal with profile {{(pid=102994) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 23 19:37:15.789613 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.plugins.ml2.managers [None req-7f906947-84d0-48e7-9c2a-de1dbf3fa9f8 None None] Attempting to bind port be8d3464-418e-47d4-85c9-a0e4ae74df89 by drivers openvswitch,hyperv on host dv-cinder-819011-1-iscsi at level 0 using segments [{'id': '5c30b9a1-7b41-4664-aa24-084baf66a2d5', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 817, 'network_id': '87e46ab6-0f90-430f-930f-9ea1580c04c3'}] {{(pid=102994) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 23 19:37:15.789613 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-7f906947-84d0-48e7-9c2a-de1dbf3fa9f8 None None] Attempting to bind port be8d3464-418e-47d4-85c9-a0e4ae74df89 on network 87e46ab6-0f90-430f-930f-9ea1580c04c3 {{(pid=102994) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 23 19:37:15.797294 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-7f906947-84d0-48e7-9c2a-de1dbf3fa9f8 None None] Checking agent: {'id': '668c8953-047c-499e-8c0d-db838fac1668', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-819011-1-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 23, 19, 25, 17), 'started_at': datetime.datetime(2021, 11, 23, 19, 25, 47), 'heartbeat_timestamp': datetime.datetime(2021, 11, 23, 19, 36, 47), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-819011-1-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=102994) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 23 19:37:15.798058 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-7f906947-84d0-48e7-9c2a-de1dbf3fa9f8 None None] Checking segment: {'id': '5c30b9a1-7b41-4664-aa24-084baf66a2d5', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 817, 'network_id': '87e46ab6-0f90-430f-930f-9ea1580c04c3'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102994) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 23 19:37:15.798693 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron_lib.callbacks.manager [None req-7f906947-84d0-48e7-9c2a-de1dbf3fa9f8 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=102994) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:37:15.799197 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-7f906947-84d0-48e7-9c2a-de1dbf3fa9f8 None None] Bound using segment: {'id': '5c30b9a1-7b41-4664-aa24-084baf66a2d5', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 817, 'network_id': '87e46ab6-0f90-430f-930f-9ea1580c04c3'} {{(pid=102994) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 23 19:37:15.799781 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.plugins.ml2.managers [None req-7f906947-84d0-48e7-9c2a-de1dbf3fa9f8 None None] Bound port: be8d3464-418e-47d4-85c9-a0e4ae74df89, host: dv-cinder-819011-1-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '5c30b9a1-7b41-4664-aa24-084baf66a2d5', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 817, 'network_id': '87e46ab6-0f90-430f-930f-9ea1580c04c3'}}] {{(pid=102994) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 23 19:37:15.800281 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron_lib.callbacks.manager [None req-7f906947-84d0-48e7-9c2a-de1dbf3fa9f8 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7921281'] for port, before_update {{(pid=102994) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:37:15.864992 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-2178b9b2-0cb5-466e-93ce-0f0b30b2f112 req-c4e411b2-58e6-4591-8afb-b62e279da8fd tempest-AttachVolumeTestJSON-1120920040 tempest-AttachVolumeTestJSON-1120920040-project] 10.222.0.62 "GET /v2.0/ports?device_id=029fedce-3168-4d1d-992e-a9466fe3e886 HTTP/1.1" status: 200 len: 210 time: 0.0614526 Nov 23 19:37:15.895367 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.plugins.ml2.db [None req-7f906947-84d0-48e7-9c2a-de1dbf3fa9f8 None None] For port be8d3464-418e-47d4-85c9-a0e4ae74df89, host dv-cinder-819011-1-iscsi, cleared binding levels {{(pid=102994) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 23 19:37:15.898925 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.plugins.ml2.db [None req-7f906947-84d0-48e7-9c2a-de1dbf3fa9f8 None None] For port be8d3464-418e-47d4-85c9-a0e4ae74df89, host dv-cinder-819011-1-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-819011-1-iscsi',level=0,port_id=be8d3464-418e-47d4-85c9-a0e4ae74df89,segment=NetworkSegment(5c30b9a1-7b41-4664-aa24-084baf66a2d5),segment_id=5c30b9a1-7b41-4664-aa24-084baf66a2d5)] {{(pid=102994) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 23 19:37:15.957128 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron_lib.callbacks.manager [None req-7f906947-84d0-48e7-9c2a-de1dbf3fa9f8 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7918660', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-15067', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560168', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8783631423946', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8783631008732', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8783631008750'] for port, after_update {{(pid=102994) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:37:16.046244 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.plugins.ml2.rpc [None req-eb87b2c3-3339-4249-8b85-e695b5b4e1f9 None None] Device 75766f49-5d4b-4c87-b9ea-e4dd672df213 up at agent ovs-agent-dv-cinder-819011-1-iscsi {{(pid=102994) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 23 19:37:16.092505 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7f906947-84d0-48e7-9c2a-de1dbf3fa9f8 None None] Pushing event updated for resources: {'Port': ['ID=be8d3464-418e-47d4-85c9-a0e4ae74df89,revision_number=2']} {{(pid=102994) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 23 19:37:16.110883 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.db.provisioning_blocks [None req-eb87b2c3-3339-4249-8b85-e695b5b4e1f9 None None] Provisioning complete for port 75766f49-5d4b-4c87-b9ea-e4dd672df213 triggered by entity L2. {{(pid=102994) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 23 19:37:16.111325 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron_lib.callbacks.manager [None req-eb87b2c3-3339-4249-8b85-e695b5b4e1f9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-8355713'] for port, provisioning_complete {{(pid=102994) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:37:16.174997 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-8576a436-33df-4958-a929-17d3bb329f87 admin admin] Publish callbacks [] for router_gateway, before_create {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:37:16.199882 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-8576a436-33df-4958-a929-17d3bb329f87 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7921281'] for port, before_create {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:37:16.357886 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.db.db_base_plugin_common [None req-8576a436-33df-4958-a929-17d3bb329f87 admin admin] Allocated IP 172.27.1.194 (a93e254e-aac9-4233-9e4d-4290fd0458e4/e0b32f3d-83d6-439a-bbed-01df7cf01051/abd59c5e-8249-4aba-855f-bf3ed33724b6) {{(pid=102993) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 23 19:37:16.478713 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-8576a436-33df-4958-a929-17d3bb329f87 admin admin] Publish callbacks [] for port, precommit_create {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:37:16.573887 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron_lib.callbacks.manager [None req-785c1d26-11ba-42d8-b5a6-51a8b3daeef0 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8783631323329', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7978582'] for agent, after_update {{(pid=102994) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:37:16.619650 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-8576a436-33df-4958-a929-17d3bb329f87 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7918660', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-15067', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560168', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8783631008714', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-17257496'] for port, after_create {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:37:16.657054 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-8576a436-33df-4958-a929-17d3bb329f87 admin admin] Network a93e254e-aac9-4233-9e4d-4290fd0458e4 is already hosted by enough agents. {{(pid=102993) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 23 19:37:16.663630 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.scheduler.base_scheduler [None req-8576a436-33df-4958-a929-17d3bb329f87 admin admin] Resources bound (agent type, host, resource id): {{(pid=102993) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 23 19:37:16.667137 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.db.l3_dvrscheduler_db [None req-8576a436-33df-4958-a929-17d3bb329f87 admin admin] Received port after_create {{(pid=102993) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 23 19:37:16.709928 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8576a436-33df-4958-a929-17d3bb329f87 admin admin] Pushing event updated for resources: {'Port': ['ID=abd59c5e-8249-4aba-855f-bf3ed33724b6,revision_number=1']} {{(pid=102993) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 23 19:37:16.998670 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-fc5e3b28-d63b-4c43-aecf-1a1428d9c573 req-27638dbc-02db-4787-9637-e5471c133df6 tempest-AttachVolumeTestJSON-1120920040 tempest-AttachVolumeTestJSON-1120920040-project] 10.222.0.62 "GET /v2.0/ports?device_id=029fedce-3168-4d1d-992e-a9466fe3e886 HTTP/1.1" status: 200 len: 210 time: 0.0373487 Nov 23 19:37:17.007685 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-8576a436-33df-4958-a929-17d3bb329f87 admin admin] Publish callbacks [] for router_gateway, after_create {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:37:17.182623 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-fbd1586a-1f23-40db-b226-90e4ff911aeb None None] Network 87e46ab6-0f90-430f-930f-9ea1580c04c3 requested from dv-cinder-819011-1-iscsi {{(pid=102994) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 23 19:37:17.193437 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8b7ce163-367c-48b4-ad80-743b82d2d05c req-e1027d2c-0107-4303-8f32-e9644d5f0adb tempest-AttachVolumeTestJSON-1120920040 tempest-AttachVolumeTestJSON-1120920040-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=102992) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:37:17.195023 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-8b7ce163-367c-48b4-ad80-743b82d2d05c req-e1027d2c-0107-4303-8f32-e9644d5f0adb tempest-AttachVolumeTestJSON-1120920040 tempest-AttachVolumeTestJSON-1120920040-project] 10.222.0.41 "GET /v2.0/networks?id=41fa5020-8aad-49ce-b2a6-39d87c9e6042 HTTP/1.1" status: 200 len: 811 time: 0.1361318 Nov 23 19:37:17.262300 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.db.provisioning_blocks [None req-bb711fb4-1b7f-4197-9bfe-d81458850956 None None] Provisioning complete for port be8d3464-418e-47d4-85c9-a0e4ae74df89 triggered by entity DHCP. {{(pid=102994) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 23 19:37:17.262300 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron_lib.callbacks.manager [None req-bb711fb4-1b7f-4197-9bfe-d81458850956 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-8355713'] for port, provisioning_complete {{(pid=102994) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:37:17.264938 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-8576a436-33df-4958-a929-17d3bb329f87 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-932875', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-926501'] for router, after_create {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:37:17.304137 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-8b7ce163-367c-48b4-ad80-743b82d2d05c req-2c7350b8-ea68-446e-bdd0-1595c87cc11a tempest-AttachVolumeTestJSON-1120920040 tempest-AttachVolumeTestJSON-1120920040-project] 10.222.0.41 "GET /v2.0/security-groups?fields=id&fields=name&tenant_id=c9d53f0599374b679185cc73383b417c HTTP/1.1" status: 200 len: 379 time: 0.0912793 Nov 23 19:37:17.316668 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.api.v2.base [req-8b7ce163-367c-48b4-ad80-743b82d2d05c req-22637ca5-8451-46e3-a617-9a6a2f93733d tempest-AttachVolumeTestJSON-1120920040 tempest-AttachVolumeTestJSON-1120920040-project] Request body: {'port': {'device_id': '029fedce-3168-4d1d-992e-a9466fe3e886', 'network_id': '41fa5020-8aad-49ce-b2a6-39d87c9e6042', 'admin_state_up': True, 'tenant_id': 'c9d53f0599374b679185cc73383b417c', 'security_groups': ['f8cf4027-ad94-4b78-b429-c3f2d7f9d324']}} {{(pid=102992) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 23 19:37:17.406050 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron_lib.callbacks.manager [None req-eb87b2c3-3339-4249-8b85-e695b5b4e1f9 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8783631323329', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7978582'] for agent, after_update {{(pid=102994) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:37:17.455348 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron_lib.callbacks.manager [None req-bb711fb4-1b7f-4197-9bfe-d81458850956 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7921281'] for port, before_update {{(pid=102994) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:37:17.512883 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.plugins.ml2.db [None req-bb711fb4-1b7f-4197-9bfe-d81458850956 None None] For port be8d3464-418e-47d4-85c9-a0e4ae74df89, host dv-cinder-819011-1-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-819011-1-iscsi',level=0,port_id=be8d3464-418e-47d4-85c9-a0e4ae74df89,segment=NetworkSegment(5c30b9a1-7b41-4664-aa24-084baf66a2d5),segment_id=5c30b9a1-7b41-4664-aa24-084baf66a2d5)] {{(pid=102994) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 23 19:37:17.533773 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-8b7ce163-367c-48b4-ad80-743b82d2d05c req-22637ca5-8451-46e3-a617-9a6a2f93733d tempest-AttachVolumeTestJSON-1120920040 tempest-AttachVolumeTestJSON-1120920040-project] Made reservation on behalf of c9d53f0599374b679185cc73383b417c for: {'port': 1} {{(pid=102992) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 23 19:37:17.537393 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [req-8b7ce163-367c-48b4-ad80-743b82d2d05c req-22637ca5-8451-46e3-a617-9a6a2f93733d tempest-AttachVolumeTestJSON-1120920040 tempest-AttachVolumeTestJSON-1120920040-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7921281'] for port, before_create {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:37:17.567448 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-8576a436-33df-4958-a929-17d3bb329f87 admin admin] Router 3524bcbc-06d6-4343-84f5-54d756e6dd80 is scheduled to L3 agent 1b20f2c4-70b6-43c3-b9bd-0062cc9e57ac with binding_index 1 {{(pid=102993) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Nov 23 19:37:17.642945 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron_lib.callbacks.manager [None req-bb711fb4-1b7f-4197-9bfe-d81458850956 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7918660', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-15067', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560168', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8783631423946', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8783631008732', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8783631008750'] for port, after_update {{(pid=102994) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:37:17.692346 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.db.db_base_plugin_common [req-8b7ce163-367c-48b4-ad80-743b82d2d05c req-22637ca5-8451-46e3-a617-9a6a2f93733d tempest-AttachVolumeTestJSON-1120920040 tempest-AttachVolumeTestJSON-1120920040-project] Allocated IP 172.20.0.6 (41fa5020-8aad-49ce-b2a6-39d87c9e6042/8f74a1ae-f892-4057-89a5-ca78a259b1bd/2872cb22-0134-49c4-b6d7-034ca4132327) {{(pid=102992) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 23 19:37:17.705900 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bb711fb4-1b7f-4197-9bfe-d81458850956 None None] Pushing event updated for resources: {'Port': ['ID=be8d3464-418e-47d4-85c9-a0e4ae74df89,revision_number=3']} {{(pid=102994) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 23 19:37:17.719030 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-8576a436-33df-4958-a929-17d3bb329f87 admin admin] Notify agent at l3_agent.dv-cinder-819011-1-iscsi the message routers_updated {{(pid=102993) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 23 19:37:17.731313 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-681a05a3-c72f-407b-b929-8de147b29921 None None] Sync routers for ids ['3524bcbc-06d6-4343-84f5-54d756e6dd80'] in dv-cinder-819011-1-iscsi {{(pid=102994) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 23 19:37:17.743649 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.db.l3_dvrscheduler_db [None req-681a05a3-c72f-407b-b929-8de147b29921 None None] Routers {'3524bcbc-06d6-4343-84f5-54d756e6dd80'} bound to L3 agent in host dv-cinder-819011-1-iscsi {{(pid=102994) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 23 19:37:17.744270 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.db.l3_hamode_db [None req-681a05a3-c72f-407b-b929-8de147b29921 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-819011-1-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-11-23T19:25:14Z,description=,heartbeat_timestamp=2021-11-23T19:37:14Z,host='dv-cinder-819011-1-iscsi',id=1b20f2c4-70b6-43c3-b9bd-0062cc9e57ac,load=0,resource_versions=,resources_synced=,started_at=2021-11-23T19:25:15Z,topic='l3_agent')) {'router_ids': ['3524bcbc-06d6-4343-84f5-54d756e6dd80'], 'active': True} {{(pid=102994) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 23 19:37:17.812697 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.db.provisioning_blocks [None req-54b6ab0f-4582-43c9-9d62-fb55269057af None None] Provisioning complete for port be8d3464-418e-47d4-85c9-a0e4ae74df89 triggered by entity DHCP. {{(pid=102994) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 23 19:37:17.813320 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron_lib.callbacks.manager [None req-54b6ab0f-4582-43c9-9d62-fb55269057af None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-8355713'] for port, provisioning_complete {{(pid=102994) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:37:17.832775 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-8576a436-33df-4958-a929-17d3bb329f87 admin admin] Publish callbacks [] for router, before_response {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:37:17.834134 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [None req-8576a436-33df-4958-a929-17d3bb329f87 admin admin] 10.222.0.62 "POST /v2.0/routers HTTP/1.1" status: 201 len: 920 time: 2.7190402 Nov 23 19:37:17.836920 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.wsgi [-] (102993) accepted ('10.222.0.62', 48144) {{(pid=102993) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 23 19:37:17.864127 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [req-8b7ce163-367c-48b4-ad80-743b82d2d05c req-22637ca5-8451-46e3-a617-9a6a2f93733d tempest-AttachVolumeTestJSON-1120920040 tempest-AttachVolumeTestJSON-1120920040-project] Publish callbacks [] for port, precommit_create {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:37:17.985834 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [req-8b7ce163-367c-48b4-ad80-743b82d2d05c req-22637ca5-8451-46e3-a617-9a6a2f93733d tempest-AttachVolumeTestJSON-1120920040 tempest-AttachVolumeTestJSON-1120920040-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7918660', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-15067', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560168', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8783631008714', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-25199805'] for port, after_create {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:37:18.023722 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.plugins.ml2.rpc [None req-eb87b2c3-3339-4249-8b85-e695b5b4e1f9 None None] Device be8d3464-418e-47d4-85c9-a0e4ae74df89 up at agent ovs-agent-dv-cinder-819011-1-iscsi {{(pid=102994) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 23 19:37:18.052434 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-8b7ce163-367c-48b4-ad80-743b82d2d05c req-22637ca5-8451-46e3-a617-9a6a2f93733d tempest-AttachVolumeTestJSON-1120920040 tempest-AttachVolumeTestJSON-1120920040-project] Network 41fa5020-8aad-49ce-b2a6-39d87c9e6042 is already hosted by enough agents. {{(pid=102992) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 23 19:37:18.055757 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.scheduler.base_scheduler [req-8b7ce163-367c-48b4-ad80-743b82d2d05c req-22637ca5-8451-46e3-a617-9a6a2f93733d tempest-AttachVolumeTestJSON-1120920040 tempest-AttachVolumeTestJSON-1120920040-project] Resources bound (agent type, host, resource id): {{(pid=102992) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 23 19:37:18.061947 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.db.l3_dvrscheduler_db [req-8b7ce163-367c-48b4-ad80-743b82d2d05c req-22637ca5-8451-46e3-a617-9a6a2f93733d tempest-AttachVolumeTestJSON-1120920040 tempest-AttachVolumeTestJSON-1120920040-project] Received port after_create {{(pid=102992) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 23 19:37:18.090203 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.db.l3_dvr_db [None req-681a05a3-c72f-407b-b929-8de147b29921 None None] Set router 3524bcbc-06d6-4343-84f5-54d756e6dd80 gateway port host: dv-cinder-819011-1-iscsi {{(pid=102994) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 23 19:37:18.093110 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-22637ca5-8451-46e3-a617-9a6a2f93733d tempest-AttachVolumeTestJSON-1120920040 tempest-AttachVolumeTestJSON-1120920040-project] Pushing event updated for resources: {'Port': ['ID=2872cb22-0134-49c4-b6d7-034ca4132327,revision_number=1']} {{(pid=102992) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 23 19:37:18.121043 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8b7ce163-367c-48b4-ad80-743b82d2d05c req-22637ca5-8451-46e3-a617-9a6a2f93733d tempest-AttachVolumeTestJSON-1120920040 tempest-AttachVolumeTestJSON-1120920040-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=102992) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:37:18.121960 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [req-8b7ce163-367c-48b4-ad80-743b82d2d05c req-22637ca5-8451-46e3-a617-9a6a2f93733d tempest-AttachVolumeTestJSON-1120920040 tempest-AttachVolumeTestJSON-1120920040-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-514902'] for port, before_response {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:37:18.188602 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bb32db10-7c0b-4e5c-bc72-3263a1969ce2 req-36d2d793-9bf3-4d9d-8649-bcd431d8cfe1 tempest-AttachVolumeTestJSON-1120920040 tempest-AttachVolumeTestJSON-1120920040-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102992) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:37:18.190352 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-bb32db10-7c0b-4e5c-bc72-3263a1969ce2 req-36d2d793-9bf3-4d9d-8649-bcd431d8cfe1 tempest-AttachVolumeTestJSON-1120920040 tempest-AttachVolumeTestJSON-1120920040-project] 10.222.0.62 "GET /v2.0/ports?device_id=029fedce-3168-4d1d-992e-a9466fe3e886 HTTP/1.1" status: 200 len: 931 time: 0.0559225 Nov 23 19:37:18.217374 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.db.provisioning_blocks [None req-eb87b2c3-3339-4249-8b85-e695b5b4e1f9 None None] Provisioning complete for port be8d3464-418e-47d4-85c9-a0e4ae74df89 triggered by entity L2. {{(pid=102994) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 23 19:37:18.217953 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron_lib.callbacks.manager [None req-eb87b2c3-3339-4249-8b85-e695b5b4e1f9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-8355713'] for port, provisioning_complete {{(pid=102994) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:37:18.227375 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-8b7ce163-367c-48b4-ad80-743b82d2d05c req-22637ca5-8451-46e3-a617-9a6a2f93733d tempest-AttachVolumeTestJSON-1120920040 tempest-AttachVolumeTestJSON-1120920040-project] 10.222.0.41 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 0.9157341 Nov 23 19:37:18.270413 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-bb32db10-7c0b-4e5c-bc72-3263a1969ce2 req-3045e7d3-fca3-4674-a53a-ac90f983f70c tempest-AttachVolumeTestJSON-1120920040 tempest-AttachVolumeTestJSON-1120920040-project] 10.222.0.62 "GET /v2.0/security-groups?id=f8cf4027-ad94-4b78-b429-c3f2d7f9d324&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0727587 Nov 23 19:37:18.275666 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.api.v2.base [req-8b7ce163-367c-48b4-ad80-743b82d2d05c req-163acbe5-5e57-488a-bbbd-bd4f9ad56ecf service neutron] Request body: {'port': {'device_id': '029fedce-3168-4d1d-992e-a9466fe3e886', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-81901'}} {{(pid=102992) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 23 19:37:18.353017 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [req-8b7ce163-367c-48b4-ad80-743b82d2d05c req-163acbe5-5e57-488a-bbbd-bd4f9ad56ecf service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7921281'] for port, before_update {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:37:18.356016 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-312dbf60-0560-4109-9e9a-da79fd172cb8 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7921281'] for port, before_create {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:37:18.469441 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.db.provisioning_blocks [None req-2b5b87b4-40fd-44dc-9820-e0d9f241d96d None None] Provisioning complete for port 2872cb22-0134-49c4-b6d7-034ca4132327 triggered by entity DHCP. {{(pid=102994) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 23 19:37:18.469970 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron_lib.callbacks.manager [None req-2b5b87b4-40fd-44dc-9820-e0d9f241d96d None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-8355713'] for port, provisioning_complete {{(pid=102994) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:37:18.498320 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.db.l3_hamode_db [None req-681a05a3-c72f-407b-b929-8de147b29921 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '3524bcbc-06d6-4343-84f5-54d756e6dd80', 'name': 'tempest-TestShelveInstance-670557749-router', 'tenant_id': '35f8a5017a27449084aabd12f27f5a8a', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'a93e254e-aac9-4233-9e4d-4290fd0458e4', 'external_fixed_ips': [{'subnet_id': 'e0b32f3d-83d6-439a-bbed-01df7cf01051', 'ip_address': '172.27.1.194'}], 'enable_snat': True}, 'gw_port_id': 'abd59c5e-8249-4aba-855f-bf3ed33724b6', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-23T19:37:15Z', 'updated_at': '2021-11-23T19:37:16Z', 'revision_number': 3, 'project_id': '35f8a5017a27449084aabd12f27f5a8a', 'gw_port': {'id': 'abd59c5e-8249-4aba-855f-bf3ed33724b6', 'name': '', 'network_id': 'a93e254e-aac9-4233-9e4d-4290fd0458e4', 'tenant_id': '', 'mac_address': 'fa:16:3e:d7:89:48', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '3524bcbc-06d6-4343-84f5-54d756e6dd80', 'device_owner': 'network:router_gateway', 'standard_attr_id': 515, 'fixed_ips': [{'subnet_id': 'e0b32f3d-83d6-439a-bbed-01df7cf01051', 'ip_address': '172.27.1.194', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-23T19:37:16Z', 'updated_at': '2021-11-23T19:37:16Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': 'e0b32f3d-83d6-439a-bbed-01df7cf01051', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-819011-1-iscsi'}], 'dv-cinder-819011-1-iscsi', False) {} {{(pid=102994) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 23 19:37:18.537035 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-681a05a3-c72f-407b-b929-8de147b29921 None None] Checking router: 3524bcbc-06d6-4343-84f5-54d756e6dd80 for host: dv-cinder-819011-1-iscsi {{(pid=102994) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 23 19:37:18.537526 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-681a05a3-c72f-407b-b929-8de147b29921 None None] Updating router 3524bcbc-06d6-4343-84f5-54d756e6dd80 port abd59c5e-8249-4aba-855f-bf3ed33724b6 binding host dv-cinder-819011-1-iscsi {{(pid=102994) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Nov 23 19:37:18.539119 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.db.db_base_plugin_common [None req-312dbf60-0560-4109-9e9a-da79fd172cb8 admin admin] Allocated IP 172.20.0.1 (87e46ab6-0f90-430f-930f-9ea1580c04c3/afa5bc59-f70c-409d-8c15-be2dcdce66a3/e277d91a-2f3d-4a95-80af-b6e6c458ebab) {{(pid=102993) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 23 19:37:18.562245 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.plugins.ml2.plugin [None req-2b5b87b4-40fd-44dc-9820-e0d9f241d96d None None] Port 2872cb22-0134-49c4-b6d7-034ca4132327 cannot update to ACTIVE because it is not bound. {{(pid=102994) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 23 19:37:18.569605 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron_lib.callbacks.manager [None req-681a05a3-c72f-407b-b929-8de147b29921 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7921281'] for port, before_update {{(pid=102994) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:37:18.651187 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-312dbf60-0560-4109-9e9a-da79fd172cb8 admin admin] Publish callbacks [] for port, precommit_create {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:37:18.662128 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.notifiers.nova [req-8b7ce163-367c-48b4-ad80-743b82d2d05c req-163acbe5-5e57-488a-bbbd-bd4f9ad56ecf service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 2872cb22-0134-49c4-b6d7-034ca4132327 {{(pid=102992) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 23 19:37:18.674024 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [req-8b7ce163-367c-48b4-ad80-743b82d2d05c req-163acbe5-5e57-488a-bbbd-bd4f9ad56ecf service neutron] Publish callbacks [] for port, precommit_update {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:37:18.689185 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.db.provisioning_blocks [req-8b7ce163-367c-48b4-ad80-743b82d2d05c req-163acbe5-5e57-488a-bbbd-bd4f9ad56ecf service neutron] Transition to ACTIVE for port object 2872cb22-0134-49c4-b6d7-034ca4132327 will not be triggered until provisioned by entity L2. {{(pid=102992) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 23 19:37:18.751321 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-312dbf60-0560-4109-9e9a-da79fd172cb8 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7918660', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-15067', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560168', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8783631008714', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-17257496'] for port, after_create {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:37:18.756404 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [req-8b7ce163-367c-48b4-ad80-743b82d2d05c req-163acbe5-5e57-488a-bbbd-bd4f9ad56ecf service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7918660', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-15067', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560168', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8783631423946', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8783631008732', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8783631008750', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-25199748'] for port, after_update {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:37:18.789877 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-312dbf60-0560-4109-9e9a-da79fd172cb8 admin admin] Network 87e46ab6-0f90-430f-930f-9ea1580c04c3 is already hosted by enough agents. {{(pid=102993) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 23 19:37:18.795304 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.scheduler.base_scheduler [None req-312dbf60-0560-4109-9e9a-da79fd172cb8 admin admin] Resources bound (agent type, host, resource id): {{(pid=102993) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 23 19:37:18.800041 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.db.l3_dvrscheduler_db [None req-312dbf60-0560-4109-9e9a-da79fd172cb8 admin admin] Received port after_create {{(pid=102993) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 23 19:37:18.838822 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-163acbe5-5e57-488a-bbbd-bd4f9ad56ecf service neutron] Pushing event updated for resources: {'Port': ['ID=2872cb22-0134-49c4-b6d7-034ca4132327,revision_number=2']} {{(pid=102992) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 23 19:37:18.844903 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-312dbf60-0560-4109-9e9a-da79fd172cb8 admin admin] Pushing event updated for resources: {'Port': ['ID=e277d91a-2f3d-4a95-80af-b6e6c458ebab,revision_number=1']} {{(pid=102993) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 23 19:37:18.860881 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-312dbf60-0560-4109-9e9a-da79fd172cb8 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-926676'] for router_interface, before_create {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:37:18.952089 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.plugins.ml2.managers [req-8b7ce163-367c-48b4-ad80-743b82d2d05c req-163acbe5-5e57-488a-bbbd-bd4f9ad56ecf service neutron] Attempting to bind port 2872cb22-0134-49c4-b6d7-034ca4132327 on host hv-cinder-81901 for vnic_type normal with profile {{(pid=102992) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 23 19:37:18.952416 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.plugins.ml2.managers [req-8b7ce163-367c-48b4-ad80-743b82d2d05c req-163acbe5-5e57-488a-bbbd-bd4f9ad56ecf service neutron] Attempting to bind port 2872cb22-0134-49c4-b6d7-034ca4132327 by drivers openvswitch,hyperv on host hv-cinder-81901 at level 0 using segments [{'id': '1a7bcd69-381b-4068-88df-df74b53e9d61', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 824, 'network_id': '41fa5020-8aad-49ce-b2a6-39d87c9e6042'}] {{(pid=102992) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 23 19:37:18.952753 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-8b7ce163-367c-48b4-ad80-743b82d2d05c req-163acbe5-5e57-488a-bbbd-bd4f9ad56ecf service neutron] Attempting to bind port 2872cb22-0134-49c4-b6d7-034ca4132327 on network 41fa5020-8aad-49ce-b2a6-39d87c9e6042 {{(pid=102992) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 23 19:37:18.963300 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-8b7ce163-367c-48b4-ad80-743b82d2d05c req-163acbe5-5e57-488a-bbbd-bd4f9ad56ecf service neutron] Port 2872cb22-0134-49c4-b6d7-034ca4132327 on network 41fa5020-8aad-49ce-b2a6-39d87c9e6042 not bound, no agent of type Open vSwitch agent registered on host hv-cinder-81901 {{(pid=102992) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Nov 23 19:37:18.963300 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-8b7ce163-367c-48b4-ad80-743b82d2d05c req-163acbe5-5e57-488a-bbbd-bd4f9ad56ecf service neutron] Attempting to bind port 2872cb22-0134-49c4-b6d7-034ca4132327 on network 41fa5020-8aad-49ce-b2a6-39d87c9e6042 {{(pid=102992) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 23 19:37:18.977321 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-8b7ce163-367c-48b4-ad80-743b82d2d05c req-163acbe5-5e57-488a-bbbd-bd4f9ad56ecf service neutron] Checking agent: {'id': '14e5d049-431d-466a-8d1c-264e5129d376', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-81901', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 23, 19, 31, 29), 'started_at': datetime.datetime(2021, 11, 23, 19, 31, 29), 'heartbeat_timestamp': datetime.datetime(2021, 11, 23, 19, 36, 59), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=102992) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 23 19:37:18.977704 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-8b7ce163-367c-48b4-ad80-743b82d2d05c req-163acbe5-5e57-488a-bbbd-bd4f9ad56ecf service neutron] Checking segment: {'id': '1a7bcd69-381b-4068-88df-df74b53e9d61', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 824, 'network_id': '41fa5020-8aad-49ce-b2a6-39d87c9e6042'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102992) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 23 19:37:18.978098 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-8b7ce163-367c-48b4-ad80-743b82d2d05c req-163acbe5-5e57-488a-bbbd-bd4f9ad56ecf service neutron] Bound using segment: {'id': '1a7bcd69-381b-4068-88df-df74b53e9d61', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 824, 'network_id': '41fa5020-8aad-49ce-b2a6-39d87c9e6042'} {{(pid=102992) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 23 19:37:18.978593 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.plugins.ml2.managers [req-8b7ce163-367c-48b4-ad80-743b82d2d05c req-163acbe5-5e57-488a-bbbd-bd4f9ad56ecf service neutron] Bound port: 2872cb22-0134-49c4-b6d7-034ca4132327, host: hv-cinder-81901, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '1a7bcd69-381b-4068-88df-df74b53e9d61', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 824, 'network_id': '41fa5020-8aad-49ce-b2a6-39d87c9e6042'}}] {{(pid=102992) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 23 19:37:18.979078 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [req-8b7ce163-367c-48b4-ad80-743b82d2d05c req-163acbe5-5e57-488a-bbbd-bd4f9ad56ecf service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7921281'] for port, before_update {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:37:19.001927 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron_lib.callbacks.manager [None req-681a05a3-c72f-407b-b929-8de147b29921 None None] Publish callbacks [] for port, precommit_update {{(pid=102994) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:37:19.068820 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron_lib.callbacks.manager [None req-681a05a3-c72f-407b-b929-8de147b29921 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7918660', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-15067', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560168', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8783631423946', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8783631008732', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8783631008750'] for port, after_update {{(pid=102994) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:37:19.075428 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.plugins.ml2.db [req-8b7ce163-367c-48b4-ad80-743b82d2d05c req-163acbe5-5e57-488a-bbbd-bd4f9ad56ecf service neutron] For port 2872cb22-0134-49c4-b6d7-034ca4132327, host hv-cinder-81901, cleared binding levels {{(pid=102992) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 23 19:37:19.080000 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.plugins.ml2.db [req-8b7ce163-367c-48b4-ad80-743b82d2d05c req-163acbe5-5e57-488a-bbbd-bd4f9ad56ecf service neutron] For port 2872cb22-0134-49c4-b6d7-034ca4132327, host hv-cinder-81901, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81901',level=0,port_id=2872cb22-0134-49c4-b6d7-034ca4132327,segment=NetworkSegment(1a7bcd69-381b-4068-88df-df74b53e9d61),segment_id=1a7bcd69-381b-4068-88df-df74b53e9d61)] {{(pid=102992) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 23 19:37:19.105292 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-312dbf60-0560-4109-9e9a-da79fd172cb8 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7921281'] for port, before_update {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:37:19.130725 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9aa4d408-9298-4e02-ab1e-98dbffbdc988 None None] Pushing event updated for resources: {'Port': ['ID=abd59c5e-8249-4aba-855f-bf3ed33724b6,revision_number=2']} {{(pid=102994) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 23 19:37:19.133197 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.plugins.ml2.managers [None req-681a05a3-c72f-407b-b929-8de147b29921 None None] Attempting to bind port abd59c5e-8249-4aba-855f-bf3ed33724b6 on host dv-cinder-819011-1-iscsi for vnic_type normal with profile {{(pid=102994) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 23 19:37:19.133595 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.plugins.ml2.managers [None req-681a05a3-c72f-407b-b929-8de147b29921 None None] Attempting to bind port abd59c5e-8249-4aba-855f-bf3ed33724b6 by drivers openvswitch,hyperv on host dv-cinder-819011-1-iscsi at level 0 using segments [{'id': '3cb5e60b-103a-47d0-a28b-d68e3159d032', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'a93e254e-aac9-4233-9e4d-4290fd0458e4'}] {{(pid=102994) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 23 19:37:19.133964 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-681a05a3-c72f-407b-b929-8de147b29921 None None] Attempting to bind port abd59c5e-8249-4aba-855f-bf3ed33724b6 on network a93e254e-aac9-4233-9e4d-4290fd0458e4 {{(pid=102994) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 23 19:37:19.140304 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-681a05a3-c72f-407b-b929-8de147b29921 None None] Checking agent: {'id': '668c8953-047c-499e-8c0d-db838fac1668', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-819011-1-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 23, 19, 25, 17), 'started_at': datetime.datetime(2021, 11, 23, 19, 25, 47), 'heartbeat_timestamp': datetime.datetime(2021, 11, 23, 19, 37, 17), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-819011-1-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=102994) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 23 19:37:19.140880 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-681a05a3-c72f-407b-b929-8de147b29921 None None] Checking segment: {'id': '3cb5e60b-103a-47d0-a28b-d68e3159d032', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'a93e254e-aac9-4233-9e4d-4290fd0458e4'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102994) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 23 19:37:19.141330 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron_lib.callbacks.manager [None req-681a05a3-c72f-407b-b929-8de147b29921 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=102994) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:37:19.141752 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-681a05a3-c72f-407b-b929-8de147b29921 None None] Bound using segment: {'id': '3cb5e60b-103a-47d0-a28b-d68e3159d032', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'a93e254e-aac9-4233-9e4d-4290fd0458e4'} {{(pid=102994) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 23 19:37:19.147254 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.plugins.ml2.managers [None req-681a05a3-c72f-407b-b929-8de147b29921 None None] Bound port: abd59c5e-8249-4aba-855f-bf3ed33724b6, host: dv-cinder-819011-1-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '3cb5e60b-103a-47d0-a28b-d68e3159d032', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'a93e254e-aac9-4233-9e4d-4290fd0458e4'}}] {{(pid=102994) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 23 19:37:19.147254 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron_lib.callbacks.manager [None req-681a05a3-c72f-407b-b929-8de147b29921 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7921281'] for port, before_update {{(pid=102994) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:37:19.147505 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [req-8b7ce163-367c-48b4-ad80-743b82d2d05c req-163acbe5-5e57-488a-bbbd-bd4f9ad56ecf service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7918660', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-15067', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560168', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8783631423946', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8783631008732', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8783631008750', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-25199748'] for port, after_update {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:37:19.190961 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8b7ce163-367c-48b4-ad80-743b82d2d05c req-163acbe5-5e57-488a-bbbd-bd4f9ad56ecf service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102992) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:37:19.192013 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [req-8b7ce163-367c-48b4-ad80-743b82d2d05c req-163acbe5-5e57-488a-bbbd-bd4f9ad56ecf service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-514902'] for port, before_response {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:37:19.193208 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-8b7ce163-367c-48b4-ad80-743b82d2d05c req-163acbe5-5e57-488a-bbbd-bd4f9ad56ecf service neutron] 10.222.0.41 "PUT /v2.0/ports/2872cb22-0134-49c4-b6d7-034ca4132327 HTTP/1.1" status: 200 len: 1093 time: 0.9281189 Nov 23 19:37:19.193750 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '029fedce-3168-4d1d-992e-a9466fe3e886', 'tag': '2872cb22-0134-49c4-b6d7-034ca4132327'}] {{(pid=102992) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 23 19:37:19.196490 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.62/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}f86c332b591ae691ababa4b64e0601cbf242a448242f95367ce03daabfb7e1ce" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-739ddac3-9edb-4059-835a-f09f3f79653c" -d '{"events": [{"name": "network-changed", "server_uuid": "029fedce-3168-4d1d-992e-a9466fe3e886", "tag": "2872cb22-0134-49c4-b6d7-034ca4132327"}]}' {{(pid=102992) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 23 19:37:19.209372 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.plugins.ml2.db [None req-681a05a3-c72f-407b-b929-8de147b29921 None None] For port abd59c5e-8249-4aba-855f-bf3ed33724b6, host dv-cinder-819011-1-iscsi, cleared binding levels {{(pid=102994) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 23 19:37:19.213746 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.plugins.ml2.db [None req-681a05a3-c72f-407b-b929-8de147b29921 None None] For port abd59c5e-8249-4aba-855f-bf3ed33724b6, host dv-cinder-819011-1-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-819011-1-iscsi',level=0,port_id=abd59c5e-8249-4aba-855f-bf3ed33724b6,segment=NetworkSegment(3cb5e60b-103a-47d0-a28b-d68e3159d032),segment_id=3cb5e60b-103a-47d0-a28b-d68e3159d032)] {{(pid=102994) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 23 19:37:19.237574 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.db.provisioning_blocks [None req-f79c549c-3758-4c18-8174-af481e1b1ba3 None None] Provisioning complete for port e277d91a-2f3d-4a95-80af-b6e6c458ebab triggered by entity DHCP. {{(pid=102994) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 23 19:37:19.245910 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-163acbe5-5e57-488a-bbbd-bd4f9ad56ecf service neutron] Pushing event updated for resources: {'Port': ['ID=2872cb22-0134-49c4-b6d7-034ca4132327,revision_number=3']} {{(pid=102992) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 23 19:37:19.251104 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron_lib.callbacks.manager [None req-f79c549c-3758-4c18-8174-af481e1b1ba3 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-8355713'] for port, provisioning_complete {{(pid=102994) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:37:19.251339 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Tue, 23 Nov 2021 19:37:19 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-209fe9c9-4f1c-4f87-bf68-704badfaa158 x-openstack-request-id: req-209fe9c9-4f1c-4f87-bf68-704badfaa158 {{(pid=102992) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 23 19:37:19.251639 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "029fedce-3168-4d1d-992e-a9466fe3e886", "tag": "2872cb22-0134-49c4-b6d7-034ca4132327", "status": "completed", "code": 200}]} {{(pid=102992) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 23 19:37:19.251902 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.62/compute/v2.1/os-server-external-events used request id req-209fe9c9-4f1c-4f87-bf68-704badfaa158 {{(pid=102992) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 23 19:37:19.252357 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '029fedce-3168-4d1d-992e-a9466fe3e886', 'tag': '2872cb22-0134-49c4-b6d7-034ca4132327', 'status': 'completed', 'code': 200} Nov 23 19:37:19.304859 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.plugins.ml2.plugin [None req-f79c549c-3758-4c18-8174-af481e1b1ba3 None None] Port e277d91a-2f3d-4a95-80af-b6e6c458ebab cannot update to ACTIVE because it is not bound. {{(pid=102994) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 23 19:37:19.327451 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron_lib.callbacks.manager [None req-681a05a3-c72f-407b-b929-8de147b29921 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7918660', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-15067', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560168', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8783631423946', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8783631008732', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8783631008750'] for port, after_update {{(pid=102994) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:37:19.334155 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-739ddac3-9edb-4059-835a-f09f3f79653c req-b830b721-865e-45e6-9e24-f2728db50782 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102992) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:37:19.335775 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-739ddac3-9edb-4059-835a-f09f3f79653c req-b830b721-865e-45e6-9e24-f2728db50782 service neutron] 10.222.0.41 "GET /v2.0/ports?tenant_id=c9d53f0599374b679185cc73383b417c&device_id=029fedce-3168-4d1d-992e-a9466fe3e886 HTTP/1.1" status: 200 len: 1096 time: 0.0600569 Nov 23 19:37:19.355442 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-312dbf60-0560-4109-9e9a-da79fd172cb8 admin admin] Publish callbacks [] for port, precommit_update {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:37:19.412850 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9aa4d408-9298-4e02-ab1e-98dbffbdc988 None None] Pushing event updated for resources: {'Port': ['ID=abd59c5e-8249-4aba-855f-bf3ed33724b6,revision_number=3']} {{(pid=102994) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 23 19:37:19.415567 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.db.l3_dvrscheduler_db [None req-681a05a3-c72f-407b-b929-8de147b29921 None None] Routers {'3524bcbc-06d6-4343-84f5-54d756e6dd80'} bound to L3 agent in host dv-cinder-819011-1-iscsi {{(pid=102994) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 23 19:37:19.416193 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.db.l3_hamode_db [None req-681a05a3-c72f-407b-b929-8de147b29921 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-819011-1-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-11-23T19:25:14Z,description=,heartbeat_timestamp=2021-11-23T19:37:14Z,host='dv-cinder-819011-1-iscsi',id=1b20f2c4-70b6-43c3-b9bd-0062cc9e57ac,load=0,resource_versions=,resources_synced=,started_at=2021-11-23T19:25:15Z,topic='l3_agent')) {'router_ids': ['3524bcbc-06d6-4343-84f5-54d756e6dd80'], 'active': True} {{(pid=102994) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 23 19:37:19.441870 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-312dbf60-0560-4109-9e9a-da79fd172cb8 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7918660', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-15067', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560168', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8783631423946', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8783631008732', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8783631008750', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-17257505'] for port, after_update {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:37:19.486978 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dab4a8d1-f2a7-4e89-a943-233879809939 req-ee384675-d9cb-4ee9-832c-f5aec2792013 tempest-AttachVolumeTestJSON-1120920040 tempest-AttachVolumeTestJSON-1120920040-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102992) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:37:19.488418 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-dab4a8d1-f2a7-4e89-a943-233879809939 req-ee384675-d9cb-4ee9-832c-f5aec2792013 tempest-AttachVolumeTestJSON-1120920040 tempest-AttachVolumeTestJSON-1120920040-project] 10.222.0.62 "GET /v2.0/ports?device_id=029fedce-3168-4d1d-992e-a9466fe3e886 HTTP/1.1" status: 200 len: 943 time: 0.1003346 Nov 23 19:37:19.515440 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-739ddac3-9edb-4059-835a-f09f3f79653c req-f9a3ceed-c524-4cfb-a536-70d6ea0cf05f service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102992) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:37:19.517496 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-739ddac3-9edb-4059-835a-f09f3f79653c req-f9a3ceed-c524-4cfb-a536-70d6ea0cf05f service neutron] 10.222.0.41 "GET /v2.0/networks?tenant_id=c9d53f0599374b679185cc73383b417c&shared=False HTTP/1.1" status: 200 len: 912 time: 0.1678104 Nov 23 19:37:19.518665 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-312dbf60-0560-4109-9e9a-da79fd172cb8 admin admin] Pushing event updated for resources: {'Port': ['ID=e277d91a-2f3d-4a95-80af-b6e6c458ebab,revision_number=2']} {{(pid=102993) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 23 19:37:19.536038 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-312dbf60-0560-4109-9e9a-da79fd172cb8 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-553426', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-932964'] for router_interface, after_create {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:37:19.547686 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.db.l3_dvr_db [None req-681a05a3-c72f-407b-b929-8de147b29921 None None] Set router 3524bcbc-06d6-4343-84f5-54d756e6dd80 gateway port host: dv-cinder-819011-1-iscsi {{(pid=102994) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 23 19:37:19.551022 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-dab4a8d1-f2a7-4e89-a943-233879809939 req-f912d56b-a1a0-458b-bc22-38b760de7aa5 tempest-AttachVolumeTestJSON-1120920040 tempest-AttachVolumeTestJSON-1120920040-project] 10.222.0.62 "GET /v2.0/security-groups?id=f8cf4027-ad94-4b78-b429-c3f2d7f9d324&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0532827 Nov 23 19:37:19.639696 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-312dbf60-0560-4109-9e9a-da79fd172cb8 admin admin] Network 87e46ab6-0f90-430f-930f-9ea1580c04c3 is already hosted by enough agents. {{(pid=102993) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 23 19:37:19.642338 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.scheduler.base_scheduler [None req-312dbf60-0560-4109-9e9a-da79fd172cb8 admin admin] Resources bound (agent type, host, resource id): {{(pid=102993) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 23 19:37:19.763652 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.db.l3_hamode_db [None req-681a05a3-c72f-407b-b929-8de147b29921 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '3524bcbc-06d6-4343-84f5-54d756e6dd80', 'name': 'tempest-TestShelveInstance-670557749-router', 'tenant_id': '35f8a5017a27449084aabd12f27f5a8a', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'a93e254e-aac9-4233-9e4d-4290fd0458e4', 'external_fixed_ips': [{'subnet_id': 'e0b32f3d-83d6-439a-bbed-01df7cf01051', 'ip_address': '172.27.1.194'}], 'enable_snat': True}, 'gw_port_id': 'abd59c5e-8249-4aba-855f-bf3ed33724b6', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-23T19:37:15Z', 'updated_at': '2021-11-23T19:37:18Z', 'revision_number': 4, 'project_id': '35f8a5017a27449084aabd12f27f5a8a', 'gw_port': {'id': 'abd59c5e-8249-4aba-855f-bf3ed33724b6', 'name': '', 'network_id': 'a93e254e-aac9-4233-9e4d-4290fd0458e4', 'tenant_id': '', 'mac_address': 'fa:16:3e:d7:89:48', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '3524bcbc-06d6-4343-84f5-54d756e6dd80', 'device_owner': 'network:router_gateway', 'standard_attr_id': 515, 'fixed_ips': [{'subnet_id': 'e0b32f3d-83d6-439a-bbed-01df7cf01051', 'ip_address': '172.27.1.194', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-819011-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-23T19:37:16Z', 'updated_at': '2021-11-23T19:37:19Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'e0b32f3d-83d6-439a-bbed-01df7cf01051', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-819011-1-iscsi', '_interfaces': [{'id': 'e277d91a-2f3d-4a95-80af-b6e6c458ebab', 'name': '', 'network_id': '87e46ab6-0f90-430f-930f-9ea1580c04c3', 'tenant_id': '35f8a5017a27449084aabd12f27f5a8a', 'mac_address': 'fa:16:3e:42:84:c0', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '3524bcbc-06d6-4343-84f5-54d756e6dd80', 'device_owner': 'network:router_interface', 'standard_attr_id': 517, 'fixed_ips': [{'subnet_id': 'afa5bc59-f70c-409d-8c15-be2dcdce66a3', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-23T19:37:18Z', 'updated_at': '2021-11-23T19:37:18Z', 'revision_number': 1, 'project_id': '35f8a5017a27449084aabd12f27f5a8a', 'subnets': [{'id': 'afa5bc59-f70c-409d-8c15-be2dcdce66a3', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-819011-1-iscsi', False) {} {{(pid=102994) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 23 19:37:19.768707 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-312dbf60-0560-4109-9e9a-da79fd172cb8 admin admin] Router 3524bcbc-06d6-4343-84f5-54d756e6dd80 has already been hosted by L3 agent 1b20f2c4-70b6-43c3-b9bd-0062cc9e57ac {{(pid=102993) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 23 19:37:19.792387 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-681a05a3-c72f-407b-b929-8de147b29921 None None] The sync data for ids ['3524bcbc-06d6-4343-84f5-54d756e6dd80'] in dv-cinder-819011-1-iscsi is: [{'id': '3524bcbc-06d6-4343-84f5-54d756e6dd80', 'name': 'tempest-TestShelveInstance-670557749-router', 'tenant_id': '35f8a5017a27449084aabd12f27f5a8a', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'a93e254e-aac9-4233-9e4d-4290fd0458e4', 'external_fixed_ips': [{'subnet_id': 'e0b32f3d-83d6-439a-bbed-01df7cf01051', 'ip_address': '172.27.1.194'}], 'enable_snat': True}, 'gw_port_id': 'abd59c5e-8249-4aba-855f-bf3ed33724b6', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-23T19:37:15Z', 'updated_at': '2021-11-23T19:37:18Z', 'revision_number': 4, 'project_id': '35f8a5017a27449084aabd12f27f5a8a', 'gw_port': {'id': 'abd59c5e-8249-4aba-855f-bf3ed33724b6', 'name': '', 'network_id': 'a93e254e-aac9-4233-9e4d-4290fd0458e4', 'tenant_id': '', 'mac_address': 'fa:16:3e:d7:89:48', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '3524bcbc-06d6-4343-84f5-54d756e6dd80', 'device_owner': 'network:router_gateway', 'standard_attr_id': 515, 'fixed_ips': [{'subnet_id': 'e0b32f3d-83d6-439a-bbed-01df7cf01051', 'ip_address': '172.27.1.194', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-819011-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-23T19:37:16Z', 'updated_at': '2021-11-23T19:37:19Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'e0b32f3d-83d6-439a-bbed-01df7cf01051', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-819011-1-iscsi', '_interfaces': [{'id': 'e277d91a-2f3d-4a95-80af-b6e6c458ebab', 'name': '', 'network_id': '87e46ab6-0f90-430f-930f-9ea1580c04c3', 'tenant_id': '35f8a5017a27449084aabd12f27f5a8a', 'mac_address': 'fa:16:3e:42:84:c0', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '3524bcbc-06d6-4343-84f5-54d756e6dd80', 'device_owner': 'network:router_interface', 'standard_attr_id': 517, 'fixed_ips': [{'subnet_id': 'afa5bc59-f70c-409d-8c15-be2dcdce66a3', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-23T19:37:18Z', 'updated_at': '2021-11-23T19:37:18Z', 'revision_number': 1, 'project_id': '35f8a5017a27449084aabd12f27f5a8a', 'subnets': [{'id': 'afa5bc59-f70c-409d-8c15-be2dcdce66a3', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=102994) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 23 19:37:19.875836 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.db.provisioning_blocks [None req-088502a5-a62d-4a2e-a413-d48c5252b7fe None None] Provisioning complete for port e277d91a-2f3d-4a95-80af-b6e6c458ebab triggered by entity DHCP. {{(pid=102994) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 23 19:37:19.876301 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron_lib.callbacks.manager [None req-088502a5-a62d-4a2e-a413-d48c5252b7fe None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-8355713'] for port, provisioning_complete {{(pid=102994) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:37:19.885661 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-312dbf60-0560-4109-9e9a-da79fd172cb8 admin admin] Notify agent at l3_agent.dv-cinder-819011-1-iscsi the message routers_updated {{(pid=102993) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 23 19:37:19.891696 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [None req-312dbf60-0560-4109-9e9a-da79fd172cb8 admin admin] 10.222.0.62 "PUT /v2.0/routers/3524bcbc-06d6-4343-84f5-54d756e6dd80/add_router_interface HTTP/1.1" status: 200 len: 503 time: 2.0537200 Nov 23 19:37:19.915842 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.plugins.ml2.plugin [None req-088502a5-a62d-4a2e-a413-d48c5252b7fe None None] Port e277d91a-2f3d-4a95-80af-b6e6c458ebab cannot update to ACTIVE because it is not bound. {{(pid=102994) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 23 19:37:20.683129 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-40214855-5b5c-4c57-aee1-cff7ef70e825 req-39aafda8-e425-4621-8ece-5e782d2b277e tempest-AttachVolumeTestJSON-1120920040 tempest-AttachVolumeTestJSON-1120920040-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102993) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:37:20.683129 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-40214855-5b5c-4c57-aee1-cff7ef70e825 req-39aafda8-e425-4621-8ece-5e782d2b277e tempest-AttachVolumeTestJSON-1120920040 tempest-AttachVolumeTestJSON-1120920040-project] 10.222.0.62 "GET /v2.0/ports?device_id=029fedce-3168-4d1d-992e-a9466fe3e886 HTTP/1.1" status: 200 len: 943 time: 0.0549440 Nov 23 19:37:20.696855 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.wsgi [-] (102992) accepted ('10.222.0.62', 48182) {{(pid=102992) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 23 19:37:20.702390 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.api.v2.base [None req-16704a8d-c536-468b-986a-61be452bf53b admin admin] Request body: {'network': {'name': 'tempest-TestShelveInstance-1814897973-network', 'tenant_id': '2782edd0ce0e455b825d4fa9efd24221'}} {{(pid=102992) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 23 19:37:20.728623 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-40214855-5b5c-4c57-aee1-cff7ef70e825 req-c8520779-3907-42db-9b8f-d81ec842811c tempest-AttachVolumeTestJSON-1120920040 tempest-AttachVolumeTestJSON-1120920040-project] 10.222.0.62 "GET /v2.0/security-groups?id=f8cf4027-ad94-4b78-b429-c3f2d7f9d324&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0463533 Nov 23 19:37:20.778882 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-16704a8d-c536-468b-986a-61be452bf53b admin admin] Made reservation on behalf of 2782edd0ce0e455b825d4fa9efd24221 for: {'network': 1} {{(pid=102992) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 23 19:37:20.781276 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [None req-16704a8d-c536-468b-986a-61be452bf53b admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7921281'] for network, before_create {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:37:20.790671 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [None req-16704a8d-c536-468b-986a-61be452bf53b admin admin] Publish callbacks [] for security_group, before_create {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:37:20.863056 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [None req-16704a8d-c536-468b-986a-61be452bf53b admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:37:20.898695 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [None req-16704a8d-c536-468b-986a-61be452bf53b admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-623933'] for security_group, after_create {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:37:20.922621 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-16704a8d-c536-468b-986a-61be452bf53b admin admin] vlan segment allocate from pool success with {'vlan_id': 831, 'physical_network': 'physnet1'} {{(pid=102992) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 23 19:37:20.931317 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-16704a8d-c536-468b-986a-61be452bf53b admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=52ef8f21-5900-4c6a-a4cb-d749c75ddf46,revision_number=1']} {{(pid=102992) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 23 19:37:20.937046 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [None req-16704a8d-c536-468b-986a-61be452bf53b admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7982218'] for segment, precommit_create {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:37:20.937390 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.db.segments_db [None req-16704a8d-c536-468b-986a-61be452bf53b admin admin] Added segment a6451c29-fea7-487e-9bb2-6a8e36a6bb38 of type vlan for network f85fa999-4237-44ad-8898-e5b57905b92f Nov 23 19:37:20.977802 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [None req-16704a8d-c536-468b-986a-61be452bf53b admin admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8783630993713'] for network, precommit_create {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:37:21.058827 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [None req-16704a8d-c536-468b-986a-61be452bf53b admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-554949', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560168'] for network, after_create {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:37:21.059802 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-16704a8d-c536-468b-986a-61be452bf53b admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102992) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:37:21.060394 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [None req-16704a8d-c536-468b-986a-61be452bf53b admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-560186'] for network, before_response {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:37:21.121149 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-16704a8d-c536-468b-986a-61be452bf53b admin admin] Pushing event updated for resources: {'Network': ['ID=f85fa999-4237-44ad-8898-e5b57905b92f,revision_number=1']} {{(pid=102992) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 23 19:37:21.131205 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.plugins.ml2.rpc [None req-eb87b2c3-3339-4249-8b85-e695b5b4e1f9 None None] Network f85fa999-4237-44ad-8898-e5b57905b92f details requested by agent ovs-agent-dv-cinder-819011-1-iscsi with host dv-cinder-819011-1-iscsi {{(pid=102994) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Nov 23 19:37:21.153308 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [None req-16704a8d-c536-468b-986a-61be452bf53b admin admin] 10.222.0.62 "POST /v2.0/networks HTTP/1.1" status: 201 len: 882 time: 0.4551055 Nov 23 19:37:21.155874 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.wsgi [-] (102992) accepted ('10.222.0.62', 48188) {{(pid=102992) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 23 19:37:21.161220 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.api.v2.base [None req-73026f86-2276-47cd-b515-09e588e1c64f admin admin] Request body: {'subnet': {'network_id': 'f85fa999-4237-44ad-8898-e5b57905b92f', 'cidr': '172.20.0.0/28', 'name': 'tempest-TestShelveInstance-1814897973-subnet', 'tenant_id': '2782edd0ce0e455b825d4fa9efd24221', 'ip_version': 4}} {{(pid=102992) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 23 19:37:21.230118 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-73026f86-2276-47cd-b515-09e588e1c64f admin admin] Made reservation on behalf of 2782edd0ce0e455b825d4fa9efd24221 for: {'subnet': 1} {{(pid=102992) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 23 19:37:21.232520 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [None req-73026f86-2276-47cd-b515-09e588e1c64f admin admin] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-25999706'] for subnet, before_create {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:37:21.452941 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [None req-73026f86-2276-47cd-b515-09e588e1c64f admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-554858', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560168', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-25199633', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-25999688'] for subnet, after_create {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:37:21.534880 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-739ddac3-9edb-4059-835a-f09f3f79653c req-a74b06ea-8554-40e3-9a6c-aa12c8346a99 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102992) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:37:21.536331 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-739ddac3-9edb-4059-835a-f09f3f79653c req-a74b06ea-8554-40e3-9a6c-aa12c8346a99 service neutron] 10.222.0.41 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 870 time: 0.1470699 Nov 23 19:37:21.536974 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-73026f86-2276-47cd-b515-09e588e1c64f admin admin] Pushing event updated for resources: {'Subnet': ['ID=baa3c93e-8af6-411c-80fd-fd8f5df6bde9,revision_number=0']} {{(pid=102992) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 23 19:37:21.545668 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-73026f86-2276-47cd-b515-09e588e1c64f admin admin] Checking segment: {'id': 'a6451c29-fea7-487e-9bb2-6a8e36a6bb38', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 831, 'network_id': 'f85fa999-4237-44ad-8898-e5b57905b92f'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102992) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 23 19:37:21.546023 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-73026f86-2276-47cd-b515-09e588e1c64f admin admin] Network hostable DHCP agents. Network: f85fa999-4237-44ad-8898-e5b57905b92f, hostable agents: ['e51c95c7-6a36-4263-ba47-1839054f3e7a'], hosted agents: [] {{(pid=102992) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 23 19:37:21.636046 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-73026f86-2276-47cd-b515-09e588e1c64f admin admin] Network f85fa999-4237-44ad-8898-e5b57905b92f is scheduled to be hosted by DHCP agent e51c95c7-6a36-4263-ba47-1839054f3e7a with binding_index 1 {{(pid=102992) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 23 19:37:21.693031 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.scheduler.base_scheduler [None req-73026f86-2276-47cd-b515-09e588e1c64f admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-819011-1-iscsi, f85fa999-4237-44ad-8898-e5b57905b92f) {{(pid=102992) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 23 19:37:21.696834 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-73026f86-2276-47cd-b515-09e588e1c64f admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=102992) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:37:21.697427 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [None req-73026f86-2276-47cd-b515-09e588e1c64f admin admin] Publish callbacks [] for subnet, before_response {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:37:21.703509 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-5ac34165-2c91-4de8-becd-ff1808c080e1 None None] Network f85fa999-4237-44ad-8898-e5b57905b92f requested from dv-cinder-819011-1-iscsi {{(pid=102994) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 23 19:37:21.774020 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [None req-73026f86-2276-47cd-b515-09e588e1c64f admin admin] 10.222.0.62 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 845 time: 0.6146262 Nov 23 19:37:21.774437 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.wsgi [-] (102993) accepted ('10.222.0.62', 48192) {{(pid=102993) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 23 19:37:21.779216 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.api.v2.base [None req-8b961f84-796c-4276-a67c-9b295e2d66f3 admin admin] Request body: {'router': {'name': 'tempest-TestShelveInstance-1814897973-router', 'tenant_id': '2782edd0ce0e455b825d4fa9efd24221', 'external_gateway_info': {'network_id': 'a93e254e-aac9-4233-9e4d-4290fd0458e4'}}} {{(pid=102993) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 23 19:37:21.863676 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-166137a0-67bf-4603-b90e-a21b8f445d34 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp8353ff9b-e01d-5e31-ab2d-60a764783255-f85fa999-4237-44ad-8898-e5b57905b92f', 'network_id': 'f85fa999-4237-44ad-8898-e5b57905b92f', 'tenant_id': '2782edd0ce0e455b825d4fa9efd24221', 'fixed_ips': [{'subnet_id': 'baa3c93e-8af6-411c-80fd-fd8f5df6bde9'}]}} from dv-cinder-819011-1-iscsi. {{(pid=102994) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:285}} Nov 23 19:37:21.864574 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-beb99dd3-ea08-4b69-8019-664c275f5506 req-ece73862-eafc-49d8-8450-b4eeb99749ca tempest-AttachVolumeTestJSON-1120920040 tempest-AttachVolumeTestJSON-1120920040-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102992) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:37:21.864704 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron_lib.callbacks.manager [None req-166137a0-67bf-4603-b90e-a21b8f445d34 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7921281'] for port, before_create {{(pid=102994) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:37:21.866154 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-beb99dd3-ea08-4b69-8019-664c275f5506 req-ece73862-eafc-49d8-8450-b4eeb99749ca tempest-AttachVolumeTestJSON-1120920040 tempest-AttachVolumeTestJSON-1120920040-project] 10.222.0.62 "GET /v2.0/ports?device_id=029fedce-3168-4d1d-992e-a9466fe3e886 HTTP/1.1" status: 200 len: 943 time: 0.0598798 Nov 23 19:37:21.887798 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-8b961f84-796c-4276-a67c-9b295e2d66f3 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-933550', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-13503'] for router, before_create {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:37:21.888864 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-8b961f84-796c-4276-a67c-9b295e2d66f3 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-933038', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-927700', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-622769', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-13448'] for router, precommit_create {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:37:21.961320 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-beb99dd3-ea08-4b69-8019-664c275f5506 req-e26b8921-6731-4912-8544-089aa0f2ed6f tempest-AttachVolumeTestJSON-1120920040 tempest-AttachVolumeTestJSON-1120920040-project] 10.222.0.62 "GET /v2.0/security-groups?id=f8cf4027-ad94-4b78-b429-c3f2d7f9d324&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0887091 Nov 23 19:37:21.986634 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-8b961f84-796c-4276-a67c-9b295e2d66f3 admin admin] Publish callbacks [] for router_controller, precommit_add_association {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:37:22.053683 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.plugins.ml2.rpc [None req-eb87b2c3-3339-4249-8b85-e695b5b4e1f9 None None] Device abd59c5e-8249-4aba-855f-bf3ed33724b6 up at agent ovs-agent-dv-cinder-819011-1-iscsi {{(pid=102994) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 23 19:37:22.097441 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.db.db_base_plugin_common [None req-166137a0-67bf-4603-b90e-a21b8f445d34 None None] Allocated IP 172.20.0.2 (f85fa999-4237-44ad-8898-e5b57905b92f/baa3c93e-8af6-411c-80fd-fd8f5df6bde9/3b694ca8-b637-46fe-addf-211dc47247ae) {{(pid=102994) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 23 19:37:22.126085 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.db.provisioning_blocks [None req-eb87b2c3-3339-4249-8b85-e695b5b4e1f9 None None] Provisioning complete for port abd59c5e-8249-4aba-855f-bf3ed33724b6 triggered by entity L2. {{(pid=102994) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 23 19:37:22.126485 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron_lib.callbacks.manager [None req-eb87b2c3-3339-4249-8b85-e695b5b4e1f9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-8355713'] for port, provisioning_complete {{(pid=102994) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:37:22.227168 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-8b961f84-796c-4276-a67c-9b295e2d66f3 admin admin] Publish callbacks [] for router_gateway, precommit_update {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:37:22.442046 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron_lib.callbacks.manager [None req-eb87b2c3-3339-4249-8b85-e695b5b4e1f9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7921281'] for port, before_update {{(pid=102994) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:37:22.462531 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron_lib.callbacks.manager [None req-166137a0-67bf-4603-b90e-a21b8f445d34 None None] Publish callbacks [] for port, precommit_create {{(pid=102994) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:37:22.474102 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.plugins.ml2.db [None req-eb87b2c3-3339-4249-8b85-e695b5b4e1f9 None None] For port abd59c5e-8249-4aba-855f-bf3ed33724b6, host dv-cinder-819011-1-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-819011-1-iscsi',level=0,port_id=abd59c5e-8249-4aba-855f-bf3ed33724b6,segment=NetworkSegment(3cb5e60b-103a-47d0-a28b-d68e3159d032),segment_id=3cb5e60b-103a-47d0-a28b-d68e3159d032)] {{(pid=102994) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 23 19:37:22.476589 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-8b961f84-796c-4276-a67c-9b295e2d66f3 admin admin] Publish callbacks [] for router_gateway, before_create {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:37:22.495916 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-8b961f84-796c-4276-a67c-9b295e2d66f3 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7921281'] for port, before_create {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:37:22.530914 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron_lib.callbacks.manager [None req-166137a0-67bf-4603-b90e-a21b8f445d34 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7918660', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-15067', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560168', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8783631008714'] for port, after_create {{(pid=102994) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:37:22.564791 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron_lib.callbacks.manager [None req-eb87b2c3-3339-4249-8b85-e695b5b4e1f9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7918660', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-15067', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560168', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8783631423946', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8783631008732', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8783631008750'] for port, after_update {{(pid=102994) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:37:22.575053 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-166137a0-67bf-4603-b90e-a21b8f445d34 None None] Network f85fa999-4237-44ad-8898-e5b57905b92f is already hosted by enough agents. {{(pid=102994) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 23 19:37:22.580580 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.scheduler.base_scheduler [None req-166137a0-67bf-4603-b90e-a21b8f445d34 None None] Resources bound (agent type, host, resource id): {{(pid=102994) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 23 19:37:22.584286 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.db.l3_dvrscheduler_db [None req-166137a0-67bf-4603-b90e-a21b8f445d34 None None] Received port after_create {{(pid=102994) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 23 19:37:22.593261 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-166137a0-67bf-4603-b90e-a21b8f445d34 None None] Pushing event updated for resources: {'Port': ['ID=3b694ca8-b637-46fe-addf-211dc47247ae,revision_number=1']} {{(pid=102994) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 23 19:37:22.606728 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.db.db_base_plugin_common [None req-8b961f84-796c-4276-a67c-9b295e2d66f3 admin admin] Allocated IP 172.27.1.217 (a93e254e-aac9-4233-9e4d-4290fd0458e4/e0b32f3d-83d6-439a-bbed-01df7cf01051/6f678090-b3f3-474e-8c77-32f412c39e45) {{(pid=102993) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 23 19:37:22.640141 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8b7ce163-367c-48b4-ad80-743b82d2d05c req-0f629132-3a6c-4d0b-93ef-ff5f1caf7a0e service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102992) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:37:22.646025 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-8b7ce163-367c-48b4-ad80-743b82d2d05c req-0f629132-3a6c-4d0b-93ef-ff5f1caf7a0e service neutron] 10.222.0.41 "GET /v2.0/ports?tenant_id=c9d53f0599374b679185cc73383b417c&device_id=029fedce-3168-4d1d-992e-a9466fe3e886 HTTP/1.1" status: 200 len: 1096 time: 0.0804567 Nov 23 19:37:22.695897 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.plugins.ml2.managers [None req-166137a0-67bf-4603-b90e-a21b8f445d34 None None] Attempting to bind port 3b694ca8-b637-46fe-addf-211dc47247ae on host dv-cinder-819011-1-iscsi for vnic_type normal with profile {{(pid=102994) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 23 19:37:22.696271 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.plugins.ml2.managers [None req-166137a0-67bf-4603-b90e-a21b8f445d34 None None] Attempting to bind port 3b694ca8-b637-46fe-addf-211dc47247ae by drivers openvswitch,hyperv on host dv-cinder-819011-1-iscsi at level 0 using segments [{'id': 'a6451c29-fea7-487e-9bb2-6a8e36a6bb38', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 831, 'network_id': 'f85fa999-4237-44ad-8898-e5b57905b92f'}] {{(pid=102994) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 23 19:37:22.696633 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-166137a0-67bf-4603-b90e-a21b8f445d34 None None] Attempting to bind port 3b694ca8-b637-46fe-addf-211dc47247ae on network f85fa999-4237-44ad-8898-e5b57905b92f {{(pid=102994) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 23 19:37:22.701986 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-eb87b2c3-3339-4249-8b85-e695b5b4e1f9 None None] Pushing event updated for resources: {'Port': ['ID=abd59c5e-8249-4aba-855f-bf3ed33724b6,revision_number=4']} {{(pid=102994) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 23 19:37:22.707170 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-166137a0-67bf-4603-b90e-a21b8f445d34 None None] Checking agent: {'id': '668c8953-047c-499e-8c0d-db838fac1668', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-819011-1-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 23, 19, 25, 17), 'started_at': datetime.datetime(2021, 11, 23, 19, 25, 47), 'heartbeat_timestamp': datetime.datetime(2021, 11, 23, 19, 37, 17), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-819011-1-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=102994) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 23 19:37:22.707553 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-166137a0-67bf-4603-b90e-a21b8f445d34 None None] Checking segment: {'id': 'a6451c29-fea7-487e-9bb2-6a8e36a6bb38', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 831, 'network_id': 'f85fa999-4237-44ad-8898-e5b57905b92f'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102994) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 23 19:37:22.707957 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron_lib.callbacks.manager [None req-166137a0-67bf-4603-b90e-a21b8f445d34 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=102994) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:37:22.708347 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-166137a0-67bf-4603-b90e-a21b8f445d34 None None] Bound using segment: {'id': 'a6451c29-fea7-487e-9bb2-6a8e36a6bb38', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 831, 'network_id': 'f85fa999-4237-44ad-8898-e5b57905b92f'} {{(pid=102994) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 23 19:37:22.708820 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.plugins.ml2.managers [None req-166137a0-67bf-4603-b90e-a21b8f445d34 None None] Bound port: 3b694ca8-b637-46fe-addf-211dc47247ae, host: dv-cinder-819011-1-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'a6451c29-fea7-487e-9bb2-6a8e36a6bb38', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 831, 'network_id': 'f85fa999-4237-44ad-8898-e5b57905b92f'}}] {{(pid=102994) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 23 19:37:22.709230 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron_lib.callbacks.manager [None req-166137a0-67bf-4603-b90e-a21b8f445d34 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7921281'] for port, before_update {{(pid=102994) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:37:22.722508 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-8b961f84-796c-4276-a67c-9b295e2d66f3 admin admin] Publish callbacks [] for port, precommit_create {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:37:22.743805 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-8b7ce163-367c-48b4-ad80-743b82d2d05c req-29dbc4a9-8712-445b-b312-0edcbd873fc4 service neutron] 10.222.0.41 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.6&port_id=2872cb22-0134-49c4-b6d7-034ca4132327 HTTP/1.1" status: 200 len: 217 time: 0.0764787 Nov 23 19:37:22.779250 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.plugins.ml2.db [None req-166137a0-67bf-4603-b90e-a21b8f445d34 None None] For port 3b694ca8-b637-46fe-addf-211dc47247ae, host dv-cinder-819011-1-iscsi, cleared binding levels {{(pid=102994) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 23 19:37:22.783279 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.plugins.ml2.db [None req-166137a0-67bf-4603-b90e-a21b8f445d34 None None] For port 3b694ca8-b637-46fe-addf-211dc47247ae, host dv-cinder-819011-1-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-819011-1-iscsi',level=0,port_id=3b694ca8-b637-46fe-addf-211dc47247ae,segment=NetworkSegment(a6451c29-fea7-487e-9bb2-6a8e36a6bb38),segment_id=a6451c29-fea7-487e-9bb2-6a8e36a6bb38)] {{(pid=102994) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 23 19:37:22.799449 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8b7ce163-367c-48b4-ad80-743b82d2d05c req-d6de5fb5-eab2-43cd-b8e5-ec9d134e68ab service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102992) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:37:22.800997 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-8b7ce163-367c-48b4-ad80-743b82d2d05c req-d6de5fb5-eab2-43cd-b8e5-ec9d134e68ab service neutron] 10.222.0.41 "GET /v2.0/subnets?id=8f74a1ae-f892-4057-89a5-ca78a259b1bd HTTP/1.1" status: 200 len: 850 time: 0.0472565 Nov 23 19:37:22.830391 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-8b961f84-796c-4276-a67c-9b295e2d66f3 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7918660', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-15067', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560168', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8783631008714', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-17257496'] for port, after_create {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:37:22.849427 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8b7ce163-367c-48b4-ad80-743b82d2d05c req-38494b69-86ed-4afb-bf33-bcfeddabcd9c service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102992) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:37:22.850935 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-8b7ce163-367c-48b4-ad80-743b82d2d05c req-38494b69-86ed-4afb-bf33-bcfeddabcd9c service neutron] 10.222.0.41 "GET /v2.0/ports?network_id=41fa5020-8aad-49ce-b2a6-39d87c9e6042&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0411415 Nov 23 19:37:22.859030 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron_lib.callbacks.manager [None req-166137a0-67bf-4603-b90e-a21b8f445d34 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7918660', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-15067', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560168', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8783631423946', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8783631008732', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8783631008750'] for port, after_update {{(pid=102994) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:37:22.873115 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-8b961f84-796c-4276-a67c-9b295e2d66f3 admin admin] Network a93e254e-aac9-4233-9e4d-4290fd0458e4 is already hosted by enough agents. {{(pid=102993) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 23 19:37:22.885650 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.scheduler.base_scheduler [None req-8b961f84-796c-4276-a67c-9b295e2d66f3 admin admin] Resources bound (agent type, host, resource id): {{(pid=102993) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 23 19:37:22.889976 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.db.l3_dvrscheduler_db [None req-8b961f84-796c-4276-a67c-9b295e2d66f3 admin admin] Received port after_create {{(pid=102993) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 23 19:37:22.923719 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8b961f84-796c-4276-a67c-9b295e2d66f3 admin admin] Pushing event updated for resources: {'Port': ['ID=6f678090-b3f3-474e-8c77-32f412c39e45,revision_number=1']} {{(pid=102993) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 23 19:37:22.927241 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-166137a0-67bf-4603-b90e-a21b8f445d34 None None] Pushing event updated for resources: {'Port': ['ID=3b694ca8-b637-46fe-addf-211dc47247ae,revision_number=2']} {{(pid=102994) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 23 19:37:22.944111 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8b961f84-796c-4276-a67c-9b295e2d66f3 admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-819011-1-iscsi {{(pid=102993) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 23 19:37:22.944490 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8b961f84-796c-4276-a67c-9b295e2d66f3 admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-819011-1-iscsi {{(pid=102993) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 23 19:37:22.945511 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8b961f84-796c-4276-a67c-9b295e2d66f3 admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-819011-1-iscsi {{(pid=102993) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 23 19:37:22.945796 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8b961f84-796c-4276-a67c-9b295e2d66f3 admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-819011-1-iscsi {{(pid=102993) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 23 19:37:22.946140 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8b961f84-796c-4276-a67c-9b295e2d66f3 admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-819011-1-iscsi {{(pid=102993) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 23 19:37:22.946484 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8b961f84-796c-4276-a67c-9b295e2d66f3 admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-819011-1-iscsi {{(pid=102993) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 23 19:37:22.946821 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8b961f84-796c-4276-a67c-9b295e2d66f3 admin admin] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-819011-1-iscsi {{(pid=102993) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 23 19:37:22.947298 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8b961f84-796c-4276-a67c-9b295e2d66f3 admin admin] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-819011-1-iscsi {{(pid=102993) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 23 19:37:22.951033 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8b961f84-796c-4276-a67c-9b295e2d66f3 admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-819011-1-iscsi {{(pid=102993) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 23 19:37:22.952918 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8b961f84-796c-4276-a67c-9b295e2d66f3 admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-819011-1-iscsi {{(pid=102993) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 23 19:37:22.952918 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8b961f84-796c-4276-a67c-9b295e2d66f3 admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-819011-1-iscsi {{(pid=102993) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 23 19:37:22.952918 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8b961f84-796c-4276-a67c-9b295e2d66f3 admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-819011-1-iscsi {{(pid=102993) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 23 19:37:22.988532 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-8b7ce163-367c-48b4-ad80-743b82d2d05c req-05a21789-8280-4f54-a6d5-6e9133cef2b5 service neutron] 10.222.0.41 "GET /v2.0/networks/41fa5020-8aad-49ce-b2a6-39d87c9e6042?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1128554 Nov 23 19:37:23.076461 dv-cinder-819011-1-iscsi neutron-server[102995]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-37d881bd-a79f-4808-b693-7a529defc2db None None] Sync routers for ids ['3524bcbc-06d6-4343-84f5-54d756e6dd80'] in dv-cinder-819011-1-iscsi {{(pid=102995) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 23 19:37:23.089585 dv-cinder-819011-1-iscsi neutron-server[102995]: DEBUG neutron.db.l3_dvrscheduler_db [None req-37d881bd-a79f-4808-b693-7a529defc2db None None] Routers {'3524bcbc-06d6-4343-84f5-54d756e6dd80'} bound to L3 agent in host dv-cinder-819011-1-iscsi {{(pid=102995) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 23 19:37:23.090219 dv-cinder-819011-1-iscsi neutron-server[102995]: DEBUG neutron.db.l3_hamode_db [None req-37d881bd-a79f-4808-b693-7a529defc2db None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-819011-1-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-11-23T19:25:14Z,description=,heartbeat_timestamp=2021-11-23T19:37:14Z,host='dv-cinder-819011-1-iscsi',id=1b20f2c4-70b6-43c3-b9bd-0062cc9e57ac,load=0,resource_versions=,resources_synced=,started_at=2021-11-23T19:25:15Z,topic='l3_agent')) {'router_ids': ['3524bcbc-06d6-4343-84f5-54d756e6dd80'], 'active': True} {{(pid=102995) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 23 19:37:23.136227 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-8b7ce163-367c-48b4-ad80-743b82d2d05c req-ed65cfce-de3e-4da7-93f9-1fbda720369a service neutron] 10.222.0.41 "GET /v2.0/networks/41fa5020-8aad-49ce-b2a6-39d87c9e6042?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1370952 Nov 23 19:37:23.269733 dv-cinder-819011-1-iscsi neutron-server[102995]: DEBUG neutron.db.l3_dvr_db [None req-37d881bd-a79f-4808-b693-7a529defc2db None None] Set router 3524bcbc-06d6-4343-84f5-54d756e6dd80 gateway port host: dv-cinder-819011-1-iscsi {{(pid=102995) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 23 19:37:23.414460 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-635c465d-0e3a-4189-ab83-70010d094d41 req-4ed065a6-1eba-4933-a39e-ff815bc727b5 tempest-AttachVolumeTestJSON-1120920040 tempest-AttachVolumeTestJSON-1120920040-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102993) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:37:23.415558 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-635c465d-0e3a-4189-ab83-70010d094d41 req-4ed065a6-1eba-4933-a39e-ff815bc727b5 tempest-AttachVolumeTestJSON-1120920040 tempest-AttachVolumeTestJSON-1120920040-project] 10.222.0.62 "GET /v2.0/ports?device_id=029fedce-3168-4d1d-992e-a9466fe3e886 HTTP/1.1" status: 200 len: 943 time: 0.0838397 Nov 23 19:37:23.481214 dv-cinder-819011-1-iscsi neutron-server[102995]: DEBUG neutron.db.l3_hamode_db [None req-37d881bd-a79f-4808-b693-7a529defc2db None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '3524bcbc-06d6-4343-84f5-54d756e6dd80', 'name': 'tempest-TestShelveInstance-670557749-router', 'tenant_id': '35f8a5017a27449084aabd12f27f5a8a', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'a93e254e-aac9-4233-9e4d-4290fd0458e4', 'external_fixed_ips': [{'subnet_id': 'e0b32f3d-83d6-439a-bbed-01df7cf01051', 'ip_address': '172.27.1.194'}], 'enable_snat': True}, 'gw_port_id': 'abd59c5e-8249-4aba-855f-bf3ed33724b6', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-23T19:37:15Z', 'updated_at': '2021-11-23T19:37:18Z', 'revision_number': 4, 'project_id': '35f8a5017a27449084aabd12f27f5a8a', 'gw_port': {'id': 'abd59c5e-8249-4aba-855f-bf3ed33724b6', 'name': '', 'network_id': 'a93e254e-aac9-4233-9e4d-4290fd0458e4', 'tenant_id': '', 'mac_address': 'fa:16:3e:d7:89:48', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '3524bcbc-06d6-4343-84f5-54d756e6dd80', 'device_owner': 'network:router_gateway', 'standard_attr_id': 515, 'fixed_ips': [{'subnet_id': 'e0b32f3d-83d6-439a-bbed-01df7cf01051', 'ip_address': '172.27.1.194', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-819011-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-23T19:37:16Z', 'updated_at': '2021-11-23T19:37:22Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'e0b32f3d-83d6-439a-bbed-01df7cf01051', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-819011-1-iscsi', '_interfaces': [{'id': 'e277d91a-2f3d-4a95-80af-b6e6c458ebab', 'name': '', 'network_id': '87e46ab6-0f90-430f-930f-9ea1580c04c3', 'tenant_id': '35f8a5017a27449084aabd12f27f5a8a', 'mac_address': 'fa:16:3e:42:84:c0', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '3524bcbc-06d6-4343-84f5-54d756e6dd80', 'device_owner': 'network:router_interface', 'standard_attr_id': 517, 'fixed_ips': [{'subnet_id': 'afa5bc59-f70c-409d-8c15-be2dcdce66a3', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-23T19:37:18Z', 'updated_at': '2021-11-23T19:37:19Z', 'revision_number': 2, 'project_id': '35f8a5017a27449084aabd12f27f5a8a', 'subnets': [{'id': 'afa5bc59-f70c-409d-8c15-be2dcdce66a3', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-819011-1-iscsi', False) {} {{(pid=102995) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 23 19:37:23.520761 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-635c465d-0e3a-4189-ab83-70010d094d41 req-e97df6fc-4c7a-48bf-8726-fb83840c69a7 tempest-AttachVolumeTestJSON-1120920040 tempest-AttachVolumeTestJSON-1120920040-project] 10.222.0.62 "GET /v2.0/security-groups?id=f8cf4027-ad94-4b78-b429-c3f2d7f9d324&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0957909 Nov 23 19:37:23.533942 dv-cinder-819011-1-iscsi neutron-server[102995]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-37d881bd-a79f-4808-b693-7a529defc2db None None] Checking router: 3524bcbc-06d6-4343-84f5-54d756e6dd80 for host: dv-cinder-819011-1-iscsi {{(pid=102995) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 23 19:37:23.534809 dv-cinder-819011-1-iscsi neutron-server[102995]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-37d881bd-a79f-4808-b693-7a529defc2db None None] Updating router 3524bcbc-06d6-4343-84f5-54d756e6dd80 port e277d91a-2f3d-4a95-80af-b6e6c458ebab binding host dv-cinder-819011-1-iscsi {{(pid=102995) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Nov 23 19:37:23.560765 dv-cinder-819011-1-iscsi neutron-server[102995]: DEBUG neutron_lib.callbacks.manager [None req-37d881bd-a79f-4808-b693-7a529defc2db None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7921281'] for port, before_update {{(pid=102995) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:37:23.576390 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-8b961f84-796c-4276-a67c-9b295e2d66f3 admin admin] Publish callbacks [] for router_gateway, after_create {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:37:23.799250 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-8b961f84-796c-4276-a67c-9b295e2d66f3 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-932875', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-926501'] for router, after_create {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:37:23.835991 dv-cinder-819011-1-iscsi neutron-server[102995]: DEBUG neutron_lib.callbacks.manager [None req-37d881bd-a79f-4808-b693-7a529defc2db None None] Publish callbacks [] for port, precommit_update {{(pid=102995) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:37:23.887405 dv-cinder-819011-1-iscsi neutron-server[102995]: DEBUG neutron_lib.callbacks.manager [None req-37d881bd-a79f-4808-b693-7a529defc2db None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7918660', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-15067', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560168', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8783631423946', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8783631008732', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8783631008750'] for port, after_update {{(pid=102995) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:37:23.932631 dv-cinder-819011-1-iscsi neutron-server[102995]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c5e54fd6-8b2b-436a-97fe-11f78dbf6140 None None] Pushing event updated for resources: {'Port': ['ID=e277d91a-2f3d-4a95-80af-b6e6c458ebab,revision_number=3']} {{(pid=102995) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 23 19:37:23.999118 dv-cinder-819011-1-iscsi neutron-server[102995]: DEBUG neutron.plugins.ml2.managers [None req-37d881bd-a79f-4808-b693-7a529defc2db None None] Attempting to bind port e277d91a-2f3d-4a95-80af-b6e6c458ebab on host dv-cinder-819011-1-iscsi for vnic_type normal with profile {{(pid=102995) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 23 19:37:23.999584 dv-cinder-819011-1-iscsi neutron-server[102995]: DEBUG neutron.plugins.ml2.managers [None req-37d881bd-a79f-4808-b693-7a529defc2db None None] Attempting to bind port e277d91a-2f3d-4a95-80af-b6e6c458ebab by drivers openvswitch,hyperv on host dv-cinder-819011-1-iscsi at level 0 using segments [{'id': '5c30b9a1-7b41-4664-aa24-084baf66a2d5', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 817, 'network_id': '87e46ab6-0f90-430f-930f-9ea1580c04c3'}] {{(pid=102995) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 23 19:37:23.999853 dv-cinder-819011-1-iscsi neutron-server[102995]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-37d881bd-a79f-4808-b693-7a529defc2db None None] Attempting to bind port e277d91a-2f3d-4a95-80af-b6e6c458ebab on network 87e46ab6-0f90-430f-930f-9ea1580c04c3 {{(pid=102995) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 23 19:37:24.001802 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-8b961f84-796c-4276-a67c-9b295e2d66f3 admin admin] Router 7d0a2886-ab9d-4826-872e-c085fa7372ce is scheduled to L3 agent 1b20f2c4-70b6-43c3-b9bd-0062cc9e57ac with binding_index 1 {{(pid=102993) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Nov 23 19:37:24.005547 dv-cinder-819011-1-iscsi neutron-server[102995]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-37d881bd-a79f-4808-b693-7a529defc2db None None] Checking agent: {'id': '668c8953-047c-499e-8c0d-db838fac1668', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-819011-1-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 23, 19, 25, 17), 'started_at': datetime.datetime(2021, 11, 23, 19, 25, 47), 'heartbeat_timestamp': datetime.datetime(2021, 11, 23, 19, 37, 17), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-819011-1-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=102995) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 23 19:37:24.005930 dv-cinder-819011-1-iscsi neutron-server[102995]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-37d881bd-a79f-4808-b693-7a529defc2db None None] Checking segment: {'id': '5c30b9a1-7b41-4664-aa24-084baf66a2d5', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 817, 'network_id': '87e46ab6-0f90-430f-930f-9ea1580c04c3'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102995) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 23 19:37:24.006356 dv-cinder-819011-1-iscsi neutron-server[102995]: DEBUG neutron_lib.callbacks.manager [None req-37d881bd-a79f-4808-b693-7a529defc2db None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=102995) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:37:24.006751 dv-cinder-819011-1-iscsi neutron-server[102995]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-37d881bd-a79f-4808-b693-7a529defc2db None None] Bound using segment: {'id': '5c30b9a1-7b41-4664-aa24-084baf66a2d5', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 817, 'network_id': '87e46ab6-0f90-430f-930f-9ea1580c04c3'} {{(pid=102995) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 23 19:37:24.007228 dv-cinder-819011-1-iscsi neutron-server[102995]: DEBUG neutron.plugins.ml2.managers [None req-37d881bd-a79f-4808-b693-7a529defc2db None None] Bound port: e277d91a-2f3d-4a95-80af-b6e6c458ebab, host: dv-cinder-819011-1-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '5c30b9a1-7b41-4664-aa24-084baf66a2d5', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 817, 'network_id': '87e46ab6-0f90-430f-930f-9ea1580c04c3'}}] {{(pid=102995) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 23 19:37:24.007630 dv-cinder-819011-1-iscsi neutron-server[102995]: DEBUG neutron_lib.callbacks.manager [None req-37d881bd-a79f-4808-b693-7a529defc2db None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7921281'] for port, before_update {{(pid=102995) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:37:24.058047 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-094b77c2-26be-408f-9c11-2a24ef65d69b None None] Network f85fa999-4237-44ad-8898-e5b57905b92f requested from dv-cinder-819011-1-iscsi {{(pid=102994) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 23 19:37:24.120806 dv-cinder-819011-1-iscsi neutron-server[102995]: DEBUG neutron.plugins.ml2.db [None req-37d881bd-a79f-4808-b693-7a529defc2db None None] For port e277d91a-2f3d-4a95-80af-b6e6c458ebab, host dv-cinder-819011-1-iscsi, cleared binding levels {{(pid=102995) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 23 19:37:24.125793 dv-cinder-819011-1-iscsi neutron-server[102995]: DEBUG neutron.plugins.ml2.db [None req-37d881bd-a79f-4808-b693-7a529defc2db None None] For port e277d91a-2f3d-4a95-80af-b6e6c458ebab, host dv-cinder-819011-1-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-819011-1-iscsi',level=0,port_id=e277d91a-2f3d-4a95-80af-b6e6c458ebab,segment=NetworkSegment(5c30b9a1-7b41-4664-aa24-084baf66a2d5),segment_id=5c30b9a1-7b41-4664-aa24-084baf66a2d5)] {{(pid=102995) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 23 19:37:24.154835 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.plugins.ml2.rpc [None req-eb87b2c3-3339-4249-8b85-e695b5b4e1f9 None None] Device 3b694ca8-b637-46fe-addf-211dc47247ae up at agent ovs-agent-dv-cinder-819011-1-iscsi {{(pid=102994) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 23 19:37:24.168577 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-8b961f84-796c-4276-a67c-9b295e2d66f3 admin admin] Notify agent at l3_agent.dv-cinder-819011-1-iscsi the message routers_updated {{(pid=102993) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 23 19:37:24.188980 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-82c956f4-7a98-4cf8-947a-54fc45a0028c None None] Sync routers for ids ['7d0a2886-ab9d-4826-872e-c085fa7372ce'] in dv-cinder-819011-1-iscsi {{(pid=102994) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 23 19:37:24.201565 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.db.provisioning_blocks [None req-5940f2fd-c9d6-4c64-8a6e-90db367dab29 None None] Provisioning complete for port 3b694ca8-b637-46fe-addf-211dc47247ae triggered by entity DHCP. {{(pid=102994) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 23 19:37:24.201947 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron_lib.callbacks.manager [None req-5940f2fd-c9d6-4c64-8a6e-90db367dab29 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-8355713'] for port, provisioning_complete {{(pid=102994) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:37:24.207442 dv-cinder-819011-1-iscsi neutron-server[102995]: DEBUG neutron_lib.callbacks.manager [None req-37d881bd-a79f-4808-b693-7a529defc2db None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7918660', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-15067', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560168', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8783631423946', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8783631008732', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8783631008750'] for port, after_update {{(pid=102995) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:37:24.251923 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-8b961f84-796c-4276-a67c-9b295e2d66f3 admin admin] Publish callbacks [] for router, before_response {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:37:24.255608 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [None req-8b961f84-796c-4276-a67c-9b295e2d66f3 admin admin] 10.222.0.62 "POST /v2.0/routers HTTP/1.1" status: 201 len: 921 time: 2.4774125 Nov 23 19:37:24.255804 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.db.l3_dvrscheduler_db [None req-82c956f4-7a98-4cf8-947a-54fc45a0028c None None] Routers {'7d0a2886-ab9d-4826-872e-c085fa7372ce'} bound to L3 agent in host dv-cinder-819011-1-iscsi {{(pid=102994) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 23 19:37:24.255979 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.wsgi [-] (102992) accepted ('10.222.0.62', 48214) {{(pid=102992) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 23 19:37:24.263470 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.db.l3_hamode_db [None req-82c956f4-7a98-4cf8-947a-54fc45a0028c None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-819011-1-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-11-23T19:25:14Z,description=,heartbeat_timestamp=2021-11-23T19:37:14Z,host='dv-cinder-819011-1-iscsi',id=1b20f2c4-70b6-43c3-b9bd-0062cc9e57ac,load=0,resource_versions=,resources_synced=,started_at=2021-11-23T19:25:15Z,topic='l3_agent')) {'router_ids': ['7d0a2886-ab9d-4826-872e-c085fa7372ce'], 'active': True} {{(pid=102994) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 23 19:37:24.276409 dv-cinder-819011-1-iscsi neutron-server[102995]: DEBUG neutron.db.l3_dvrscheduler_db [None req-37d881bd-a79f-4808-b693-7a529defc2db None None] Routers {'3524bcbc-06d6-4343-84f5-54d756e6dd80'} bound to L3 agent in host dv-cinder-819011-1-iscsi {{(pid=102995) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 23 19:37:24.277287 dv-cinder-819011-1-iscsi neutron-server[102995]: DEBUG neutron.db.l3_hamode_db [None req-37d881bd-a79f-4808-b693-7a529defc2db None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-819011-1-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-11-23T19:25:14Z,description=,heartbeat_timestamp=2021-11-23T19:37:14Z,host='dv-cinder-819011-1-iscsi',id=1b20f2c4-70b6-43c3-b9bd-0062cc9e57ac,load=0,resource_versions=,resources_synced=,started_at=2021-11-23T19:25:15Z,topic='l3_agent')) {'router_ids': ['3524bcbc-06d6-4343-84f5-54d756e6dd80'], 'active': True} {{(pid=102995) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 23 19:37:24.327981 dv-cinder-819011-1-iscsi neutron-server[102995]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c5e54fd6-8b2b-436a-97fe-11f78dbf6140 None None] Pushing event updated for resources: {'Port': ['ID=e277d91a-2f3d-4a95-80af-b6e6c458ebab,revision_number=4']} {{(pid=102995) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 23 19:37:24.430168 dv-cinder-819011-1-iscsi neutron-server[102995]: DEBUG neutron.db.l3_dvr_db [None req-37d881bd-a79f-4808-b693-7a529defc2db None None] Set router 3524bcbc-06d6-4343-84f5-54d756e6dd80 gateway port host: dv-cinder-819011-1-iscsi {{(pid=102995) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 23 19:37:24.462139 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.db.provisioning_blocks [None req-eb87b2c3-3339-4249-8b85-e695b5b4e1f9 None None] Provisioning complete for port 3b694ca8-b637-46fe-addf-211dc47247ae triggered by entity L2. {{(pid=102994) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 23 19:37:24.462702 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron_lib.callbacks.manager [None req-eb87b2c3-3339-4249-8b85-e695b5b4e1f9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-8355713'] for port, provisioning_complete {{(pid=102994) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:37:24.614785 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.db.l3_dvr_db [None req-82c956f4-7a98-4cf8-947a-54fc45a0028c None None] Set router 7d0a2886-ab9d-4826-872e-c085fa7372ce gateway port host: dv-cinder-819011-1-iscsi {{(pid=102994) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 23 19:37:24.681037 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron_lib.callbacks.manager [None req-5940f2fd-c9d6-4c64-8a6e-90db367dab29 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7921281'] for port, before_update {{(pid=102994) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:37:24.821225 dv-cinder-819011-1-iscsi neutron-server[102995]: DEBUG neutron.db.l3_hamode_db [None req-37d881bd-a79f-4808-b693-7a529defc2db None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '3524bcbc-06d6-4343-84f5-54d756e6dd80', 'name': 'tempest-TestShelveInstance-670557749-router', 'tenant_id': '35f8a5017a27449084aabd12f27f5a8a', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'a93e254e-aac9-4233-9e4d-4290fd0458e4', 'external_fixed_ips': [{'subnet_id': 'e0b32f3d-83d6-439a-bbed-01df7cf01051', 'ip_address': '172.27.1.194'}], 'enable_snat': True}, 'gw_port_id': 'abd59c5e-8249-4aba-855f-bf3ed33724b6', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-23T19:37:15Z', 'updated_at': '2021-11-23T19:37:18Z', 'revision_number': 4, 'project_id': '35f8a5017a27449084aabd12f27f5a8a', 'gw_port': {'id': 'abd59c5e-8249-4aba-855f-bf3ed33724b6', 'name': '', 'network_id': 'a93e254e-aac9-4233-9e4d-4290fd0458e4', 'tenant_id': '', 'mac_address': 'fa:16:3e:d7:89:48', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '3524bcbc-06d6-4343-84f5-54d756e6dd80', 'device_owner': 'network:router_gateway', 'standard_attr_id': 515, 'fixed_ips': [{'subnet_id': 'e0b32f3d-83d6-439a-bbed-01df7cf01051', 'ip_address': '172.27.1.194', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-819011-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-23T19:37:16Z', 'updated_at': '2021-11-23T19:37:22Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'e0b32f3d-83d6-439a-bbed-01df7cf01051', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-819011-1-iscsi', '_interfaces': [{'id': 'e277d91a-2f3d-4a95-80af-b6e6c458ebab', 'name': '', 'network_id': '87e46ab6-0f90-430f-930f-9ea1580c04c3', 'tenant_id': '35f8a5017a27449084aabd12f27f5a8a', 'mac_address': 'fa:16:3e:42:84:c0', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '3524bcbc-06d6-4343-84f5-54d756e6dd80', 'device_owner': 'network:router_interface', 'standard_attr_id': 517, 'fixed_ips': [{'subnet_id': 'afa5bc59-f70c-409d-8c15-be2dcdce66a3', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-819011-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-23T19:37:18Z', 'updated_at': '2021-11-23T19:37:24Z', 'revision_number': 4, 'project_id': '35f8a5017a27449084aabd12f27f5a8a', 'subnets': [{'id': 'afa5bc59-f70c-409d-8c15-be2dcdce66a3', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-819011-1-iscsi', False) {} {{(pid=102995) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 23 19:37:24.827980 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.plugins.ml2.db [None req-5940f2fd-c9d6-4c64-8a6e-90db367dab29 None None] For port 3b694ca8-b637-46fe-addf-211dc47247ae, host dv-cinder-819011-1-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-819011-1-iscsi',level=0,port_id=3b694ca8-b637-46fe-addf-211dc47247ae,segment=NetworkSegment(a6451c29-fea7-487e-9bb2-6a8e36a6bb38),segment_id=a6451c29-fea7-487e-9bb2-6a8e36a6bb38)] {{(pid=102994) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 23 19:37:24.862375 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron_lib.callbacks.manager [None req-eb87b2c3-3339-4249-8b85-e695b5b4e1f9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7921281'] for port, before_update {{(pid=102994) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:37:24.863620 dv-cinder-819011-1-iscsi neutron-server[102995]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-37d881bd-a79f-4808-b693-7a529defc2db None None] The sync data for ids ['3524bcbc-06d6-4343-84f5-54d756e6dd80'] in dv-cinder-819011-1-iscsi is: [{'id': '3524bcbc-06d6-4343-84f5-54d756e6dd80', 'name': 'tempest-TestShelveInstance-670557749-router', 'tenant_id': '35f8a5017a27449084aabd12f27f5a8a', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'a93e254e-aac9-4233-9e4d-4290fd0458e4', 'external_fixed_ips': [{'subnet_id': 'e0b32f3d-83d6-439a-bbed-01df7cf01051', 'ip_address': '172.27.1.194'}], 'enable_snat': True}, 'gw_port_id': 'abd59c5e-8249-4aba-855f-bf3ed33724b6', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-23T19:37:15Z', 'updated_at': '2021-11-23T19:37:18Z', 'revision_number': 4, 'project_id': '35f8a5017a27449084aabd12f27f5a8a', 'gw_port': {'id': 'abd59c5e-8249-4aba-855f-bf3ed33724b6', 'name': '', 'network_id': 'a93e254e-aac9-4233-9e4d-4290fd0458e4', 'tenant_id': '', 'mac_address': 'fa:16:3e:d7:89:48', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '3524bcbc-06d6-4343-84f5-54d756e6dd80', 'device_owner': 'network:router_gateway', 'standard_attr_id': 515, 'fixed_ips': [{'subnet_id': 'e0b32f3d-83d6-439a-bbed-01df7cf01051', 'ip_address': '172.27.1.194', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-819011-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-23T19:37:16Z', 'updated_at': '2021-11-23T19:37:22Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'e0b32f3d-83d6-439a-bbed-01df7cf01051', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-819011-1-iscsi', '_interfaces': [{'id': 'e277d91a-2f3d-4a95-80af-b6e6c458ebab', 'name': '', 'network_id': '87e46ab6-0f90-430f-930f-9ea1580c04c3', 'tenant_id': '35f8a5017a27449084aabd12f27f5a8a', 'mac_address': 'fa:16:3e:42:84:c0', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '3524bcbc-06d6-4343-84f5-54d756e6dd80', 'device_owner': 'network:router_interface', 'standard_attr_id': 517, 'fixed_ips': [{'subnet_id': 'afa5bc59-f70c-409d-8c15-be2dcdce66a3', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-819011-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-23T19:37:18Z', 'updated_at': '2021-11-23T19:37:24Z', 'revision_number': 4, 'project_id': '35f8a5017a27449084aabd12f27f5a8a', 'subnets': [{'id': 'afa5bc59-f70c-409d-8c15-be2dcdce66a3', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=102995) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 23 19:37:24.904996 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron_lib.callbacks.manager [None req-5940f2fd-c9d6-4c64-8a6e-90db367dab29 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7918660', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-15067', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560168', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8783631423946', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8783631008732', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8783631008750'] for port, after_update {{(pid=102994) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:37:25.010431 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-377a8472-f244-4b70-94aa-76bf1bbc3616 req-829139eb-5dcd-4f90-9e04-7e4d1a4264ce tempest-AttachVolumeTestJSON-1120920040 tempest-AttachVolumeTestJSON-1120920040-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102992) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:37:25.011914 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-377a8472-f244-4b70-94aa-76bf1bbc3616 req-829139eb-5dcd-4f90-9e04-7e4d1a4264ce tempest-AttachVolumeTestJSON-1120920040 tempest-AttachVolumeTestJSON-1120920040-project] 10.222.0.62 "GET /v2.0/ports?device_id=029fedce-3168-4d1d-992e-a9466fe3e886 HTTP/1.1" status: 200 len: 943 time: 0.1292846 Nov 23 19:37:25.028595 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5940f2fd-c9d6-4c64-8a6e-90db367dab29 None None] Pushing event updated for resources: {'Port': ['ID=3b694ca8-b637-46fe-addf-211dc47247ae,revision_number=3']} {{(pid=102994) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 23 19:37:25.034185 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron_lib.db.api [None req-eb87b2c3-3339-4249-8b85-e695b5b4e1f9 None None] Retry wrapper got retriable exception: UPDATE statement on table 'standardattributes' expected to update 1 row(s); 0 were matched. {{(pid=102994) wrapped /usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py:183}} Nov 23 19:37:25.034540 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG oslo_db.api [None req-eb87b2c3-3339-4249-8b85-e695b5b4e1f9 None None] Performing DB retry for function neutron.plugins.ml2.plugin.Ml2Plugin.update_port_statuses {{(pid=102994) wrapper /usr/local/lib/python3.8/dist-packages/oslo_db/api.py:155}} Nov 23 19:37:25.042502 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.db.l3_hamode_db [None req-82c956f4-7a98-4cf8-947a-54fc45a0028c None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '7d0a2886-ab9d-4826-872e-c085fa7372ce', 'name': 'tempest-TestShelveInstance-1814897973-router', 'tenant_id': '2782edd0ce0e455b825d4fa9efd24221', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'a93e254e-aac9-4233-9e4d-4290fd0458e4', 'external_fixed_ips': [{'subnet_id': 'e0b32f3d-83d6-439a-bbed-01df7cf01051', 'ip_address': '172.27.1.217'}], 'enable_snat': True}, 'gw_port_id': '6f678090-b3f3-474e-8c77-32f412c39e45', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-23T19:37:21Z', 'updated_at': '2021-11-23T19:37:23Z', 'revision_number': 3, 'project_id': '2782edd0ce0e455b825d4fa9efd24221', 'gw_port': {'id': '6f678090-b3f3-474e-8c77-32f412c39e45', 'name': '', 'network_id': 'a93e254e-aac9-4233-9e4d-4290fd0458e4', 'tenant_id': '', 'mac_address': 'fa:16:3e:bd:9a:bb', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '7d0a2886-ab9d-4826-872e-c085fa7372ce', 'device_owner': 'network:router_gateway', 'standard_attr_id': 528, 'fixed_ips': [{'subnet_id': 'e0b32f3d-83d6-439a-bbed-01df7cf01051', 'ip_address': '172.27.1.217', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-23T19:37:22Z', 'updated_at': '2021-11-23T19:37:22Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': 'e0b32f3d-83d6-439a-bbed-01df7cf01051', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-819011-1-iscsi'}], 'dv-cinder-819011-1-iscsi', False) {} {{(pid=102994) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 23 19:37:25.075591 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-82c956f4-7a98-4cf8-947a-54fc45a0028c None None] Checking router: 7d0a2886-ab9d-4826-872e-c085fa7372ce for host: dv-cinder-819011-1-iscsi {{(pid=102994) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 23 19:37:25.076263 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-82c956f4-7a98-4cf8-947a-54fc45a0028c None None] Updating router 7d0a2886-ab9d-4826-872e-c085fa7372ce port 6f678090-b3f3-474e-8c77-32f412c39e45 binding host dv-cinder-819011-1-iscsi {{(pid=102994) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Nov 23 19:37:25.077979 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.db.provisioning_blocks [None req-6b0537a0-a293-4160-b10f-a69d96080519 None None] Provisioning complete for port 3b694ca8-b637-46fe-addf-211dc47247ae triggered by entity DHCP. {{(pid=102994) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 23 19:37:25.078999 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron_lib.callbacks.manager [None req-6b0537a0-a293-4160-b10f-a69d96080519 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-8355713'] for port, provisioning_complete {{(pid=102994) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:37:25.101208 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-377a8472-f244-4b70-94aa-76bf1bbc3616 req-3b5e17d6-c0df-4bdb-8be9-da6bda9dcf43 tempest-AttachVolumeTestJSON-1120920040 tempest-AttachVolumeTestJSON-1120920040-project] 10.222.0.62 "GET /v2.0/security-groups?id=f8cf4027-ad94-4b78-b429-c3f2d7f9d324&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0811079 Nov 23 19:37:25.132553 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron_lib.callbacks.manager [None req-82c956f4-7a98-4cf8-947a-54fc45a0028c None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7921281'] for port, before_update {{(pid=102994) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:37:25.139606 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [None req-27613fd8-4f63-43e1-90ff-933b88387ca4 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7921281'] for port, before_create {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:37:25.305022 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.db.db_base_plugin_common [None req-27613fd8-4f63-43e1-90ff-933b88387ca4 admin admin] Allocated IP 172.20.0.1 (f85fa999-4237-44ad-8898-e5b57905b92f/baa3c93e-8af6-411c-80fd-fd8f5df6bde9/6316de48-e729-4e1a-8557-06a3ec7c6a4a) {{(pid=102992) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 23 19:37:25.345281 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.db.provisioning_blocks [None req-6b0537a0-a293-4160-b10f-a69d96080519 None None] Provisioning complete for port e277d91a-2f3d-4a95-80af-b6e6c458ebab triggered by entity DHCP. {{(pid=102994) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 23 19:37:25.345589 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron_lib.callbacks.manager [None req-6b0537a0-a293-4160-b10f-a69d96080519 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-8355713'] for port, provisioning_complete {{(pid=102994) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:37:25.419290 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [None req-27613fd8-4f63-43e1-90ff-933b88387ca4 admin admin] Publish callbacks [] for port, precommit_create {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:37:25.511416 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [None req-27613fd8-4f63-43e1-90ff-933b88387ca4 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7918660', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-15067', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560168', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8783631008714', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-25199805'] for port, after_create {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:37:25.569033 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-27613fd8-4f63-43e1-90ff-933b88387ca4 admin admin] Network f85fa999-4237-44ad-8898-e5b57905b92f is already hosted by enough agents. {{(pid=102992) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 23 19:37:25.574493 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.scheduler.base_scheduler [None req-27613fd8-4f63-43e1-90ff-933b88387ca4 admin admin] Resources bound (agent type, host, resource id): {{(pid=102992) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 23 19:37:25.580709 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.db.l3_dvrscheduler_db [None req-27613fd8-4f63-43e1-90ff-933b88387ca4 admin admin] Received port after_create {{(pid=102992) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 23 19:37:25.587026 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-27613fd8-4f63-43e1-90ff-933b88387ca4 admin admin] Pushing event updated for resources: {'Port': ['ID=6316de48-e729-4e1a-8557-06a3ec7c6a4a,revision_number=1']} {{(pid=102992) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 23 19:37:25.653792 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [None req-27613fd8-4f63-43e1-90ff-933b88387ca4 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-926676'] for router_interface, before_create {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:37:25.662171 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.plugins.ml2.rpc [None req-eb87b2c3-3339-4249-8b85-e695b5b4e1f9 None None] Device abd59c5e-8249-4aba-855f-bf3ed33724b6 up at agent ovs-agent-dv-cinder-819011-1-iscsi {{(pid=102994) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 23 19:37:25.664961 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron_lib.callbacks.manager [None req-82c956f4-7a98-4cf8-947a-54fc45a0028c None None] Publish callbacks [] for port, precommit_update {{(pid=102994) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:37:25.667575 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron_lib.callbacks.manager [None req-6b0537a0-a293-4160-b10f-a69d96080519 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7921281'] for port, before_update {{(pid=102994) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:37:25.728975 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.plugins.ml2.db [None req-6b0537a0-a293-4160-b10f-a69d96080519 None None] For port e277d91a-2f3d-4a95-80af-b6e6c458ebab, host dv-cinder-819011-1-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-819011-1-iscsi',level=0,port_id=e277d91a-2f3d-4a95-80af-b6e6c458ebab,segment=NetworkSegment(5c30b9a1-7b41-4664-aa24-084baf66a2d5),segment_id=5c30b9a1-7b41-4664-aa24-084baf66a2d5)] {{(pid=102994) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 23 19:37:25.741658 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.db.provisioning_blocks [None req-eb87b2c3-3339-4249-8b85-e695b5b4e1f9 None None] Provisioning complete for port abd59c5e-8249-4aba-855f-bf3ed33724b6 triggered by entity L2. {{(pid=102994) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 23 19:37:25.742029 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron_lib.callbacks.manager [None req-eb87b2c3-3339-4249-8b85-e695b5b4e1f9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-8355713'] for port, provisioning_complete {{(pid=102994) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:37:25.763741 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron_lib.callbacks.manager [None req-82c956f4-7a98-4cf8-947a-54fc45a0028c None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7918660', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-15067', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560168', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8783631423946', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8783631008732', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8783631008750'] for port, after_update {{(pid=102994) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:37:25.804311 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron_lib.callbacks.manager [None req-6b0537a0-a293-4160-b10f-a69d96080519 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7918660', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-15067', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560168', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8783631423946', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8783631008732', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8783631008750'] for port, after_update {{(pid=102994) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:37:25.836041 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e5c17790-8d7d-4023-86e4-1b8e311cffeb None None] Pushing event updated for resources: {'Port': ['ID=6f678090-b3f3-474e-8c77-32f412c39e45,revision_number=2']} {{(pid=102994) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 23 19:37:25.838278 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.plugins.ml2.managers [None req-82c956f4-7a98-4cf8-947a-54fc45a0028c None None] Attempting to bind port 6f678090-b3f3-474e-8c77-32f412c39e45 on host dv-cinder-819011-1-iscsi for vnic_type normal with profile {{(pid=102994) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 23 19:37:25.838645 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.plugins.ml2.managers [None req-82c956f4-7a98-4cf8-947a-54fc45a0028c None None] Attempting to bind port 6f678090-b3f3-474e-8c77-32f412c39e45 by drivers openvswitch,hyperv on host dv-cinder-819011-1-iscsi at level 0 using segments [{'id': '3cb5e60b-103a-47d0-a28b-d68e3159d032', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'a93e254e-aac9-4233-9e4d-4290fd0458e4'}] {{(pid=102994) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 23 19:37:25.839012 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-82c956f4-7a98-4cf8-947a-54fc45a0028c None None] Attempting to bind port 6f678090-b3f3-474e-8c77-32f412c39e45 on network a93e254e-aac9-4233-9e4d-4290fd0458e4 {{(pid=102994) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 23 19:37:25.862339 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [None req-27613fd8-4f63-43e1-90ff-933b88387ca4 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7921281'] for port, before_update {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:37:25.868362 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-82c956f4-7a98-4cf8-947a-54fc45a0028c None None] Checking agent: {'id': '668c8953-047c-499e-8c0d-db838fac1668', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-819011-1-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 23, 19, 25, 17), 'started_at': datetime.datetime(2021, 11, 23, 19, 25, 47), 'heartbeat_timestamp': datetime.datetime(2021, 11, 23, 19, 37, 17), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-819011-1-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=102994) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 23 19:37:25.868742 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-82c956f4-7a98-4cf8-947a-54fc45a0028c None None] Checking segment: {'id': '3cb5e60b-103a-47d0-a28b-d68e3159d032', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'a93e254e-aac9-4233-9e4d-4290fd0458e4'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102994) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 23 19:37:25.869135 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron_lib.callbacks.manager [None req-82c956f4-7a98-4cf8-947a-54fc45a0028c None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=102994) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:37:25.869549 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-82c956f4-7a98-4cf8-947a-54fc45a0028c None None] Bound using segment: {'id': '3cb5e60b-103a-47d0-a28b-d68e3159d032', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'a93e254e-aac9-4233-9e4d-4290fd0458e4'} {{(pid=102994) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 23 19:37:25.870028 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.plugins.ml2.managers [None req-82c956f4-7a98-4cf8-947a-54fc45a0028c None None] Bound port: 6f678090-b3f3-474e-8c77-32f412c39e45, host: dv-cinder-819011-1-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '3cb5e60b-103a-47d0-a28b-d68e3159d032', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'a93e254e-aac9-4233-9e4d-4290fd0458e4'}}] {{(pid=102994) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 23 19:37:25.870405 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron_lib.callbacks.manager [None req-82c956f4-7a98-4cf8-947a-54fc45a0028c None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7921281'] for port, before_update {{(pid=102994) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:37:25.972401 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6b0537a0-a293-4160-b10f-a69d96080519 None None] Pushing event updated for resources: {'Port': ['ID=e277d91a-2f3d-4a95-80af-b6e6c458ebab,revision_number=5']} {{(pid=102994) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 23 19:37:25.983686 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.plugins.ml2.db [None req-82c956f4-7a98-4cf8-947a-54fc45a0028c None None] For port 6f678090-b3f3-474e-8c77-32f412c39e45, host dv-cinder-819011-1-iscsi, cleared binding levels {{(pid=102994) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 23 19:37:25.986980 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.plugins.ml2.db [None req-82c956f4-7a98-4cf8-947a-54fc45a0028c None None] For port 6f678090-b3f3-474e-8c77-32f412c39e45, host dv-cinder-819011-1-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-819011-1-iscsi',level=0,port_id=6f678090-b3f3-474e-8c77-32f412c39e45,segment=NetworkSegment(3cb5e60b-103a-47d0-a28b-d68e3159d032),segment_id=3cb5e60b-103a-47d0-a28b-d68e3159d032)] {{(pid=102994) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 23 19:37:25.989891 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.db.provisioning_blocks [None req-009b67f5-9bd7-46ef-b874-1241e7b96920 None None] Provisioning complete for port 6316de48-e729-4e1a-8557-06a3ec7c6a4a triggered by entity DHCP. {{(pid=102994) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 23 19:37:25.990273 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron_lib.callbacks.manager [None req-009b67f5-9bd7-46ef-b874-1241e7b96920 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-8355713'] for port, provisioning_complete {{(pid=102994) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:37:26.031153 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.plugins.ml2.plugin [None req-009b67f5-9bd7-46ef-b874-1241e7b96920 None None] Port 6316de48-e729-4e1a-8557-06a3ec7c6a4a cannot update to ACTIVE because it is not bound. {{(pid=102994) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 23 19:37:26.035919 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [None req-27613fd8-4f63-43e1-90ff-933b88387ca4 admin admin] Publish callbacks [] for port, precommit_update {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:37:26.047630 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron_lib.callbacks.manager [None req-82c956f4-7a98-4cf8-947a-54fc45a0028c None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7918660', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-15067', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560168', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8783631423946', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8783631008732', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8783631008750'] for port, after_update {{(pid=102994) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:37:26.076132 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [None req-27613fd8-4f63-43e1-90ff-933b88387ca4 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7918660', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-15067', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560168', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8783631423946', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8783631008732', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8783631008750', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-25199748'] for port, after_update {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:37:26.110038 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.plugins.ml2.rpc [None req-eb87b2c3-3339-4249-8b85-e695b5b4e1f9 None None] Device 3b694ca8-b637-46fe-addf-211dc47247ae up at agent ovs-agent-dv-cinder-819011-1-iscsi {{(pid=102994) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 23 19:37:26.117691 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.db.l3_dvrscheduler_db [None req-82c956f4-7a98-4cf8-947a-54fc45a0028c None None] Routers {'7d0a2886-ab9d-4826-872e-c085fa7372ce'} bound to L3 agent in host dv-cinder-819011-1-iscsi {{(pid=102994) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 23 19:37:26.118324 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.db.l3_hamode_db [None req-82c956f4-7a98-4cf8-947a-54fc45a0028c None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-819011-1-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-11-23T19:25:14Z,description=,heartbeat_timestamp=2021-11-23T19:37:14Z,host='dv-cinder-819011-1-iscsi',id=1b20f2c4-70b6-43c3-b9bd-0062cc9e57ac,load=0,resource_versions=,resources_synced=,started_at=2021-11-23T19:25:15Z,topic='l3_agent')) {'router_ids': ['7d0a2886-ab9d-4826-872e-c085fa7372ce'], 'active': True} {{(pid=102994) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 23 19:37:26.140065 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e5c17790-8d7d-4023-86e4-1b8e311cffeb None None] Pushing event updated for resources: {'Port': ['ID=6f678090-b3f3-474e-8c77-32f412c39e45,revision_number=3']} {{(pid=102994) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 23 19:37:26.154366 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-27613fd8-4f63-43e1-90ff-933b88387ca4 admin admin] Pushing event updated for resources: {'Port': ['ID=6316de48-e729-4e1a-8557-06a3ec7c6a4a,revision_number=2']} {{(pid=102992) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 23 19:37:26.158102 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [None req-27613fd8-4f63-43e1-90ff-933b88387ca4 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-553426', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-932964'] for router_interface, after_create {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:37:26.231471 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3981bea5-a352-460e-8bc2-eab500f1792a req-64c66d84-3a1d-48ca-b897-b89bd52a6e19 tempest-AttachVolumeTestJSON-1120920040 tempest-AttachVolumeTestJSON-1120920040-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102993) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:37:26.232989 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-3981bea5-a352-460e-8bc2-eab500f1792a req-64c66d84-3a1d-48ca-b897-b89bd52a6e19 tempest-AttachVolumeTestJSON-1120920040 tempest-AttachVolumeTestJSON-1120920040-project] 10.222.0.62 "GET /v2.0/ports?device_id=029fedce-3168-4d1d-992e-a9466fe3e886 HTTP/1.1" status: 200 len: 943 time: 0.0502896 Nov 23 19:37:26.259541 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.db.provisioning_blocks [None req-eb87b2c3-3339-4249-8b85-e695b5b4e1f9 None None] Provisioning complete for port 3b694ca8-b637-46fe-addf-211dc47247ae triggered by entity L2. {{(pid=102994) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 23 19:37:26.260059 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron_lib.callbacks.manager [None req-eb87b2c3-3339-4249-8b85-e695b5b4e1f9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-8355713'] for port, provisioning_complete {{(pid=102994) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:37:26.260854 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-27613fd8-4f63-43e1-90ff-933b88387ca4 admin admin] Network f85fa999-4237-44ad-8898-e5b57905b92f is already hosted by enough agents. {{(pid=102992) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 23 19:37:26.262263 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.scheduler.base_scheduler [None req-27613fd8-4f63-43e1-90ff-933b88387ca4 admin admin] Resources bound (agent type, host, resource id): {{(pid=102992) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 23 19:37:26.287796 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.db.l3_dvr_db [None req-82c956f4-7a98-4cf8-947a-54fc45a0028c None None] Set router 7d0a2886-ab9d-4826-872e-c085fa7372ce gateway port host: dv-cinder-819011-1-iscsi {{(pid=102994) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 23 19:37:26.314108 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-3981bea5-a352-460e-8bc2-eab500f1792a req-1a2af959-1833-43da-a60d-0b1eb2fe5920 tempest-AttachVolumeTestJSON-1120920040 tempest-AttachVolumeTestJSON-1120920040-project] 10.222.0.62 "GET /v2.0/security-groups?id=f8cf4027-ad94-4b78-b429-c3f2d7f9d324&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0530422 Nov 23 19:37:26.398176 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-27613fd8-4f63-43e1-90ff-933b88387ca4 admin admin] Router 7d0a2886-ab9d-4826-872e-c085fa7372ce has already been hosted by L3 agent 1b20f2c4-70b6-43c3-b9bd-0062cc9e57ac {{(pid=102992) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 23 19:37:26.470550 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.plugins.ml2.rpc [None req-eb87b2c3-3339-4249-8b85-e695b5b4e1f9 None None] Device e277d91a-2f3d-4a95-80af-b6e6c458ebab up at agent ovs-agent-dv-cinder-819011-1-iscsi {{(pid=102994) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 23 19:37:26.516135 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-27613fd8-4f63-43e1-90ff-933b88387ca4 admin admin] Notify agent at l3_agent.dv-cinder-819011-1-iscsi the message routers_updated {{(pid=102992) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 23 19:37:26.521508 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [None req-27613fd8-4f63-43e1-90ff-933b88387ca4 admin admin] 10.222.0.62 "PUT /v2.0/routers/7d0a2886-ab9d-4826-872e-c085fa7372ce/add_router_interface HTTP/1.1" status: 200 len: 503 time: 2.2641928 Nov 23 19:37:26.579175 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.db.provisioning_blocks [None req-eb87b2c3-3339-4249-8b85-e695b5b4e1f9 None None] Provisioning complete for port e277d91a-2f3d-4a95-80af-b6e6c458ebab triggered by entity L2. {{(pid=102994) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 23 19:37:26.579553 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron_lib.callbacks.manager [None req-eb87b2c3-3339-4249-8b85-e695b5b4e1f9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-8355713'] for port, provisioning_complete {{(pid=102994) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:37:26.583040 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.db.provisioning_blocks [None req-5a4fcf7f-bafb-416d-aa80-a548d8ad9c85 None None] Provisioning complete for port 6316de48-e729-4e1a-8557-06a3ec7c6a4a triggered by entity DHCP. {{(pid=102994) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 23 19:37:26.583441 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron_lib.callbacks.manager [None req-5a4fcf7f-bafb-416d-aa80-a548d8ad9c85 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-8355713'] for port, provisioning_complete {{(pid=102994) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:37:26.663274 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.plugins.ml2.plugin [None req-5a4fcf7f-bafb-416d-aa80-a548d8ad9c85 None None] Port 6316de48-e729-4e1a-8557-06a3ec7c6a4a cannot update to ACTIVE because it is not bound. {{(pid=102994) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 23 19:37:26.670703 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.db.l3_hamode_db [None req-82c956f4-7a98-4cf8-947a-54fc45a0028c None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '7d0a2886-ab9d-4826-872e-c085fa7372ce', 'name': 'tempest-TestShelveInstance-1814897973-router', 'tenant_id': '2782edd0ce0e455b825d4fa9efd24221', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'a93e254e-aac9-4233-9e4d-4290fd0458e4', 'external_fixed_ips': [{'subnet_id': 'e0b32f3d-83d6-439a-bbed-01df7cf01051', 'ip_address': '172.27.1.217'}], 'enable_snat': True}, 'gw_port_id': '6f678090-b3f3-474e-8c77-32f412c39e45', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-23T19:37:21Z', 'updated_at': '2021-11-23T19:37:25Z', 'revision_number': 4, 'project_id': '2782edd0ce0e455b825d4fa9efd24221', 'gw_port': {'id': '6f678090-b3f3-474e-8c77-32f412c39e45', 'name': '', 'network_id': 'a93e254e-aac9-4233-9e4d-4290fd0458e4', 'tenant_id': '', 'mac_address': 'fa:16:3e:bd:9a:bb', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '7d0a2886-ab9d-4826-872e-c085fa7372ce', 'device_owner': 'network:router_gateway', 'standard_attr_id': 528, 'fixed_ips': [{'subnet_id': 'e0b32f3d-83d6-439a-bbed-01df7cf01051', 'ip_address': '172.27.1.217', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-819011-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-23T19:37:22Z', 'updated_at': '2021-11-23T19:37:25Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'e0b32f3d-83d6-439a-bbed-01df7cf01051', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-819011-1-iscsi', '_interfaces': [{'id': '6316de48-e729-4e1a-8557-06a3ec7c6a4a', 'name': '', 'network_id': 'f85fa999-4237-44ad-8898-e5b57905b92f', 'tenant_id': '2782edd0ce0e455b825d4fa9efd24221', 'mac_address': 'fa:16:3e:df:4c:b9', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '7d0a2886-ab9d-4826-872e-c085fa7372ce', 'device_owner': 'network:router_interface', 'standard_attr_id': 529, 'fixed_ips': [{'subnet_id': 'baa3c93e-8af6-411c-80fd-fd8f5df6bde9', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-23T19:37:25Z', 'updated_at': '2021-11-23T19:37:25Z', 'revision_number': 2, 'project_id': '2782edd0ce0e455b825d4fa9efd24221', 'subnets': [{'id': 'baa3c93e-8af6-411c-80fd-fd8f5df6bde9', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-819011-1-iscsi', False) {} {{(pid=102994) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 23 19:37:26.703380 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-82c956f4-7a98-4cf8-947a-54fc45a0028c None None] The sync data for ids ['7d0a2886-ab9d-4826-872e-c085fa7372ce'] in dv-cinder-819011-1-iscsi is: [{'id': '7d0a2886-ab9d-4826-872e-c085fa7372ce', 'name': 'tempest-TestShelveInstance-1814897973-router', 'tenant_id': '2782edd0ce0e455b825d4fa9efd24221', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'a93e254e-aac9-4233-9e4d-4290fd0458e4', 'external_fixed_ips': [{'subnet_id': 'e0b32f3d-83d6-439a-bbed-01df7cf01051', 'ip_address': '172.27.1.217'}], 'enable_snat': True}, 'gw_port_id': '6f678090-b3f3-474e-8c77-32f412c39e45', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-23T19:37:21Z', 'updated_at': '2021-11-23T19:37:25Z', 'revision_number': 4, 'project_id': '2782edd0ce0e455b825d4fa9efd24221', 'gw_port': {'id': '6f678090-b3f3-474e-8c77-32f412c39e45', 'name': '', 'network_id': 'a93e254e-aac9-4233-9e4d-4290fd0458e4', 'tenant_id': '', 'mac_address': 'fa:16:3e:bd:9a:bb', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '7d0a2886-ab9d-4826-872e-c085fa7372ce', 'device_owner': 'network:router_gateway', 'standard_attr_id': 528, 'fixed_ips': [{'subnet_id': 'e0b32f3d-83d6-439a-bbed-01df7cf01051', 'ip_address': '172.27.1.217', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-819011-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-23T19:37:22Z', 'updated_at': '2021-11-23T19:37:25Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'e0b32f3d-83d6-439a-bbed-01df7cf01051', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-819011-1-iscsi', '_interfaces': [{'id': '6316de48-e729-4e1a-8557-06a3ec7c6a4a', 'name': '', 'network_id': 'f85fa999-4237-44ad-8898-e5b57905b92f', 'tenant_id': '2782edd0ce0e455b825d4fa9efd24221', 'mac_address': 'fa:16:3e:df:4c:b9', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '7d0a2886-ab9d-4826-872e-c085fa7372ce', 'device_owner': 'network:router_interface', 'standard_attr_id': 529, 'fixed_ips': [{'subnet_id': 'baa3c93e-8af6-411c-80fd-fd8f5df6bde9', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-23T19:37:25Z', 'updated_at': '2021-11-23T19:37:25Z', 'revision_number': 2, 'project_id': '2782edd0ce0e455b825d4fa9efd24221', 'subnets': [{'id': 'baa3c93e-8af6-411c-80fd-fd8f5df6bde9', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=102994) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 23 19:37:27.170832 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.wsgi [-] (102992) accepted ('10.222.0.62', 48244) {{(pid=102992) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 23 19:37:27.175503 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.api.v2.base [None req-d050a543-4b83-4ea6-8b58-edf8738d7dc5 tempest-TestShelveInstance-292550524 tempest-TestShelveInstance-292550524-project] Request body: {'security_group': {'name': 'tempest-secgroup-smoke-1888869429', 'description': 'tempest-secgroup-smoke-1888869429 description', 'project_id': '35f8a5017a27449084aabd12f27f5a8a'}} {{(pid=102992) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 23 19:37:27.275763 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [None req-d050a543-4b83-4ea6-8b58-edf8738d7dc5 tempest-TestShelveInstance-292550524 tempest-TestShelveInstance-292550524-project] Publish callbacks [] for security_group, before_create {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:37:27.387329 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [None req-d050a543-4b83-4ea6-8b58-edf8738d7dc5 tempest-TestShelveInstance-292550524 tempest-TestShelveInstance-292550524-project] Publish callbacks [] for security_group, precommit_create {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:37:27.432866 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-559b41e4-de97-448d-9b85-ed70aedb570c req-8c58f071-5f79-4ad8-b69c-012a1edc8f5d tempest-AttachVolumeTestJSON-1120920040 tempest-AttachVolumeTestJSON-1120920040-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102993) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:37:27.434491 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-559b41e4-de97-448d-9b85-ed70aedb570c req-8c58f071-5f79-4ad8-b69c-012a1edc8f5d tempest-AttachVolumeTestJSON-1120920040 tempest-AttachVolumeTestJSON-1120920040-project] 10.222.0.62 "GET /v2.0/ports?device_id=029fedce-3168-4d1d-992e-a9466fe3e886 HTTP/1.1" status: 200 len: 943 time: 0.0513933 Nov 23 19:37:27.447028 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [None req-d050a543-4b83-4ea6-8b58-edf8738d7dc5 tempest-TestShelveInstance-292550524 tempest-TestShelveInstance-292550524-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-623933'] for security_group, after_create {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:37:27.481387 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d050a543-4b83-4ea6-8b58-edf8738d7dc5 tempest-TestShelveInstance-292550524 tempest-TestShelveInstance-292550524-project] Pushing event updated for resources: {'SecurityGroup': ['ID=7fe194e6-71c3-47a9-8f36-0dbb24d1f72d,revision_number=1']} {{(pid=102992) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 23 19:37:27.498623 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-559b41e4-de97-448d-9b85-ed70aedb570c req-b6b5518b-0800-42e8-b15f-58e91a3dd8cf tempest-AttachVolumeTestJSON-1120920040 tempest-AttachVolumeTestJSON-1120920040-project] 10.222.0.62 "GET /v2.0/security-groups?id=f8cf4027-ad94-4b78-b429-c3f2d7f9d324&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0571198 Nov 23 19:37:27.540920 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [None req-d050a543-4b83-4ea6-8b58-edf8738d7dc5 tempest-TestShelveInstance-292550524 tempest-TestShelveInstance-292550524-project] Publish callbacks [] for security_group, before_response {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:37:27.542243 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [None req-d050a543-4b83-4ea6-8b58-edf8738d7dc5 tempest-TestShelveInstance-292550524 tempest-TestShelveInstance-292550524-project] 10.222.0.62 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1811 time: 0.3703818 Nov 23 19:37:27.545246 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.wsgi [-] (102992) accepted ('10.222.0.62', 48248) {{(pid=102992) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 23 19:37:27.549932 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.api.v2.base [None req-168b2964-1347-40bd-bc0c-6906c01fe035 tempest-TestShelveInstance-292550524 tempest-TestShelveInstance-292550524-project] Request body: {'security_group_rule': {'security_group_id': '7fe194e6-71c3-47a9-8f36-0dbb24d1f72d', 'project_id': '35f8a5017a27449084aabd12f27f5a8a', 'protocol': 'tcp', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'ingress'}} {{(pid=102992) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 23 19:37:27.636760 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [None req-168b2964-1347-40bd-bc0c-6906c01fe035 tempest-TestShelveInstance-292550524 tempest-TestShelveInstance-292550524-project] Publish callbacks [] for security_group_rule, before_create {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:37:27.702119 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [None req-168b2964-1347-40bd-bc0c-6906c01fe035 tempest-TestShelveInstance-292550524 tempest-TestShelveInstance-292550524-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:37:27.743937 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [None req-168b2964-1347-40bd-bc0c-6906c01fe035 tempest-TestShelveInstance-292550524 tempest-TestShelveInstance-292550524-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-601991'] for security_group_rule, after_create {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:37:27.763611 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-168b2964-1347-40bd-bc0c-6906c01fe035 tempest-TestShelveInstance-292550524 tempest-TestShelveInstance-292550524-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=7f169c91-5249-4dc1-82bd-e69d605e54e5,revision_number=0']} {{(pid=102992) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 23 19:37:27.815418 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [None req-168b2964-1347-40bd-bc0c-6906c01fe035 tempest-TestShelveInstance-292550524 tempest-TestShelveInstance-292550524-project] Publish callbacks [] for security_group_rule, before_response {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:37:27.816656 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [None req-168b2964-1347-40bd-bc0c-6906c01fe035 tempest-TestShelveInstance-292550524 tempest-TestShelveInstance-292550524-project] 10.222.0.62 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 764 time: 0.2704263 Nov 23 19:37:27.819540 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.wsgi [-] (102992) accepted ('10.222.0.62', 48252) {{(pid=102992) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 23 19:37:27.824351 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.api.v2.base [None req-41151e41-0e5f-4a93-8fbc-460169622ba3 tempest-TestShelveInstance-292550524 tempest-TestShelveInstance-292550524-project] Request body: {'security_group_rule': {'security_group_id': '7fe194e6-71c3-47a9-8f36-0dbb24d1f72d', 'project_id': '35f8a5017a27449084aabd12f27f5a8a', 'protocol': 'tcp', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'egress'}} {{(pid=102992) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 23 19:37:27.886285 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [None req-41151e41-0e5f-4a93-8fbc-460169622ba3 tempest-TestShelveInstance-292550524 tempest-TestShelveInstance-292550524-project] Publish callbacks [] for security_group_rule, before_create {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:37:27.948982 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [None req-41151e41-0e5f-4a93-8fbc-460169622ba3 tempest-TestShelveInstance-292550524 tempest-TestShelveInstance-292550524-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:37:28.018976 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [None req-41151e41-0e5f-4a93-8fbc-460169622ba3 tempest-TestShelveInstance-292550524 tempest-TestShelveInstance-292550524-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-601991'] for security_group_rule, after_create {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:37:28.037166 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-41151e41-0e5f-4a93-8fbc-460169622ba3 tempest-TestShelveInstance-292550524 tempest-TestShelveInstance-292550524-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=890b241a-ac5a-41f4-8b77-acb651ee58c7,revision_number=0']} {{(pid=102992) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 23 19:37:28.080488 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.plugins.ml2.rpc [None req-eb87b2c3-3339-4249-8b85-e695b5b4e1f9 None None] Device 6f678090-b3f3-474e-8c77-32f412c39e45 up at agent ovs-agent-dv-cinder-819011-1-iscsi {{(pid=102994) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 23 19:37:28.100761 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [None req-41151e41-0e5f-4a93-8fbc-460169622ba3 tempest-TestShelveInstance-292550524 tempest-TestShelveInstance-292550524-project] Publish callbacks [] for security_group_rule, before_response {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:37:28.102063 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [None req-41151e41-0e5f-4a93-8fbc-460169622ba3 tempest-TestShelveInstance-292550524 tempest-TestShelveInstance-292550524-project] 10.222.0.62 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 763 time: 0.2815180 Nov 23 19:37:28.104845 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.wsgi [-] (102992) accepted ('10.222.0.62', 48256) {{(pid=102992) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 23 19:37:28.109282 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.api.v2.base [None req-c1083659-0845-4e11-a827-630630fe99de tempest-TestShelveInstance-292550524 tempest-TestShelveInstance-292550524-project] Request body: {'security_group_rule': {'security_group_id': '7fe194e6-71c3-47a9-8f36-0dbb24d1f72d', 'project_id': '35f8a5017a27449084aabd12f27f5a8a', 'protocol': 'icmp', 'direction': 'ingress'}} {{(pid=102992) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 23 19:37:28.130889 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.db.provisioning_blocks [None req-eb87b2c3-3339-4249-8b85-e695b5b4e1f9 None None] Provisioning complete for port 6f678090-b3f3-474e-8c77-32f412c39e45 triggered by entity L2. {{(pid=102994) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 23 19:37:28.131266 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron_lib.callbacks.manager [None req-eb87b2c3-3339-4249-8b85-e695b5b4e1f9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-8355713'] for port, provisioning_complete {{(pid=102994) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:37:28.200652 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [None req-c1083659-0845-4e11-a827-630630fe99de tempest-TestShelveInstance-292550524 tempest-TestShelveInstance-292550524-project] Publish callbacks [] for security_group_rule, before_create {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:37:28.215618 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron_lib.callbacks.manager [None req-eb87b2c3-3339-4249-8b85-e695b5b4e1f9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7921281'] for port, before_update {{(pid=102994) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:37:28.236789 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.plugins.ml2.db [None req-eb87b2c3-3339-4249-8b85-e695b5b4e1f9 None None] For port 6f678090-b3f3-474e-8c77-32f412c39e45, host dv-cinder-819011-1-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-819011-1-iscsi',level=0,port_id=6f678090-b3f3-474e-8c77-32f412c39e45,segment=NetworkSegment(3cb5e60b-103a-47d0-a28b-d68e3159d032),segment_id=3cb5e60b-103a-47d0-a28b-d68e3159d032)] {{(pid=102994) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 23 19:37:28.260038 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [None req-c1083659-0845-4e11-a827-630630fe99de tempest-TestShelveInstance-292550524 tempest-TestShelveInstance-292550524-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:37:28.304349 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron_lib.callbacks.manager [None req-eb87b2c3-3339-4249-8b85-e695b5b4e1f9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7918660', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-15067', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560168', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8783631423946', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8783631008732', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8783631008750'] for port, after_update {{(pid=102994) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:37:28.327283 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [None req-c1083659-0845-4e11-a827-630630fe99de tempest-TestShelveInstance-292550524 tempest-TestShelveInstance-292550524-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-601991'] for security_group_rule, after_create {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:37:28.347693 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c1083659-0845-4e11-a827-630630fe99de tempest-TestShelveInstance-292550524 tempest-TestShelveInstance-292550524-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=c9177398-6f06-4d6c-8887-1a040a419457,revision_number=0']} {{(pid=102992) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 23 19:37:28.358582 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-eb87b2c3-3339-4249-8b85-e695b5b4e1f9 None None] Pushing event updated for resources: {'Port': ['ID=6f678090-b3f3-474e-8c77-32f412c39e45,revision_number=4']} {{(pid=102994) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 23 19:37:28.414822 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [None req-c1083659-0845-4e11-a827-630630fe99de tempest-TestShelveInstance-292550524 tempest-TestShelveInstance-292550524-project] Publish callbacks [] for security_group_rule, before_response {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:37:28.418667 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [None req-c1083659-0845-4e11-a827-630630fe99de tempest-TestShelveInstance-292550524 tempest-TestShelveInstance-292550524-project] 10.222.0.62 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 769 time: 0.3102531 Nov 23 19:37:28.418824 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.wsgi [-] (102992) accepted ('10.222.0.62', 48258) {{(pid=102992) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 23 19:37:28.424841 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.api.v2.base [None req-d67db19a-b24d-4e9f-b448-016d8a57d050 tempest-TestShelveInstance-292550524 tempest-TestShelveInstance-292550524-project] Request body: {'security_group_rule': {'security_group_id': '7fe194e6-71c3-47a9-8f36-0dbb24d1f72d', 'project_id': '35f8a5017a27449084aabd12f27f5a8a', 'protocol': 'icmp', 'direction': 'egress'}} {{(pid=102992) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 23 19:37:28.526342 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [None req-d67db19a-b24d-4e9f-b448-016d8a57d050 tempest-TestShelveInstance-292550524 tempest-TestShelveInstance-292550524-project] Publish callbacks [] for security_group_rule, before_create {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:37:28.608202 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [None req-d67db19a-b24d-4e9f-b448-016d8a57d050 tempest-TestShelveInstance-292550524 tempest-TestShelveInstance-292550524-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:37:28.650488 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d65e0ef1-bf74-44f3-9cb9-e302b288a637 req-293fbc92-5024-4509-b235-38e43602334e tempest-AttachVolumeTestJSON-1120920040 tempest-AttachVolumeTestJSON-1120920040-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102992) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:37:28.652403 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-d65e0ef1-bf74-44f3-9cb9-e302b288a637 req-293fbc92-5024-4509-b235-38e43602334e tempest-AttachVolumeTestJSON-1120920040 tempest-AttachVolumeTestJSON-1120920040-project] 10.222.0.62 "GET /v2.0/ports?device_id=029fedce-3168-4d1d-992e-a9466fe3e886 HTTP/1.1" status: 200 len: 943 time: 0.0676486 Nov 23 19:37:28.674280 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [None req-d67db19a-b24d-4e9f-b448-016d8a57d050 tempest-TestShelveInstance-292550524 tempest-TestShelveInstance-292550524-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-601991'] for security_group_rule, after_create {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:37:28.688836 dv-cinder-819011-1-iscsi neutron-server[102995]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-00ce1fa8-9f31-4a3c-a5b0-ef562222457f None None] Sync routers for ids ['7d0a2886-ab9d-4826-872e-c085fa7372ce'] in dv-cinder-819011-1-iscsi {{(pid=102995) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 23 19:37:28.701256 dv-cinder-819011-1-iscsi neutron-server[102995]: DEBUG neutron.db.l3_dvrscheduler_db [None req-00ce1fa8-9f31-4a3c-a5b0-ef562222457f None None] Routers {'7d0a2886-ab9d-4826-872e-c085fa7372ce'} bound to L3 agent in host dv-cinder-819011-1-iscsi {{(pid=102995) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 23 19:37:28.701978 dv-cinder-819011-1-iscsi neutron-server[102995]: DEBUG neutron.db.l3_hamode_db [None req-00ce1fa8-9f31-4a3c-a5b0-ef562222457f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-819011-1-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-11-23T19:25:14Z,description=,heartbeat_timestamp=2021-11-23T19:37:14Z,host='dv-cinder-819011-1-iscsi',id=1b20f2c4-70b6-43c3-b9bd-0062cc9e57ac,load=0,resource_versions=,resources_synced=,started_at=2021-11-23T19:25:15Z,topic='l3_agent')) {'router_ids': ['7d0a2886-ab9d-4826-872e-c085fa7372ce'], 'active': True} {{(pid=102995) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 23 19:37:28.705783 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d67db19a-b24d-4e9f-b448-016d8a57d050 tempest-TestShelveInstance-292550524 tempest-TestShelveInstance-292550524-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=14fd077c-22b2-421e-ab51-c77485560c60,revision_number=0']} {{(pid=102992) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 23 19:37:28.737156 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-d65e0ef1-bf74-44f3-9cb9-e302b288a637 req-192b7bf2-042d-40bf-852c-06babdc3597b tempest-AttachVolumeTestJSON-1120920040 tempest-AttachVolumeTestJSON-1120920040-project] 10.222.0.62 "GET /v2.0/security-groups?id=f8cf4027-ad94-4b78-b429-c3f2d7f9d324&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0719976 Nov 23 19:37:28.774771 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [None req-d67db19a-b24d-4e9f-b448-016d8a57d050 tempest-TestShelveInstance-292550524 tempest-TestShelveInstance-292550524-project] Publish callbacks [] for security_group_rule, before_response {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:37:28.775979 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [None req-d67db19a-b24d-4e9f-b448-016d8a57d050 tempest-TestShelveInstance-292550524 tempest-TestShelveInstance-292550524-project] 10.222.0.62 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 768 time: 0.3562272 Nov 23 19:37:28.778811 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.wsgi [-] (102992) accepted ('10.222.0.62', 48264) {{(pid=102992) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 23 19:37:28.784010 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.api.v2.base [None req-f4d99c12-3c3c-4dd3-98b2-d6a9cbc8da32 tempest-TestShelveInstance-292550524 tempest-TestShelveInstance-292550524-project] Request body: {'security_group_rule': {'security_group_id': '7fe194e6-71c3-47a9-8f36-0dbb24d1f72d', 'project_id': '35f8a5017a27449084aabd12f27f5a8a', 'protocol': 'icmp', 'ethertype': 'IPv6', 'direction': 'ingress'}} {{(pid=102992) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 23 19:37:28.815074 dv-cinder-819011-1-iscsi neutron-server[102995]: DEBUG neutron.db.l3_dvr_db [None req-00ce1fa8-9f31-4a3c-a5b0-ef562222457f None None] Set router 7d0a2886-ab9d-4826-872e-c085fa7372ce gateway port host: dv-cinder-819011-1-iscsi {{(pid=102995) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 23 19:37:28.858141 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.db.securitygroups_db [None req-f4d99c12-3c3c-4dd3-98b2-d6a9cbc8da32 tempest-TestShelveInstance-292550524 tempest-TestShelveInstance-292550524-project] Project 35f8a5017a27449084aabd12f27f5a8a added a security group rule with legacy IPv6 ICMP protocol name icmp, ipv6-icmp should be used instead. It was automatically converted. Nov 23 19:37:28.864315 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [None req-f4d99c12-3c3c-4dd3-98b2-d6a9cbc8da32 tempest-TestShelveInstance-292550524 tempest-TestShelveInstance-292550524-project] Publish callbacks [] for security_group_rule, before_create {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:37:28.924260 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [None req-f4d99c12-3c3c-4dd3-98b2-d6a9cbc8da32 tempest-TestShelveInstance-292550524 tempest-TestShelveInstance-292550524-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:37:28.995205 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [None req-f4d99c12-3c3c-4dd3-98b2-d6a9cbc8da32 tempest-TestShelveInstance-292550524 tempest-TestShelveInstance-292550524-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-601991'] for security_group_rule, after_create {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:37:29.013116 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f4d99c12-3c3c-4dd3-98b2-d6a9cbc8da32 tempest-TestShelveInstance-292550524 tempest-TestShelveInstance-292550524-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=60415e74-c87d-4a4a-a560-381a3717422b,revision_number=0']} {{(pid=102992) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 23 19:37:29.016980 dv-cinder-819011-1-iscsi neutron-server[102995]: DEBUG neutron.db.l3_hamode_db [None req-00ce1fa8-9f31-4a3c-a5b0-ef562222457f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '7d0a2886-ab9d-4826-872e-c085fa7372ce', 'name': 'tempest-TestShelveInstance-1814897973-router', 'tenant_id': '2782edd0ce0e455b825d4fa9efd24221', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'a93e254e-aac9-4233-9e4d-4290fd0458e4', 'external_fixed_ips': [{'subnet_id': 'e0b32f3d-83d6-439a-bbed-01df7cf01051', 'ip_address': '172.27.1.217'}], 'enable_snat': True}, 'gw_port_id': '6f678090-b3f3-474e-8c77-32f412c39e45', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-23T19:37:21Z', 'updated_at': '2021-11-23T19:37:25Z', 'revision_number': 4, 'project_id': '2782edd0ce0e455b825d4fa9efd24221', 'gw_port': {'id': '6f678090-b3f3-474e-8c77-32f412c39e45', 'name': '', 'network_id': 'a93e254e-aac9-4233-9e4d-4290fd0458e4', 'tenant_id': '', 'mac_address': 'fa:16:3e:bd:9a:bb', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '7d0a2886-ab9d-4826-872e-c085fa7372ce', 'device_owner': 'network:router_gateway', 'standard_attr_id': 528, 'fixed_ips': [{'subnet_id': 'e0b32f3d-83d6-439a-bbed-01df7cf01051', 'ip_address': '172.27.1.217', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-819011-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-23T19:37:22Z', 'updated_at': '2021-11-23T19:37:28Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'e0b32f3d-83d6-439a-bbed-01df7cf01051', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-819011-1-iscsi', '_interfaces': [{'id': '6316de48-e729-4e1a-8557-06a3ec7c6a4a', 'name': '', 'network_id': 'f85fa999-4237-44ad-8898-e5b57905b92f', 'tenant_id': '2782edd0ce0e455b825d4fa9efd24221', 'mac_address': 'fa:16:3e:df:4c:b9', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '7d0a2886-ab9d-4826-872e-c085fa7372ce', 'device_owner': 'network:router_interface', 'standard_attr_id': 529, 'fixed_ips': [{'subnet_id': 'baa3c93e-8af6-411c-80fd-fd8f5df6bde9', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-23T19:37:25Z', 'updated_at': '2021-11-23T19:37:25Z', 'revision_number': 2, 'project_id': '2782edd0ce0e455b825d4fa9efd24221', 'subnets': [{'id': 'baa3c93e-8af6-411c-80fd-fd8f5df6bde9', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-819011-1-iscsi', False) {} {{(pid=102995) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 23 19:37:29.043590 dv-cinder-819011-1-iscsi neutron-server[102995]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-00ce1fa8-9f31-4a3c-a5b0-ef562222457f None None] Checking router: 7d0a2886-ab9d-4826-872e-c085fa7372ce for host: dv-cinder-819011-1-iscsi {{(pid=102995) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 23 19:37:29.043954 dv-cinder-819011-1-iscsi neutron-server[102995]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-00ce1fa8-9f31-4a3c-a5b0-ef562222457f None None] Updating router 7d0a2886-ab9d-4826-872e-c085fa7372ce port 6316de48-e729-4e1a-8557-06a3ec7c6a4a binding host dv-cinder-819011-1-iscsi {{(pid=102995) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Nov 23 19:37:29.069134 dv-cinder-819011-1-iscsi neutron-server[102995]: DEBUG neutron_lib.callbacks.manager [None req-00ce1fa8-9f31-4a3c-a5b0-ef562222457f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7921281'] for port, before_update {{(pid=102995) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:37:29.071861 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [None req-f4d99c12-3c3c-4dd3-98b2-d6a9cbc8da32 tempest-TestShelveInstance-292550524 tempest-TestShelveInstance-292550524-project] Publish callbacks [] for security_group_rule, before_response {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:37:29.076040 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [None req-f4d99c12-3c3c-4dd3-98b2-d6a9cbc8da32 tempest-TestShelveInstance-292550524 tempest-TestShelveInstance-292550524-project] 10.222.0.62 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 774 time: 0.2936158 Nov 23 19:37:29.076166 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.wsgi [-] (102992) accepted ('10.222.0.62', 48266) {{(pid=102992) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 23 19:37:29.080531 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.api.v2.base [None req-afaafdd8-0a74-4a53-8819-278293e16830 tempest-TestShelveInstance-292550524 tempest-TestShelveInstance-292550524-project] Request body: {'security_group_rule': {'security_group_id': '7fe194e6-71c3-47a9-8f36-0dbb24d1f72d', 'project_id': '35f8a5017a27449084aabd12f27f5a8a', 'protocol': 'icmp', 'ethertype': 'IPv6', 'direction': 'egress'}} {{(pid=102992) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 23 19:37:29.161343 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.db.securitygroups_db [None req-afaafdd8-0a74-4a53-8819-278293e16830 tempest-TestShelveInstance-292550524 tempest-TestShelveInstance-292550524-project] Project 35f8a5017a27449084aabd12f27f5a8a added a security group rule with legacy IPv6 ICMP protocol name icmp, ipv6-icmp should be used instead. It was automatically converted. Nov 23 19:37:29.166453 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [None req-afaafdd8-0a74-4a53-8819-278293e16830 tempest-TestShelveInstance-292550524 tempest-TestShelveInstance-292550524-project] Publish callbacks [] for security_group_rule, before_create {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:37:29.227418 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [None req-afaafdd8-0a74-4a53-8819-278293e16830 tempest-TestShelveInstance-292550524 tempest-TestShelveInstance-292550524-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:37:29.269758 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [None req-afaafdd8-0a74-4a53-8819-278293e16830 tempest-TestShelveInstance-292550524 tempest-TestShelveInstance-292550524-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-601991'] for security_group_rule, after_create {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:37:29.288617 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-afaafdd8-0a74-4a53-8819-278293e16830 tempest-TestShelveInstance-292550524 tempest-TestShelveInstance-292550524-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=0c12ba23-8472-4d72-9438-df0e8144154b,revision_number=0']} {{(pid=102992) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 23 19:37:29.338036 dv-cinder-819011-1-iscsi neutron-server[102995]: DEBUG neutron_lib.callbacks.manager [None req-00ce1fa8-9f31-4a3c-a5b0-ef562222457f None None] Publish callbacks [] for port, precommit_update {{(pid=102995) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:37:29.351965 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [None req-afaafdd8-0a74-4a53-8819-278293e16830 tempest-TestShelveInstance-292550524 tempest-TestShelveInstance-292550524-project] Publish callbacks [] for security_group_rule, before_response {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:37:29.353283 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [None req-afaafdd8-0a74-4a53-8819-278293e16830 tempest-TestShelveInstance-292550524 tempest-TestShelveInstance-292550524-project] 10.222.0.62 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 773 time: 0.2761450 Nov 23 19:37:29.424323 dv-cinder-819011-1-iscsi neutron-server[102995]: DEBUG neutron_lib.callbacks.manager [None req-00ce1fa8-9f31-4a3c-a5b0-ef562222457f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7918660', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-15067', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560168', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8783631423946', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8783631008732', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8783631008750'] for port, after_update {{(pid=102995) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:37:29.473531 dv-cinder-819011-1-iscsi neutron-server[102995]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a2213599-0227-45a1-9a42-532ef2416830 None None] Pushing event updated for resources: {'Port': ['ID=6316de48-e729-4e1a-8557-06a3ec7c6a4a,revision_number=3']} {{(pid=102995) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 23 19:37:29.531157 dv-cinder-819011-1-iscsi neutron-server[102995]: DEBUG neutron.plugins.ml2.managers [None req-00ce1fa8-9f31-4a3c-a5b0-ef562222457f None None] Attempting to bind port 6316de48-e729-4e1a-8557-06a3ec7c6a4a on host dv-cinder-819011-1-iscsi for vnic_type normal with profile {{(pid=102995) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 23 19:37:29.532260 dv-cinder-819011-1-iscsi neutron-server[102995]: DEBUG neutron.plugins.ml2.managers [None req-00ce1fa8-9f31-4a3c-a5b0-ef562222457f None None] Attempting to bind port 6316de48-e729-4e1a-8557-06a3ec7c6a4a by drivers openvswitch,hyperv on host dv-cinder-819011-1-iscsi at level 0 using segments [{'id': 'a6451c29-fea7-487e-9bb2-6a8e36a6bb38', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 831, 'network_id': 'f85fa999-4237-44ad-8898-e5b57905b92f'}] {{(pid=102995) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 23 19:37:29.533117 dv-cinder-819011-1-iscsi neutron-server[102995]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-00ce1fa8-9f31-4a3c-a5b0-ef562222457f None None] Attempting to bind port 6316de48-e729-4e1a-8557-06a3ec7c6a4a on network f85fa999-4237-44ad-8898-e5b57905b92f {{(pid=102995) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 23 19:37:29.539513 dv-cinder-819011-1-iscsi neutron-server[102995]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-00ce1fa8-9f31-4a3c-a5b0-ef562222457f None None] Checking agent: {'id': '668c8953-047c-499e-8c0d-db838fac1668', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-819011-1-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 23, 19, 25, 17), 'started_at': datetime.datetime(2021, 11, 23, 19, 25, 47), 'heartbeat_timestamp': datetime.datetime(2021, 11, 23, 19, 37, 17), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-819011-1-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=102995) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 23 19:37:29.539893 dv-cinder-819011-1-iscsi neutron-server[102995]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-00ce1fa8-9f31-4a3c-a5b0-ef562222457f None None] Checking segment: {'id': 'a6451c29-fea7-487e-9bb2-6a8e36a6bb38', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 831, 'network_id': 'f85fa999-4237-44ad-8898-e5b57905b92f'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102995) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 23 19:37:29.540305 dv-cinder-819011-1-iscsi neutron-server[102995]: DEBUG neutron_lib.callbacks.manager [None req-00ce1fa8-9f31-4a3c-a5b0-ef562222457f None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=102995) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:37:29.540762 dv-cinder-819011-1-iscsi neutron-server[102995]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-00ce1fa8-9f31-4a3c-a5b0-ef562222457f None None] Bound using segment: {'id': 'a6451c29-fea7-487e-9bb2-6a8e36a6bb38', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 831, 'network_id': 'f85fa999-4237-44ad-8898-e5b57905b92f'} {{(pid=102995) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 23 19:37:29.541240 dv-cinder-819011-1-iscsi neutron-server[102995]: DEBUG neutron.plugins.ml2.managers [None req-00ce1fa8-9f31-4a3c-a5b0-ef562222457f None None] Bound port: 6316de48-e729-4e1a-8557-06a3ec7c6a4a, host: dv-cinder-819011-1-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'a6451c29-fea7-487e-9bb2-6a8e36a6bb38', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 831, 'network_id': 'f85fa999-4237-44ad-8898-e5b57905b92f'}}] {{(pid=102995) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 23 19:37:29.541854 dv-cinder-819011-1-iscsi neutron-server[102995]: DEBUG neutron_lib.callbacks.manager [None req-00ce1fa8-9f31-4a3c-a5b0-ef562222457f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7921281'] for port, before_update {{(pid=102995) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:37:29.616891 dv-cinder-819011-1-iscsi neutron-server[102995]: DEBUG neutron.plugins.ml2.db [None req-00ce1fa8-9f31-4a3c-a5b0-ef562222457f None None] For port 6316de48-e729-4e1a-8557-06a3ec7c6a4a, host dv-cinder-819011-1-iscsi, cleared binding levels {{(pid=102995) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 23 19:37:29.622032 dv-cinder-819011-1-iscsi neutron-server[102995]: DEBUG neutron.plugins.ml2.db [None req-00ce1fa8-9f31-4a3c-a5b0-ef562222457f None None] For port 6316de48-e729-4e1a-8557-06a3ec7c6a4a, host dv-cinder-819011-1-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-819011-1-iscsi',level=0,port_id=6316de48-e729-4e1a-8557-06a3ec7c6a4a,segment=NetworkSegment(a6451c29-fea7-487e-9bb2-6a8e36a6bb38),segment_id=a6451c29-fea7-487e-9bb2-6a8e36a6bb38)] {{(pid=102995) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 23 19:37:29.664623 dv-cinder-819011-1-iscsi neutron-server[102995]: DEBUG neutron_lib.callbacks.manager [None req-00ce1fa8-9f31-4a3c-a5b0-ef562222457f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7918660', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-15067', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560168', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8783631423946', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8783631008732', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8783631008750'] for port, after_update {{(pid=102995) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:37:29.687802 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron_lib.callbacks.manager [None req-4bf48ff4-ecfb-4168-8b63-249b8c6e9f04 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8783631323329', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7978582'] for agent, after_update {{(pid=102994) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:37:29.709860 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-0f9863e7-566a-4d86-a825-a1041e6c0948 req-866a1ae3-4b21-4751-8048-c98125a94061 service neutron] 10.222.0.41 "GET /v2.0/ports?device_id=85ea3d72-6c17-4ea2-82b7-90cce01633bd&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 275 time: 0.0485144 Nov 23 19:37:29.716723 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.db.provisioning_blocks [None req-1060f5b5-e97d-4354-93ca-9f7e632b43fe None None] Provisioning complete for port 6316de48-e729-4e1a-8557-06a3ec7c6a4a triggered by entity DHCP. {{(pid=102994) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 23 19:37:29.717193 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron_lib.callbacks.manager [None req-1060f5b5-e97d-4354-93ca-9f7e632b43fe None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-8355713'] for port, provisioning_complete {{(pid=102994) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:37:29.717745 dv-cinder-819011-1-iscsi neutron-server[102995]: DEBUG neutron.db.l3_dvrscheduler_db [None req-00ce1fa8-9f31-4a3c-a5b0-ef562222457f None None] Routers {'7d0a2886-ab9d-4826-872e-c085fa7372ce'} bound to L3 agent in host dv-cinder-819011-1-iscsi {{(pid=102995) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 23 19:37:29.718383 dv-cinder-819011-1-iscsi neutron-server[102995]: DEBUG neutron.db.l3_hamode_db [None req-00ce1fa8-9f31-4a3c-a5b0-ef562222457f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-819011-1-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-11-23T19:25:14Z,description=,heartbeat_timestamp=2021-11-23T19:37:14Z,host='dv-cinder-819011-1-iscsi',id=1b20f2c4-70b6-43c3-b9bd-0062cc9e57ac,load=0,resource_versions=,resources_synced=,started_at=2021-11-23T19:25:15Z,topic='l3_agent')) {'router_ids': ['7d0a2886-ab9d-4826-872e-c085fa7372ce'], 'active': True} {{(pid=102995) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 23 19:37:29.784309 dv-cinder-819011-1-iscsi neutron-server[102995]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a2213599-0227-45a1-9a42-532ef2416830 None None] Pushing event updated for resources: {'Port': ['ID=6316de48-e729-4e1a-8557-06a3ec7c6a4a,revision_number=4']} {{(pid=102995) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 23 19:37:29.849290 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0f9863e7-566a-4d86-a825-a1041e6c0948 req-10671b23-693b-4117-a703-e5aeab4dbe78 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102992) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:37:29.850946 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-0f9863e7-566a-4d86-a825-a1041e6c0948 req-10671b23-693b-4117-a703-e5aeab4dbe78 service neutron] 10.222.0.41 "GET /v2.0/ports?tenant_id=2d925fb59ba34355aa85758374d76928&device_id=85ea3d72-6c17-4ea2-82b7-90cce01633bd HTTP/1.1" status: 200 len: 1099 time: 0.0588946 Nov 23 19:37:29.884177 dv-cinder-819011-1-iscsi neutron-server[102995]: DEBUG neutron.db.l3_dvr_db [None req-00ce1fa8-9f31-4a3c-a5b0-ef562222457f None None] Set router 7d0a2886-ab9d-4826-872e-c085fa7372ce gateway port host: dv-cinder-819011-1-iscsi {{(pid=102995) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 23 19:37:29.889876 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron_lib.callbacks.manager [None req-1060f5b5-e97d-4354-93ca-9f7e632b43fe None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7921281'] for port, before_update {{(pid=102994) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:37:29.937139 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.plugins.ml2.db [None req-1060f5b5-e97d-4354-93ca-9f7e632b43fe None None] For port 6316de48-e729-4e1a-8557-06a3ec7c6a4a, host dv-cinder-819011-1-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-819011-1-iscsi',level=0,port_id=6316de48-e729-4e1a-8557-06a3ec7c6a4a,segment=NetworkSegment(a6451c29-fea7-487e-9bb2-6a8e36a6bb38),segment_id=a6451c29-fea7-487e-9bb2-6a8e36a6bb38)] {{(pid=102994) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 23 19:37:29.937739 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-927b6845-259f-4874-bed0-151e8d90a8ec req-93e4bfa8-db42-4f04-9f6c-85e583ffe56f tempest-AttachVolumeTestJSON-1120920040 tempest-AttachVolumeTestJSON-1120920040-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102993) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:37:29.945069 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-927b6845-259f-4874-bed0-151e8d90a8ec req-93e4bfa8-db42-4f04-9f6c-85e583ffe56f tempest-AttachVolumeTestJSON-1120920040 tempest-AttachVolumeTestJSON-1120920040-project] 10.222.0.62 "GET /v2.0/ports?device_id=029fedce-3168-4d1d-992e-a9466fe3e886 HTTP/1.1" status: 200 len: 943 time: 0.0880783 Nov 23 19:37:30.010549 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron_lib.callbacks.manager [None req-1060f5b5-e97d-4354-93ca-9f7e632b43fe None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7918660', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-15067', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560168', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8783631423946', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8783631008732', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8783631008750'] for port, after_update {{(pid=102994) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:37:30.040828 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0f9863e7-566a-4d86-a825-a1041e6c0948 req-8ab39e8f-510c-4d06-b62a-8a7ba7bc8606 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102992) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:37:30.043646 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-0f9863e7-566a-4d86-a825-a1041e6c0948 req-8ab39e8f-510c-4d06-b62a-8a7ba7bc8606 service neutron] 10.222.0.41 "GET /v2.0/networks?id=fc901312-2937-4784-8a6d-c046666e8bf8 HTTP/1.1" status: 200 len: 918 time: 0.1494830 Nov 23 19:37:30.055189 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-927b6845-259f-4874-bed0-151e8d90a8ec req-4eb780f7-04b7-419f-95df-c9c1a2effd4e tempest-AttachVolumeTestJSON-1120920040 tempest-AttachVolumeTestJSON-1120920040-project] 10.222.0.62 "GET /v2.0/security-groups?id=f8cf4027-ad94-4b78-b429-c3f2d7f9d324&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.1054838 Nov 23 19:37:30.083568 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1060f5b5-e97d-4354-93ca-9f7e632b43fe None None] Pushing event updated for resources: {'Port': ['ID=6316de48-e729-4e1a-8557-06a3ec7c6a4a,revision_number=5']} {{(pid=102994) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 23 19:37:30.137060 dv-cinder-819011-1-iscsi neutron-server[102995]: DEBUG neutron.db.l3_hamode_db [None req-00ce1fa8-9f31-4a3c-a5b0-ef562222457f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '7d0a2886-ab9d-4826-872e-c085fa7372ce', 'name': 'tempest-TestShelveInstance-1814897973-router', 'tenant_id': '2782edd0ce0e455b825d4fa9efd24221', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'a93e254e-aac9-4233-9e4d-4290fd0458e4', 'external_fixed_ips': [{'subnet_id': 'e0b32f3d-83d6-439a-bbed-01df7cf01051', 'ip_address': '172.27.1.217'}], 'enable_snat': True}, 'gw_port_id': '6f678090-b3f3-474e-8c77-32f412c39e45', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-23T19:37:21Z', 'updated_at': '2021-11-23T19:37:25Z', 'revision_number': 4, 'project_id': '2782edd0ce0e455b825d4fa9efd24221', 'gw_port': {'id': '6f678090-b3f3-474e-8c77-32f412c39e45', 'name': '', 'network_id': 'a93e254e-aac9-4233-9e4d-4290fd0458e4', 'tenant_id': '', 'mac_address': 'fa:16:3e:bd:9a:bb', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '7d0a2886-ab9d-4826-872e-c085fa7372ce', 'device_owner': 'network:router_gateway', 'standard_attr_id': 528, 'fixed_ips': [{'subnet_id': 'e0b32f3d-83d6-439a-bbed-01df7cf01051', 'ip_address': '172.27.1.217', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-819011-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-23T19:37:22Z', 'updated_at': '2021-11-23T19:37:28Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'e0b32f3d-83d6-439a-bbed-01df7cf01051', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-819011-1-iscsi', '_interfaces': [{'id': '6316de48-e729-4e1a-8557-06a3ec7c6a4a', 'name': '', 'network_id': 'f85fa999-4237-44ad-8898-e5b57905b92f', 'tenant_id': '2782edd0ce0e455b825d4fa9efd24221', 'mac_address': 'fa:16:3e:df:4c:b9', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '7d0a2886-ab9d-4826-872e-c085fa7372ce', 'device_owner': 'network:router_interface', 'standard_attr_id': 529, 'fixed_ips': [{'subnet_id': 'baa3c93e-8af6-411c-80fd-fd8f5df6bde9', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-819011-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-23T19:37:25Z', 'updated_at': '2021-11-23T19:37:29Z', 'revision_number': 4, 'project_id': '2782edd0ce0e455b825d4fa9efd24221', 'subnets': [{'id': 'baa3c93e-8af6-411c-80fd-fd8f5df6bde9', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-819011-1-iscsi', False) {} {{(pid=102995) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 23 19:37:30.137336 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.db.provisioning_blocks [None req-f5397538-033a-477d-b20e-86b503520ae4 None None] Provisioning complete for port 6316de48-e729-4e1a-8557-06a3ec7c6a4a triggered by entity DHCP. {{(pid=102994) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 23 19:37:30.137695 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron_lib.callbacks.manager [None req-f5397538-033a-477d-b20e-86b503520ae4 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-8355713'] for port, provisioning_complete {{(pid=102994) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:37:30.162321 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-0f9863e7-566a-4d86-a825-a1041e6c0948 req-17a7f620-8532-4d99-9ff0-3fcc219dfa36 service neutron] 10.222.0.41 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.7&port_id=4b380ab6-f3ec-4e12-9a2a-b5a20828969d HTTP/1.1" status: 200 len: 1001 time: 0.0938468 Nov 23 19:37:30.168495 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.plugins.ml2.rpc [None req-eb87b2c3-3339-4249-8b85-e695b5b4e1f9 None None] Device 6316de48-e729-4e1a-8557-06a3ec7c6a4a up at agent ovs-agent-dv-cinder-819011-1-iscsi {{(pid=102994) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 23 19:37:30.170041 dv-cinder-819011-1-iscsi neutron-server[102995]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-00ce1fa8-9f31-4a3c-a5b0-ef562222457f None None] The sync data for ids ['7d0a2886-ab9d-4826-872e-c085fa7372ce'] in dv-cinder-819011-1-iscsi is: [{'id': '7d0a2886-ab9d-4826-872e-c085fa7372ce', 'name': 'tempest-TestShelveInstance-1814897973-router', 'tenant_id': '2782edd0ce0e455b825d4fa9efd24221', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'a93e254e-aac9-4233-9e4d-4290fd0458e4', 'external_fixed_ips': [{'subnet_id': 'e0b32f3d-83d6-439a-bbed-01df7cf01051', 'ip_address': '172.27.1.217'}], 'enable_snat': True}, 'gw_port_id': '6f678090-b3f3-474e-8c77-32f412c39e45', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-23T19:37:21Z', 'updated_at': '2021-11-23T19:37:25Z', 'revision_number': 4, 'project_id': '2782edd0ce0e455b825d4fa9efd24221', 'gw_port': {'id': '6f678090-b3f3-474e-8c77-32f412c39e45', 'name': '', 'network_id': 'a93e254e-aac9-4233-9e4d-4290fd0458e4', 'tenant_id': '', 'mac_address': 'fa:16:3e:bd:9a:bb', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '7d0a2886-ab9d-4826-872e-c085fa7372ce', 'device_owner': 'network:router_gateway', 'standard_attr_id': 528, 'fixed_ips': [{'subnet_id': 'e0b32f3d-83d6-439a-bbed-01df7cf01051', 'ip_address': '172.27.1.217', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-819011-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-23T19:37:22Z', 'updated_at': '2021-11-23T19:37:28Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'e0b32f3d-83d6-439a-bbed-01df7cf01051', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-819011-1-iscsi', '_interfaces': [{'id': '6316de48-e729-4e1a-8557-06a3ec7c6a4a', 'name': '', 'network_id': 'f85fa999-4237-44ad-8898-e5b57905b92f', 'tenant_id': '2782edd0ce0e455b825d4fa9efd24221', 'mac_address': 'fa:16:3e:df:4c:b9', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '7d0a2886-ab9d-4826-872e-c085fa7372ce', 'device_owner': 'network:router_interface', 'standard_attr_id': 529, 'fixed_ips': [{'subnet_id': 'baa3c93e-8af6-411c-80fd-fd8f5df6bde9', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-819011-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-23T19:37:25Z', 'updated_at': '2021-11-23T19:37:29Z', 'revision_number': 4, 'project_id': '2782edd0ce0e455b825d4fa9efd24221', 'subnets': [{'id': 'baa3c93e-8af6-411c-80fd-fd8f5df6bde9', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=102995) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 23 19:37:30.275304 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.db.provisioning_blocks [None req-eb87b2c3-3339-4249-8b85-e695b5b4e1f9 None None] Provisioning complete for port 6316de48-e729-4e1a-8557-06a3ec7c6a4a triggered by entity L2. {{(pid=102994) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 23 19:37:30.275914 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron_lib.callbacks.manager [None req-eb87b2c3-3339-4249-8b85-e695b5b4e1f9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-8355713'] for port, provisioning_complete {{(pid=102994) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:37:30.277703 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0f9863e7-566a-4d86-a825-a1041e6c0948 req-8b0d0b44-eae9-4274-a20e-d77f2318d556 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102992) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:37:30.280284 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-0f9863e7-566a-4d86-a825-a1041e6c0948 req-8b0d0b44-eae9-4274-a20e-d77f2318d556 service neutron] 10.222.0.41 "GET /v2.0/subnets?id=2caca985-6ed6-4ef7-ba49-7b7410bea160 HTTP/1.1" status: 200 len: 856 time: 0.1053157 Nov 23 19:37:30.406895 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.plugins.ml2.rpc [None req-eb87b2c3-3339-4249-8b85-e695b5b4e1f9 None None] Device 6f678090-b3f3-474e-8c77-32f412c39e45 up at agent ovs-agent-dv-cinder-819011-1-iscsi {{(pid=102994) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 23 19:37:30.457613 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.db.provisioning_blocks [None req-eb87b2c3-3339-4249-8b85-e695b5b4e1f9 None None] Provisioning complete for port 6f678090-b3f3-474e-8c77-32f412c39e45 triggered by entity L2. {{(pid=102994) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 23 19:37:30.457613 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron_lib.callbacks.manager [None req-eb87b2c3-3339-4249-8b85-e695b5b4e1f9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-8355713'] for port, provisioning_complete {{(pid=102994) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:37:31.166028 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-092055e3-a04a-4144-8609-0a30afec55a1 req-cb595a46-9d3b-42de-9dd0-d27d002496b3 tempest-AttachVolumeTestJSON-1120920040 tempest-AttachVolumeTestJSON-1120920040-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102992) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:37:31.167559 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-092055e3-a04a-4144-8609-0a30afec55a1 req-cb595a46-9d3b-42de-9dd0-d27d002496b3 tempest-AttachVolumeTestJSON-1120920040 tempest-AttachVolumeTestJSON-1120920040-project] 10.222.0.62 "GET /v2.0/ports?device_id=029fedce-3168-4d1d-992e-a9466fe3e886 HTTP/1.1" status: 200 len: 943 time: 0.0526216 Nov 23 19:37:31.221614 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-092055e3-a04a-4144-8609-0a30afec55a1 req-96a5feec-b5c3-4d7d-a79c-3cc95a4552f5 tempest-AttachVolumeTestJSON-1120920040 tempest-AttachVolumeTestJSON-1120920040-project] 10.222.0.62 "GET /v2.0/security-groups?id=f8cf4027-ad94-4b78-b429-c3f2d7f9d324&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0462008 Nov 23 19:37:31.323748 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0f9863e7-566a-4d86-a825-a1041e6c0948 req-b6ea6755-9074-420b-a893-f98a8b8b0ac6 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102992) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:37:31.325284 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-0f9863e7-566a-4d86-a825-a1041e6c0948 req-b6ea6755-9074-420b-a893-f98a8b8b0ac6 service neutron] 10.222.0.41 "GET /v2.0/ports?network_id=fc901312-2937-4784-8a6d-c046666e8bf8&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0417759 Nov 23 19:37:32.059127 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.plugins.ml2.rpc [None req-eb87b2c3-3339-4249-8b85-e695b5b4e1f9 None None] Device 6316de48-e729-4e1a-8557-06a3ec7c6a4a up at agent ovs-agent-dv-cinder-819011-1-iscsi {{(pid=102994) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 23 19:37:32.110563 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.db.provisioning_blocks [None req-eb87b2c3-3339-4249-8b85-e695b5b4e1f9 None None] Provisioning complete for port 6316de48-e729-4e1a-8557-06a3ec7c6a4a triggered by entity L2. {{(pid=102994) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 23 19:37:32.110940 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron_lib.callbacks.manager [None req-eb87b2c3-3339-4249-8b85-e695b5b4e1f9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-8355713'] for port, provisioning_complete {{(pid=102994) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:37:32.257635 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-0f9863e7-566a-4d86-a825-a1041e6c0948 req-4d4042e7-fab3-4438-a9e7-c81a7f49f260 service neutron] 10.222.0.41 "GET /v2.0/networks/fc901312-2937-4784-8a6d-c046666e8bf8?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0840716 Nov 23 19:37:32.334108 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6f12344d-c8fb-4f4f-9eb5-2872089289fd req-ce9e4d6a-6bf5-44aa-9e95-50cee053ada6 tempest-AttachVolumeTestJSON-1120920040 tempest-AttachVolumeTestJSON-1120920040-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102993) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:37:32.335571 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-6f12344d-c8fb-4f4f-9eb5-2872089289fd req-ce9e4d6a-6bf5-44aa-9e95-50cee053ada6 tempest-AttachVolumeTestJSON-1120920040 tempest-AttachVolumeTestJSON-1120920040-project] 10.222.0.62 "GET /v2.0/ports?device_id=029fedce-3168-4d1d-992e-a9466fe3e886 HTTP/1.1" status: 200 len: 943 time: 0.0484018 Nov 23 19:37:32.383858 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-6f12344d-c8fb-4f4f-9eb5-2872089289fd req-09777046-428c-408b-a446-713ff0d3e2f4 tempest-AttachVolumeTestJSON-1120920040 tempest-AttachVolumeTestJSON-1120920040-project] 10.222.0.62 "GET /v2.0/security-groups?id=f8cf4027-ad94-4b78-b429-c3f2d7f9d324&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0424225 Nov 23 19:37:33.007378 dv-cinder-819011-1-iscsi neutron-server[102995]: DEBUG neutron.db.agents_db [None req-84bdc9b2-57ea-4bdb-a245-07c78d37cea8 None None] Agent healthcheck: found 6 active agents {{(pid=102995) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 23 19:37:33.357015 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-0f9863e7-566a-4d86-a825-a1041e6c0948 req-5b6a3490-a152-46d3-99ed-065cba5458f9 service neutron] 10.222.0.41 "GET /v2.0/networks/fc901312-2937-4784-8a6d-c046666e8bf8?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0898767 Nov 23 19:37:33.521320 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a33a4218-faa0-4291-b339-8b0f37d55131 req-0451f946-07aa-4d60-b195-3144793b82ac tempest-AttachVolumeTestJSON-1120920040 tempest-AttachVolumeTestJSON-1120920040-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102992) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:37:33.522849 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-a33a4218-faa0-4291-b339-8b0f37d55131 req-0451f946-07aa-4d60-b195-3144793b82ac tempest-AttachVolumeTestJSON-1120920040 tempest-AttachVolumeTestJSON-1120920040-project] 10.222.0.62 "GET /v2.0/ports?device_id=029fedce-3168-4d1d-992e-a9466fe3e886 HTTP/1.1" status: 200 len: 943 time: 0.0545583 Nov 23 19:37:33.571879 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-a33a4218-faa0-4291-b339-8b0f37d55131 req-00783a92-d450-4e8a-9b7d-a5e544669f0b tempest-AttachVolumeTestJSON-1120920040 tempest-AttachVolumeTestJSON-1120920040-project] 10.222.0.62 "GET /v2.0/security-groups?id=f8cf4027-ad94-4b78-b429-c3f2d7f9d324&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0429931 Nov 23 19:37:33.625911 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.plugins.ml2.rpc [None req-4bf48ff4-ecfb-4168-8b63-249b8c6e9f04 None None] Device 2872cb22-0134-49c4-b6d7-034ca4132327 details requested by agent hyperv_hv-cinder-81901 with host hv-cinder-81901 {{(pid=102994) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Nov 23 19:37:33.849118 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.plugins.ml2.db [None req-4bf48ff4-ecfb-4168-8b63-249b8c6e9f04 None None] For port 2872cb22-0134-49c4-b6d7-034ca4132327, host hv-cinder-81901, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81901',level=0,port_id=2872cb22-0134-49c4-b6d7-034ca4132327,segment=NetworkSegment(1a7bcd69-381b-4068-88df-df74b53e9d61),segment_id=1a7bcd69-381b-4068-88df-df74b53e9d61)] {{(pid=102994) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 23 19:37:33.860059 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.plugins.ml2.rpc [None req-4bf48ff4-ecfb-4168-8b63-249b8c6e9f04 None None] Returning: {'device': '2872cb22-0134-49c4-b6d7-034ca4132327', 'network_id': '41fa5020-8aad-49ce-b2a6-39d87c9e6042', 'port_id': '2872cb22-0134-49c4-b6d7-034ca4132327', 'mac_address': 'fa:16:3e:1d:ae:e6', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 824, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '8f74a1ae-f892-4057-89a5-ca78a259b1bd', 'ip_address': '172.20.0.6'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=102994) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Nov 23 19:37:33.897574 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron_lib.callbacks.manager [None req-4bf48ff4-ecfb-4168-8b63-249b8c6e9f04 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7921281'] for port, before_update {{(pid=102994) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:37:33.910152 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.notifiers.nova [None req-4bf48ff4-ecfb-4168-8b63-249b8c6e9f04 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 2872cb22-0134-49c4-b6d7-034ca4132327 {{(pid=102994) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 23 19:37:33.930621 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.plugins.ml2.db [None req-4bf48ff4-ecfb-4168-8b63-249b8c6e9f04 None None] For port 2872cb22-0134-49c4-b6d7-034ca4132327, host hv-cinder-81901, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81901',level=0,port_id=2872cb22-0134-49c4-b6d7-034ca4132327,segment=NetworkSegment(1a7bcd69-381b-4068-88df-df74b53e9d61),segment_id=1a7bcd69-381b-4068-88df-df74b53e9d61)] {{(pid=102994) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 23 19:37:33.983779 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron_lib.callbacks.manager [None req-4bf48ff4-ecfb-4168-8b63-249b8c6e9f04 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7918660', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-15067', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560168', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8783631423946', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8783631008732', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8783631008750'] for port, after_update {{(pid=102994) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:37:34.035141 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4bf48ff4-ecfb-4168-8b63-249b8c6e9f04 None None] Pushing event updated for resources: {'Port': ['ID=2872cb22-0134-49c4-b6d7-034ca4132327,revision_number=4']} {{(pid=102994) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 23 19:37:34.692644 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ad42d5d7-2281-4655-85c9-66019a8a1ff0 req-ccfc6d51-5738-4da7-9ca2-b874179ce7d1 tempest-AttachVolumeTestJSON-1120920040 tempest-AttachVolumeTestJSON-1120920040-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102993) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:37:34.694133 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-ad42d5d7-2281-4655-85c9-66019a8a1ff0 req-ccfc6d51-5738-4da7-9ca2-b874179ce7d1 tempest-AttachVolumeTestJSON-1120920040 tempest-AttachVolumeTestJSON-1120920040-project] 10.222.0.62 "GET /v2.0/ports?device_id=029fedce-3168-4d1d-992e-a9466fe3e886 HTTP/1.1" status: 200 len: 944 time: 0.0533295 Nov 23 19:37:34.742764 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-ad42d5d7-2281-4655-85c9-66019a8a1ff0 req-4f0941a3-ec5f-469a-8490-8bba1cddd776 tempest-AttachVolumeTestJSON-1120920040 tempest-AttachVolumeTestJSON-1120920040-project] 10.222.0.62 "GET /v2.0/security-groups?id=f8cf4027-ad94-4b78-b429-c3f2d7f9d324&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0424223 Nov 23 19:37:35.861566 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-313f3841-1cb4-4571-bcfe-e47771fa934e req-42b0a308-c979-47ae-ad61-08050941b74b tempest-AttachVolumeTestJSON-1120920040 tempest-AttachVolumeTestJSON-1120920040-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102992) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:37:35.863043 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-313f3841-1cb4-4571-bcfe-e47771fa934e req-42b0a308-c979-47ae-ad61-08050941b74b tempest-AttachVolumeTestJSON-1120920040 tempest-AttachVolumeTestJSON-1120920040-project] 10.222.0.62 "GET /v2.0/ports?device_id=029fedce-3168-4d1d-992e-a9466fe3e886 HTTP/1.1" status: 200 len: 944 time: 0.0522637 Nov 23 19:37:35.910305 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-313f3841-1cb4-4571-bcfe-e47771fa934e req-624074bd-94e6-408a-a08a-dbbfad14bae2 tempest-AttachVolumeTestJSON-1120920040 tempest-AttachVolumeTestJSON-1120920040-project] 10.222.0.62 "GET /v2.0/security-groups?id=f8cf4027-ad94-4b78-b429-c3f2d7f9d324&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0410569 Nov 23 19:37:37.025115 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7022d310-f789-40c3-a48e-511b27ef7770 req-ed8a1390-fe05-4029-af2d-68ff457caed9 tempest-AttachVolumeTestJSON-1120920040 tempest-AttachVolumeTestJSON-1120920040-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102993) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:37:37.026643 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-7022d310-f789-40c3-a48e-511b27ef7770 req-ed8a1390-fe05-4029-af2d-68ff457caed9 tempest-AttachVolumeTestJSON-1120920040 tempest-AttachVolumeTestJSON-1120920040-project] 10.222.0.62 "GET /v2.0/ports?device_id=029fedce-3168-4d1d-992e-a9466fe3e886 HTTP/1.1" status: 200 len: 944 time: 0.0494199 Nov 23 19:37:37.076292 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-7022d310-f789-40c3-a48e-511b27ef7770 req-6e69207a-31b3-4029-9172-faaa2d1505ba tempest-AttachVolumeTestJSON-1120920040 tempest-AttachVolumeTestJSON-1120920040-project] 10.222.0.62 "GET /v2.0/security-groups?id=f8cf4027-ad94-4b78-b429-c3f2d7f9d324&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0436251 Nov 23 19:37:37.395093 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.plugins.ml2.db [None req-4bf48ff4-ecfb-4168-8b63-249b8c6e9f04 None None] get_ports_and_sgs() called for port_ids ['2872cb22-0134-49c4-b6d7-034ca4132327'] {{(pid=102994) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 23 19:37:38.190827 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a69291d7-7e3f-4860-bd67-47f33793a8d7 req-0d38c78b-36d0-4756-9d13-6447b3fda5c3 tempest-AttachVolumeTestJSON-1120920040 tempest-AttachVolumeTestJSON-1120920040-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102992) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:37:38.192726 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-a69291d7-7e3f-4860-bd67-47f33793a8d7 req-0d38c78b-36d0-4756-9d13-6447b3fda5c3 tempest-AttachVolumeTestJSON-1120920040 tempest-AttachVolumeTestJSON-1120920040-project] 10.222.0.62 "GET /v2.0/ports?device_id=029fedce-3168-4d1d-992e-a9466fe3e886 HTTP/1.1" status: 200 len: 944 time: 0.0494115 Nov 23 19:37:38.240091 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-a69291d7-7e3f-4860-bd67-47f33793a8d7 req-94136de0-9e80-4ba0-acf2-2970c8b25370 tempest-AttachVolumeTestJSON-1120920040 tempest-AttachVolumeTestJSON-1120920040-project] 10.222.0.62 "GET /v2.0/security-groups?id=f8cf4027-ad94-4b78-b429-c3f2d7f9d324&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0410001 Nov 23 19:37:39.361023 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1d11e839-81d2-4ce7-9d9b-8e7a11f666dd req-b9ae1669-b8ac-4030-93cb-14fd605e0684 tempest-AttachVolumeTestJSON-1120920040 tempest-AttachVolumeTestJSON-1120920040-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102993) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:37:39.362719 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-1d11e839-81d2-4ce7-9d9b-8e7a11f666dd req-b9ae1669-b8ac-4030-93cb-14fd605e0684 tempest-AttachVolumeTestJSON-1120920040 tempest-AttachVolumeTestJSON-1120920040-project] 10.222.0.62 "GET /v2.0/ports?device_id=029fedce-3168-4d1d-992e-a9466fe3e886 HTTP/1.1" status: 200 len: 944 time: 0.0541759 Nov 23 19:37:39.411289 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-1d11e839-81d2-4ce7-9d9b-8e7a11f666dd req-df711f2a-5fd2-4a6c-9693-86a0df121c55 tempest-AttachVolumeTestJSON-1120920040 tempest-AttachVolumeTestJSON-1120920040-project] 10.222.0.62 "GET /v2.0/security-groups?id=f8cf4027-ad94-4b78-b429-c3f2d7f9d324&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0426619 Nov 23 19:37:39.966391 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.plugins.ml2.rpc [None req-4bf48ff4-ecfb-4168-8b63-249b8c6e9f04 None None] Device 2872cb22-0134-49c4-b6d7-034ca4132327 up at agent hyperv_hv-cinder-81901 {{(pid=102994) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 23 19:37:40.097488 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.db.provisioning_blocks [None req-4bf48ff4-ecfb-4168-8b63-249b8c6e9f04 None None] Provisioning for port 2872cb22-0134-49c4-b6d7-034ca4132327 completed by entity L2. {{(pid=102994) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 23 19:37:40.102181 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.db.provisioning_blocks [None req-4bf48ff4-ecfb-4168-8b63-249b8c6e9f04 None None] Provisioning complete for port 2872cb22-0134-49c4-b6d7-034ca4132327 triggered by entity L2. {{(pid=102994) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 23 19:37:40.107311 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron_lib.callbacks.manager [None req-4bf48ff4-ecfb-4168-8b63-249b8c6e9f04 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-8355713'] for port, provisioning_complete {{(pid=102994) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:37:40.183384 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron_lib.callbacks.manager [None req-4bf48ff4-ecfb-4168-8b63-249b8c6e9f04 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7921281'] for port, before_update {{(pid=102994) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:37:40.208441 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '029fedce-3168-4d1d-992e-a9466fe3e886', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '2872cb22-0134-49c4-b6d7-034ca4132327'}] {{(pid=102994) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 23 19:37:40.210864 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.62/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}09a7511da0d2ba1d728b27e36a8467ec5289399952f0059588048a7cb66d3a43" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-fa268816-d492-447b-ac81-967e64474afe" -d '{"events": [{"server_uuid": "029fedce-3168-4d1d-992e-a9466fe3e886", "name": "network-vif-plugged", "status": "completed", "tag": "2872cb22-0134-49c4-b6d7-034ca4132327"}]}' {{(pid=102994) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 23 19:37:40.231902 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.plugins.ml2.db [None req-4bf48ff4-ecfb-4168-8b63-249b8c6e9f04 None None] For port 2872cb22-0134-49c4-b6d7-034ca4132327, host hv-cinder-81901, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81901',level=0,port_id=2872cb22-0134-49c4-b6d7-034ca4132327,segment=NetworkSegment(1a7bcd69-381b-4068-88df-df74b53e9d61),segment_id=1a7bcd69-381b-4068-88df-df74b53e9d61)] {{(pid=102994) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 23 19:37:40.257120 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 23 Nov 2021 19:37:40 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-a26b60f4-8ace-4aa1-abe1-1b80bb15aa7c x-openstack-request-id: req-a26b60f4-8ace-4aa1-abe1-1b80bb15aa7c {{(pid=102994) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 23 19:37:40.257478 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "029fedce-3168-4d1d-992e-a9466fe3e886", "name": "network-vif-plugged", "status": "completed", "tag": "2872cb22-0134-49c4-b6d7-034ca4132327", "code": 200}]} {{(pid=102994) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 23 19:37:40.257743 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.62/compute/v2.1/os-server-external-events used request id req-a26b60f4-8ace-4aa1-abe1-1b80bb15aa7c {{(pid=102994) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 23 19:37:40.262353 dv-cinder-819011-1-iscsi neutron-server[102994]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '029fedce-3168-4d1d-992e-a9466fe3e886', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '2872cb22-0134-49c4-b6d7-034ca4132327', 'code': 200} Nov 23 19:37:40.314679 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron_lib.callbacks.manager [None req-4bf48ff4-ecfb-4168-8b63-249b8c6e9f04 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7918660', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-15067', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560168', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8783631423946', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8783631008732', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8783631008750'] for port, after_update {{(pid=102994) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:37:40.368062 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4bf48ff4-ecfb-4168-8b63-249b8c6e9f04 None None] Pushing event updated for resources: {'Port': ['ID=2872cb22-0134-49c4-b6d7-034ca4132327,revision_number=5']} {{(pid=102994) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 23 19:37:40.532635 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ad529e22-610a-4ae6-ac20-0fd700144067 req-0911caa1-d828-435a-b100-d3eaf7a940ac tempest-AttachVolumeTestJSON-1120920040 tempest-AttachVolumeTestJSON-1120920040-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102993) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:37:40.535170 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-ad529e22-610a-4ae6-ac20-0fd700144067 req-0911caa1-d828-435a-b100-d3eaf7a940ac tempest-AttachVolumeTestJSON-1120920040 tempest-AttachVolumeTestJSON-1120920040-project] 10.222.0.62 "GET /v2.0/ports?device_id=029fedce-3168-4d1d-992e-a9466fe3e886 HTTP/1.1" status: 200 len: 945 time: 0.0536904 Nov 23 19:37:40.586470 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-ad529e22-610a-4ae6-ac20-0fd700144067 req-62b6e59d-1729-4d9a-a1f6-815f6941974e tempest-AttachVolumeTestJSON-1120920040 tempest-AttachVolumeTestJSON-1120920040-project] 10.222.0.62 "GET /v2.0/security-groups?id=f8cf4027-ad94-4b78-b429-c3f2d7f9d324&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0453119 Nov 23 19:37:40.587174 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1afeb16e-d069-4ecf-a2ff-cf86a2ff200d req-c82fc515-7803-4997-8b6a-7353e0423c41 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102992) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:37:40.588792 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-1afeb16e-d069-4ecf-a2ff-cf86a2ff200d req-c82fc515-7803-4997-8b6a-7353e0423c41 service neutron] 10.222.0.41 "GET /v2.0/ports?device_id=029fedce-3168-4d1d-992e-a9466fe3e886 HTTP/1.1" status: 200 len: 1098 time: 0.0451779 Nov 23 19:37:40.636050 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-1afeb16e-d069-4ecf-a2ff-cf86a2ff200d req-3ac61dc4-cb94-4ef5-9401-8982d96ac0ba service neutron] 10.222.0.41 "GET /v2.0/security-groups?id=f8cf4027-ad94-4b78-b429-c3f2d7f9d324&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0378878 Nov 23 19:37:41.702994 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron_lib.callbacks.manager [None req-2816d86c-7590-418a-a19a-873023313673 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8783631323329', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7978582'] for agent, after_update {{(pid=102994) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:37:41.709950 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0fdcf074-3418-4aa6-a98c-5800b044a05c req-690722f2-23ef-4202-b14a-0af6e9362d37 tempest-AttachVolumeTestJSON-1120920040 tempest-AttachVolumeTestJSON-1120920040-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102993) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:37:41.712298 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-0fdcf074-3418-4aa6-a98c-5800b044a05c req-690722f2-23ef-4202-b14a-0af6e9362d37 tempest-AttachVolumeTestJSON-1120920040 tempest-AttachVolumeTestJSON-1120920040-project] 10.222.0.62 "GET /v2.0/ports?device_id=029fedce-3168-4d1d-992e-a9466fe3e886 HTTP/1.1" status: 200 len: 945 time: 0.0560594 Nov 23 19:37:41.770804 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-0fdcf074-3418-4aa6-a98c-5800b044a05c req-b8b537ac-2141-4060-884a-23c2b4047a8b tempest-AttachVolumeTestJSON-1120920040 tempest-AttachVolumeTestJSON-1120920040-project] 10.222.0.62 "GET /v2.0/security-groups?id=f8cf4027-ad94-4b78-b429-c3f2d7f9d324&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0525746 Nov 23 19:37:42.888681 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e47a2aa1-c37f-4a0c-a846-496dfdfb3e67 req-5113ea69-8375-4c8f-b8ea-684570645907 tempest-AttachVolumeTestJSON-1120920040 tempest-AttachVolumeTestJSON-1120920040-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102992) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:37:42.890209 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-e47a2aa1-c37f-4a0c-a846-496dfdfb3e67 req-5113ea69-8375-4c8f-b8ea-684570645907 tempest-AttachVolumeTestJSON-1120920040 tempest-AttachVolumeTestJSON-1120920040-project] 10.222.0.62 "GET /v2.0/ports?device_id=029fedce-3168-4d1d-992e-a9466fe3e886 HTTP/1.1" status: 200 len: 945 time: 0.0493298 Nov 23 19:37:42.937488 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-e47a2aa1-c37f-4a0c-a846-496dfdfb3e67 req-bd60d576-8a5f-4504-80db-081699e92bce tempest-AttachVolumeTestJSON-1120920040 tempest-AttachVolumeTestJSON-1120920040-project] 10.222.0.62 "GET /v2.0/security-groups?id=f8cf4027-ad94-4b78-b429-c3f2d7f9d324&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0414627 Nov 23 19:37:43.051855 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-13f7208e-98f5-47d8-a0d7-585b11d7d312 req-c9b4edd9-a2cd-4574-ba9c-0c3321b737a4 tempest-AttachVolumeTestJSON-1120920040 tempest-AttachVolumeTestJSON-1120920040-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102993) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:37:43.053258 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-13f7208e-98f5-47d8-a0d7-585b11d7d312 req-c9b4edd9-a2cd-4574-ba9c-0c3321b737a4 tempest-AttachVolumeTestJSON-1120920040 tempest-AttachVolumeTestJSON-1120920040-project] 10.222.0.62 "GET /v2.0/ports?device_id=029fedce-3168-4d1d-992e-a9466fe3e886 HTTP/1.1" status: 200 len: 945 time: 0.0490053 Nov 23 19:37:43.061753 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.wsgi [-] (102993) accepted ('10.222.0.62', 48510) {{(pid=102993) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 23 19:37:43.066250 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.api.v2.base [None req-53f0b1a6-4c13-4349-af55-f1c20d36c867 tempest-AttachVolumeTestJSON-1120920040 tempest-AttachVolumeTestJSON-1120920040-project] Request body: {'floatingip': {'port_id': '2872cb22-0134-49c4-b6d7-034ca4132327'}} {{(pid=102993) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 23 19:37:43.139311 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-53f0b1a6-4c13-4349-af55-f1c20d36c867 tempest-AttachVolumeTestJSON-1120920040 tempest-AttachVolumeTestJSON-1120920040-project] Publish callbacks [] for floatingip, before_update {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:37:43.639655 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-53f0b1a6-4c13-4349-af55-f1c20d36c867 tempest-AttachVolumeTestJSON-1120920040 tempest-AttachVolumeTestJSON-1120920040-project] Publish callbacks [] for floatingip, precommit_update {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:37:43.655996 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a4c45884-1706-4442-be7d-c4a788cdaf8c req-8fe7814d-5050-4a08-8cb7-7966935d824e tempest-VolumesSnapshotTestJSON-97879810 tempest-VolumesSnapshotTestJSON-97879810-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102993) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:37:43.657518 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-a4c45884-1706-4442-be7d-c4a788cdaf8c req-8fe7814d-5050-4a08-8cb7-7966935d824e tempest-VolumesSnapshotTestJSON-97879810 tempest-VolumesSnapshotTestJSON-97879810-project] 10.222.0.62 "GET /v2.0/ports?device_id=56521436-30ba-4dcc-8272-0fcda3e896b0 HTTP/1.1" status: 200 len: 945 time: 0.0874043 Nov 23 19:37:43.700850 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-53f0b1a6-4c13-4349-af55-f1c20d36c867 tempest-AttachVolumeTestJSON-1120920040 tempest-AttachVolumeTestJSON-1120920040-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-926531'] for floatingip, after_update {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:37:43.707735 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-a4c45884-1706-4442-be7d-c4a788cdaf8c req-2db2e6f2-a7c6-47aa-bd7f-f6b8a12cc33a tempest-VolumesSnapshotTestJSON-97879810 tempest-VolumesSnapshotTestJSON-97879810-project] 10.222.0.62 "GET /v2.0/security-groups?id=2fd4bf42-f1cd-4ab5-94a3-e2347f7bb016&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0442135 Nov 23 19:37:43.819971 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.db.l3_db [None req-53f0b1a6-4c13-4349-af55-f1c20d36c867 tempest-AttachVolumeTestJSON-1120920040 tempest-AttachVolumeTestJSON-1120920040-project] Floating IP a621b55c-734d-4ae5-8844-c2140ad172fa associated. External IP: 172.27.1.128, port: 2872cb22-0134-49c4-b6d7-034ca4132327. Nov 23 19:37:44.032657 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-53f0b1a6-4c13-4349-af55-f1c20d36c867 tempest-AttachVolumeTestJSON-1120920040 tempest-AttachVolumeTestJSON-1120920040-project] Router c925adea-d520-48c2-a2b3-fdb5661aaf95 has already been hosted by L3 agent 1b20f2c4-70b6-43c3-b9bd-0062cc9e57ac {{(pid=102993) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 23 19:37:44.142119 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-53f0b1a6-4c13-4349-af55-f1c20d36c867 tempest-AttachVolumeTestJSON-1120920040 tempest-AttachVolumeTestJSON-1120920040-project] Notify agent at l3_agent.dv-cinder-819011-1-iscsi the message routers_updated {{(pid=102993) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 23 19:37:44.147572 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-53f0b1a6-4c13-4349-af55-f1c20d36c867 tempest-AttachVolumeTestJSON-1120920040 tempest-AttachVolumeTestJSON-1120920040-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-514902'] for floatingip, before_response {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:37:44.153302 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-4f7e90b4-4ad0-431d-b0e4-0b8a7f543dda None None] Sync routers for ids ['c925adea-d520-48c2-a2b3-fdb5661aaf95'] in dv-cinder-819011-1-iscsi {{(pid=102994) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 23 19:37:44.163876 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.db.l3_dvrscheduler_db [None req-4f7e90b4-4ad0-431d-b0e4-0b8a7f543dda None None] Routers {'c925adea-d520-48c2-a2b3-fdb5661aaf95'} bound to L3 agent in host dv-cinder-819011-1-iscsi {{(pid=102994) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 23 19:37:44.164607 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.db.l3_hamode_db [None req-4f7e90b4-4ad0-431d-b0e4-0b8a7f543dda None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-819011-1-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-11-23T19:25:14Z,description=,heartbeat_timestamp=2021-11-23T19:37:14Z,host='dv-cinder-819011-1-iscsi',id=1b20f2c4-70b6-43c3-b9bd-0062cc9e57ac,load=0,resource_versions=,resources_synced=,started_at=2021-11-23T19:25:15Z,topic='l3_agent')) {'router_ids': ['c925adea-d520-48c2-a2b3-fdb5661aaf95'], 'active': True} {{(pid=102994) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 23 19:37:44.177242 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [None req-53f0b1a6-4c13-4349-af55-f1c20d36c867 tempest-AttachVolumeTestJSON-1120920040 tempest-AttachVolumeTestJSON-1120920040-project] 10.222.0.62 "PUT /v2.0/floatingips/a621b55c-734d-4ae5-8844-c2140ad172fa HTTP/1.1" status: 200 len: 991 time: 1.1136055 Nov 23 19:37:44.177965 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '029fedce-3168-4d1d-992e-a9466fe3e886', 'tag': '2872cb22-0134-49c4-b6d7-034ca4132327'}] {{(pid=102993) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 23 19:37:44.180703 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.62/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}9b10b92acbee16fb695be1efeed0b68f7c36a5b215ec004a8d9d707fa3d35b2c" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-5b4b7d69-2157-4aee-98f9-f025df93a5e3" -d '{"events": [{"name": "network-changed", "server_uuid": "029fedce-3168-4d1d-992e-a9466fe3e886", "tag": "2872cb22-0134-49c4-b6d7-034ca4132327"}]}' {{(pid=102993) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 23 19:37:44.226988 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Tue, 23 Nov 2021 19:37:44 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-185b661e-410a-4d04-a78a-5d0fb46a349c x-openstack-request-id: req-185b661e-410a-4d04-a78a-5d0fb46a349c {{(pid=102993) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 23 19:37:44.227354 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "029fedce-3168-4d1d-992e-a9466fe3e886", "tag": "2872cb22-0134-49c4-b6d7-034ca4132327", "status": "completed", "code": 200}]} {{(pid=102993) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 23 19:37:44.227681 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.62/compute/v2.1/os-server-external-events used request id req-185b661e-410a-4d04-a78a-5d0fb46a349c {{(pid=102993) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 23 19:37:44.228765 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '029fedce-3168-4d1d-992e-a9466fe3e886', 'tag': '2872cb22-0134-49c4-b6d7-034ca4132327', 'status': 'completed', 'code': 200} Nov 23 19:37:44.252594 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron_lib.callbacks.manager [None req-42817ada-49f4-46db-b7e8-b0ed7611b3ca None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8783631323329', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7978582'] for agent, after_update {{(pid=102994) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:37:44.283838 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.db.l3_dvr_db [None req-4f7e90b4-4ad0-431d-b0e4-0b8a7f543dda None None] Set router c925adea-d520-48c2-a2b3-fdb5661aaf95 gateway port host: dv-cinder-819011-1-iscsi {{(pid=102994) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 23 19:37:44.299728 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.wsgi [-] (102993) accepted ('10.222.0.62', 48530) {{(pid=102993) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 23 19:37:44.314793 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5b4b7d69-2157-4aee-98f9-f025df93a5e3 req-cd0ab3c4-9be9-4895-8c52-c4dcbcab07c2 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102992) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:37:44.317864 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-5b4b7d69-2157-4aee-98f9-f025df93a5e3 req-cd0ab3c4-9be9-4895-8c52-c4dcbcab07c2 service neutron] 10.222.0.41 "GET /v2.0/ports?tenant_id=c9d53f0599374b679185cc73383b417c&device_id=029fedce-3168-4d1d-992e-a9466fe3e886 HTTP/1.1" status: 200 len: 1098 time: 0.0536625 Nov 23 19:37:44.413381 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-717abe27-424b-48e9-b5df-1bcb2b6e0830 admin admin] Publish callbacks [] for security_group, before_create {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:37:44.435176 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5b4b7d69-2157-4aee-98f9-f025df93a5e3 req-7bb4d695-0b27-46c6-b7b9-5ce71ff28788 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102992) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:37:44.436651 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-5b4b7d69-2157-4aee-98f9-f025df93a5e3 req-7bb4d695-0b27-46c6-b7b9-5ce71ff28788 service neutron] 10.222.0.41 "GET /v2.0/networks?id=41fa5020-8aad-49ce-b2a6-39d87c9e6042 HTTP/1.1" status: 200 len: 912 time: 0.0994880 Nov 23 19:37:44.497094 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-717abe27-424b-48e9-b5df-1bcb2b6e0830 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:37:44.511663 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-5b4b7d69-2157-4aee-98f9-f025df93a5e3 req-5225abf7-2f2d-4d6b-8cb3-ad13f3bbeeb8 service neutron] 10.222.0.41 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.6&port_id=2872cb22-0134-49c4-b6d7-034ca4132327 HTTP/1.1" status: 200 len: 999 time: 0.0634348 Nov 23 19:37:44.531886 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.db.l3_hamode_db [None req-4f7e90b4-4ad0-431d-b0e4-0b8a7f543dda None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'c925adea-d520-48c2-a2b3-fdb5661aaf95', 'name': 'tempest-AttachVolumeTestJSON-1672505821-router', 'tenant_id': 'c9d53f0599374b679185cc73383b417c', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'a93e254e-aac9-4233-9e4d-4290fd0458e4', 'external_fixed_ips': [{'subnet_id': 'e0b32f3d-83d6-439a-bbed-01df7cf01051', 'ip_address': '172.27.1.34'}], 'enable_snat': True}, 'gw_port_id': '41109199-34e8-4da6-963c-4a47600cb432', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-23T19:37:05Z', 'updated_at': '2021-11-23T19:37:09Z', 'revision_number': 4, 'project_id': 'c9d53f0599374b679185cc73383b417c', 'gw_port': {'id': '41109199-34e8-4da6-963c-4a47600cb432', 'name': '', 'network_id': 'a93e254e-aac9-4233-9e4d-4290fd0458e4', 'tenant_id': '', 'mac_address': 'fa:16:3e:52:78:cc', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'c925adea-d520-48c2-a2b3-fdb5661aaf95', 'device_owner': 'network:router_gateway', 'standard_attr_id': 486, 'fixed_ips': [{'subnet_id': 'e0b32f3d-83d6-439a-bbed-01df7cf01051', 'ip_address': '172.27.1.34', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-819011-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-23T19:37:06Z', 'updated_at': '2021-11-23T19:37:12Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'e0b32f3d-83d6-439a-bbed-01df7cf01051', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-819011-1-iscsi', '_floatingips': [{'id': 'a621b55c-734d-4ae5-8844-c2140ad172fa', 'tenant_id': 'c9d53f0599374b679185cc73383b417c', 'floating_ip_address': '172.27.1.128', 'floating_network_id': 'a93e254e-aac9-4233-9e4d-4290fd0458e4', 'router_id': 'c925adea-d520-48c2-a2b3-fdb5661aaf95', 'port_id': '2872cb22-0134-49c4-b6d7-034ca4132327', 'fixed_ip_address': '172.20.0.6', 'status': 'DOWN', 'standard_attr_id': 504, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '41fa5020-8aad-49ce-b2a6-39d87c9e6042', 'mac_address': 'fa:16:3e:1d:ae:e6', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '029fedce-3168-4d1d-992e-a9466fe3e886', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-23T19:37:13Z', 'updated_at': '2021-11-23T19:37:43Z', 'revision_number': 1, 'project_id': 'c9d53f0599374b679185cc73383b417c', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '75766f49-5d4b-4c87-b9ea-e4dd672df213', 'name': '', 'network_id': '41fa5020-8aad-49ce-b2a6-39d87c9e6042', 'tenant_id': 'c9d53f0599374b679185cc73383b417c', 'mac_address': 'fa:16:3e:31:a3:fa', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'c925adea-d520-48c2-a2b3-fdb5661aaf95', 'device_owner': 'network:router_interface', 'standard_attr_id': 487, 'fixed_ips': [{'subnet_id': '8f74a1ae-f892-4057-89a5-ca78a259b1bd', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-819011-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-23T19:37:08Z', 'updated_at': '2021-11-23T19:37:14Z', 'revision_number': 5, 'project_id': 'c9d53f0599374b679185cc73383b417c', 'subnets': [{'id': '8f74a1ae-f892-4057-89a5-ca78a259b1bd', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-819011-1-iscsi', False) {} {{(pid=102994) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 23 19:37:44.549075 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-717abe27-424b-48e9-b5df-1bcb2b6e0830 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-623933'] for security_group, after_create {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:37:44.559960 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-4f7e90b4-4ad0-431d-b0e4-0b8a7f543dda None None] Checking router: c925adea-d520-48c2-a2b3-fdb5661aaf95 for host: dv-cinder-819011-1-iscsi {{(pid=102994) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 23 19:37:44.570936 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.db.l3_dvrscheduler_db [None req-4f7e90b4-4ad0-431d-b0e4-0b8a7f543dda None None] Routers {'c925adea-d520-48c2-a2b3-fdb5661aaf95'} bound to L3 agent in host dv-cinder-819011-1-iscsi {{(pid=102994) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 23 19:37:44.571210 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.db.l3_hamode_db [None req-4f7e90b4-4ad0-431d-b0e4-0b8a7f543dda None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-819011-1-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 7, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 7, "log_agent_heartbeats": false, "routers": 7},created_at=2021-11-23T19:25:14Z,description=,heartbeat_timestamp=2021-11-23T19:37:44Z,host='dv-cinder-819011-1-iscsi',id=1b20f2c4-70b6-43c3-b9bd-0062cc9e57ac,load=0,resource_versions=,resources_synced=,started_at=2021-11-23T19:25:15Z,topic='l3_agent')) {'router_ids': ['c925adea-d520-48c2-a2b3-fdb5661aaf95'], 'active': True} {{(pid=102994) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 23 19:37:44.583900 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5b4b7d69-2157-4aee-98f9-f025df93a5e3 req-f0708ce7-0df6-4372-b10b-e7bf852b3c95 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102992) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:37:44.585748 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-5b4b7d69-2157-4aee-98f9-f025df93a5e3 req-f0708ce7-0df6-4372-b10b-e7bf852b3c95 service neutron] 10.222.0.41 "GET /v2.0/subnets?id=8f74a1ae-f892-4057-89a5-ca78a259b1bd HTTP/1.1" status: 200 len: 850 time: 0.0537655 Nov 23 19:37:44.594563 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [None req-717abe27-424b-48e9-b5df-1bcb2b6e0830 admin admin] 10.222.0.62 "GET /v2.0/security-groups?tenant_id=6ad465310286400ca50d99ed32f6a4bc&name=default HTTP/1.1" status: 200 len: 2996 time: 0.2935350 Nov 23 19:37:44.595416 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-717abe27-424b-48e9-b5df-1bcb2b6e0830 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=ad4decb0-e91b-459d-845e-25d6d3df3c9c,revision_number=1']} {{(pid=102993) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 23 19:37:44.597498 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.wsgi [-] (102992) accepted ('10.222.0.62', 48534) {{(pid=102992) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 23 19:37:44.663957 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5b4b7d69-2157-4aee-98f9-f025df93a5e3 req-a158e6a4-9195-4e23-9397-46da2e618452 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102992) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:37:44.665459 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-5b4b7d69-2157-4aee-98f9-f025df93a5e3 req-a158e6a4-9195-4e23-9397-46da2e618452 service neutron] 10.222.0.41 "GET /v2.0/ports?network_id=41fa5020-8aad-49ce-b2a6-39d87c9e6042&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0692391 Nov 23 19:37:44.683664 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.db.l3_dvr_db [None req-4f7e90b4-4ad0-431d-b0e4-0b8a7f543dda None None] Set router c925adea-d520-48c2-a2b3-fdb5661aaf95 gateway port host: dv-cinder-819011-1-iscsi {{(pid=102994) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 23 19:37:44.686919 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [None req-0cd21801-2d7f-4651-8c12-6d9ee59c3194 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:37:44.752819 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [None req-0cd21801-2d7f-4651-8c12-6d9ee59c3194 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:37:44.809850 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-5b4b7d69-2157-4aee-98f9-f025df93a5e3 req-e64e6c0e-e00e-4592-a74b-f9dc914010e8 service neutron] 10.222.0.41 "GET /v2.0/networks/41fa5020-8aad-49ce-b2a6-39d87c9e6042?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1329434 Nov 23 19:37:44.847464 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-58c81249-aaa9-473a-8db3-e6d81ad90772 req-b099b57f-5ea8-40fc-97c7-aec9a9520931 tempest-VolumesSnapshotTestJSON-97879810 tempest-VolumesSnapshotTestJSON-97879810-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102993) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:37:44.849155 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-58c81249-aaa9-473a-8db3-e6d81ad90772 req-b099b57f-5ea8-40fc-97c7-aec9a9520931 tempest-VolumesSnapshotTestJSON-97879810 tempest-VolumesSnapshotTestJSON-97879810-project] 10.222.0.62 "GET /v2.0/ports?device_id=56521436-30ba-4dcc-8272-0fcda3e896b0 HTTP/1.1" status: 200 len: 945 time: 0.0657306 Nov 23 19:37:44.910589 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-58c81249-aaa9-473a-8db3-e6d81ad90772 req-821d18a2-4286-4a2e-b362-7936d0ca7206 tempest-VolumesSnapshotTestJSON-97879810 tempest-VolumesSnapshotTestJSON-97879810-project] 10.222.0.62 "GET /v2.0/security-groups?id=2fd4bf42-f1cd-4ab5-94a3-e2347f7bb016&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0527716 Nov 23 19:37:44.916334 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [None req-0cd21801-2d7f-4651-8c12-6d9ee59c3194 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-623933'] for security_group, after_delete {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:37:44.918543 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [None req-0cd21801-2d7f-4651-8c12-6d9ee59c3194 admin admin] Publish callbacks [] for security_group, before_response {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:37:44.922081 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [None req-0cd21801-2d7f-4651-8c12-6d9ee59c3194 admin admin] 10.222.0.62 "DELETE /v2.0/security-groups/ad4decb0-e91b-459d-845e-25d6d3df3c9c HTTP/1.1" status: 204 len: 168 time: 0.3210845 Nov 23 19:37:44.927353 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-5b4b7d69-2157-4aee-98f9-f025df93a5e3 req-b1e20b3e-ef2f-42e9-8d16-9c101b7a2a5a service neutron] 10.222.0.41 "GET /v2.0/networks/41fa5020-8aad-49ce-b2a6-39d87c9e6042?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1048250 Nov 23 19:37:44.939061 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0cd21801-2d7f-4651-8c12-6d9ee59c3194 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=ad4decb0-e91b-459d-845e-25d6d3df3c9c,revision_number=None']} {{(pid=102992) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 23 19:37:44.945050 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.db.l3_hamode_db [None req-4f7e90b4-4ad0-431d-b0e4-0b8a7f543dda None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'c925adea-d520-48c2-a2b3-fdb5661aaf95', 'name': 'tempest-AttachVolumeTestJSON-1672505821-router', 'tenant_id': 'c9d53f0599374b679185cc73383b417c', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'a93e254e-aac9-4233-9e4d-4290fd0458e4', 'external_fixed_ips': [{'subnet_id': 'e0b32f3d-83d6-439a-bbed-01df7cf01051', 'ip_address': '172.27.1.34'}], 'enable_snat': True}, 'gw_port_id': '41109199-34e8-4da6-963c-4a47600cb432', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-23T19:37:05Z', 'updated_at': '2021-11-23T19:37:09Z', 'revision_number': 4, 'project_id': 'c9d53f0599374b679185cc73383b417c', 'gw_port': {'id': '41109199-34e8-4da6-963c-4a47600cb432', 'name': '', 'network_id': 'a93e254e-aac9-4233-9e4d-4290fd0458e4', 'tenant_id': '', 'mac_address': 'fa:16:3e:52:78:cc', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'c925adea-d520-48c2-a2b3-fdb5661aaf95', 'device_owner': 'network:router_gateway', 'standard_attr_id': 486, 'fixed_ips': [{'subnet_id': 'e0b32f3d-83d6-439a-bbed-01df7cf01051', 'ip_address': '172.27.1.34', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-819011-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-23T19:37:06Z', 'updated_at': '2021-11-23T19:37:12Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'e0b32f3d-83d6-439a-bbed-01df7cf01051', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-819011-1-iscsi', '_floatingips': [{'id': 'a621b55c-734d-4ae5-8844-c2140ad172fa', 'tenant_id': 'c9d53f0599374b679185cc73383b417c', 'floating_ip_address': '172.27.1.128', 'floating_network_id': 'a93e254e-aac9-4233-9e4d-4290fd0458e4', 'router_id': 'c925adea-d520-48c2-a2b3-fdb5661aaf95', 'port_id': '2872cb22-0134-49c4-b6d7-034ca4132327', 'fixed_ip_address': '172.20.0.6', 'status': 'DOWN', 'standard_attr_id': 504, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '41fa5020-8aad-49ce-b2a6-39d87c9e6042', 'mac_address': 'fa:16:3e:1d:ae:e6', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '029fedce-3168-4d1d-992e-a9466fe3e886', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-23T19:37:13Z', 'updated_at': '2021-11-23T19:37:43Z', 'revision_number': 1, 'project_id': 'c9d53f0599374b679185cc73383b417c', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '75766f49-5d4b-4c87-b9ea-e4dd672df213', 'name': '', 'network_id': '41fa5020-8aad-49ce-b2a6-39d87c9e6042', 'tenant_id': 'c9d53f0599374b679185cc73383b417c', 'mac_address': 'fa:16:3e:31:a3:fa', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'c925adea-d520-48c2-a2b3-fdb5661aaf95', 'device_owner': 'network:router_interface', 'standard_attr_id': 487, 'fixed_ips': [{'subnet_id': '8f74a1ae-f892-4057-89a5-ca78a259b1bd', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-819011-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-23T19:37:08Z', 'updated_at': '2021-11-23T19:37:14Z', 'revision_number': 5, 'project_id': 'c9d53f0599374b679185cc73383b417c', 'subnets': [{'id': '8f74a1ae-f892-4057-89a5-ca78a259b1bd', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-819011-1-iscsi', False) {} {{(pid=102994) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 23 19:37:44.949796 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0cd21801-2d7f-4651-8c12-6d9ee59c3194 admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-819011-1-iscsi {{(pid=102992) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 23 19:37:44.950388 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0cd21801-2d7f-4651-8c12-6d9ee59c3194 admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-819011-1-iscsi {{(pid=102992) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 23 19:37:44.950746 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0cd21801-2d7f-4651-8c12-6d9ee59c3194 admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-819011-1-iscsi {{(pid=102992) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 23 19:37:44.951220 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0cd21801-2d7f-4651-8c12-6d9ee59c3194 admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-819011-1-iscsi {{(pid=102992) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 23 19:37:44.951737 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0cd21801-2d7f-4651-8c12-6d9ee59c3194 admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-819011-1-iscsi {{(pid=102992) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 23 19:37:44.952082 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0cd21801-2d7f-4651-8c12-6d9ee59c3194 admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-819011-1-iscsi {{(pid=102992) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 23 19:37:44.952422 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0cd21801-2d7f-4651-8c12-6d9ee59c3194 admin admin] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-819011-1-iscsi {{(pid=102992) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 23 19:37:44.952793 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0cd21801-2d7f-4651-8c12-6d9ee59c3194 admin admin] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-819011-1-iscsi {{(pid=102992) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 23 19:37:44.953165 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0cd21801-2d7f-4651-8c12-6d9ee59c3194 admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-819011-1-iscsi {{(pid=102992) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 23 19:37:44.953551 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0cd21801-2d7f-4651-8c12-6d9ee59c3194 admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-819011-1-iscsi {{(pid=102992) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 23 19:37:44.953890 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0cd21801-2d7f-4651-8c12-6d9ee59c3194 admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-819011-1-iscsi {{(pid=102992) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 23 19:37:44.954221 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0cd21801-2d7f-4651-8c12-6d9ee59c3194 admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-819011-1-iscsi {{(pid=102992) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 23 19:37:44.985922 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-4f7e90b4-4ad0-431d-b0e4-0b8a7f543dda None None] The sync data for ids ['c925adea-d520-48c2-a2b3-fdb5661aaf95'] in dv-cinder-819011-1-iscsi is: [{'id': 'c925adea-d520-48c2-a2b3-fdb5661aaf95', 'name': 'tempest-AttachVolumeTestJSON-1672505821-router', 'tenant_id': 'c9d53f0599374b679185cc73383b417c', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'a93e254e-aac9-4233-9e4d-4290fd0458e4', 'external_fixed_ips': [{'subnet_id': 'e0b32f3d-83d6-439a-bbed-01df7cf01051', 'ip_address': '172.27.1.34'}], 'enable_snat': True}, 'gw_port_id': '41109199-34e8-4da6-963c-4a47600cb432', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-23T19:37:05Z', 'updated_at': '2021-11-23T19:37:09Z', 'revision_number': 4, 'project_id': 'c9d53f0599374b679185cc73383b417c', 'gw_port': {'id': '41109199-34e8-4da6-963c-4a47600cb432', 'name': '', 'network_id': 'a93e254e-aac9-4233-9e4d-4290fd0458e4', 'tenant_id': '', 'mac_address': 'fa:16:3e:52:78:cc', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'c925adea-d520-48c2-a2b3-fdb5661aaf95', 'device_owner': 'network:router_gateway', 'standard_attr_id': 486, 'fixed_ips': [{'subnet_id': 'e0b32f3d-83d6-439a-bbed-01df7cf01051', 'ip_address': '172.27.1.34', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-819011-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-23T19:37:06Z', 'updated_at': '2021-11-23T19:37:12Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'e0b32f3d-83d6-439a-bbed-01df7cf01051', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-819011-1-iscsi', '_floatingips': [{'id': 'a621b55c-734d-4ae5-8844-c2140ad172fa', 'tenant_id': 'c9d53f0599374b679185cc73383b417c', 'floating_ip_address': '172.27.1.128', 'floating_network_id': 'a93e254e-aac9-4233-9e4d-4290fd0458e4', 'router_id': 'c925adea-d520-48c2-a2b3-fdb5661aaf95', 'port_id': '2872cb22-0134-49c4-b6d7-034ca4132327', 'fixed_ip_address': '172.20.0.6', 'status': 'DOWN', 'standard_attr_id': 504, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '41fa5020-8aad-49ce-b2a6-39d87c9e6042', 'mac_address': 'fa:16:3e:1d:ae:e6', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '029fedce-3168-4d1d-992e-a9466fe3e886', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-23T19:37:13Z', 'updated_at': '2021-11-23T19:37:43Z', 'revision_number': 1, 'project_id': 'c9d53f0599374b679185cc73383b417c', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '75766f49-5d4b-4c87-b9ea-e4dd672df213', 'name': '', 'network_id': '41fa5020-8aad-49ce-b2a6-39d87c9e6042', 'tenant_id': 'c9d53f0599374b679185cc73383b417c', 'mac_address': 'fa:16:3e:31:a3:fa', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'c925adea-d520-48c2-a2b3-fdb5661aaf95', 'device_owner': 'network:router_interface', 'standard_attr_id': 487, 'fixed_ips': [{'subnet_id': '8f74a1ae-f892-4057-89a5-ca78a259b1bd', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-819011-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-23T19:37:08Z', 'updated_at': '2021-11-23T19:37:14Z', 'revision_number': 5, 'project_id': 'c9d53f0599374b679185cc73383b417c', 'subnets': [{'id': '8f74a1ae-f892-4057-89a5-ca78a259b1bd', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=102994) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 23 19:37:45.063056 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron_lib.callbacks.manager [None req-8346ef05-f685-4c3d-af3d-a159b683bec2 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8783631323329', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7978582'] for agent, after_update {{(pid=102994) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:37:45.186245 dv-cinder-819011-1-iscsi neutron-server[102995]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-219f54f9-1056-4860-9bf5-2ccc066e3d5f None None] New status for floating IP a621b55c-734d-4ae5-8844-c2140ad172fa: ACTIVE {{(pid=102995) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Nov 23 19:37:45.940154 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.wsgi [-] (102992) accepted ('10.222.0.62', 48564) {{(pid=102992) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 23 19:37:46.034975 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-56d6b111-ba0b-4fef-ac59-af934cef68e0 req-5e892e1a-837b-4cce-8b73-b80700f87cbf tempest-VolumesSnapshotTestJSON-97879810 tempest-VolumesSnapshotTestJSON-97879810-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102993) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:37:46.036634 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-56d6b111-ba0b-4fef-ac59-af934cef68e0 req-5e892e1a-837b-4cce-8b73-b80700f87cbf tempest-VolumesSnapshotTestJSON-97879810 tempest-VolumesSnapshotTestJSON-97879810-project] 10.222.0.62 "GET /v2.0/ports?device_id=56521436-30ba-4dcc-8272-0fcda3e896b0 HTTP/1.1" status: 200 len: 945 time: 0.0529964 Nov 23 19:37:46.055567 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.api.v2.base [None req-5ea58cc9-4fd2-4592-8271-518ed05b4f3a admin admin] Request body: {'network': {'name': 'tempest-TestMinimumBasicScenario-387750355-network', 'tenant_id': 'ed0d906c96b540a7b11d508615543890'}} {{(pid=102992) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 23 19:37:46.089187 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-56d6b111-ba0b-4fef-ac59-af934cef68e0 req-25abd55c-1d02-4437-b4ea-ad79b1892908 tempest-VolumesSnapshotTestJSON-97879810 tempest-VolumesSnapshotTestJSON-97879810-project] 10.222.0.62 "GET /v2.0/security-groups?id=2fd4bf42-f1cd-4ab5-94a3-e2347f7bb016&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0459945 Nov 23 19:37:46.154461 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-5ea58cc9-4fd2-4592-8271-518ed05b4f3a admin admin] Made reservation on behalf of ed0d906c96b540a7b11d508615543890 for: {'network': 1} {{(pid=102992) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 23 19:37:46.156850 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [None req-5ea58cc9-4fd2-4592-8271-518ed05b4f3a admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7921281'] for network, before_create {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:37:46.166311 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [None req-5ea58cc9-4fd2-4592-8271-518ed05b4f3a admin admin] Publish callbacks [] for security_group, before_create {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:37:46.241129 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [None req-5ea58cc9-4fd2-4592-8271-518ed05b4f3a admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:37:46.280225 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [None req-5ea58cc9-4fd2-4592-8271-518ed05b4f3a admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-623933'] for security_group, after_create {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:37:46.305197 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-5ea58cc9-4fd2-4592-8271-518ed05b4f3a admin admin] vlan segment allocate from pool success with {'vlan_id': 816, 'physical_network': 'physnet1'} {{(pid=102992) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 23 19:37:46.315949 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5ea58cc9-4fd2-4592-8271-518ed05b4f3a admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=d09b4044-91d5-4432-9faa-4b7a40b1627d,revision_number=1']} {{(pid=102992) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 23 19:37:46.329335 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [None req-5ea58cc9-4fd2-4592-8271-518ed05b4f3a admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7982218'] for segment, precommit_create {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:37:46.329705 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.db.segments_db [None req-5ea58cc9-4fd2-4592-8271-518ed05b4f3a admin admin] Added segment 81f92f0c-ea8d-4880-af1c-e4418f898de3 of type vlan for network 96f89427-8150-464f-a280-f07cf823b4fd Nov 23 19:37:46.388924 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [None req-5ea58cc9-4fd2-4592-8271-518ed05b4f3a admin admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8783630993713'] for network, precommit_create {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:37:46.407121 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f88ff52f-cdc9-4e7a-a6c2-b4464bc9261a req-a487877c-f5d5-4bb5-964b-9983a419b50a tempest-VolumesSnapshotTestJSON-97879810 tempest-VolumesSnapshotTestJSON-97879810-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102992) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:37:46.409037 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-f88ff52f-cdc9-4e7a-a6c2-b4464bc9261a req-a487877c-f5d5-4bb5-964b-9983a419b50a tempest-VolumesSnapshotTestJSON-97879810 tempest-VolumesSnapshotTestJSON-97879810-project] 10.222.0.41 "GET /v2.0/ports?device_id=56521436-30ba-4dcc-8272-0fcda3e896b0 HTTP/1.1" status: 200 len: 945 time: 0.0901408 Nov 23 19:37:46.513154 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [None req-5ea58cc9-4fd2-4592-8271-518ed05b4f3a admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-554949', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560168'] for network, after_create {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:37:46.513154 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-5ea58cc9-4fd2-4592-8271-518ed05b4f3a admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102992) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:37:46.513523 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [None req-5ea58cc9-4fd2-4592-8271-518ed05b4f3a admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-560186'] for network, before_response {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:37:46.546382 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.plugins.ml2.plugin [req-f88ff52f-cdc9-4e7a-a6c2-b4464bc9261a req-876c79fd-54ef-417d-98fa-a4084310bb64 tempest-VolumesSnapshotTestJSON-97879810 tempest-VolumesSnapshotTestJSON-97879810-project] Deleting port cee918cb-f6e3-450a-9a6b-6a6e13f08868 {{(pid=102992) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 23 19:37:46.546720 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [req-f88ff52f-cdc9-4e7a-a6c2-b4464bc9261a req-876c79fd-54ef-417d-98fa-a4084310bb64 tempest-VolumesSnapshotTestJSON-97879810 tempest-VolumesSnapshotTestJSON-97879810-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8783631423070'] for port, before_delete {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:37:46.605100 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5ea58cc9-4fd2-4592-8271-518ed05b4f3a admin admin] Pushing event updated for resources: {'Network': ['ID=96f89427-8150-464f-a280-f07cf823b4fd,revision_number=1']} {{(pid=102992) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 23 19:37:46.611551 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron_lib.callbacks.manager [None req-785c1d26-11ba-42d8-b5a6-51a8b3daeef0 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8783631323329', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7978582'] for agent, after_update {{(pid=102994) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:37:46.616287 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.plugins.ml2.rpc [None req-eb87b2c3-3339-4249-8b85-e695b5b4e1f9 None None] Network 96f89427-8150-464f-a280-f07cf823b4fd details requested by agent ovs-agent-dv-cinder-819011-1-iscsi with host dv-cinder-819011-1-iscsi {{(pid=102994) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Nov 23 19:37:46.645184 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [None req-5ea58cc9-4fd2-4592-8271-518ed05b4f3a admin admin] 10.222.0.62 "POST /v2.0/networks HTTP/1.1" status: 201 len: 887 time: 0.7032609 Nov 23 19:37:46.648604 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.wsgi [-] (102993) accepted ('10.222.0.62', 48572) {{(pid=102993) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 23 19:37:46.653707 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.api.v2.base [None req-844a7487-3f36-4c18-a055-06bef522fbfd admin admin] Request body: {'subnet': {'network_id': '96f89427-8150-464f-a280-f07cf823b4fd', 'cidr': '172.20.0.0/28', 'name': 'tempest-TestMinimumBasicScenario-387750355-subnet', 'tenant_id': 'ed0d906c96b540a7b11d508615543890', 'ip_version': 4}} {{(pid=102993) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 23 19:37:46.681806 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.plugins.ml2.db [req-f88ff52f-cdc9-4e7a-a6c2-b4464bc9261a req-876c79fd-54ef-417d-98fa-a4084310bb64 tempest-VolumesSnapshotTestJSON-97879810 tempest-VolumesSnapshotTestJSON-97879810-project] For port cee918cb-f6e3-450a-9a6b-6a6e13f08868, host hv-cinder-81901, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81901',level=0,port_id=cee918cb-f6e3-450a-9a6b-6a6e13f08868,segment=NetworkSegment(b67642b4-1845-4b49-9392-51fd2c9bc8b8),segment_id=b67642b4-1845-4b49-9392-51fd2c9bc8b8)] {{(pid=102992) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 23 19:37:46.682262 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [req-f88ff52f-cdc9-4e7a-a6c2-b4464bc9261a req-876c79fd-54ef-417d-98fa-a4084310bb64 tempest-VolumesSnapshotTestJSON-97879810 tempest-VolumesSnapshotTestJSON-97879810-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-927332'] for port, precommit_delete {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:37:46.696491 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.plugins.ml2.plugin [req-f88ff52f-cdc9-4e7a-a6c2-b4464bc9261a req-876c79fd-54ef-417d-98fa-a4084310bb64 tempest-VolumesSnapshotTestJSON-97879810 tempest-VolumesSnapshotTestJSON-97879810-project] Calling delete_port for cee918cb-f6e3-450a-9a6b-6a6e13f08868 owned by compute:nova {{(pid=102992) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 23 19:37:46.731500 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-844a7487-3f36-4c18-a055-06bef522fbfd admin admin] Made reservation on behalf of ed0d906c96b540a7b11d508615543890 for: {'subnet': 1} {{(pid=102993) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 23 19:37:46.733918 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-844a7487-3f36-4c18-a055-06bef522fbfd admin admin] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-17772934'] for subnet, before_create {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:37:46.879939 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [req-f88ff52f-cdc9-4e7a-a6c2-b4464bc9261a req-876c79fd-54ef-417d-98fa-a4084310bb64 tempest-VolumesSnapshotTestJSON-97879810 tempest-VolumesSnapshotTestJSON-97879810-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7918660', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-15067', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560168', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8783631424624', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8783631008723', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-25199805'] for port, after_delete {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:37:46.901689 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.plugins.ml2.db [None req-4bf48ff4-ecfb-4168-8b63-249b8c6e9f04 None None] get_ports_and_sgs() called for port_ids ['cee918cb-f6e3-450a-9a6b-6a6e13f08868'] {{(pid=102994) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 23 19:37:46.910282 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-876c79fd-54ef-417d-98fa-a4084310bb64 tempest-VolumesSnapshotTestJSON-97879810 tempest-VolumesSnapshotTestJSON-97879810-project] Pushing event deleted for resources: {'Port': ['ID=cee918cb-f6e3-450a-9a6b-6a6e13f08868,revision_number=None']} {{(pid=102992) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 23 19:37:46.948746 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-844a7487-3f36-4c18-a055-06bef522fbfd admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-554858', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560168', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-17257652', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-17772948'] for subnet, after_create {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:37:46.950086 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.db.l3_dvrscheduler_db [req-f88ff52f-cdc9-4e7a-a6c2-b4464bc9261a req-876c79fd-54ef-417d-98fa-a4084310bb64 tempest-VolumesSnapshotTestJSON-97879810 tempest-VolumesSnapshotTestJSON-97879810-project] No DVR routers for this DVR port cee918cb-f6e3-450a-9a6b-6a6e13f08868 on host hv-cinder-81901 {{(pid=102992) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 23 19:37:46.952763 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [req-f88ff52f-cdc9-4e7a-a6c2-b4464bc9261a req-876c79fd-54ef-417d-98fa-a4084310bb64 tempest-VolumesSnapshotTestJSON-97879810 tempest-VolumesSnapshotTestJSON-97879810-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-514902'] for port, before_response {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:37:46.956775 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-f88ff52f-cdc9-4e7a-a6c2-b4464bc9261a req-876c79fd-54ef-417d-98fa-a4084310bb64 tempest-VolumesSnapshotTestJSON-97879810 tempest-VolumesSnapshotTestJSON-97879810-project] 10.222.0.41 "DELETE /v2.0/ports/cee918cb-f6e3-450a-9a6b-6a6e13f08868 HTTP/1.1" status: 204 len: 173 time: 0.5364945 Nov 23 19:37:46.960985 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '56521436-30ba-4dcc-8272-0fcda3e896b0', 'name': 'network-vif-deleted', 'tag': 'cee918cb-f6e3-450a-9a6b-6a6e13f08868'}] {{(pid=102992) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 23 19:37:46.960985 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.62/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}f86c332b591ae691ababa4b64e0601cbf242a448242f95367ce03daabfb7e1ce" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-ad616c09-3aeb-419d-ac07-df6f29a2da9c" -d '{"events": [{"server_uuid": "56521436-30ba-4dcc-8272-0fcda3e896b0", "name": "network-vif-deleted", "tag": "cee918cb-f6e3-450a-9a6b-6a6e13f08868"}]}' {{(pid=102992) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 23 19:37:47.004999 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 23 Nov 2021 19:37:46 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-15e9c125-4661-4e83-a80f-903652b273b5 x-openstack-request-id: req-15e9c125-4661-4e83-a80f-903652b273b5 {{(pid=102992) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 23 19:37:47.005264 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-844a7487-3f36-4c18-a055-06bef522fbfd admin admin] Pushing event updated for resources: {'Subnet': ['ID=bfa70c12-21c8-4b7f-8a30-da7ff37b80b8,revision_number=0']} {{(pid=102993) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 23 19:37:47.005398 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "56521436-30ba-4dcc-8272-0fcda3e896b0", "name": "network-vif-deleted", "tag": "cee918cb-f6e3-450a-9a6b-6a6e13f08868", "status": "completed", "code": 200}]} {{(pid=102992) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 23 19:37:47.005716 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.62/compute/v2.1/os-server-external-events used request id req-15e9c125-4661-4e83-a80f-903652b273b5 {{(pid=102992) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 23 19:37:47.006115 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '56521436-30ba-4dcc-8272-0fcda3e896b0', 'name': 'network-vif-deleted', 'tag': 'cee918cb-f6e3-450a-9a6b-6a6e13f08868', 'status': 'completed', 'code': 200} Nov 23 19:37:47.015801 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-844a7487-3f36-4c18-a055-06bef522fbfd admin admin] Checking segment: {'id': '81f92f0c-ea8d-4880-af1c-e4418f898de3', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 816, 'network_id': '96f89427-8150-464f-a280-f07cf823b4fd'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102993) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 23 19:37:47.016165 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-844a7487-3f36-4c18-a055-06bef522fbfd admin admin] Network hostable DHCP agents. Network: 96f89427-8150-464f-a280-f07cf823b4fd, hostable agents: ['e51c95c7-6a36-4263-ba47-1839054f3e7a'], hosted agents: [] {{(pid=102993) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 23 19:37:47.091232 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-844a7487-3f36-4c18-a055-06bef522fbfd admin admin] Network 96f89427-8150-464f-a280-f07cf823b4fd is scheduled to be hosted by DHCP agent e51c95c7-6a36-4263-ba47-1839054f3e7a with binding_index 1 {{(pid=102993) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 23 19:37:47.142720 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.scheduler.base_scheduler [None req-844a7487-3f36-4c18-a055-06bef522fbfd admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-819011-1-iscsi, 96f89427-8150-464f-a280-f07cf823b4fd) {{(pid=102993) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 23 19:37:47.147061 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-844a7487-3f36-4c18-a055-06bef522fbfd admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=102993) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:37:47.147696 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-844a7487-3f36-4c18-a055-06bef522fbfd admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-560186'] for subnet, before_response {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:37:47.152923 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-1df4b85a-f331-412e-a0ee-6cab959ac3cb None None] Network 96f89427-8150-464f-a280-f07cf823b4fd requested from dv-cinder-819011-1-iscsi {{(pid=102994) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 23 19:37:47.195530 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-fbd64e9b-1019-4890-8aaf-5f74fe58727b req-1272f0ce-fe8d-47a2-a4c0-a7bfe7e22d14 tempest-VolumesSnapshotTestJSON-97879810 tempest-VolumesSnapshotTestJSON-97879810-project] 10.222.0.62 "GET /v2.0/ports?device_id=56521436-30ba-4dcc-8272-0fcda3e896b0 HTTP/1.1" status: 200 len: 210 time: 0.0333946 Nov 23 19:37:47.231876 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [None req-844a7487-3f36-4c18-a055-06bef522fbfd admin admin] 10.222.0.62 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 850 time: 0.5820255 Nov 23 19:37:47.236385 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.wsgi [-] (102993) accepted ('10.222.0.62', 48580) {{(pid=102993) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 23 19:37:47.241915 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.api.v2.base [None req-54829aa6-2cdb-492e-a3b1-dbc3f0e5d001 admin admin] Request body: {'router': {'name': 'tempest-TestMinimumBasicScenario-387750355-router', 'tenant_id': 'ed0d906c96b540a7b11d508615543890', 'external_gateway_info': {'network_id': 'a93e254e-aac9-4233-9e4d-4290fd0458e4'}}} {{(pid=102993) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 23 19:37:47.308922 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-54829aa6-2cdb-492e-a3b1-dbc3f0e5d001 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-933550', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-13503'] for router, before_create {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:37:47.310631 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-54829aa6-2cdb-492e-a3b1-dbc3f0e5d001 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-933038', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-927700', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-622769', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-13448'] for router, precommit_create {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:37:47.328002 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-c3616fc0-4d80-4b37-a365-b95c926efbf3 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp8353ff9b-e01d-5e31-ab2d-60a764783255-96f89427-8150-464f-a280-f07cf823b4fd', 'network_id': '96f89427-8150-464f-a280-f07cf823b4fd', 'tenant_id': 'ed0d906c96b540a7b11d508615543890', 'fixed_ips': [{'subnet_id': 'bfa70c12-21c8-4b7f-8a30-da7ff37b80b8'}]}} from dv-cinder-819011-1-iscsi. {{(pid=102994) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:285}} Nov 23 19:37:47.329226 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron_lib.callbacks.manager [None req-c3616fc0-4d80-4b37-a365-b95c926efbf3 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7921281'] for port, before_create {{(pid=102994) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:37:47.372192 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-54829aa6-2cdb-492e-a3b1-dbc3f0e5d001 admin admin] Publish callbacks [] for router_controller, precommit_add_association {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:37:47.395724 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron_lib.callbacks.manager [None req-eb87b2c3-3339-4249-8b85-e695b5b4e1f9 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8783631323329', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7978582'] for agent, after_update {{(pid=102994) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:37:47.601698 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.db.db_base_plugin_common [None req-c3616fc0-4d80-4b37-a365-b95c926efbf3 None None] Allocated IP 172.20.0.2 (96f89427-8150-464f-a280-f07cf823b4fd/bfa70c12-21c8-4b7f-8a30-da7ff37b80b8/42144ab1-222d-419d-bc9e-bfd56a9e1e94) {{(pid=102994) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 23 19:37:47.756143 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron_lib.callbacks.manager [None req-c3616fc0-4d80-4b37-a365-b95c926efbf3 None None] Publish callbacks [] for port, precommit_create {{(pid=102994) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:37:47.811894 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron_lib.callbacks.manager [None req-c3616fc0-4d80-4b37-a365-b95c926efbf3 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7918660', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-15067', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560168', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8783631008714'] for port, after_create {{(pid=102994) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:37:47.846518 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-54829aa6-2cdb-492e-a3b1-dbc3f0e5d001 admin admin] Publish callbacks [] for router_gateway, precommit_update {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:37:47.852879 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-c3616fc0-4d80-4b37-a365-b95c926efbf3 None None] Network 96f89427-8150-464f-a280-f07cf823b4fd is already hosted by enough agents. {{(pid=102994) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 23 19:37:47.856026 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.scheduler.base_scheduler [None req-c3616fc0-4d80-4b37-a365-b95c926efbf3 None None] Resources bound (agent type, host, resource id): {{(pid=102994) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 23 19:37:47.859911 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.db.l3_dvrscheduler_db [None req-c3616fc0-4d80-4b37-a365-b95c926efbf3 None None] Received port after_create {{(pid=102994) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 23 19:37:47.866363 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c3616fc0-4d80-4b37-a365-b95c926efbf3 None None] Pushing event updated for resources: {'Port': ['ID=42144ab1-222d-419d-bc9e-bfd56a9e1e94,revision_number=1']} {{(pid=102994) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 23 19:37:47.878222 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c3616fc0-4d80-4b37-a365-b95c926efbf3 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-819011-1-iscsi {{(pid=102994) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 23 19:37:47.879512 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c3616fc0-4d80-4b37-a365-b95c926efbf3 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-819011-1-iscsi {{(pid=102994) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 23 19:37:47.879512 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c3616fc0-4d80-4b37-a365-b95c926efbf3 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-819011-1-iscsi {{(pid=102994) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 23 19:37:47.879512 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c3616fc0-4d80-4b37-a365-b95c926efbf3 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-819011-1-iscsi {{(pid=102994) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 23 19:37:47.879769 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c3616fc0-4d80-4b37-a365-b95c926efbf3 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-819011-1-iscsi {{(pid=102994) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 23 19:37:47.880045 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c3616fc0-4d80-4b37-a365-b95c926efbf3 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-819011-1-iscsi {{(pid=102994) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 23 19:37:47.880380 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c3616fc0-4d80-4b37-a365-b95c926efbf3 None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-819011-1-iscsi {{(pid=102994) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 23 19:37:47.880710 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c3616fc0-4d80-4b37-a365-b95c926efbf3 None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-819011-1-iscsi {{(pid=102994) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 23 19:37:47.881057 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c3616fc0-4d80-4b37-a365-b95c926efbf3 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-819011-1-iscsi {{(pid=102994) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 23 19:37:47.881390 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c3616fc0-4d80-4b37-a365-b95c926efbf3 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-819011-1-iscsi {{(pid=102994) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 23 19:37:47.881740 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c3616fc0-4d80-4b37-a365-b95c926efbf3 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-819011-1-iscsi {{(pid=102994) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 23 19:37:47.882061 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c3616fc0-4d80-4b37-a365-b95c926efbf3 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-819011-1-iscsi {{(pid=102994) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 23 19:37:47.930934 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.plugins.ml2.managers [None req-c3616fc0-4d80-4b37-a365-b95c926efbf3 None None] Attempting to bind port 42144ab1-222d-419d-bc9e-bfd56a9e1e94 on host dv-cinder-819011-1-iscsi for vnic_type normal with profile {{(pid=102994) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 23 19:37:47.931312 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.plugins.ml2.managers [None req-c3616fc0-4d80-4b37-a365-b95c926efbf3 None None] Attempting to bind port 42144ab1-222d-419d-bc9e-bfd56a9e1e94 by drivers openvswitch,hyperv on host dv-cinder-819011-1-iscsi at level 0 using segments [{'id': '81f92f0c-ea8d-4880-af1c-e4418f898de3', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 816, 'network_id': '96f89427-8150-464f-a280-f07cf823b4fd'}] {{(pid=102994) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 23 19:37:47.931681 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-c3616fc0-4d80-4b37-a365-b95c926efbf3 None None] Attempting to bind port 42144ab1-222d-419d-bc9e-bfd56a9e1e94 on network 96f89427-8150-464f-a280-f07cf823b4fd {{(pid=102994) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 23 19:37:47.936933 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-c3616fc0-4d80-4b37-a365-b95c926efbf3 None None] Checking agent: {'id': '668c8953-047c-499e-8c0d-db838fac1668', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-819011-1-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 23, 19, 25, 17), 'started_at': datetime.datetime(2021, 11, 23, 19, 25, 47), 'heartbeat_timestamp': datetime.datetime(2021, 11, 23, 19, 37, 47), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-819011-1-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=102994) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 23 19:37:47.937310 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-c3616fc0-4d80-4b37-a365-b95c926efbf3 None None] Checking segment: {'id': '81f92f0c-ea8d-4880-af1c-e4418f898de3', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 816, 'network_id': '96f89427-8150-464f-a280-f07cf823b4fd'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102994) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 23 19:37:47.937797 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron_lib.callbacks.manager [None req-c3616fc0-4d80-4b37-a365-b95c926efbf3 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=102994) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:37:47.938193 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-c3616fc0-4d80-4b37-a365-b95c926efbf3 None None] Bound using segment: {'id': '81f92f0c-ea8d-4880-af1c-e4418f898de3', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 816, 'network_id': '96f89427-8150-464f-a280-f07cf823b4fd'} {{(pid=102994) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 23 19:37:47.938658 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.plugins.ml2.managers [None req-c3616fc0-4d80-4b37-a365-b95c926efbf3 None None] Bound port: 42144ab1-222d-419d-bc9e-bfd56a9e1e94, host: dv-cinder-819011-1-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '81f92f0c-ea8d-4880-af1c-e4418f898de3', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 816, 'network_id': '96f89427-8150-464f-a280-f07cf823b4fd'}}] {{(pid=102994) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 23 19:37:47.939045 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron_lib.callbacks.manager [None req-c3616fc0-4d80-4b37-a365-b95c926efbf3 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7921281'] for port, before_update {{(pid=102994) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:37:48.006677 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.plugins.ml2.db [None req-c3616fc0-4d80-4b37-a365-b95c926efbf3 None None] For port 42144ab1-222d-419d-bc9e-bfd56a9e1e94, host dv-cinder-819011-1-iscsi, cleared binding levels {{(pid=102994) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 23 19:37:48.009853 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.plugins.ml2.db [None req-c3616fc0-4d80-4b37-a365-b95c926efbf3 None None] For port 42144ab1-222d-419d-bc9e-bfd56a9e1e94, host dv-cinder-819011-1-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-819011-1-iscsi',level=0,port_id=42144ab1-222d-419d-bc9e-bfd56a9e1e94,segment=NetworkSegment(81f92f0c-ea8d-4880-af1c-e4418f898de3),segment_id=81f92f0c-ea8d-4880-af1c-e4418f898de3)] {{(pid=102994) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 23 19:37:48.080316 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron_lib.callbacks.manager [None req-c3616fc0-4d80-4b37-a365-b95c926efbf3 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7918660', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-15067', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560168', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8783631423946', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8783631008732', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8783631008750'] for port, after_update {{(pid=102994) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:37:48.153017 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c3616fc0-4d80-4b37-a365-b95c926efbf3 None None] Pushing event updated for resources: {'Port': ['ID=42144ab1-222d-419d-bc9e-bfd56a9e1e94,revision_number=2']} {{(pid=102994) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 23 19:37:48.166082 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-54829aa6-2cdb-492e-a3b1-dbc3f0e5d001 admin admin] Publish callbacks [] for router_gateway, before_create {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:37:48.186341 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-54829aa6-2cdb-492e-a3b1-dbc3f0e5d001 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7921281'] for port, before_create {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:37:48.329081 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.db.db_base_plugin_common [None req-54829aa6-2cdb-492e-a3b1-dbc3f0e5d001 admin admin] Allocated IP 172.27.1.102 (a93e254e-aac9-4233-9e4d-4290fd0458e4/e0b32f3d-83d6-439a-bbed-01df7cf01051/80f6861a-4aab-4ba4-a058-5c03b253434a) {{(pid=102993) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 23 19:37:48.456146 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-54829aa6-2cdb-492e-a3b1-dbc3f0e5d001 admin admin] Publish callbacks [] for port, precommit_create {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:37:48.572252 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-54829aa6-2cdb-492e-a3b1-dbc3f0e5d001 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7918660', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-15067', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560168', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8783631008714', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-17257496'] for port, after_create {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:37:48.615338 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-54829aa6-2cdb-492e-a3b1-dbc3f0e5d001 admin admin] Network a93e254e-aac9-4233-9e4d-4290fd0458e4 is already hosted by enough agents. {{(pid=102993) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 23 19:37:48.620017 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.scheduler.base_scheduler [None req-54829aa6-2cdb-492e-a3b1-dbc3f0e5d001 admin admin] Resources bound (agent type, host, resource id): {{(pid=102993) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 23 19:37:48.624791 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.db.l3_dvrscheduler_db [None req-54829aa6-2cdb-492e-a3b1-dbc3f0e5d001 admin admin] Received port after_create {{(pid=102993) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 23 19:37:48.655063 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-54829aa6-2cdb-492e-a3b1-dbc3f0e5d001 admin admin] Pushing event updated for resources: {'Port': ['ID=80f6861a-4aab-4ba4-a058-5c03b253434a,revision_number=1']} {{(pid=102993) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 23 19:37:48.990969 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-54829aa6-2cdb-492e-a3b1-dbc3f0e5d001 admin admin] Publish callbacks [] for router_gateway, after_create {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:37:49.121437 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-0efb1942-032a-4f5d-a4ea-9bbf56cf54b2 None None] Network 96f89427-8150-464f-a280-f07cf823b4fd requested from dv-cinder-819011-1-iscsi {{(pid=102994) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 23 19:37:49.195272 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-54829aa6-2cdb-492e-a3b1-dbc3f0e5d001 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-932875', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-926501'] for router, after_create {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:37:49.262606 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.db.provisioning_blocks [None req-b2999edc-903c-4e61-86ab-c23050b09b33 None None] Provisioning complete for port 42144ab1-222d-419d-bc9e-bfd56a9e1e94 triggered by entity DHCP. {{(pid=102994) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 23 19:37:49.262979 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron_lib.callbacks.manager [None req-b2999edc-903c-4e61-86ab-c23050b09b33 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-8355713'] for port, provisioning_complete {{(pid=102994) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:37:49.375785 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron_lib.callbacks.manager [None req-b2999edc-903c-4e61-86ab-c23050b09b33 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7921281'] for port, before_update {{(pid=102994) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:37:49.382883 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-54829aa6-2cdb-492e-a3b1-dbc3f0e5d001 admin admin] Router dea93f43-8b8f-439e-820e-4269a0926491 is scheduled to L3 agent 1b20f2c4-70b6-43c3-b9bd-0062cc9e57ac with binding_index 1 {{(pid=102993) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Nov 23 19:37:49.411516 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.plugins.ml2.db [None req-b2999edc-903c-4e61-86ab-c23050b09b33 None None] For port 42144ab1-222d-419d-bc9e-bfd56a9e1e94, host dv-cinder-819011-1-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-819011-1-iscsi',level=0,port_id=42144ab1-222d-419d-bc9e-bfd56a9e1e94,segment=NetworkSegment(81f92f0c-ea8d-4880-af1c-e4418f898de3),segment_id=81f92f0c-ea8d-4880-af1c-e4418f898de3)] {{(pid=102994) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 23 19:37:49.499310 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-54829aa6-2cdb-492e-a3b1-dbc3f0e5d001 admin admin] Notify agent at l3_agent.dv-cinder-819011-1-iscsi the message routers_updated {{(pid=102993) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 23 19:37:49.509801 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-3ded8ad2-3117-4be6-9699-b93ce46aa402 None None] Sync routers for ids ['dea93f43-8b8f-439e-820e-4269a0926491'] in dv-cinder-819011-1-iscsi {{(pid=102994) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 23 19:37:49.516828 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron_lib.callbacks.manager [None req-b2999edc-903c-4e61-86ab-c23050b09b33 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7918660', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-15067', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560168', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8783631423946', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8783631008732', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8783631008750'] for port, after_update {{(pid=102994) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:37:49.543701 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.db.l3_dvrscheduler_db [None req-3ded8ad2-3117-4be6-9699-b93ce46aa402 None None] Routers {'dea93f43-8b8f-439e-820e-4269a0926491'} bound to L3 agent in host dv-cinder-819011-1-iscsi {{(pid=102994) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 23 19:37:49.547564 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.db.l3_hamode_db [None req-3ded8ad2-3117-4be6-9699-b93ce46aa402 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-819011-1-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 7, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 7, "log_agent_heartbeats": false, "routers": 7},created_at=2021-11-23T19:25:14Z,description=,heartbeat_timestamp=2021-11-23T19:37:44Z,host='dv-cinder-819011-1-iscsi',id=1b20f2c4-70b6-43c3-b9bd-0062cc9e57ac,load=0,resource_versions=,resources_synced=,started_at=2021-11-23T19:25:15Z,topic='l3_agent')) {'router_ids': ['dea93f43-8b8f-439e-820e-4269a0926491'], 'active': True} {{(pid=102994) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 23 19:37:49.613822 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b2999edc-903c-4e61-86ab-c23050b09b33 None None] Pushing event updated for resources: {'Port': ['ID=42144ab1-222d-419d-bc9e-bfd56a9e1e94,revision_number=3']} {{(pid=102994) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 23 19:37:49.614055 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-54829aa6-2cdb-492e-a3b1-dbc3f0e5d001 admin admin] Publish callbacks [] for router, before_response {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:37:49.615193 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [None req-54829aa6-2cdb-492e-a3b1-dbc3f0e5d001 admin admin] 10.222.0.62 "POST /v2.0/routers HTTP/1.1" status: 201 len: 926 time: 2.3772252 Nov 23 19:37:49.618042 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.wsgi [-] (102993) accepted ('10.222.0.62', 48598) {{(pid=102993) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 23 19:37:49.670530 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.db.provisioning_blocks [None req-d73de7ec-da29-4a3b-b49a-1127adecdde4 None None] Provisioning complete for port 42144ab1-222d-419d-bc9e-bfd56a9e1e94 triggered by entity DHCP. {{(pid=102994) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 23 19:37:49.670902 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron_lib.callbacks.manager [None req-d73de7ec-da29-4a3b-b49a-1127adecdde4 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-8355713'] for port, provisioning_complete {{(pid=102994) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:37:49.701933 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.db.l3_dvr_db [None req-3ded8ad2-3117-4be6-9699-b93ce46aa402 None None] Set router dea93f43-8b8f-439e-820e-4269a0926491 gateway port host: dv-cinder-819011-1-iscsi {{(pid=102994) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 23 19:37:49.938037 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.db.l3_hamode_db [None req-3ded8ad2-3117-4be6-9699-b93ce46aa402 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'dea93f43-8b8f-439e-820e-4269a0926491', 'name': 'tempest-TestMinimumBasicScenario-387750355-router', 'tenant_id': 'ed0d906c96b540a7b11d508615543890', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'a93e254e-aac9-4233-9e4d-4290fd0458e4', 'external_fixed_ips': [{'subnet_id': 'e0b32f3d-83d6-439a-bbed-01df7cf01051', 'ip_address': '172.27.1.102'}], 'enable_snat': True}, 'gw_port_id': '80f6861a-4aab-4ba4-a058-5c03b253434a', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-23T19:37:47Z', 'updated_at': '2021-11-23T19:37:48Z', 'revision_number': 3, 'project_id': 'ed0d906c96b540a7b11d508615543890', 'gw_port': {'id': '80f6861a-4aab-4ba4-a058-5c03b253434a', 'name': '', 'network_id': 'a93e254e-aac9-4233-9e4d-4290fd0458e4', 'tenant_id': '', 'mac_address': 'fa:16:3e:d4:39:b5', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'dea93f43-8b8f-439e-820e-4269a0926491', 'device_owner': 'network:router_gateway', 'standard_attr_id': 554, 'fixed_ips': [{'subnet_id': 'e0b32f3d-83d6-439a-bbed-01df7cf01051', 'ip_address': '172.27.1.102', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-23T19:37:48Z', 'updated_at': '2021-11-23T19:37:48Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': 'e0b32f3d-83d6-439a-bbed-01df7cf01051', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-819011-1-iscsi'}], 'dv-cinder-819011-1-iscsi', False) {} {{(pid=102994) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 23 19:37:49.968790 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-3ded8ad2-3117-4be6-9699-b93ce46aa402 None None] Checking router: dea93f43-8b8f-439e-820e-4269a0926491 for host: dv-cinder-819011-1-iscsi {{(pid=102994) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 23 19:37:49.969055 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-3ded8ad2-3117-4be6-9699-b93ce46aa402 None None] Updating router dea93f43-8b8f-439e-820e-4269a0926491 port 80f6861a-4aab-4ba4-a058-5c03b253434a binding host dv-cinder-819011-1-iscsi {{(pid=102994) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Nov 23 19:37:49.995223 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron_lib.callbacks.manager [None req-3ded8ad2-3117-4be6-9699-b93ce46aa402 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7921281'] for port, before_update {{(pid=102994) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:37:50.068215 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-849d334b-1661-478c-96fa-b0f7a00807f9 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7921281'] for port, before_create {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:37:50.143944 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.plugins.ml2.rpc [None req-eb87b2c3-3339-4249-8b85-e695b5b4e1f9 None None] Device 42144ab1-222d-419d-bc9e-bfd56a9e1e94 up at agent ovs-agent-dv-cinder-819011-1-iscsi {{(pid=102994) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 23 19:37:50.272401 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.db.db_base_plugin_common [None req-849d334b-1661-478c-96fa-b0f7a00807f9 admin admin] Allocated IP 172.20.0.1 (96f89427-8150-464f-a280-f07cf823b4fd/bfa70c12-21c8-4b7f-8a30-da7ff37b80b8/35d7927f-9541-4e91-b520-51ae3ab623f1) {{(pid=102993) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 23 19:37:50.319537 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron_lib.callbacks.manager [None req-3ded8ad2-3117-4be6-9699-b93ce46aa402 None None] Publish callbacks [] for port, precommit_update {{(pid=102994) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:37:50.326938 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.db.provisioning_blocks [None req-eb87b2c3-3339-4249-8b85-e695b5b4e1f9 None None] Provisioning complete for port 42144ab1-222d-419d-bc9e-bfd56a9e1e94 triggered by entity L2. {{(pid=102994) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 23 19:37:50.327301 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron_lib.callbacks.manager [None req-eb87b2c3-3339-4249-8b85-e695b5b4e1f9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-8355713'] for port, provisioning_complete {{(pid=102994) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:37:50.391623 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-849d334b-1661-478c-96fa-b0f7a00807f9 admin admin] Publish callbacks [] for port, precommit_create {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:37:50.402425 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron_lib.callbacks.manager [None req-3ded8ad2-3117-4be6-9699-b93ce46aa402 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7918660', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-15067', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560168', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8783631423946', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8783631008732', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8783631008750'] for port, after_update {{(pid=102994) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:37:50.459352 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.plugins.ml2.managers [None req-3ded8ad2-3117-4be6-9699-b93ce46aa402 None None] Attempting to bind port 80f6861a-4aab-4ba4-a058-5c03b253434a on host dv-cinder-819011-1-iscsi for vnic_type normal with profile {{(pid=102994) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 23 19:37:50.462058 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.plugins.ml2.managers [None req-3ded8ad2-3117-4be6-9699-b93ce46aa402 None None] Attempting to bind port 80f6861a-4aab-4ba4-a058-5c03b253434a by drivers openvswitch,hyperv on host dv-cinder-819011-1-iscsi at level 0 using segments [{'id': '3cb5e60b-103a-47d0-a28b-d68e3159d032', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'a93e254e-aac9-4233-9e4d-4290fd0458e4'}] {{(pid=102994) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 23 19:37:50.462058 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-3ded8ad2-3117-4be6-9699-b93ce46aa402 None None] Attempting to bind port 80f6861a-4aab-4ba4-a058-5c03b253434a on network a93e254e-aac9-4233-9e4d-4290fd0458e4 {{(pid=102994) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 23 19:37:50.462445 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3d5cceca-53db-4ad3-a916-1ec3e1b2bb5a None None] Pushing event updated for resources: {'Port': ['ID=80f6861a-4aab-4ba4-a058-5c03b253434a,revision_number=2']} {{(pid=102994) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 23 19:37:50.468263 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-3ded8ad2-3117-4be6-9699-b93ce46aa402 None None] Checking agent: {'id': '668c8953-047c-499e-8c0d-db838fac1668', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-819011-1-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 23, 19, 25, 17), 'started_at': datetime.datetime(2021, 11, 23, 19, 25, 47), 'heartbeat_timestamp': datetime.datetime(2021, 11, 23, 19, 37, 47), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-819011-1-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=102994) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 23 19:37:50.468637 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-3ded8ad2-3117-4be6-9699-b93ce46aa402 None None] Checking segment: {'id': '3cb5e60b-103a-47d0-a28b-d68e3159d032', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'a93e254e-aac9-4233-9e4d-4290fd0458e4'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102994) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 23 19:37:50.469077 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron_lib.callbacks.manager [None req-3ded8ad2-3117-4be6-9699-b93ce46aa402 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=102994) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:37:50.469435 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-3ded8ad2-3117-4be6-9699-b93ce46aa402 None None] Bound using segment: {'id': '3cb5e60b-103a-47d0-a28b-d68e3159d032', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'a93e254e-aac9-4233-9e4d-4290fd0458e4'} {{(pid=102994) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 23 19:37:50.469915 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.plugins.ml2.managers [None req-3ded8ad2-3117-4be6-9699-b93ce46aa402 None None] Bound port: 80f6861a-4aab-4ba4-a058-5c03b253434a, host: dv-cinder-819011-1-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '3cb5e60b-103a-47d0-a28b-d68e3159d032', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'a93e254e-aac9-4233-9e4d-4290fd0458e4'}}] {{(pid=102994) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 23 19:37:50.470295 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron_lib.callbacks.manager [None req-3ded8ad2-3117-4be6-9699-b93ce46aa402 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7921281'] for port, before_update {{(pid=102994) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:37:50.479193 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-849d334b-1661-478c-96fa-b0f7a00807f9 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7918660', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-15067', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560168', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8783631008714', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-17257496'] for port, after_create {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:37:50.519821 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-849d334b-1661-478c-96fa-b0f7a00807f9 admin admin] Network 96f89427-8150-464f-a280-f07cf823b4fd is already hosted by enough agents. {{(pid=102993) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 23 19:37:50.522745 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.scheduler.base_scheduler [None req-849d334b-1661-478c-96fa-b0f7a00807f9 admin admin] Resources bound (agent type, host, resource id): {{(pid=102993) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 23 19:37:50.525125 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.plugins.ml2.db [None req-3ded8ad2-3117-4be6-9699-b93ce46aa402 None None] For port 80f6861a-4aab-4ba4-a058-5c03b253434a, host dv-cinder-819011-1-iscsi, cleared binding levels {{(pid=102994) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 23 19:37:50.525307 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.db.l3_dvrscheduler_db [None req-849d334b-1661-478c-96fa-b0f7a00807f9 admin admin] Received port after_create {{(pid=102993) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 23 19:37:50.528539 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.plugins.ml2.db [None req-3ded8ad2-3117-4be6-9699-b93ce46aa402 None None] For port 80f6861a-4aab-4ba4-a058-5c03b253434a, host dv-cinder-819011-1-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-819011-1-iscsi',level=0,port_id=80f6861a-4aab-4ba4-a058-5c03b253434a,segment=NetworkSegment(3cb5e60b-103a-47d0-a28b-d68e3159d032),segment_id=3cb5e60b-103a-47d0-a28b-d68e3159d032)] {{(pid=102994) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 23 19:37:50.555356 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-849d334b-1661-478c-96fa-b0f7a00807f9 admin admin] Pushing event updated for resources: {'Port': ['ID=35d7927f-9541-4e91-b520-51ae3ab623f1,revision_number=1']} {{(pid=102993) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 23 19:37:50.575990 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-849d334b-1661-478c-96fa-b0f7a00807f9 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-926676'] for router_interface, before_create {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:37:50.583376 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron_lib.callbacks.manager [None req-3ded8ad2-3117-4be6-9699-b93ce46aa402 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7918660', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-15067', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560168', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8783631423946', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8783631008732', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8783631008750'] for port, after_update {{(pid=102994) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:37:50.646085 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.db.l3_dvrscheduler_db [None req-3ded8ad2-3117-4be6-9699-b93ce46aa402 None None] Routers {'dea93f43-8b8f-439e-820e-4269a0926491'} bound to L3 agent in host dv-cinder-819011-1-iscsi {{(pid=102994) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 23 19:37:50.646729 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.db.l3_hamode_db [None req-3ded8ad2-3117-4be6-9699-b93ce46aa402 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-819011-1-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 7, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 7, "log_agent_heartbeats": false, "routers": 7},created_at=2021-11-23T19:25:14Z,description=,heartbeat_timestamp=2021-11-23T19:37:44Z,host='dv-cinder-819011-1-iscsi',id=1b20f2c4-70b6-43c3-b9bd-0062cc9e57ac,load=0,resource_versions=,resources_synced=,started_at=2021-11-23T19:25:15Z,topic='l3_agent')) {'router_ids': ['dea93f43-8b8f-439e-820e-4269a0926491'], 'active': True} {{(pid=102994) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 23 19:37:50.685743 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3d5cceca-53db-4ad3-a916-1ec3e1b2bb5a None None] Pushing event updated for resources: {'Port': ['ID=80f6861a-4aab-4ba4-a058-5c03b253434a,revision_number=3']} {{(pid=102994) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 23 19:37:50.776482 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-849d334b-1661-478c-96fa-b0f7a00807f9 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7921281'] for port, before_update {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:37:50.887815 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.db.provisioning_blocks [None req-d6e17f4a-397c-43d4-acd6-38da2e003259 None None] Provisioning complete for port 35d7927f-9541-4e91-b520-51ae3ab623f1 triggered by entity DHCP. {{(pid=102994) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 23 19:37:50.888192 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron_lib.callbacks.manager [None req-d6e17f4a-397c-43d4-acd6-38da2e003259 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-8355713'] for port, provisioning_complete {{(pid=102994) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:37:50.913158 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.db.l3_dvr_db [None req-3ded8ad2-3117-4be6-9699-b93ce46aa402 None None] Set router dea93f43-8b8f-439e-820e-4269a0926491 gateway port host: dv-cinder-819011-1-iscsi {{(pid=102994) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 23 19:37:50.950405 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-849d334b-1661-478c-96fa-b0f7a00807f9 admin admin] Publish callbacks [] for port, precommit_update {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:37:50.989911 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.plugins.ml2.plugin [None req-d6e17f4a-397c-43d4-acd6-38da2e003259 None None] Port 35d7927f-9541-4e91-b520-51ae3ab623f1 cannot update to ACTIVE because it is not bound. {{(pid=102994) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 23 19:37:51.028360 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-849d334b-1661-478c-96fa-b0f7a00807f9 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7918660', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-15067', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560168', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8783631423946', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8783631008732', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8783631008750', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-17257505'] for port, after_update {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:37:51.094491 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-849d334b-1661-478c-96fa-b0f7a00807f9 admin admin] Pushing event updated for resources: {'Port': ['ID=35d7927f-9541-4e91-b520-51ae3ab623f1,revision_number=2']} {{(pid=102993) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 23 19:37:51.097624 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-849d334b-1661-478c-96fa-b0f7a00807f9 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-553426', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-932964'] for router_interface, after_create {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:37:51.101922 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.db.l3_hamode_db [None req-3ded8ad2-3117-4be6-9699-b93ce46aa402 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'dea93f43-8b8f-439e-820e-4269a0926491', 'name': 'tempest-TestMinimumBasicScenario-387750355-router', 'tenant_id': 'ed0d906c96b540a7b11d508615543890', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'a93e254e-aac9-4233-9e4d-4290fd0458e4', 'external_fixed_ips': [{'subnet_id': 'e0b32f3d-83d6-439a-bbed-01df7cf01051', 'ip_address': '172.27.1.102'}], 'enable_snat': True}, 'gw_port_id': '80f6861a-4aab-4ba4-a058-5c03b253434a', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-23T19:37:47Z', 'updated_at': '2021-11-23T19:37:48Z', 'revision_number': 3, 'project_id': 'ed0d906c96b540a7b11d508615543890', 'gw_port': {'id': '80f6861a-4aab-4ba4-a058-5c03b253434a', 'name': '', 'network_id': 'a93e254e-aac9-4233-9e4d-4290fd0458e4', 'tenant_id': '', 'mac_address': 'fa:16:3e:d4:39:b5', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'dea93f43-8b8f-439e-820e-4269a0926491', 'device_owner': 'network:router_gateway', 'standard_attr_id': 554, 'fixed_ips': [{'subnet_id': 'e0b32f3d-83d6-439a-bbed-01df7cf01051', 'ip_address': '172.27.1.102', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-819011-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-23T19:37:48Z', 'updated_at': '2021-11-23T19:37:50Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'e0b32f3d-83d6-439a-bbed-01df7cf01051', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-819011-1-iscsi'}], 'dv-cinder-819011-1-iscsi', False) {} {{(pid=102994) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 23 19:37:51.132850 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-3ded8ad2-3117-4be6-9699-b93ce46aa402 None None] The sync data for ids ['dea93f43-8b8f-439e-820e-4269a0926491'] in dv-cinder-819011-1-iscsi is: [{'id': 'dea93f43-8b8f-439e-820e-4269a0926491', 'name': 'tempest-TestMinimumBasicScenario-387750355-router', 'tenant_id': 'ed0d906c96b540a7b11d508615543890', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'a93e254e-aac9-4233-9e4d-4290fd0458e4', 'external_fixed_ips': [{'subnet_id': 'e0b32f3d-83d6-439a-bbed-01df7cf01051', 'ip_address': '172.27.1.102'}], 'enable_snat': True}, 'gw_port_id': '80f6861a-4aab-4ba4-a058-5c03b253434a', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-23T19:37:47Z', 'updated_at': '2021-11-23T19:37:48Z', 'revision_number': 3, 'project_id': 'ed0d906c96b540a7b11d508615543890', 'gw_port': {'id': '80f6861a-4aab-4ba4-a058-5c03b253434a', 'name': '', 'network_id': 'a93e254e-aac9-4233-9e4d-4290fd0458e4', 'tenant_id': '', 'mac_address': 'fa:16:3e:d4:39:b5', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'dea93f43-8b8f-439e-820e-4269a0926491', 'device_owner': 'network:router_gateway', 'standard_attr_id': 554, 'fixed_ips': [{'subnet_id': 'e0b32f3d-83d6-439a-bbed-01df7cf01051', 'ip_address': '172.27.1.102', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-819011-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-23T19:37:48Z', 'updated_at': '2021-11-23T19:37:50Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'e0b32f3d-83d6-439a-bbed-01df7cf01051', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-819011-1-iscsi'}] {{(pid=102994) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 23 19:37:51.192835 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-849d334b-1661-478c-96fa-b0f7a00807f9 admin admin] Network 96f89427-8150-464f-a280-f07cf823b4fd is already hosted by enough agents. {{(pid=102993) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 23 19:37:51.194263 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.scheduler.base_scheduler [None req-849d334b-1661-478c-96fa-b0f7a00807f9 admin admin] Resources bound (agent type, host, resource id): {{(pid=102993) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 23 19:37:51.318549 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-849d334b-1661-478c-96fa-b0f7a00807f9 admin admin] Router dea93f43-8b8f-439e-820e-4269a0926491 has already been hosted by L3 agent 1b20f2c4-70b6-43c3-b9bd-0062cc9e57ac {{(pid=102993) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 23 19:37:51.515177 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.db.provisioning_blocks [None req-551c0f0c-4563-4642-abbf-76b43bb6ff32 None None] Provisioning complete for port 35d7927f-9541-4e91-b520-51ae3ab623f1 triggered by entity DHCP. {{(pid=102994) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 23 19:37:51.515753 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron_lib.callbacks.manager [None req-551c0f0c-4563-4642-abbf-76b43bb6ff32 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-8355713'] for port, provisioning_complete {{(pid=102994) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:37:51.554069 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.plugins.ml2.plugin [None req-551c0f0c-4563-4642-abbf-76b43bb6ff32 None None] Port 35d7927f-9541-4e91-b520-51ae3ab623f1 cannot update to ACTIVE because it is not bound. {{(pid=102994) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 23 19:37:51.718009 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-849d334b-1661-478c-96fa-b0f7a00807f9 admin admin] Notify agent at l3_agent.dv-cinder-819011-1-iscsi the message routers_updated {{(pid=102993) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 23 19:37:51.724037 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [None req-849d334b-1661-478c-96fa-b0f7a00807f9 admin admin] 10.222.0.62 "PUT /v2.0/routers/dea93f43-8b8f-439e-820e-4269a0926491/add_router_interface HTTP/1.1" status: 200 len: 503 time: 2.1049011 Nov 23 19:37:52.093345 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.plugins.ml2.rpc [None req-eb87b2c3-3339-4249-8b85-e695b5b4e1f9 None None] Device 80f6861a-4aab-4ba4-a058-5c03b253434a up at agent ovs-agent-dv-cinder-819011-1-iscsi {{(pid=102994) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 23 19:37:52.144063 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.db.provisioning_blocks [None req-eb87b2c3-3339-4249-8b85-e695b5b4e1f9 None None] Provisioning complete for port 80f6861a-4aab-4ba4-a058-5c03b253434a triggered by entity L2. {{(pid=102994) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 23 19:37:52.144436 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron_lib.callbacks.manager [None req-eb87b2c3-3339-4249-8b85-e695b5b4e1f9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-8355713'] for port, provisioning_complete {{(pid=102994) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:37:52.226388 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron_lib.callbacks.manager [None req-eb87b2c3-3339-4249-8b85-e695b5b4e1f9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7921281'] for port, before_update {{(pid=102994) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:37:52.247038 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.plugins.ml2.db [None req-eb87b2c3-3339-4249-8b85-e695b5b4e1f9 None None] For port 80f6861a-4aab-4ba4-a058-5c03b253434a, host dv-cinder-819011-1-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-819011-1-iscsi',level=0,port_id=80f6861a-4aab-4ba4-a058-5c03b253434a,segment=NetworkSegment(3cb5e60b-103a-47d0-a28b-d68e3159d032),segment_id=3cb5e60b-103a-47d0-a28b-d68e3159d032)] {{(pid=102994) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 23 19:37:52.291753 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron_lib.callbacks.manager [None req-eb87b2c3-3339-4249-8b85-e695b5b4e1f9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7918660', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-15067', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560168', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8783631423946', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8783631008732', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8783631008750'] for port, after_update {{(pid=102994) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:37:52.349397 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-eb87b2c3-3339-4249-8b85-e695b5b4e1f9 None None] Pushing event updated for resources: {'Port': ['ID=80f6861a-4aab-4ba4-a058-5c03b253434a,revision_number=4']} {{(pid=102994) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 23 19:37:52.373639 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.wsgi [-] (102993) accepted ('10.222.0.62', 48638) {{(pid=102993) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 23 19:37:52.379640 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.api.v2.base [None req-9bf3e7e1-cbb5-4c40-ae00-308a14a27434 admin admin] Request body: {'network': {'name': 'tempest-TestMinimumBasicScenario-1019384590-network', 'tenant_id': 'ce37dcbb36ad436fbb4c75aff35bbebf'}} {{(pid=102993) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 23 19:37:52.467974 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-9bf3e7e1-cbb5-4c40-ae00-308a14a27434 admin admin] Made reservation on behalf of ce37dcbb36ad436fbb4c75aff35bbebf for: {'network': 1} {{(pid=102993) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 23 19:37:52.470574 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-9bf3e7e1-cbb5-4c40-ae00-308a14a27434 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7921281'] for network, before_create {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:37:52.480197 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-9bf3e7e1-cbb5-4c40-ae00-308a14a27434 admin admin] Publish callbacks [] for security_group, before_create {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:37:52.555162 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-9bf3e7e1-cbb5-4c40-ae00-308a14a27434 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:37:52.611309 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-9bf3e7e1-cbb5-4c40-ae00-308a14a27434 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-623933'] for security_group, after_create {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:37:52.637300 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-9bf3e7e1-cbb5-4c40-ae00-308a14a27434 admin admin] vlan segment allocate from pool success with {'vlan_id': 814, 'physical_network': 'physnet1'} {{(pid=102993) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 23 19:37:52.648153 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9bf3e7e1-cbb5-4c40-ae00-308a14a27434 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=de59d408-34e1-4392-9424-9e47c20da5fb,revision_number=1']} {{(pid=102993) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 23 19:37:52.652747 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-9bf3e7e1-cbb5-4c40-ae00-308a14a27434 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7982218'] for segment, precommit_create {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:37:52.658184 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.db.segments_db [None req-9bf3e7e1-cbb5-4c40-ae00-308a14a27434 admin admin] Added segment af2ab065-e074-4168-9b03-e42fa5dfb6ab of type vlan for network e174bef4-375a-481e-8191-fce5c2cbb97d Nov 23 19:37:52.682319 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.plugins.ml2.rpc [None req-4bf48ff4-ecfb-4168-8b63-249b8c6e9f04 None None] Device cee918cb-f6e3-450a-9a6b-6a6e13f08868 no longer exists at agent hyperv_hv-cinder-81901 {{(pid=102994) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 23 19:37:52.699370 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-9bf3e7e1-cbb5-4c40-ae00-308a14a27434 admin admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8783630993713'] for network, precommit_create {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:37:52.704420 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.plugins.ml2.plugin [None req-4bf48ff4-ecfb-4168-8b63-249b8c6e9f04 None None] No Port match for: cee918cb-f6e3-450a-9a6b-6a6e13f08868 {{(pid=102994) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 23 19:37:52.705063 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.plugins.ml2.rpc [None req-4bf48ff4-ecfb-4168-8b63-249b8c6e9f04 None None] Device cee918cb-f6e3-450a-9a6b-6a6e13f08868 not bound to the agent host hv-cinder-81901 {{(pid=102994) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 23 19:37:52.710962 dv-cinder-819011-1-iscsi neutron-server[102995]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-4a0e5f31-94c9-4be0-b2c9-606a6f4e9172 None None] Sync routers for ids ['dea93f43-8b8f-439e-820e-4269a0926491'] in dv-cinder-819011-1-iscsi {{(pid=102995) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 23 19:37:52.724248 dv-cinder-819011-1-iscsi neutron-server[102995]: DEBUG neutron.db.l3_dvrscheduler_db [None req-4a0e5f31-94c9-4be0-b2c9-606a6f4e9172 None None] Routers {'dea93f43-8b8f-439e-820e-4269a0926491'} bound to L3 agent in host dv-cinder-819011-1-iscsi {{(pid=102995) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 23 19:37:52.724870 dv-cinder-819011-1-iscsi neutron-server[102995]: DEBUG neutron.db.l3_hamode_db [None req-4a0e5f31-94c9-4be0-b2c9-606a6f4e9172 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-819011-1-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 7, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 7, "log_agent_heartbeats": false, "routers": 7},created_at=2021-11-23T19:25:14Z,description=,heartbeat_timestamp=2021-11-23T19:37:44Z,host='dv-cinder-819011-1-iscsi',id=1b20f2c4-70b6-43c3-b9bd-0062cc9e57ac,load=0,resource_versions=,resources_synced=,started_at=2021-11-23T19:25:15Z,topic='l3_agent')) {'router_ids': ['dea93f43-8b8f-439e-820e-4269a0926491'], 'active': True} {{(pid=102995) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 23 19:37:52.782478 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-9bf3e7e1-cbb5-4c40-ae00-308a14a27434 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-554949', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560168'] for network, after_create {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:37:52.784585 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-9bf3e7e1-cbb5-4c40-ae00-308a14a27434 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102993) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:37:52.785236 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-9bf3e7e1-cbb5-4c40-ae00-308a14a27434 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-560186'] for network, before_response {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:37:52.831327 dv-cinder-819011-1-iscsi neutron-server[102995]: DEBUG neutron.db.l3_dvr_db [None req-4a0e5f31-94c9-4be0-b2c9-606a6f4e9172 None None] Set router dea93f43-8b8f-439e-820e-4269a0926491 gateway port host: dv-cinder-819011-1-iscsi {{(pid=102995) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 23 19:37:52.849110 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [None req-9bf3e7e1-cbb5-4c40-ae00-308a14a27434 admin admin] 10.222.0.62 "POST /v2.0/networks HTTP/1.1" status: 201 len: 888 time: 0.4742978 Nov 23 19:37:52.851997 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.wsgi [-] (102992) accepted ('10.222.0.62', 48642) {{(pid=102992) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 23 19:37:52.852842 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9bf3e7e1-cbb5-4c40-ae00-308a14a27434 admin admin] Pushing event updated for resources: {'Network': ['ID=e174bef4-375a-481e-8191-fce5c2cbb97d,revision_number=1']} {{(pid=102993) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 23 19:37:52.859020 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.api.v2.base [None req-a7ae4662-75d5-4914-8004-7307aaa85599 admin admin] Request body: {'subnet': {'network_id': 'e174bef4-375a-481e-8191-fce5c2cbb97d', 'cidr': '172.20.0.0/28', 'name': 'tempest-TestMinimumBasicScenario-1019384590-subnet', 'tenant_id': 'ce37dcbb36ad436fbb4c75aff35bbebf', 'ip_version': 4}} {{(pid=102992) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 23 19:37:52.864288 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.plugins.ml2.rpc [None req-eb87b2c3-3339-4249-8b85-e695b5b4e1f9 None None] Network e174bef4-375a-481e-8191-fce5c2cbb97d details requested by agent ovs-agent-dv-cinder-819011-1-iscsi with host dv-cinder-819011-1-iscsi {{(pid=102994) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Nov 23 19:37:52.942239 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-a7ae4662-75d5-4914-8004-7307aaa85599 admin admin] Made reservation on behalf of ce37dcbb36ad436fbb4c75aff35bbebf for: {'subnet': 1} {{(pid=102992) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 23 19:37:52.944546 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [None req-a7ae4662-75d5-4914-8004-7307aaa85599 admin admin] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-25999706'] for subnet, before_create {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:37:53.120259 dv-cinder-819011-1-iscsi neutron-server[102995]: DEBUG neutron.db.l3_hamode_db [None req-4a0e5f31-94c9-4be0-b2c9-606a6f4e9172 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'dea93f43-8b8f-439e-820e-4269a0926491', 'name': 'tempest-TestMinimumBasicScenario-387750355-router', 'tenant_id': 'ed0d906c96b540a7b11d508615543890', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'a93e254e-aac9-4233-9e4d-4290fd0458e4', 'external_fixed_ips': [{'subnet_id': 'e0b32f3d-83d6-439a-bbed-01df7cf01051', 'ip_address': '172.27.1.102'}], 'enable_snat': True}, 'gw_port_id': '80f6861a-4aab-4ba4-a058-5c03b253434a', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-23T19:37:47Z', 'updated_at': '2021-11-23T19:37:50Z', 'revision_number': 4, 'project_id': 'ed0d906c96b540a7b11d508615543890', 'gw_port': {'id': '80f6861a-4aab-4ba4-a058-5c03b253434a', 'name': '', 'network_id': 'a93e254e-aac9-4233-9e4d-4290fd0458e4', 'tenant_id': '', 'mac_address': 'fa:16:3e:d4:39:b5', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'dea93f43-8b8f-439e-820e-4269a0926491', 'device_owner': 'network:router_gateway', 'standard_attr_id': 554, 'fixed_ips': [{'subnet_id': 'e0b32f3d-83d6-439a-bbed-01df7cf01051', 'ip_address': '172.27.1.102', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-819011-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-23T19:37:48Z', 'updated_at': '2021-11-23T19:37:52Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'e0b32f3d-83d6-439a-bbed-01df7cf01051', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-819011-1-iscsi', '_interfaces': [{'id': '35d7927f-9541-4e91-b520-51ae3ab623f1', 'name': '', 'network_id': '96f89427-8150-464f-a280-f07cf823b4fd', 'tenant_id': 'ed0d906c96b540a7b11d508615543890', 'mac_address': 'fa:16:3e:00:20:e6', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'dea93f43-8b8f-439e-820e-4269a0926491', 'device_owner': 'network:router_interface', 'standard_attr_id': 555, 'fixed_ips': [{'subnet_id': 'bfa70c12-21c8-4b7f-8a30-da7ff37b80b8', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-23T19:37:50Z', 'updated_at': '2021-11-23T19:37:50Z', 'revision_number': 2, 'project_id': 'ed0d906c96b540a7b11d508615543890', 'subnets': [{'id': 'bfa70c12-21c8-4b7f-8a30-da7ff37b80b8', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-819011-1-iscsi', False) {} {{(pid=102995) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 23 19:37:53.146334 dv-cinder-819011-1-iscsi neutron-server[102995]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-4a0e5f31-94c9-4be0-b2c9-606a6f4e9172 None None] Checking router: dea93f43-8b8f-439e-820e-4269a0926491 for host: dv-cinder-819011-1-iscsi {{(pid=102995) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 23 19:37:53.146700 dv-cinder-819011-1-iscsi neutron-server[102995]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-4a0e5f31-94c9-4be0-b2c9-606a6f4e9172 None None] Updating router dea93f43-8b8f-439e-820e-4269a0926491 port 35d7927f-9541-4e91-b520-51ae3ab623f1 binding host dv-cinder-819011-1-iscsi {{(pid=102995) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Nov 23 19:37:53.171065 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [None req-a7ae4662-75d5-4914-8004-7307aaa85599 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-554858', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560168', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-25199633', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-25999688'] for subnet, after_create {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:37:53.173739 dv-cinder-819011-1-iscsi neutron-server[102995]: DEBUG neutron_lib.callbacks.manager [None req-4a0e5f31-94c9-4be0-b2c9-606a6f4e9172 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7921281'] for port, before_update {{(pid=102995) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:37:53.220158 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a7ae4662-75d5-4914-8004-7307aaa85599 admin admin] Pushing event updated for resources: {'Subnet': ['ID=ae751b05-57d4-48cb-8d43-9f8a983127e9,revision_number=0']} {{(pid=102992) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 23 19:37:53.236151 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-a7ae4662-75d5-4914-8004-7307aaa85599 admin admin] Checking segment: {'id': 'af2ab065-e074-4168-9b03-e42fa5dfb6ab', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 814, 'network_id': 'e174bef4-375a-481e-8191-fce5c2cbb97d'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102992) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 23 19:37:53.237137 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-a7ae4662-75d5-4914-8004-7307aaa85599 admin admin] Network hostable DHCP agents. Network: e174bef4-375a-481e-8191-fce5c2cbb97d, hostable agents: ['e51c95c7-6a36-4263-ba47-1839054f3e7a'], hosted agents: [] {{(pid=102992) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 23 19:37:53.331221 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-a7ae4662-75d5-4914-8004-7307aaa85599 admin admin] Network e174bef4-375a-481e-8191-fce5c2cbb97d is scheduled to be hosted by DHCP agent e51c95c7-6a36-4263-ba47-1839054f3e7a with binding_index 1 {{(pid=102992) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 23 19:37:53.382489 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.scheduler.base_scheduler [None req-a7ae4662-75d5-4914-8004-7307aaa85599 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-819011-1-iscsi, e174bef4-375a-481e-8191-fce5c2cbb97d) {{(pid=102992) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 23 19:37:53.387578 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-a7ae4662-75d5-4914-8004-7307aaa85599 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=102992) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:37:53.388549 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [None req-a7ae4662-75d5-4914-8004-7307aaa85599 admin admin] Publish callbacks [] for subnet, before_response {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:37:53.393329 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-82969940-1897-4c50-bfe5-29f452087b9e None None] Network e174bef4-375a-481e-8191-fce5c2cbb97d requested from dv-cinder-819011-1-iscsi {{(pid=102994) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 23 19:37:53.443376 dv-cinder-819011-1-iscsi neutron-server[102995]: DEBUG neutron_lib.callbacks.manager [None req-4a0e5f31-94c9-4be0-b2c9-606a6f4e9172 None None] Publish callbacks [] for port, precommit_update {{(pid=102995) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:37:53.460326 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [None req-a7ae4662-75d5-4914-8004-7307aaa85599 admin admin] 10.222.0.62 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 851 time: 0.6066551 Nov 23 19:37:53.462846 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.wsgi [-] (102992) accepted ('10.222.0.62', 48648) {{(pid=102992) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 23 19:37:53.467219 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.api.v2.base [None req-e47def78-db9b-4651-aea2-d808bf7ae351 admin admin] Request body: {'router': {'name': 'tempest-TestMinimumBasicScenario-1019384590-router', 'tenant_id': 'ce37dcbb36ad436fbb4c75aff35bbebf', 'external_gateway_info': {'network_id': 'a93e254e-aac9-4233-9e4d-4290fd0458e4'}}} {{(pid=102992) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 23 19:37:53.513861 dv-cinder-819011-1-iscsi neutron-server[102995]: DEBUG neutron_lib.callbacks.manager [None req-4a0e5f31-94c9-4be0-b2c9-606a6f4e9172 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7918660', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-15067', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560168', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8783631423946', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8783631008732', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8783631008750'] for port, after_update {{(pid=102995) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:37:53.543001 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [None req-e47def78-db9b-4651-aea2-d808bf7ae351 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-933550', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-13503'] for router, before_create {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:37:53.544261 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [None req-e47def78-db9b-4651-aea2-d808bf7ae351 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-933038', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-927700', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-622769', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-13448'] for router, precommit_create {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:37:53.561936 dv-cinder-819011-1-iscsi neutron-server[102995]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-dd429dcd-1865-40cd-a384-1a3c46b0b72a None None] Pushing event updated for resources: {'Port': ['ID=35d7927f-9541-4e91-b520-51ae3ab623f1,revision_number=3']} {{(pid=102995) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 23 19:37:53.586713 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-0464af04-463d-466a-bec4-86f88c1afbe6 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp8353ff9b-e01d-5e31-ab2d-60a764783255-e174bef4-375a-481e-8191-fce5c2cbb97d', 'network_id': 'e174bef4-375a-481e-8191-fce5c2cbb97d', 'tenant_id': 'ce37dcbb36ad436fbb4c75aff35bbebf', 'fixed_ips': [{'subnet_id': 'ae751b05-57d4-48cb-8d43-9f8a983127e9'}]}} from dv-cinder-819011-1-iscsi. {{(pid=102994) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:285}} Nov 23 19:37:53.587653 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron_lib.callbacks.manager [None req-0464af04-463d-466a-bec4-86f88c1afbe6 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7921281'] for port, before_create {{(pid=102994) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:37:53.606081 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [None req-e47def78-db9b-4651-aea2-d808bf7ae351 admin admin] Publish callbacks [] for router_controller, precommit_add_association {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:37:53.629490 dv-cinder-819011-1-iscsi neutron-server[102995]: DEBUG neutron.plugins.ml2.managers [None req-4a0e5f31-94c9-4be0-b2c9-606a6f4e9172 None None] Attempting to bind port 35d7927f-9541-4e91-b520-51ae3ab623f1 on host dv-cinder-819011-1-iscsi for vnic_type normal with profile {{(pid=102995) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 23 19:37:53.629858 dv-cinder-819011-1-iscsi neutron-server[102995]: DEBUG neutron.plugins.ml2.managers [None req-4a0e5f31-94c9-4be0-b2c9-606a6f4e9172 None None] Attempting to bind port 35d7927f-9541-4e91-b520-51ae3ab623f1 by drivers openvswitch,hyperv on host dv-cinder-819011-1-iscsi at level 0 using segments [{'id': '81f92f0c-ea8d-4880-af1c-e4418f898de3', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 816, 'network_id': '96f89427-8150-464f-a280-f07cf823b4fd'}] {{(pid=102995) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 23 19:37:53.630244 dv-cinder-819011-1-iscsi neutron-server[102995]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-4a0e5f31-94c9-4be0-b2c9-606a6f4e9172 None None] Attempting to bind port 35d7927f-9541-4e91-b520-51ae3ab623f1 on network 96f89427-8150-464f-a280-f07cf823b4fd {{(pid=102995) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 23 19:37:53.635758 dv-cinder-819011-1-iscsi neutron-server[102995]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-4a0e5f31-94c9-4be0-b2c9-606a6f4e9172 None None] Checking agent: {'id': '668c8953-047c-499e-8c0d-db838fac1668', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-819011-1-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 23, 19, 25, 17), 'started_at': datetime.datetime(2021, 11, 23, 19, 25, 47), 'heartbeat_timestamp': datetime.datetime(2021, 11, 23, 19, 37, 47), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-819011-1-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=102995) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 23 19:37:53.636162 dv-cinder-819011-1-iscsi neutron-server[102995]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-4a0e5f31-94c9-4be0-b2c9-606a6f4e9172 None None] Checking segment: {'id': '81f92f0c-ea8d-4880-af1c-e4418f898de3', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 816, 'network_id': '96f89427-8150-464f-a280-f07cf823b4fd'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102995) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 23 19:37:53.636564 dv-cinder-819011-1-iscsi neutron-server[102995]: DEBUG neutron_lib.callbacks.manager [None req-4a0e5f31-94c9-4be0-b2c9-606a6f4e9172 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=102995) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:37:53.636960 dv-cinder-819011-1-iscsi neutron-server[102995]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-4a0e5f31-94c9-4be0-b2c9-606a6f4e9172 None None] Bound using segment: {'id': '81f92f0c-ea8d-4880-af1c-e4418f898de3', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 816, 'network_id': '96f89427-8150-464f-a280-f07cf823b4fd'} {{(pid=102995) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 23 19:37:53.637440 dv-cinder-819011-1-iscsi neutron-server[102995]: DEBUG neutron.plugins.ml2.managers [None req-4a0e5f31-94c9-4be0-b2c9-606a6f4e9172 None None] Bound port: 35d7927f-9541-4e91-b520-51ae3ab623f1, host: dv-cinder-819011-1-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '81f92f0c-ea8d-4880-af1c-e4418f898de3', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 816, 'network_id': '96f89427-8150-464f-a280-f07cf823b4fd'}}] {{(pid=102995) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 23 19:37:53.637863 dv-cinder-819011-1-iscsi neutron-server[102995]: DEBUG neutron_lib.callbacks.manager [None req-4a0e5f31-94c9-4be0-b2c9-606a6f4e9172 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7921281'] for port, before_update {{(pid=102995) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:37:53.706796 dv-cinder-819011-1-iscsi neutron-server[102995]: DEBUG neutron.plugins.ml2.db [None req-4a0e5f31-94c9-4be0-b2c9-606a6f4e9172 None None] For port 35d7927f-9541-4e91-b520-51ae3ab623f1, host dv-cinder-819011-1-iscsi, cleared binding levels {{(pid=102995) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 23 19:37:53.710250 dv-cinder-819011-1-iscsi neutron-server[102995]: DEBUG neutron.plugins.ml2.db [None req-4a0e5f31-94c9-4be0-b2c9-606a6f4e9172 None None] For port 35d7927f-9541-4e91-b520-51ae3ab623f1, host dv-cinder-819011-1-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-819011-1-iscsi',level=0,port_id=35d7927f-9541-4e91-b520-51ae3ab623f1,segment=NetworkSegment(81f92f0c-ea8d-4880-af1c-e4418f898de3),segment_id=81f92f0c-ea8d-4880-af1c-e4418f898de3)] {{(pid=102995) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 23 19:37:53.751423 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.db.db_base_plugin_common [None req-0464af04-463d-466a-bec4-86f88c1afbe6 None None] Allocated IP 172.20.0.2 (e174bef4-375a-481e-8191-fce5c2cbb97d/ae751b05-57d4-48cb-8d43-9f8a983127e9/d12303ae-95fd-4188-99d6-02b273fd2188) {{(pid=102994) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 23 19:37:53.794756 dv-cinder-819011-1-iscsi neutron-server[102995]: DEBUG neutron_lib.callbacks.manager [None req-4a0e5f31-94c9-4be0-b2c9-606a6f4e9172 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7918660', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-15067', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560168', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8783631423946', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8783631008732', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8783631008750'] for port, after_update {{(pid=102995) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:37:53.833850 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.db.provisioning_blocks [None req-21df10f7-00bd-48b1-920e-5eed2f1b46c4 None None] Provisioning complete for port 35d7927f-9541-4e91-b520-51ae3ab623f1 triggered by entity DHCP. {{(pid=102994) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 23 19:37:53.834146 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron_lib.callbacks.manager [None req-21df10f7-00bd-48b1-920e-5eed2f1b46c4 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-8355713'] for port, provisioning_complete {{(pid=102994) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:37:53.863220 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [None req-e47def78-db9b-4651-aea2-d808bf7ae351 admin admin] Publish callbacks [] for router_gateway, precommit_update {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:37:53.867948 dv-cinder-819011-1-iscsi neutron-server[102995]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-dd429dcd-1865-40cd-a384-1a3c46b0b72a None None] Pushing event updated for resources: {'Port': ['ID=35d7927f-9541-4e91-b520-51ae3ab623f1,revision_number=4']} {{(pid=102995) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 23 19:37:53.881908 dv-cinder-819011-1-iscsi neutron-server[102995]: DEBUG neutron.db.l3_dvrscheduler_db [None req-4a0e5f31-94c9-4be0-b2c9-606a6f4e9172 None None] Routers {'dea93f43-8b8f-439e-820e-4269a0926491'} bound to L3 agent in host dv-cinder-819011-1-iscsi {{(pid=102995) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 23 19:37:53.881908 dv-cinder-819011-1-iscsi neutron-server[102995]: DEBUG neutron.db.l3_hamode_db [None req-4a0e5f31-94c9-4be0-b2c9-606a6f4e9172 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-819011-1-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 7, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 7, "log_agent_heartbeats": false, "routers": 7},created_at=2021-11-23T19:25:14Z,description=,heartbeat_timestamp=2021-11-23T19:37:44Z,host='dv-cinder-819011-1-iscsi',id=1b20f2c4-70b6-43c3-b9bd-0062cc9e57ac,load=0,resource_versions=,resources_synced=,started_at=2021-11-23T19:25:15Z,topic='l3_agent')) {'router_ids': ['dea93f43-8b8f-439e-820e-4269a0926491'], 'active': True} {{(pid=102995) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 23 19:37:53.966820 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron_lib.callbacks.manager [None req-0464af04-463d-466a-bec4-86f88c1afbe6 None None] Publish callbacks [] for port, precommit_create {{(pid=102994) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:37:53.992100 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron_lib.callbacks.manager [None req-21df10f7-00bd-48b1-920e-5eed2f1b46c4 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7921281'] for port, before_update {{(pid=102994) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:37:54.003202 dv-cinder-819011-1-iscsi neutron-server[102995]: DEBUG neutron.db.l3_dvr_db [None req-4a0e5f31-94c9-4be0-b2c9-606a6f4e9172 None None] Set router dea93f43-8b8f-439e-820e-4269a0926491 gateway port host: dv-cinder-819011-1-iscsi {{(pid=102995) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 23 19:37:54.053214 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron_lib.callbacks.manager [None req-0464af04-463d-466a-bec4-86f88c1afbe6 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7918660', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-15067', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560168', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8783631008714'] for port, after_create {{(pid=102994) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:37:54.111748 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.plugins.ml2.db [None req-21df10f7-00bd-48b1-920e-5eed2f1b46c4 None None] For port 35d7927f-9541-4e91-b520-51ae3ab623f1, host dv-cinder-819011-1-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-819011-1-iscsi',level=0,port_id=35d7927f-9541-4e91-b520-51ae3ab623f1,segment=NetworkSegment(81f92f0c-ea8d-4880-af1c-e4418f898de3),segment_id=81f92f0c-ea8d-4880-af1c-e4418f898de3)] {{(pid=102994) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 23 19:37:54.113176 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.plugins.ml2.rpc [None req-eb87b2c3-3339-4249-8b85-e695b5b4e1f9 None None] Device 80f6861a-4aab-4ba4-a058-5c03b253434a up at agent ovs-agent-dv-cinder-819011-1-iscsi {{(pid=102994) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 23 19:37:54.151197 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-0464af04-463d-466a-bec4-86f88c1afbe6 None None] Network e174bef4-375a-481e-8191-fce5c2cbb97d is already hosted by enough agents. {{(pid=102994) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 23 19:37:54.160928 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.scheduler.base_scheduler [None req-0464af04-463d-466a-bec4-86f88c1afbe6 None None] Resources bound (agent type, host, resource id): {{(pid=102994) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 23 19:37:54.168247 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.db.l3_dvrscheduler_db [None req-0464af04-463d-466a-bec4-86f88c1afbe6 None None] Received port after_create {{(pid=102994) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 23 19:37:54.175080 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0464af04-463d-466a-bec4-86f88c1afbe6 None None] Pushing event updated for resources: {'Port': ['ID=d12303ae-95fd-4188-99d6-02b273fd2188,revision_number=1']} {{(pid=102994) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 23 19:37:54.199805 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [None req-e47def78-db9b-4651-aea2-d808bf7ae351 admin admin] Publish callbacks [] for router_gateway, before_create {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:37:54.224586 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [None req-e47def78-db9b-4651-aea2-d808bf7ae351 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7921281'] for port, before_create {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:37:54.232127 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron_lib.callbacks.manager [None req-21df10f7-00bd-48b1-920e-5eed2f1b46c4 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7918660', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-15067', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560168', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8783631423946', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8783631008732', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8783631008750'] for port, after_update {{(pid=102994) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:37:54.237911 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.db.provisioning_blocks [None req-eb87b2c3-3339-4249-8b85-e695b5b4e1f9 None None] Provisioning complete for port 80f6861a-4aab-4ba4-a058-5c03b253434a triggered by entity L2. {{(pid=102994) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 23 19:37:54.238286 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron_lib.callbacks.manager [None req-eb87b2c3-3339-4249-8b85-e695b5b4e1f9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-8355713'] for port, provisioning_complete {{(pid=102994) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:37:54.240920 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.plugins.ml2.managers [None req-0464af04-463d-466a-bec4-86f88c1afbe6 None None] Attempting to bind port d12303ae-95fd-4188-99d6-02b273fd2188 on host dv-cinder-819011-1-iscsi for vnic_type normal with profile {{(pid=102994) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 23 19:37:54.241297 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.plugins.ml2.managers [None req-0464af04-463d-466a-bec4-86f88c1afbe6 None None] Attempting to bind port d12303ae-95fd-4188-99d6-02b273fd2188 by drivers openvswitch,hyperv on host dv-cinder-819011-1-iscsi at level 0 using segments [{'id': 'af2ab065-e074-4168-9b03-e42fa5dfb6ab', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 814, 'network_id': 'e174bef4-375a-481e-8191-fce5c2cbb97d'}] {{(pid=102994) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 23 19:37:54.246800 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-0464af04-463d-466a-bec4-86f88c1afbe6 None None] Attempting to bind port d12303ae-95fd-4188-99d6-02b273fd2188 on network e174bef4-375a-481e-8191-fce5c2cbb97d {{(pid=102994) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 23 19:37:54.254378 dv-cinder-819011-1-iscsi neutron-server[102995]: DEBUG neutron.db.l3_hamode_db [None req-4a0e5f31-94c9-4be0-b2c9-606a6f4e9172 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'dea93f43-8b8f-439e-820e-4269a0926491', 'name': 'tempest-TestMinimumBasicScenario-387750355-router', 'tenant_id': 'ed0d906c96b540a7b11d508615543890', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'a93e254e-aac9-4233-9e4d-4290fd0458e4', 'external_fixed_ips': [{'subnet_id': 'e0b32f3d-83d6-439a-bbed-01df7cf01051', 'ip_address': '172.27.1.102'}], 'enable_snat': True}, 'gw_port_id': '80f6861a-4aab-4ba4-a058-5c03b253434a', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-23T19:37:47Z', 'updated_at': '2021-11-23T19:37:50Z', 'revision_number': 4, 'project_id': 'ed0d906c96b540a7b11d508615543890', 'gw_port': {'id': '80f6861a-4aab-4ba4-a058-5c03b253434a', 'name': '', 'network_id': 'a93e254e-aac9-4233-9e4d-4290fd0458e4', 'tenant_id': '', 'mac_address': 'fa:16:3e:d4:39:b5', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'dea93f43-8b8f-439e-820e-4269a0926491', 'device_owner': 'network:router_gateway', 'standard_attr_id': 554, 'fixed_ips': [{'subnet_id': 'e0b32f3d-83d6-439a-bbed-01df7cf01051', 'ip_address': '172.27.1.102', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-819011-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-23T19:37:48Z', 'updated_at': '2021-11-23T19:37:52Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'e0b32f3d-83d6-439a-bbed-01df7cf01051', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-819011-1-iscsi', '_interfaces': [{'id': '35d7927f-9541-4e91-b520-51ae3ab623f1', 'name': '', 'network_id': '96f89427-8150-464f-a280-f07cf823b4fd', 'tenant_id': 'ed0d906c96b540a7b11d508615543890', 'mac_address': 'fa:16:3e:00:20:e6', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'dea93f43-8b8f-439e-820e-4269a0926491', 'device_owner': 'network:router_interface', 'standard_attr_id': 555, 'fixed_ips': [{'subnet_id': 'bfa70c12-21c8-4b7f-8a30-da7ff37b80b8', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-819011-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-23T19:37:50Z', 'updated_at': '2021-11-23T19:37:53Z', 'revision_number': 4, 'project_id': 'ed0d906c96b540a7b11d508615543890', 'subnets': [{'id': 'bfa70c12-21c8-4b7f-8a30-da7ff37b80b8', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-819011-1-iscsi', False) {} {{(pid=102995) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 23 19:37:54.282469 dv-cinder-819011-1-iscsi neutron-server[102995]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-4a0e5f31-94c9-4be0-b2c9-606a6f4e9172 None None] The sync data for ids ['dea93f43-8b8f-439e-820e-4269a0926491'] in dv-cinder-819011-1-iscsi is: [{'id': 'dea93f43-8b8f-439e-820e-4269a0926491', 'name': 'tempest-TestMinimumBasicScenario-387750355-router', 'tenant_id': 'ed0d906c96b540a7b11d508615543890', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'a93e254e-aac9-4233-9e4d-4290fd0458e4', 'external_fixed_ips': [{'subnet_id': 'e0b32f3d-83d6-439a-bbed-01df7cf01051', 'ip_address': '172.27.1.102'}], 'enable_snat': True}, 'gw_port_id': '80f6861a-4aab-4ba4-a058-5c03b253434a', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-23T19:37:47Z', 'updated_at': '2021-11-23T19:37:50Z', 'revision_number': 4, 'project_id': 'ed0d906c96b540a7b11d508615543890', 'gw_port': {'id': '80f6861a-4aab-4ba4-a058-5c03b253434a', 'name': '', 'network_id': 'a93e254e-aac9-4233-9e4d-4290fd0458e4', 'tenant_id': '', 'mac_address': 'fa:16:3e:d4:39:b5', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'dea93f43-8b8f-439e-820e-4269a0926491', 'device_owner': 'network:router_gateway', 'standard_attr_id': 554, 'fixed_ips': [{'subnet_id': 'e0b32f3d-83d6-439a-bbed-01df7cf01051', 'ip_address': '172.27.1.102', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-819011-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-23T19:37:48Z', 'updated_at': '2021-11-23T19:37:52Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'e0b32f3d-83d6-439a-bbed-01df7cf01051', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-819011-1-iscsi', '_interfaces': [{'id': '35d7927f-9541-4e91-b520-51ae3ab623f1', 'name': '', 'network_id': '96f89427-8150-464f-a280-f07cf823b4fd', 'tenant_id': 'ed0d906c96b540a7b11d508615543890', 'mac_address': 'fa:16:3e:00:20:e6', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'dea93f43-8b8f-439e-820e-4269a0926491', 'device_owner': 'network:router_interface', 'standard_attr_id': 555, 'fixed_ips': [{'subnet_id': 'bfa70c12-21c8-4b7f-8a30-da7ff37b80b8', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-819011-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-23T19:37:50Z', 'updated_at': '2021-11-23T19:37:53Z', 'revision_number': 4, 'project_id': 'ed0d906c96b540a7b11d508615543890', 'subnets': [{'id': 'bfa70c12-21c8-4b7f-8a30-da7ff37b80b8', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=102995) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 23 19:37:54.298913 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-0464af04-463d-466a-bec4-86f88c1afbe6 None None] Checking agent: {'id': '668c8953-047c-499e-8c0d-db838fac1668', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-819011-1-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 23, 19, 25, 17), 'started_at': datetime.datetime(2021, 11, 23, 19, 25, 47), 'heartbeat_timestamp': datetime.datetime(2021, 11, 23, 19, 37, 47), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-819011-1-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=102994) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 23 19:37:54.299384 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-0464af04-463d-466a-bec4-86f88c1afbe6 None None] Checking segment: {'id': 'af2ab065-e074-4168-9b03-e42fa5dfb6ab', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 814, 'network_id': 'e174bef4-375a-481e-8191-fce5c2cbb97d'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102994) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 23 19:37:54.299784 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron_lib.callbacks.manager [None req-0464af04-463d-466a-bec4-86f88c1afbe6 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=102994) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:37:54.300192 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-0464af04-463d-466a-bec4-86f88c1afbe6 None None] Bound using segment: {'id': 'af2ab065-e074-4168-9b03-e42fa5dfb6ab', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 814, 'network_id': 'e174bef4-375a-481e-8191-fce5c2cbb97d'} {{(pid=102994) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 23 19:37:54.300685 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.plugins.ml2.managers [None req-0464af04-463d-466a-bec4-86f88c1afbe6 None None] Bound port: d12303ae-95fd-4188-99d6-02b273fd2188, host: dv-cinder-819011-1-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'af2ab065-e074-4168-9b03-e42fa5dfb6ab', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 814, 'network_id': 'e174bef4-375a-481e-8191-fce5c2cbb97d'}}] {{(pid=102994) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 23 19:37:54.301175 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron_lib.callbacks.manager [None req-0464af04-463d-466a-bec4-86f88c1afbe6 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7921281'] for port, before_update {{(pid=102994) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:37:54.346541 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.db.db_base_plugin_common [None req-e47def78-db9b-4651-aea2-d808bf7ae351 admin admin] Allocated IP 172.27.1.250 (a93e254e-aac9-4233-9e4d-4290fd0458e4/e0b32f3d-83d6-439a-bbed-01df7cf01051/7d43a82d-0eb8-4132-bc25-a50299a7264c) {{(pid=102992) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 23 19:37:54.385737 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-21df10f7-00bd-48b1-920e-5eed2f1b46c4 None None] Pushing event updated for resources: {'Port': ['ID=35d7927f-9541-4e91-b520-51ae3ab623f1,revision_number=5']} {{(pid=102994) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 23 19:37:54.459061 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.db.provisioning_blocks [None req-74124485-7695-40f0-a64c-7a34ad45251b None None] Provisioning complete for port 35d7927f-9541-4e91-b520-51ae3ab623f1 triggered by entity DHCP. {{(pid=102994) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 23 19:37:54.459453 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron_lib.callbacks.manager [None req-74124485-7695-40f0-a64c-7a34ad45251b None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-8355713'] for port, provisioning_complete {{(pid=102994) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:37:54.505436 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.plugins.ml2.db [None req-0464af04-463d-466a-bec4-86f88c1afbe6 None None] For port d12303ae-95fd-4188-99d6-02b273fd2188, host dv-cinder-819011-1-iscsi, cleared binding levels {{(pid=102994) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 23 19:37:54.520949 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [None req-e47def78-db9b-4651-aea2-d808bf7ae351 admin admin] Publish callbacks [] for port, precommit_create {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:37:54.524259 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.plugins.ml2.db [None req-0464af04-463d-466a-bec4-86f88c1afbe6 None None] For port d12303ae-95fd-4188-99d6-02b273fd2188, host dv-cinder-819011-1-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-819011-1-iscsi',level=0,port_id=d12303ae-95fd-4188-99d6-02b273fd2188,segment=NetworkSegment(af2ab065-e074-4168-9b03-e42fa5dfb6ab),segment_id=af2ab065-e074-4168-9b03-e42fa5dfb6ab)] {{(pid=102994) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 23 19:37:54.601934 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron_lib.callbacks.manager [None req-0464af04-463d-466a-bec4-86f88c1afbe6 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7918660', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-15067', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560168', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8783631423946', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8783631008732', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8783631008750'] for port, after_update {{(pid=102994) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:37:54.680948 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0464af04-463d-466a-bec4-86f88c1afbe6 None None] Pushing event updated for resources: {'Port': ['ID=d12303ae-95fd-4188-99d6-02b273fd2188,revision_number=2']} {{(pid=102994) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 23 19:37:54.915083 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [None req-e47def78-db9b-4651-aea2-d808bf7ae351 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7918660', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-15067', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560168', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8783631008714', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-25199805'] for port, after_create {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:37:54.955187 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-e47def78-db9b-4651-aea2-d808bf7ae351 admin admin] Network a93e254e-aac9-4233-9e4d-4290fd0458e4 is already hosted by enough agents. {{(pid=102992) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 23 19:37:54.964415 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.scheduler.base_scheduler [None req-e47def78-db9b-4651-aea2-d808bf7ae351 admin admin] Resources bound (agent type, host, resource id): {{(pid=102992) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 23 19:37:54.968165 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.db.l3_dvrscheduler_db [None req-e47def78-db9b-4651-aea2-d808bf7ae351 admin admin] Received port after_create {{(pid=102992) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 23 19:37:55.000633 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e47def78-db9b-4651-aea2-d808bf7ae351 admin admin] Pushing event updated for resources: {'Port': ['ID=7d43a82d-0eb8-4132-bc25-a50299a7264c,revision_number=1']} {{(pid=102992) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 23 19:37:55.318844 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [None req-e47def78-db9b-4651-aea2-d808bf7ae351 admin admin] Publish callbacks [] for router_gateway, after_create {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:37:55.534436 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [None req-e47def78-db9b-4651-aea2-d808bf7ae351 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-932875', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-926501'] for router, after_create {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:37:55.726875 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-ac26adb5-b972-4eae-bd06-292e9ab0579b None None] Network e174bef4-375a-481e-8191-fce5c2cbb97d requested from dv-cinder-819011-1-iscsi {{(pid=102994) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 23 19:37:55.730850 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-e47def78-db9b-4651-aea2-d808bf7ae351 admin admin] Router cd026b6a-8872-4a92-92e4-4bd664068764 is scheduled to L3 agent 1b20f2c4-70b6-43c3-b9bd-0062cc9e57ac with binding_index 1 {{(pid=102992) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Nov 23 19:37:55.813699 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.db.provisioning_blocks [None req-9328d776-0734-4c37-aa04-9e6cb34d0374 None None] Provisioning complete for port d12303ae-95fd-4188-99d6-02b273fd2188 triggered by entity DHCP. {{(pid=102994) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 23 19:37:55.814080 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron_lib.callbacks.manager [None req-9328d776-0734-4c37-aa04-9e6cb34d0374 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-8355713'] for port, provisioning_complete {{(pid=102994) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:37:55.842234 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-e47def78-db9b-4651-aea2-d808bf7ae351 admin admin] Notify agent at l3_agent.dv-cinder-819011-1-iscsi the message routers_updated {{(pid=102992) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 23 19:37:55.857954 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-dad2d830-e570-498c-9ef3-d6c6c1a30ede None None] Sync routers for ids ['cd026b6a-8872-4a92-92e4-4bd664068764'] in dv-cinder-819011-1-iscsi {{(pid=102994) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 23 19:37:55.904349 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.db.l3_dvrscheduler_db [None req-dad2d830-e570-498c-9ef3-d6c6c1a30ede None None] Routers {'cd026b6a-8872-4a92-92e4-4bd664068764'} bound to L3 agent in host dv-cinder-819011-1-iscsi {{(pid=102994) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 23 19:37:55.904980 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.db.l3_hamode_db [None req-dad2d830-e570-498c-9ef3-d6c6c1a30ede None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-819011-1-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 7, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 7, "log_agent_heartbeats": false, "routers": 7},created_at=2021-11-23T19:25:14Z,description=,heartbeat_timestamp=2021-11-23T19:37:44Z,host='dv-cinder-819011-1-iscsi',id=1b20f2c4-70b6-43c3-b9bd-0062cc9e57ac,load=0,resource_versions=,resources_synced=,started_at=2021-11-23T19:25:15Z,topic='l3_agent')) {'router_ids': ['cd026b6a-8872-4a92-92e4-4bd664068764'], 'active': True} {{(pid=102994) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 23 19:37:55.950693 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [None req-e47def78-db9b-4651-aea2-d808bf7ae351 admin admin] Publish callbacks [] for router, before_response {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:37:55.952051 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [None req-e47def78-db9b-4651-aea2-d808bf7ae351 admin admin] 10.222.0.62 "POST /v2.0/routers HTTP/1.1" status: 201 len: 927 time: 2.4881635 Nov 23 19:37:55.954954 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.wsgi [-] (102993) accepted ('10.222.0.62', 48678) {{(pid=102993) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 23 19:37:56.194376 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.plugins.ml2.rpc [None req-eb87b2c3-3339-4249-8b85-e695b5b4e1f9 None None] Device d12303ae-95fd-4188-99d6-02b273fd2188 up at agent ovs-agent-dv-cinder-819011-1-iscsi {{(pid=102994) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 23 19:37:56.229376 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron_lib.callbacks.manager [None req-9328d776-0734-4c37-aa04-9e6cb34d0374 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7921281'] for port, before_update {{(pid=102994) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:37:56.301940 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.db.l3_dvr_db [None req-dad2d830-e570-498c-9ef3-d6c6c1a30ede None None] Set router cd026b6a-8872-4a92-92e4-4bd664068764 gateway port host: dv-cinder-819011-1-iscsi {{(pid=102994) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 23 19:37:56.332103 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.plugins.ml2.db [None req-9328d776-0734-4c37-aa04-9e6cb34d0374 None None] For port d12303ae-95fd-4188-99d6-02b273fd2188, host dv-cinder-819011-1-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-819011-1-iscsi',level=0,port_id=d12303ae-95fd-4188-99d6-02b273fd2188,segment=NetworkSegment(af2ab065-e074-4168-9b03-e42fa5dfb6ab),segment_id=af2ab065-e074-4168-9b03-e42fa5dfb6ab)] {{(pid=102994) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 23 19:37:56.393856 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.db.provisioning_blocks [None req-eb87b2c3-3339-4249-8b85-e695b5b4e1f9 None None] Provisioning complete for port d12303ae-95fd-4188-99d6-02b273fd2188 triggered by entity L2. {{(pid=102994) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 23 19:37:56.394375 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron_lib.callbacks.manager [None req-eb87b2c3-3339-4249-8b85-e695b5b4e1f9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-8355713'] for port, provisioning_complete {{(pid=102994) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:37:56.398536 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron_lib.callbacks.manager [None req-9328d776-0734-4c37-aa04-9e6cb34d0374 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7918660', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-15067', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560168', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8783631423946', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8783631008732', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8783631008750'] for port, after_update {{(pid=102994) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:37:56.488599 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-81e7261f-3a62-45d8-80ef-e3604d77dc51 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7921281'] for port, before_create {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:37:56.562555 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9328d776-0734-4c37-aa04-9e6cb34d0374 None None] Pushing event updated for resources: {'Port': ['ID=d12303ae-95fd-4188-99d6-02b273fd2188,revision_number=3']} {{(pid=102994) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 23 19:37:56.569519 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.db.provisioning_blocks [None req-77d9d1a3-44ab-46e1-9051-60ff11257647 None None] Provisioning complete for port d12303ae-95fd-4188-99d6-02b273fd2188 triggered by entity DHCP. {{(pid=102994) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 23 19:37:56.569519 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron_lib.callbacks.manager [None req-77d9d1a3-44ab-46e1-9051-60ff11257647 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-8355713'] for port, provisioning_complete {{(pid=102994) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:37:56.665425 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.db.db_base_plugin_common [None req-81e7261f-3a62-45d8-80ef-e3604d77dc51 admin admin] Allocated IP 172.20.0.1 (e174bef4-375a-481e-8191-fce5c2cbb97d/ae751b05-57d4-48cb-8d43-9f8a983127e9/bc49825c-fa1c-4a34-9835-46a0c3e77dd2) {{(pid=102993) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 23 19:37:56.723363 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.plugins.ml2.rpc [None req-eb87b2c3-3339-4249-8b85-e695b5b4e1f9 None None] Device 35d7927f-9541-4e91-b520-51ae3ab623f1 up at agent ovs-agent-dv-cinder-819011-1-iscsi {{(pid=102994) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 23 19:37:56.776944 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-81e7261f-3a62-45d8-80ef-e3604d77dc51 admin admin] Publish callbacks [] for port, precommit_create {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:37:56.815076 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.db.l3_hamode_db [None req-dad2d830-e570-498c-9ef3-d6c6c1a30ede None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'cd026b6a-8872-4a92-92e4-4bd664068764', 'name': 'tempest-TestMinimumBasicScenario-1019384590-router', 'tenant_id': 'ce37dcbb36ad436fbb4c75aff35bbebf', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'a93e254e-aac9-4233-9e4d-4290fd0458e4', 'external_fixed_ips': [{'subnet_id': 'e0b32f3d-83d6-439a-bbed-01df7cf01051', 'ip_address': '172.27.1.250'}], 'enable_snat': True}, 'gw_port_id': '7d43a82d-0eb8-4132-bc25-a50299a7264c', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-23T19:37:53Z', 'updated_at': '2021-11-23T19:37:55Z', 'revision_number': 3, 'project_id': 'ce37dcbb36ad436fbb4c75aff35bbebf', 'gw_port': {'id': '7d43a82d-0eb8-4132-bc25-a50299a7264c', 'name': '', 'network_id': 'a93e254e-aac9-4233-9e4d-4290fd0458e4', 'tenant_id': '', 'mac_address': 'fa:16:3e:ad:76:0e', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'cd026b6a-8872-4a92-92e4-4bd664068764', 'device_owner': 'network:router_gateway', 'standard_attr_id': 566, 'fixed_ips': [{'subnet_id': 'e0b32f3d-83d6-439a-bbed-01df7cf01051', 'ip_address': '172.27.1.250', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-23T19:37:54Z', 'updated_at': '2021-11-23T19:37:54Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': 'e0b32f3d-83d6-439a-bbed-01df7cf01051', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-819011-1-iscsi'}], 'dv-cinder-819011-1-iscsi', False) {} {{(pid=102994) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 23 19:37:56.845078 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-dad2d830-e570-498c-9ef3-d6c6c1a30ede None None] Checking router: cd026b6a-8872-4a92-92e4-4bd664068764 for host: dv-cinder-819011-1-iscsi {{(pid=102994) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 23 19:37:56.845455 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-dad2d830-e570-498c-9ef3-d6c6c1a30ede None None] Updating router cd026b6a-8872-4a92-92e4-4bd664068764 port 7d43a82d-0eb8-4132-bc25-a50299a7264c binding host dv-cinder-819011-1-iscsi {{(pid=102994) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Nov 23 19:37:56.849288 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.db.provisioning_blocks [None req-eb87b2c3-3339-4249-8b85-e695b5b4e1f9 None None] Provisioning complete for port 35d7927f-9541-4e91-b520-51ae3ab623f1 triggered by entity L2. {{(pid=102994) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 23 19:37:56.849686 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron_lib.callbacks.manager [None req-eb87b2c3-3339-4249-8b85-e695b5b4e1f9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-8355713'] for port, provisioning_complete {{(pid=102994) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:37:56.885343 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-81e7261f-3a62-45d8-80ef-e3604d77dc51 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7918660', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-15067', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560168', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8783631008714', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-17257496'] for port, after_create {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:37:56.895619 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron_lib.callbacks.manager [None req-dad2d830-e570-498c-9ef3-d6c6c1a30ede None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7921281'] for port, before_update {{(pid=102994) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:37:56.928884 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-81e7261f-3a62-45d8-80ef-e3604d77dc51 admin admin] Network e174bef4-375a-481e-8191-fce5c2cbb97d is already hosted by enough agents. {{(pid=102993) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 23 19:37:56.931815 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.scheduler.base_scheduler [None req-81e7261f-3a62-45d8-80ef-e3604d77dc51 admin admin] Resources bound (agent type, host, resource id): {{(pid=102993) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 23 19:37:56.935326 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.db.l3_dvrscheduler_db [None req-81e7261f-3a62-45d8-80ef-e3604d77dc51 admin admin] Received port after_create {{(pid=102993) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 23 19:37:56.960842 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-81e7261f-3a62-45d8-80ef-e3604d77dc51 admin admin] Pushing event updated for resources: {'Port': ['ID=bc49825c-fa1c-4a34-9835-46a0c3e77dd2,revision_number=1']} {{(pid=102993) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 23 19:37:56.983335 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-81e7261f-3a62-45d8-80ef-e3604d77dc51 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-926676'] for router_interface, before_create {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:37:57.215815 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-81e7261f-3a62-45d8-80ef-e3604d77dc51 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7921281'] for port, before_update {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:37:57.225464 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron_lib.callbacks.manager [None req-dad2d830-e570-498c-9ef3-d6c6c1a30ede None None] Publish callbacks [] for port, precommit_update {{(pid=102994) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:37:57.233133 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.db.provisioning_blocks [None req-7ccefe88-cf19-408b-b753-db37eb819d7f None None] Provisioning complete for port bc49825c-fa1c-4a34-9835-46a0c3e77dd2 triggered by entity DHCP. {{(pid=102994) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 23 19:37:57.233593 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron_lib.callbacks.manager [None req-7ccefe88-cf19-408b-b753-db37eb819d7f None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-8355713'] for port, provisioning_complete {{(pid=102994) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:37:57.269169 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.plugins.ml2.plugin [None req-7ccefe88-cf19-408b-b753-db37eb819d7f None None] Port bc49825c-fa1c-4a34-9835-46a0c3e77dd2 cannot update to ACTIVE because it is not bound. {{(pid=102994) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 23 19:37:57.285374 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron_lib.callbacks.manager [None req-dad2d830-e570-498c-9ef3-d6c6c1a30ede None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7918660', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-15067', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560168', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8783631423946', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8783631008732', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8783631008750'] for port, after_update {{(pid=102994) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:37:57.341681 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.plugins.ml2.managers [None req-dad2d830-e570-498c-9ef3-d6c6c1a30ede None None] Attempting to bind port 7d43a82d-0eb8-4132-bc25-a50299a7264c on host dv-cinder-819011-1-iscsi for vnic_type normal with profile {{(pid=102994) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 23 19:37:57.342053 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.plugins.ml2.managers [None req-dad2d830-e570-498c-9ef3-d6c6c1a30ede None None] Attempting to bind port 7d43a82d-0eb8-4132-bc25-a50299a7264c by drivers openvswitch,hyperv on host dv-cinder-819011-1-iscsi at level 0 using segments [{'id': '3cb5e60b-103a-47d0-a28b-d68e3159d032', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'a93e254e-aac9-4233-9e4d-4290fd0458e4'}] {{(pid=102994) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 23 19:37:57.342420 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-dad2d830-e570-498c-9ef3-d6c6c1a30ede None None] Attempting to bind port 7d43a82d-0eb8-4132-bc25-a50299a7264c on network a93e254e-aac9-4233-9e4d-4290fd0458e4 {{(pid=102994) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 23 19:37:57.348308 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8892f351-738a-4683-b833-fb5e88be5167 None None] Pushing event updated for resources: {'Port': ['ID=7d43a82d-0eb8-4132-bc25-a50299a7264c,revision_number=2']} {{(pid=102994) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 23 19:37:57.354077 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-dad2d830-e570-498c-9ef3-d6c6c1a30ede None None] Checking agent: {'id': '668c8953-047c-499e-8c0d-db838fac1668', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-819011-1-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 23, 19, 25, 17), 'started_at': datetime.datetime(2021, 11, 23, 19, 25, 47), 'heartbeat_timestamp': datetime.datetime(2021, 11, 23, 19, 37, 47), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-819011-1-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=102994) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 23 19:37:57.354624 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-dad2d830-e570-498c-9ef3-d6c6c1a30ede None None] Checking segment: {'id': '3cb5e60b-103a-47d0-a28b-d68e3159d032', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'a93e254e-aac9-4233-9e4d-4290fd0458e4'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102994) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 23 19:37:57.355138 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron_lib.callbacks.manager [None req-dad2d830-e570-498c-9ef3-d6c6c1a30ede None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=102994) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:37:57.355828 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-dad2d830-e570-498c-9ef3-d6c6c1a30ede None None] Bound using segment: {'id': '3cb5e60b-103a-47d0-a28b-d68e3159d032', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'a93e254e-aac9-4233-9e4d-4290fd0458e4'} {{(pid=102994) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 23 19:37:57.356449 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.plugins.ml2.managers [None req-dad2d830-e570-498c-9ef3-d6c6c1a30ede None None] Bound port: 7d43a82d-0eb8-4132-bc25-a50299a7264c, host: dv-cinder-819011-1-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '3cb5e60b-103a-47d0-a28b-d68e3159d032', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'a93e254e-aac9-4233-9e4d-4290fd0458e4'}}] {{(pid=102994) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 23 19:37:57.356934 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron_lib.callbacks.manager [None req-dad2d830-e570-498c-9ef3-d6c6c1a30ede None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7921281'] for port, before_update {{(pid=102994) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:37:57.382684 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-81e7261f-3a62-45d8-80ef-e3604d77dc51 admin admin] Publish callbacks [] for port, precommit_update {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:37:57.410230 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.plugins.ml2.db [None req-dad2d830-e570-498c-9ef3-d6c6c1a30ede None None] For port 7d43a82d-0eb8-4132-bc25-a50299a7264c, host dv-cinder-819011-1-iscsi, cleared binding levels {{(pid=102994) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 23 19:37:57.413302 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.plugins.ml2.db [None req-dad2d830-e570-498c-9ef3-d6c6c1a30ede None None] For port 7d43a82d-0eb8-4132-bc25-a50299a7264c, host dv-cinder-819011-1-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-819011-1-iscsi',level=0,port_id=7d43a82d-0eb8-4132-bc25-a50299a7264c,segment=NetworkSegment(3cb5e60b-103a-47d0-a28b-d68e3159d032),segment_id=3cb5e60b-103a-47d0-a28b-d68e3159d032)] {{(pid=102994) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 23 19:37:57.440031 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-81e7261f-3a62-45d8-80ef-e3604d77dc51 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7918660', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-15067', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560168', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8783631423946', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8783631008732', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8783631008750', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-17257505'] for port, after_update {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:37:57.462922 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron_lib.callbacks.manager [None req-dad2d830-e570-498c-9ef3-d6c6c1a30ede None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7918660', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-15067', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560168', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8783631423946', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8783631008732', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8783631008750'] for port, after_update {{(pid=102994) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:37:57.506547 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-81e7261f-3a62-45d8-80ef-e3604d77dc51 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-553426', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-932964'] for router_interface, after_create {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:37:57.512506 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-81e7261f-3a62-45d8-80ef-e3604d77dc51 admin admin] Pushing event updated for resources: {'Port': ['ID=bc49825c-fa1c-4a34-9835-46a0c3e77dd2,revision_number=2']} {{(pid=102993) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 23 19:37:57.517356 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.db.l3_dvrscheduler_db [None req-dad2d830-e570-498c-9ef3-d6c6c1a30ede None None] Routers {'cd026b6a-8872-4a92-92e4-4bd664068764'} bound to L3 agent in host dv-cinder-819011-1-iscsi {{(pid=102994) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 23 19:37:57.517356 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.db.l3_hamode_db [None req-dad2d830-e570-498c-9ef3-d6c6c1a30ede None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-819011-1-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 7, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 7, "log_agent_heartbeats": false, "routers": 7},created_at=2021-11-23T19:25:14Z,description=,heartbeat_timestamp=2021-11-23T19:37:44Z,host='dv-cinder-819011-1-iscsi',id=1b20f2c4-70b6-43c3-b9bd-0062cc9e57ac,load=0,resource_versions=,resources_synced=,started_at=2021-11-23T19:25:15Z,topic='l3_agent')) {'router_ids': ['cd026b6a-8872-4a92-92e4-4bd664068764'], 'active': True} {{(pid=102994) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 23 19:37:57.570488 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8892f351-738a-4683-b833-fb5e88be5167 None None] Pushing event updated for resources: {'Port': ['ID=7d43a82d-0eb8-4132-bc25-a50299a7264c,revision_number=3']} {{(pid=102994) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 23 19:37:57.613157 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-81e7261f-3a62-45d8-80ef-e3604d77dc51 admin admin] Network e174bef4-375a-481e-8191-fce5c2cbb97d is already hosted by enough agents. {{(pid=102993) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 23 19:37:57.615052 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.scheduler.base_scheduler [None req-81e7261f-3a62-45d8-80ef-e3604d77dc51 admin admin] Resources bound (agent type, host, resource id): {{(pid=102993) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 23 19:37:57.653984 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.db.l3_dvr_db [None req-dad2d830-e570-498c-9ef3-d6c6c1a30ede None None] Set router cd026b6a-8872-4a92-92e4-4bd664068764 gateway port host: dv-cinder-819011-1-iscsi {{(pid=102994) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 23 19:37:57.759241 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-81e7261f-3a62-45d8-80ef-e3604d77dc51 admin admin] Router cd026b6a-8872-4a92-92e4-4bd664068764 has already been hosted by L3 agent 1b20f2c4-70b6-43c3-b9bd-0062cc9e57ac {{(pid=102993) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 23 19:37:57.891264 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-81e7261f-3a62-45d8-80ef-e3604d77dc51 admin admin] Notify agent at l3_agent.dv-cinder-819011-1-iscsi the message routers_updated {{(pid=102993) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 23 19:37:57.905077 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [None req-81e7261f-3a62-45d8-80ef-e3604d77dc51 admin admin] 10.222.0.62 "PUT /v2.0/routers/cd026b6a-8872-4a92-92e4-4bd664068764/add_router_interface HTTP/1.1" status: 200 len: 503 time: 1.9402070 Nov 23 19:37:57.905372 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.db.provisioning_blocks [None req-dee9c61b-a426-4473-949a-2dd00c62bfd2 None None] Provisioning complete for port bc49825c-fa1c-4a34-9835-46a0c3e77dd2 triggered by entity DHCP. {{(pid=102994) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 23 19:37:57.905372 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron_lib.callbacks.manager [None req-dee9c61b-a426-4473-949a-2dd00c62bfd2 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-8355713'] for port, provisioning_complete {{(pid=102994) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:37:57.937614 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.db.l3_hamode_db [None req-dad2d830-e570-498c-9ef3-d6c6c1a30ede None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'cd026b6a-8872-4a92-92e4-4bd664068764', 'name': 'tempest-TestMinimumBasicScenario-1019384590-router', 'tenant_id': 'ce37dcbb36ad436fbb4c75aff35bbebf', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'a93e254e-aac9-4233-9e4d-4290fd0458e4', 'external_fixed_ips': [{'subnet_id': 'e0b32f3d-83d6-439a-bbed-01df7cf01051', 'ip_address': '172.27.1.250'}], 'enable_snat': True}, 'gw_port_id': '7d43a82d-0eb8-4132-bc25-a50299a7264c', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-23T19:37:53Z', 'updated_at': '2021-11-23T19:37:57Z', 'revision_number': 4, 'project_id': 'ce37dcbb36ad436fbb4c75aff35bbebf', 'gw_port': {'id': '7d43a82d-0eb8-4132-bc25-a50299a7264c', 'name': '', 'network_id': 'a93e254e-aac9-4233-9e4d-4290fd0458e4', 'tenant_id': '', 'mac_address': 'fa:16:3e:ad:76:0e', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'cd026b6a-8872-4a92-92e4-4bd664068764', 'device_owner': 'network:router_gateway', 'standard_attr_id': 566, 'fixed_ips': [{'subnet_id': 'e0b32f3d-83d6-439a-bbed-01df7cf01051', 'ip_address': '172.27.1.250', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-819011-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-23T19:37:54Z', 'updated_at': '2021-11-23T19:37:57Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'e0b32f3d-83d6-439a-bbed-01df7cf01051', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-819011-1-iscsi', '_interfaces': [{'id': 'bc49825c-fa1c-4a34-9835-46a0c3e77dd2', 'name': '', 'network_id': 'e174bef4-375a-481e-8191-fce5c2cbb97d', 'tenant_id': 'ce37dcbb36ad436fbb4c75aff35bbebf', 'mac_address': 'fa:16:3e:de:9b:d1', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'cd026b6a-8872-4a92-92e4-4bd664068764', 'device_owner': 'network:router_interface', 'standard_attr_id': 567, 'fixed_ips': [{'subnet_id': 'ae751b05-57d4-48cb-8d43-9f8a983127e9', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-23T19:37:56Z', 'updated_at': '2021-11-23T19:37:57Z', 'revision_number': 2, 'project_id': 'ce37dcbb36ad436fbb4c75aff35bbebf', 'subnets': [{'id': 'ae751b05-57d4-48cb-8d43-9f8a983127e9', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-819011-1-iscsi', False) {} {{(pid=102994) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 23 19:37:57.967091 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.plugins.ml2.plugin [None req-dee9c61b-a426-4473-949a-2dd00c62bfd2 None None] Port bc49825c-fa1c-4a34-9835-46a0c3e77dd2 cannot update to ACTIVE because it is not bound. {{(pid=102994) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 23 19:37:57.968746 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-dad2d830-e570-498c-9ef3-d6c6c1a30ede None None] The sync data for ids ['cd026b6a-8872-4a92-92e4-4bd664068764'] in dv-cinder-819011-1-iscsi is: [{'id': 'cd026b6a-8872-4a92-92e4-4bd664068764', 'name': 'tempest-TestMinimumBasicScenario-1019384590-router', 'tenant_id': 'ce37dcbb36ad436fbb4c75aff35bbebf', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'a93e254e-aac9-4233-9e4d-4290fd0458e4', 'external_fixed_ips': [{'subnet_id': 'e0b32f3d-83d6-439a-bbed-01df7cf01051', 'ip_address': '172.27.1.250'}], 'enable_snat': True}, 'gw_port_id': '7d43a82d-0eb8-4132-bc25-a50299a7264c', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-23T19:37:53Z', 'updated_at': '2021-11-23T19:37:57Z', 'revision_number': 4, 'project_id': 'ce37dcbb36ad436fbb4c75aff35bbebf', 'gw_port': {'id': '7d43a82d-0eb8-4132-bc25-a50299a7264c', 'name': '', 'network_id': 'a93e254e-aac9-4233-9e4d-4290fd0458e4', 'tenant_id': '', 'mac_address': 'fa:16:3e:ad:76:0e', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'cd026b6a-8872-4a92-92e4-4bd664068764', 'device_owner': 'network:router_gateway', 'standard_attr_id': 566, 'fixed_ips': [{'subnet_id': 'e0b32f3d-83d6-439a-bbed-01df7cf01051', 'ip_address': '172.27.1.250', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-819011-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-23T19:37:54Z', 'updated_at': '2021-11-23T19:37:57Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'e0b32f3d-83d6-439a-bbed-01df7cf01051', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-819011-1-iscsi', '_interfaces': [{'id': 'bc49825c-fa1c-4a34-9835-46a0c3e77dd2', 'name': '', 'network_id': 'e174bef4-375a-481e-8191-fce5c2cbb97d', 'tenant_id': 'ce37dcbb36ad436fbb4c75aff35bbebf', 'mac_address': 'fa:16:3e:de:9b:d1', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'cd026b6a-8872-4a92-92e4-4bd664068764', 'device_owner': 'network:router_interface', 'standard_attr_id': 567, 'fixed_ips': [{'subnet_id': 'ae751b05-57d4-48cb-8d43-9f8a983127e9', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-23T19:37:56Z', 'updated_at': '2021-11-23T19:37:57Z', 'revision_number': 2, 'project_id': 'ce37dcbb36ad436fbb4c75aff35bbebf', 'subnets': [{'id': 'ae751b05-57d4-48cb-8d43-9f8a983127e9', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=102994) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 23 19:37:58.102805 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.plugins.ml2.rpc [None req-eb87b2c3-3339-4249-8b85-e695b5b4e1f9 None None] Device d12303ae-95fd-4188-99d6-02b273fd2188 up at agent ovs-agent-dv-cinder-819011-1-iscsi {{(pid=102994) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 23 19:37:58.161497 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.db.provisioning_blocks [None req-eb87b2c3-3339-4249-8b85-e695b5b4e1f9 None None] Provisioning complete for port d12303ae-95fd-4188-99d6-02b273fd2188 triggered by entity L2. {{(pid=102994) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 23 19:37:58.161958 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron_lib.callbacks.manager [None req-eb87b2c3-3339-4249-8b85-e695b5b4e1f9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-8355713'] for port, provisioning_complete {{(pid=102994) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:37:59.730652 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron_lib.callbacks.manager [None req-4bf48ff4-ecfb-4168-8b63-249b8c6e9f04 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8783631323329', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7978582'] for agent, after_update {{(pid=102994) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:37:59.924616 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-fa9d14d4-c672-4208-9f51-9e8c0194e990 req-a1862f0b-8789-4ec3-a91b-264d94554171 tempest-TestShelveInstance-292550524 tempest-TestShelveInstance-292550524-project] 10.222.0.62 "GET /v2.0/security-groups?name=tempest-secgroup-smoke-1888869429&fields=id&tenant_id=35f8a5017a27449084aabd12f27f5a8a HTTP/1.1" status: 200 len: 267 time: 0.0476370 Nov 23 19:38:00.046566 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fa9d14d4-c672-4208-9f51-9e8c0194e990 req-bdca2e3b-fdb1-4413-b207-f032cfdde67c tempest-TestShelveInstance-292550524 tempest-TestShelveInstance-292550524-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=102992) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:38:00.048330 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-fa9d14d4-c672-4208-9f51-9e8c0194e990 req-bdca2e3b-fdb1-4413-b207-f032cfdde67c tempest-TestShelveInstance-292550524 tempest-TestShelveInstance-292550524-project] 10.222.0.62 "GET /v2.0/networks?id=87e46ab6-0f90-430f-930f-9ea1580c04c3 HTTP/1.1" status: 200 len: 808 time: 0.1136572 Nov 23 19:38:00.073252 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-fa9d14d4-c672-4208-9f51-9e8c0194e990 req-c7ed658d-048f-4099-a075-f56d9c756b32 tempest-TestShelveInstance-292550524 tempest-TestShelveInstance-292550524-project] 10.222.0.62 "GET /v2.0/quotas/35f8a5017a27449084aabd12f27f5a8a HTTP/1.1" status: 200 len: 375 time: 0.0173957 Nov 23 19:38:00.136449 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-fa9d14d4-c672-4208-9f51-9e8c0194e990 req-aa64c650-7390-4631-86a8-7ae913a131ae tempest-TestShelveInstance-292550524 tempest-TestShelveInstance-292550524-project] 10.222.0.62 "GET /v2.0/ports?tenant_id=35f8a5017a27449084aabd12f27f5a8a&fields=id HTTP/1.1" status: 200 len: 302 time: 0.0579770 Nov 23 19:38:00.170615 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.plugins.ml2.rpc [None req-eb87b2c3-3339-4249-8b85-e695b5b4e1f9 None None] Device 7d43a82d-0eb8-4132-bc25-a50299a7264c up at agent ovs-agent-dv-cinder-819011-1-iscsi {{(pid=102994) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 23 19:38:00.238157 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.db.provisioning_blocks [None req-eb87b2c3-3339-4249-8b85-e695b5b4e1f9 None None] Provisioning complete for port 7d43a82d-0eb8-4132-bc25-a50299a7264c triggered by entity L2. {{(pid=102994) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 23 19:38:00.238506 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron_lib.callbacks.manager [None req-eb87b2c3-3339-4249-8b85-e695b5b4e1f9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-8355713'] for port, provisioning_complete {{(pid=102994) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:38:00.345962 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-fa9d14d4-c672-4208-9f51-9e8c0194e990 req-e0b09602-a386-481b-b95f-c979fdbcede1 service neutron] 10.222.0.62 "GET /v2.0/networks/87e46ab6-0f90-430f-930f-9ea1580c04c3?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2027304 Nov 23 19:38:00.465502 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-fa9d14d4-c672-4208-9f51-9e8c0194e990 req-e19d7cb1-ba6a-4fbb-b101-1f277328d270 service neutron] 10.222.0.62 "GET /v2.0/networks/87e46ab6-0f90-430f-930f-9ea1580c04c3?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1179030 Nov 23 19:38:00.476235 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron_lib.callbacks.manager [None req-eb87b2c3-3339-4249-8b85-e695b5b4e1f9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7921281'] for port, before_update {{(pid=102994) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:38:00.514916 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.plugins.ml2.db [None req-eb87b2c3-3339-4249-8b85-e695b5b4e1f9 None None] For port 7d43a82d-0eb8-4132-bc25-a50299a7264c, host dv-cinder-819011-1-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-819011-1-iscsi',level=0,port_id=7d43a82d-0eb8-4132-bc25-a50299a7264c,segment=NetworkSegment(3cb5e60b-103a-47d0-a28b-d68e3159d032),segment_id=3cb5e60b-103a-47d0-a28b-d68e3159d032)] {{(pid=102994) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 23 19:38:00.576551 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron_lib.callbacks.manager [None req-eb87b2c3-3339-4249-8b85-e695b5b4e1f9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7918660', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-15067', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560168', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8783631423946', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8783631008732', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8783631008750'] for port, after_update {{(pid=102994) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:38:00.644902 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-eb87b2c3-3339-4249-8b85-e695b5b4e1f9 None None] Pushing event updated for resources: {'Port': ['ID=7d43a82d-0eb8-4132-bc25-a50299a7264c,revision_number=4']} {{(pid=102994) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 23 19:38:01.228058 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-40f74372-9831-42cd-92db-7c70704f92e8 req-03f7ad84-548e-4a63-a47f-bc4c0e046688 tempest-TestShelveInstance-292550524 tempest-TestShelveInstance-292550524-project] 10.222.0.62 "GET /v2.0/ports?device_id=b504cdb2-6182-4c24-9b46-6dc0f85da342 HTTP/1.1" status: 200 len: 210 time: 0.0309801 Nov 23 19:38:01.697394 dv-cinder-819011-1-iscsi neutron-server[102995]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-712848ff-739b-45a1-a8ff-669ddb9ce529 None None] Sync routers for ids ['cd026b6a-8872-4a92-92e4-4bd664068764'] in dv-cinder-819011-1-iscsi {{(pid=102995) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 23 19:38:01.710934 dv-cinder-819011-1-iscsi neutron-server[102995]: DEBUG neutron.db.l3_dvrscheduler_db [None req-712848ff-739b-45a1-a8ff-669ddb9ce529 None None] Routers {'cd026b6a-8872-4a92-92e4-4bd664068764'} bound to L3 agent in host dv-cinder-819011-1-iscsi {{(pid=102995) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 23 19:38:01.711688 dv-cinder-819011-1-iscsi neutron-server[102995]: DEBUG neutron.db.l3_hamode_db [None req-712848ff-739b-45a1-a8ff-669ddb9ce529 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-819011-1-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 7, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 7, "log_agent_heartbeats": false, "routers": 7},created_at=2021-11-23T19:25:14Z,description=,heartbeat_timestamp=2021-11-23T19:37:44Z,host='dv-cinder-819011-1-iscsi',id=1b20f2c4-70b6-43c3-b9bd-0062cc9e57ac,load=0,resource_versions=,resources_synced=,started_at=2021-11-23T19:25:15Z,topic='l3_agent')) {'router_ids': ['cd026b6a-8872-4a92-92e4-4bd664068764'], 'active': True} {{(pid=102995) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 23 19:38:01.827233 dv-cinder-819011-1-iscsi neutron-server[102995]: DEBUG neutron.db.l3_dvr_db [None req-712848ff-739b-45a1-a8ff-669ddb9ce529 None None] Set router cd026b6a-8872-4a92-92e4-4bd664068764 gateway port host: dv-cinder-819011-1-iscsi {{(pid=102995) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 23 19:38:02.030363 dv-cinder-819011-1-iscsi neutron-server[102995]: DEBUG neutron.db.l3_hamode_db [None req-712848ff-739b-45a1-a8ff-669ddb9ce529 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'cd026b6a-8872-4a92-92e4-4bd664068764', 'name': 'tempest-TestMinimumBasicScenario-1019384590-router', 'tenant_id': 'ce37dcbb36ad436fbb4c75aff35bbebf', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'a93e254e-aac9-4233-9e4d-4290fd0458e4', 'external_fixed_ips': [{'subnet_id': 'e0b32f3d-83d6-439a-bbed-01df7cf01051', 'ip_address': '172.27.1.250'}], 'enable_snat': True}, 'gw_port_id': '7d43a82d-0eb8-4132-bc25-a50299a7264c', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-23T19:37:53Z', 'updated_at': '2021-11-23T19:37:57Z', 'revision_number': 4, 'project_id': 'ce37dcbb36ad436fbb4c75aff35bbebf', 'gw_port': {'id': '7d43a82d-0eb8-4132-bc25-a50299a7264c', 'name': '', 'network_id': 'a93e254e-aac9-4233-9e4d-4290fd0458e4', 'tenant_id': '', 'mac_address': 'fa:16:3e:ad:76:0e', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'cd026b6a-8872-4a92-92e4-4bd664068764', 'device_owner': 'network:router_gateway', 'standard_attr_id': 566, 'fixed_ips': [{'subnet_id': 'e0b32f3d-83d6-439a-bbed-01df7cf01051', 'ip_address': '172.27.1.250', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-819011-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-23T19:37:54Z', 'updated_at': '2021-11-23T19:38:00Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'e0b32f3d-83d6-439a-bbed-01df7cf01051', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-819011-1-iscsi', '_interfaces': [{'id': 'bc49825c-fa1c-4a34-9835-46a0c3e77dd2', 'name': '', 'network_id': 'e174bef4-375a-481e-8191-fce5c2cbb97d', 'tenant_id': 'ce37dcbb36ad436fbb4c75aff35bbebf', 'mac_address': 'fa:16:3e:de:9b:d1', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'cd026b6a-8872-4a92-92e4-4bd664068764', 'device_owner': 'network:router_interface', 'standard_attr_id': 567, 'fixed_ips': [{'subnet_id': 'ae751b05-57d4-48cb-8d43-9f8a983127e9', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-23T19:37:56Z', 'updated_at': '2021-11-23T19:37:57Z', 'revision_number': 2, 'project_id': 'ce37dcbb36ad436fbb4c75aff35bbebf', 'subnets': [{'id': 'ae751b05-57d4-48cb-8d43-9f8a983127e9', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-819011-1-iscsi', False) {} {{(pid=102995) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 23 19:38:02.057036 dv-cinder-819011-1-iscsi neutron-server[102995]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-712848ff-739b-45a1-a8ff-669ddb9ce529 None None] Checking router: cd026b6a-8872-4a92-92e4-4bd664068764 for host: dv-cinder-819011-1-iscsi {{(pid=102995) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 23 19:38:02.057398 dv-cinder-819011-1-iscsi neutron-server[102995]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-712848ff-739b-45a1-a8ff-669ddb9ce529 None None] Updating router cd026b6a-8872-4a92-92e4-4bd664068764 port bc49825c-fa1c-4a34-9835-46a0c3e77dd2 binding host dv-cinder-819011-1-iscsi {{(pid=102995) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Nov 23 19:38:02.088948 dv-cinder-819011-1-iscsi neutron-server[102995]: DEBUG neutron_lib.callbacks.manager [None req-712848ff-739b-45a1-a8ff-669ddb9ce529 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7921281'] for port, before_update {{(pid=102995) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:38:02.096231 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.plugins.ml2.rpc [None req-eb87b2c3-3339-4249-8b85-e695b5b4e1f9 None None] Device 7d43a82d-0eb8-4132-bc25-a50299a7264c up at agent ovs-agent-dv-cinder-819011-1-iscsi {{(pid=102994) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 23 19:38:02.147149 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.db.provisioning_blocks [None req-eb87b2c3-3339-4249-8b85-e695b5b4e1f9 None None] Provisioning complete for port 7d43a82d-0eb8-4132-bc25-a50299a7264c triggered by entity L2. {{(pid=102994) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 23 19:38:02.147819 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron_lib.callbacks.manager [None req-eb87b2c3-3339-4249-8b85-e695b5b4e1f9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-8355713'] for port, provisioning_complete {{(pid=102994) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:38:02.309533 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-67abe0e7-78f3-4bb7-9140-c68f0ffd2491 req-7660699f-28a6-4f04-b1df-445d8680590d tempest-TestShelveInstance-292550524 tempest-TestShelveInstance-292550524-project] 10.222.0.62 "GET /v2.0/ports?device_id=b504cdb2-6182-4c24-9b46-6dc0f85da342 HTTP/1.1" status: 200 len: 210 time: 0.0278804 Nov 23 19:38:02.431738 dv-cinder-819011-1-iscsi neutron-server[102995]: DEBUG neutron_lib.callbacks.manager [None req-712848ff-739b-45a1-a8ff-669ddb9ce529 None None] Publish callbacks [] for port, precommit_update {{(pid=102995) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:38:02.482010 dv-cinder-819011-1-iscsi neutron-server[102995]: DEBUG neutron_lib.callbacks.manager [None req-712848ff-739b-45a1-a8ff-669ddb9ce529 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7918660', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-15067', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560168', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8783631423946', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8783631008732', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8783631008750'] for port, after_update {{(pid=102995) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:38:02.528575 dv-cinder-819011-1-iscsi neutron-server[102995]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5c7f7cff-5560-47e8-be08-488c13396e2f None None] Pushing event updated for resources: {'Port': ['ID=bc49825c-fa1c-4a34-9835-46a0c3e77dd2,revision_number=3']} {{(pid=102995) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 23 19:38:02.612367 dv-cinder-819011-1-iscsi neutron-server[102995]: DEBUG neutron.plugins.ml2.managers [None req-712848ff-739b-45a1-a8ff-669ddb9ce529 None None] Attempting to bind port bc49825c-fa1c-4a34-9835-46a0c3e77dd2 on host dv-cinder-819011-1-iscsi for vnic_type normal with profile {{(pid=102995) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 23 19:38:02.612748 dv-cinder-819011-1-iscsi neutron-server[102995]: DEBUG neutron.plugins.ml2.managers [None req-712848ff-739b-45a1-a8ff-669ddb9ce529 None None] Attempting to bind port bc49825c-fa1c-4a34-9835-46a0c3e77dd2 by drivers openvswitch,hyperv on host dv-cinder-819011-1-iscsi at level 0 using segments [{'id': 'af2ab065-e074-4168-9b03-e42fa5dfb6ab', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 814, 'network_id': 'e174bef4-375a-481e-8191-fce5c2cbb97d'}] {{(pid=102995) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 23 19:38:02.613224 dv-cinder-819011-1-iscsi neutron-server[102995]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-712848ff-739b-45a1-a8ff-669ddb9ce529 None None] Attempting to bind port bc49825c-fa1c-4a34-9835-46a0c3e77dd2 on network e174bef4-375a-481e-8191-fce5c2cbb97d {{(pid=102995) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 23 19:38:02.618734 dv-cinder-819011-1-iscsi neutron-server[102995]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-712848ff-739b-45a1-a8ff-669ddb9ce529 None None] Checking agent: {'id': '668c8953-047c-499e-8c0d-db838fac1668', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-819011-1-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 23, 19, 25, 17), 'started_at': datetime.datetime(2021, 11, 23, 19, 25, 47), 'heartbeat_timestamp': datetime.datetime(2021, 11, 23, 19, 37, 47), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-819011-1-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=102995) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 23 19:38:02.619116 dv-cinder-819011-1-iscsi neutron-server[102995]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-712848ff-739b-45a1-a8ff-669ddb9ce529 None None] Checking segment: {'id': 'af2ab065-e074-4168-9b03-e42fa5dfb6ab', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 814, 'network_id': 'e174bef4-375a-481e-8191-fce5c2cbb97d'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102995) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 23 19:38:02.619647 dv-cinder-819011-1-iscsi neutron-server[102995]: DEBUG neutron_lib.callbacks.manager [None req-712848ff-739b-45a1-a8ff-669ddb9ce529 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=102995) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:38:02.620065 dv-cinder-819011-1-iscsi neutron-server[102995]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-712848ff-739b-45a1-a8ff-669ddb9ce529 None None] Bound using segment: {'id': 'af2ab065-e074-4168-9b03-e42fa5dfb6ab', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 814, 'network_id': 'e174bef4-375a-481e-8191-fce5c2cbb97d'} {{(pid=102995) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 23 19:38:02.620527 dv-cinder-819011-1-iscsi neutron-server[102995]: DEBUG neutron.plugins.ml2.managers [None req-712848ff-739b-45a1-a8ff-669ddb9ce529 None None] Bound port: bc49825c-fa1c-4a34-9835-46a0c3e77dd2, host: dv-cinder-819011-1-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'af2ab065-e074-4168-9b03-e42fa5dfb6ab', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 814, 'network_id': 'e174bef4-375a-481e-8191-fce5c2cbb97d'}}] {{(pid=102995) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 23 19:38:02.621608 dv-cinder-819011-1-iscsi neutron-server[102995]: DEBUG neutron_lib.callbacks.manager [None req-712848ff-739b-45a1-a8ff-669ddb9ce529 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7921281'] for port, before_update {{(pid=102995) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:38:02.699958 dv-cinder-819011-1-iscsi neutron-server[102995]: DEBUG neutron.plugins.ml2.db [None req-712848ff-739b-45a1-a8ff-669ddb9ce529 None None] For port bc49825c-fa1c-4a34-9835-46a0c3e77dd2, host dv-cinder-819011-1-iscsi, cleared binding levels {{(pid=102995) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 23 19:38:02.706103 dv-cinder-819011-1-iscsi neutron-server[102995]: DEBUG neutron.plugins.ml2.db [None req-712848ff-739b-45a1-a8ff-669ddb9ce529 None None] For port bc49825c-fa1c-4a34-9835-46a0c3e77dd2, host dv-cinder-819011-1-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-819011-1-iscsi',level=0,port_id=bc49825c-fa1c-4a34-9835-46a0c3e77dd2,segment=NetworkSegment(af2ab065-e074-4168-9b03-e42fa5dfb6ab),segment_id=af2ab065-e074-4168-9b03-e42fa5dfb6ab)] {{(pid=102995) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 23 19:38:02.765763 dv-cinder-819011-1-iscsi neutron-server[102995]: DEBUG neutron_lib.callbacks.manager [None req-712848ff-739b-45a1-a8ff-669ddb9ce529 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7918660', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-15067', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560168', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8783631423946', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8783631008732', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8783631008750'] for port, after_update {{(pid=102995) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:38:02.836708 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.db.provisioning_blocks [None req-45b212a5-53ba-4367-9d6b-3795e933ca01 None None] Provisioning complete for port bc49825c-fa1c-4a34-9835-46a0c3e77dd2 triggered by entity DHCP. {{(pid=102994) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 23 19:38:02.837176 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron_lib.callbacks.manager [None req-45b212a5-53ba-4367-9d6b-3795e933ca01 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-8355713'] for port, provisioning_complete {{(pid=102994) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:38:02.837954 dv-cinder-819011-1-iscsi neutron-server[102995]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5c7f7cff-5560-47e8-be08-488c13396e2f None None] Pushing event updated for resources: {'Port': ['ID=bc49825c-fa1c-4a34-9835-46a0c3e77dd2,revision_number=4']} {{(pid=102995) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 23 19:38:02.862351 dv-cinder-819011-1-iscsi neutron-server[102995]: DEBUG neutron.db.l3_dvrscheduler_db [None req-712848ff-739b-45a1-a8ff-669ddb9ce529 None None] Routers {'cd026b6a-8872-4a92-92e4-4bd664068764'} bound to L3 agent in host dv-cinder-819011-1-iscsi {{(pid=102995) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 23 19:38:02.863191 dv-cinder-819011-1-iscsi neutron-server[102995]: DEBUG neutron.db.l3_hamode_db [None req-712848ff-739b-45a1-a8ff-669ddb9ce529 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-819011-1-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 7, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 7, "log_agent_heartbeats": false, "routers": 7},created_at=2021-11-23T19:25:14Z,description=,heartbeat_timestamp=2021-11-23T19:37:44Z,host='dv-cinder-819011-1-iscsi',id=1b20f2c4-70b6-43c3-b9bd-0062cc9e57ac,load=0,resource_versions=,resources_synced=,started_at=2021-11-23T19:25:15Z,topic='l3_agent')) {'router_ids': ['cd026b6a-8872-4a92-92e4-4bd664068764'], 'active': True} {{(pid=102995) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 23 19:38:02.990391 dv-cinder-819011-1-iscsi neutron-server[102995]: DEBUG neutron.db.l3_dvr_db [None req-712848ff-739b-45a1-a8ff-669ddb9ce529 None None] Set router cd026b6a-8872-4a92-92e4-4bd664068764 gateway port host: dv-cinder-819011-1-iscsi {{(pid=102995) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 23 19:38:02.992604 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron_lib.callbacks.manager [None req-45b212a5-53ba-4367-9d6b-3795e933ca01 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7921281'] for port, before_update {{(pid=102994) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:38:03.031867 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.plugins.ml2.db [None req-45b212a5-53ba-4367-9d6b-3795e933ca01 None None] For port bc49825c-fa1c-4a34-9835-46a0c3e77dd2, host dv-cinder-819011-1-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-819011-1-iscsi',level=0,port_id=bc49825c-fa1c-4a34-9835-46a0c3e77dd2,segment=NetworkSegment(af2ab065-e074-4168-9b03-e42fa5dfb6ab),segment_id=af2ab065-e074-4168-9b03-e42fa5dfb6ab)] {{(pid=102994) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 23 19:38:03.136376 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron_lib.callbacks.manager [None req-45b212a5-53ba-4367-9d6b-3795e933ca01 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7918660', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-15067', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560168', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8783631423946', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8783631008732', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8783631008750'] for port, after_update {{(pid=102994) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:38:03.198465 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-45b212a5-53ba-4367-9d6b-3795e933ca01 None None] Pushing event updated for resources: {'Port': ['ID=bc49825c-fa1c-4a34-9835-46a0c3e77dd2,revision_number=5']} {{(pid=102994) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 23 19:38:03.253154 dv-cinder-819011-1-iscsi neutron-server[102995]: DEBUG neutron.db.l3_hamode_db [None req-712848ff-739b-45a1-a8ff-669ddb9ce529 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'cd026b6a-8872-4a92-92e4-4bd664068764', 'name': 'tempest-TestMinimumBasicScenario-1019384590-router', 'tenant_id': 'ce37dcbb36ad436fbb4c75aff35bbebf', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'a93e254e-aac9-4233-9e4d-4290fd0458e4', 'external_fixed_ips': [{'subnet_id': 'e0b32f3d-83d6-439a-bbed-01df7cf01051', 'ip_address': '172.27.1.250'}], 'enable_snat': True}, 'gw_port_id': '7d43a82d-0eb8-4132-bc25-a50299a7264c', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-23T19:37:53Z', 'updated_at': '2021-11-23T19:37:57Z', 'revision_number': 4, 'project_id': 'ce37dcbb36ad436fbb4c75aff35bbebf', 'gw_port': {'id': '7d43a82d-0eb8-4132-bc25-a50299a7264c', 'name': '', 'network_id': 'a93e254e-aac9-4233-9e4d-4290fd0458e4', 'tenant_id': '', 'mac_address': 'fa:16:3e:ad:76:0e', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'cd026b6a-8872-4a92-92e4-4bd664068764', 'device_owner': 'network:router_gateway', 'standard_attr_id': 566, 'fixed_ips': [{'subnet_id': 'e0b32f3d-83d6-439a-bbed-01df7cf01051', 'ip_address': '172.27.1.250', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-819011-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-23T19:37:54Z', 'updated_at': '2021-11-23T19:38:00Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'e0b32f3d-83d6-439a-bbed-01df7cf01051', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-819011-1-iscsi', '_interfaces': [{'id': 'bc49825c-fa1c-4a34-9835-46a0c3e77dd2', 'name': '', 'network_id': 'e174bef4-375a-481e-8191-fce5c2cbb97d', 'tenant_id': 'ce37dcbb36ad436fbb4c75aff35bbebf', 'mac_address': 'fa:16:3e:de:9b:d1', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'cd026b6a-8872-4a92-92e4-4bd664068764', 'device_owner': 'network:router_interface', 'standard_attr_id': 567, 'fixed_ips': [{'subnet_id': 'ae751b05-57d4-48cb-8d43-9f8a983127e9', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-819011-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-23T19:37:56Z', 'updated_at': '2021-11-23T19:38:02Z', 'revision_number': 4, 'project_id': 'ce37dcbb36ad436fbb4c75aff35bbebf', 'subnets': [{'id': 'ae751b05-57d4-48cb-8d43-9f8a983127e9', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-819011-1-iscsi', False) {} {{(pid=102995) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 23 19:38:03.259015 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.db.provisioning_blocks [None req-0756ae9d-53ea-4d58-8c07-511dd31a8cc3 None None] Provisioning complete for port bc49825c-fa1c-4a34-9835-46a0c3e77dd2 triggered by entity DHCP. {{(pid=102994) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 23 19:38:03.259604 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron_lib.callbacks.manager [None req-0756ae9d-53ea-4d58-8c07-511dd31a8cc3 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-8355713'] for port, provisioning_complete {{(pid=102994) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:38:03.317386 dv-cinder-819011-1-iscsi neutron-server[102995]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-712848ff-739b-45a1-a8ff-669ddb9ce529 None None] The sync data for ids ['cd026b6a-8872-4a92-92e4-4bd664068764'] in dv-cinder-819011-1-iscsi is: [{'id': 'cd026b6a-8872-4a92-92e4-4bd664068764', 'name': 'tempest-TestMinimumBasicScenario-1019384590-router', 'tenant_id': 'ce37dcbb36ad436fbb4c75aff35bbebf', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'a93e254e-aac9-4233-9e4d-4290fd0458e4', 'external_fixed_ips': [{'subnet_id': 'e0b32f3d-83d6-439a-bbed-01df7cf01051', 'ip_address': '172.27.1.250'}], 'enable_snat': True}, 'gw_port_id': '7d43a82d-0eb8-4132-bc25-a50299a7264c', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-23T19:37:53Z', 'updated_at': '2021-11-23T19:37:57Z', 'revision_number': 4, 'project_id': 'ce37dcbb36ad436fbb4c75aff35bbebf', 'gw_port': {'id': '7d43a82d-0eb8-4132-bc25-a50299a7264c', 'name': '', 'network_id': 'a93e254e-aac9-4233-9e4d-4290fd0458e4', 'tenant_id': '', 'mac_address': 'fa:16:3e:ad:76:0e', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'cd026b6a-8872-4a92-92e4-4bd664068764', 'device_owner': 'network:router_gateway', 'standard_attr_id': 566, 'fixed_ips': [{'subnet_id': 'e0b32f3d-83d6-439a-bbed-01df7cf01051', 'ip_address': '172.27.1.250', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-819011-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-23T19:37:54Z', 'updated_at': '2021-11-23T19:38:00Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'e0b32f3d-83d6-439a-bbed-01df7cf01051', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-819011-1-iscsi', '_interfaces': [{'id': 'bc49825c-fa1c-4a34-9835-46a0c3e77dd2', 'name': '', 'network_id': 'e174bef4-375a-481e-8191-fce5c2cbb97d', 'tenant_id': 'ce37dcbb36ad436fbb4c75aff35bbebf', 'mac_address': 'fa:16:3e:de:9b:d1', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'cd026b6a-8872-4a92-92e4-4bd664068764', 'device_owner': 'network:router_interface', 'standard_attr_id': 567, 'fixed_ips': [{'subnet_id': 'ae751b05-57d4-48cb-8d43-9f8a983127e9', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-819011-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-23T19:37:56Z', 'updated_at': '2021-11-23T19:38:02Z', 'revision_number': 4, 'project_id': 'ce37dcbb36ad436fbb4c75aff35bbebf', 'subnets': [{'id': 'ae751b05-57d4-48cb-8d43-9f8a983127e9', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=102995) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 23 19:38:03.469814 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-8e680611-ccb8-4fcb-a25e-17e0c7a88f78 req-b6ccf67e-e54b-43dc-9535-7a10b5ac18ea tempest-TestShelveInstance-292550524 tempest-TestShelveInstance-292550524-project] 10.222.0.62 "GET /v2.0/ports?device_id=b504cdb2-6182-4c24-9b46-6dc0f85da342 HTTP/1.1" status: 200 len: 210 time: 0.0618811 Nov 23 19:38:04.144612 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.plugins.ml2.rpc [None req-eb87b2c3-3339-4249-8b85-e695b5b4e1f9 None None] Device bc49825c-fa1c-4a34-9835-46a0c3e77dd2 up at agent ovs-agent-dv-cinder-819011-1-iscsi {{(pid=102994) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 23 19:38:04.234150 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.db.provisioning_blocks [None req-eb87b2c3-3339-4249-8b85-e695b5b4e1f9 None None] Provisioning complete for port bc49825c-fa1c-4a34-9835-46a0c3e77dd2 triggered by entity L2. {{(pid=102994) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 23 19:38:04.234606 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron_lib.callbacks.manager [None req-eb87b2c3-3339-4249-8b85-e695b5b4e1f9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-8355713'] for port, provisioning_complete {{(pid=102994) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:38:04.629061 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-00aab832-23fd-4982-8691-fb9825b4faed req-bcb76ace-ff26-4259-98fb-6b0f39861260 tempest-TestShelveInstance-292550524 tempest-TestShelveInstance-292550524-project] 10.222.0.62 "GET /v2.0/ports?device_id=b504cdb2-6182-4c24-9b46-6dc0f85da342 HTTP/1.1" status: 200 len: 210 time: 0.0387239 Nov 23 19:38:04.667786 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fa9d14d4-c672-4208-9f51-9e8c0194e990 req-abb291c7-1890-4af2-a601-0e3b2f60244d tempest-TestShelveInstance-292550524 tempest-TestShelveInstance-292550524-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=102992) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:38:04.669677 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-fa9d14d4-c672-4208-9f51-9e8c0194e990 req-abb291c7-1890-4af2-a601-0e3b2f60244d tempest-TestShelveInstance-292550524 tempest-TestShelveInstance-292550524-project] 10.222.0.41 "GET /v2.0/networks?id=87e46ab6-0f90-430f-930f-9ea1580c04c3 HTTP/1.1" status: 200 len: 808 time: 0.2031326 Nov 23 19:38:04.763243 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-fa9d14d4-c672-4208-9f51-9e8c0194e990 req-b0498c87-7622-4954-aebc-ff2f1ba38d63 tempest-TestShelveInstance-292550524 tempest-TestShelveInstance-292550524-project] 10.222.0.41 "GET /v2.0/security-groups?fields=id&fields=name&tenant_id=35f8a5017a27449084aabd12f27f5a8a HTTP/1.1" status: 200 len: 380 time: 0.0740001 Nov 23 19:38:04.780997 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.api.v2.base [req-fa9d14d4-c672-4208-9f51-9e8c0194e990 req-2ec98690-3b1a-403c-9601-e8c2af50fde4 tempest-TestShelveInstance-292550524 tempest-TestShelveInstance-292550524-project] Request body: {'port': {'device_id': 'b504cdb2-6182-4c24-9b46-6dc0f85da342', 'network_id': '87e46ab6-0f90-430f-930f-9ea1580c04c3', 'admin_state_up': True, 'tenant_id': '35f8a5017a27449084aabd12f27f5a8a', 'security_groups': ['7fe194e6-71c3-47a9-8f36-0dbb24d1f72d']}} {{(pid=102992) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 23 19:38:04.987805 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-fa9d14d4-c672-4208-9f51-9e8c0194e990 req-2ec98690-3b1a-403c-9601-e8c2af50fde4 tempest-TestShelveInstance-292550524 tempest-TestShelveInstance-292550524-project] Made reservation on behalf of 35f8a5017a27449084aabd12f27f5a8a for: {'port': 1} {{(pid=102992) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 23 19:38:04.992023 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [req-fa9d14d4-c672-4208-9f51-9e8c0194e990 req-2ec98690-3b1a-403c-9601-e8c2af50fde4 tempest-TestShelveInstance-292550524 tempest-TestShelveInstance-292550524-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7921281'] for port, before_create {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:38:05.146112 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.db.db_base_plugin_common [req-fa9d14d4-c672-4208-9f51-9e8c0194e990 req-2ec98690-3b1a-403c-9601-e8c2af50fde4 tempest-TestShelveInstance-292550524 tempest-TestShelveInstance-292550524-project] Allocated IP 172.20.0.13 (87e46ab6-0f90-430f-930f-9ea1580c04c3/afa5bc59-f70c-409d-8c15-be2dcdce66a3/bbafb0bb-163c-43f4-8d2c-2f5304e0bd04) {{(pid=102992) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 23 19:38:05.311032 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [req-fa9d14d4-c672-4208-9f51-9e8c0194e990 req-2ec98690-3b1a-403c-9601-e8c2af50fde4 tempest-TestShelveInstance-292550524 tempest-TestShelveInstance-292550524-project] Publish callbacks [] for port, precommit_create {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:38:05.399874 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [req-fa9d14d4-c672-4208-9f51-9e8c0194e990 req-2ec98690-3b1a-403c-9601-e8c2af50fde4 tempest-TestShelveInstance-292550524 tempest-TestShelveInstance-292550524-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7918660', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-15067', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560168', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8783631008714', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-25199805'] for port, after_create {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:38:05.457256 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-fa9d14d4-c672-4208-9f51-9e8c0194e990 req-2ec98690-3b1a-403c-9601-e8c2af50fde4 tempest-TestShelveInstance-292550524 tempest-TestShelveInstance-292550524-project] Network 87e46ab6-0f90-430f-930f-9ea1580c04c3 is already hosted by enough agents. {{(pid=102992) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 23 19:38:05.461459 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.scheduler.base_scheduler [req-fa9d14d4-c672-4208-9f51-9e8c0194e990 req-2ec98690-3b1a-403c-9601-e8c2af50fde4 tempest-TestShelveInstance-292550524 tempest-TestShelveInstance-292550524-project] Resources bound (agent type, host, resource id): {{(pid=102992) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 23 19:38:05.467161 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.db.l3_dvrscheduler_db [req-fa9d14d4-c672-4208-9f51-9e8c0194e990 req-2ec98690-3b1a-403c-9601-e8c2af50fde4 tempest-TestShelveInstance-292550524 tempest-TestShelveInstance-292550524-project] Received port after_create {{(pid=102992) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 23 19:38:05.494842 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2ec98690-3b1a-403c-9601-e8c2af50fde4 tempest-TestShelveInstance-292550524 tempest-TestShelveInstance-292550524-project] Pushing event updated for resources: {'Port': ['ID=bbafb0bb-163c-43f4-8d2c-2f5304e0bd04,revision_number=1']} {{(pid=102992) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 23 19:38:05.554276 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fa9d14d4-c672-4208-9f51-9e8c0194e990 req-2ec98690-3b1a-403c-9601-e8c2af50fde4 tempest-TestShelveInstance-292550524 tempest-TestShelveInstance-292550524-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=102992) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:38:05.555147 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [req-fa9d14d4-c672-4208-9f51-9e8c0194e990 req-2ec98690-3b1a-403c-9601-e8c2af50fde4 tempest-TestShelveInstance-292550524 tempest-TestShelveInstance-292550524-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-514902'] for port, before_response {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:38:05.706747 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-fa9d14d4-c672-4208-9f51-9e8c0194e990 req-2ec98690-3b1a-403c-9601-e8c2af50fde4 tempest-TestShelveInstance-292550524 tempest-TestShelveInstance-292550524-project] 10.222.0.41 "POST /v2.0/ports HTTP/1.1" status: 201 len: 934 time: 0.9288833 Nov 23 19:38:05.723928 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.api.v2.base [req-fa9d14d4-c672-4208-9f51-9e8c0194e990 req-27e5c1c9-7cb8-426d-bf9d-dcbf17dfdbdc service neutron] Request body: {'port': {'device_id': 'b504cdb2-6182-4c24-9b46-6dc0f85da342', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-81901'}} {{(pid=102992) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 23 19:38:05.850126 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.db.provisioning_blocks [None req-40c0a4fa-ee1a-40e6-8aa5-5bc1f7689458 None None] Provisioning complete for port bbafb0bb-163c-43f4-8d2c-2f5304e0bd04 triggered by entity DHCP. {{(pid=102994) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 23 19:38:05.852258 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron_lib.callbacks.manager [None req-40c0a4fa-ee1a-40e6-8aa5-5bc1f7689458 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-8355713'] for port, provisioning_complete {{(pid=102994) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:38:05.904053 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.plugins.ml2.plugin [None req-40c0a4fa-ee1a-40e6-8aa5-5bc1f7689458 None None] Port bbafb0bb-163c-43f4-8d2c-2f5304e0bd04 cannot update to ACTIVE because it is not bound. {{(pid=102994) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 23 19:38:06.157373 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [req-fa9d14d4-c672-4208-9f51-9e8c0194e990 req-27e5c1c9-7cb8-426d-bf9d-dcbf17dfdbdc service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7921281'] for port, before_update {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:38:06.157373 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4b25d58b-b614-4d83-97b0-281907a598e9 req-293e5bdf-3561-4ff4-ae69-6c31a6ddf541 tempest-TestShelveInstance-292550524 tempest-TestShelveInstance-292550524-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102992) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:38:06.157373 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-4b25d58b-b614-4d83-97b0-281907a598e9 req-293e5bdf-3561-4ff4-ae69-6c31a6ddf541 tempest-TestShelveInstance-292550524 tempest-TestShelveInstance-292550524-project] 10.222.0.62 "GET /v2.0/ports?device_id=b504cdb2-6182-4c24-9b46-6dc0f85da342 HTTP/1.1" status: 200 len: 932 time: 0.2126479 Nov 23 19:38:06.157373 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-4b25d58b-b614-4d83-97b0-281907a598e9 req-498cd03f-929d-4df8-a05a-877b37e497ae tempest-TestShelveInstance-292550524 tempest-TestShelveInstance-292550524-project] 10.222.0.62 "GET /v2.0/security-groups?id=7fe194e6-71c3-47a9-8f36-0dbb24d1f72d&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0852890 Nov 23 19:38:06.243890 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.notifiers.nova [req-fa9d14d4-c672-4208-9f51-9e8c0194e990 req-27e5c1c9-7cb8-426d-bf9d-dcbf17dfdbdc service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id bbafb0bb-163c-43f4-8d2c-2f5304e0bd04 {{(pid=102992) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 23 19:38:06.252491 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [req-fa9d14d4-c672-4208-9f51-9e8c0194e990 req-27e5c1c9-7cb8-426d-bf9d-dcbf17dfdbdc service neutron] Publish callbacks [] for port, precommit_update {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:38:06.264556 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.db.provisioning_blocks [req-fa9d14d4-c672-4208-9f51-9e8c0194e990 req-27e5c1c9-7cb8-426d-bf9d-dcbf17dfdbdc service neutron] Transition to ACTIVE for port object bbafb0bb-163c-43f4-8d2c-2f5304e0bd04 will not be triggered until provisioned by entity L2. {{(pid=102992) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 23 19:38:06.376094 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [req-fa9d14d4-c672-4208-9f51-9e8c0194e990 req-27e5c1c9-7cb8-426d-bf9d-dcbf17dfdbdc service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7918660', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-15067', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560168', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8783631423946', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8783631008732', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8783631008750', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-25199748'] for port, after_update {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:38:06.465103 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-27e5c1c9-7cb8-426d-bf9d-dcbf17dfdbdc service neutron] Pushing event updated for resources: {'Port': ['ID=bbafb0bb-163c-43f4-8d2c-2f5304e0bd04,revision_number=2']} {{(pid=102992) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 23 19:38:06.524294 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9f0c3c9d-2d7d-4e7d-97b3-b57b18683306 req-9f6452c7-2af5-42eb-83e5-9c82a10721a1 tempest-AttachVolumeShelveTestJSON-1172915835 tempest-AttachVolumeShelveTestJSON-1172915835-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102992) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:38:06.526164 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-9f0c3c9d-2d7d-4e7d-97b3-b57b18683306 req-9f6452c7-2af5-42eb-83e5-9c82a10721a1 tempest-AttachVolumeShelveTestJSON-1172915835 tempest-AttachVolumeShelveTestJSON-1172915835-project] 10.222.0.62 "GET /v2.0/ports?device_id=85ea3d72-6c17-4ea2-82b7-90cce01633bd HTTP/1.1" status: 200 len: 946 time: 0.1454368 Nov 23 19:38:06.603654 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-9f0c3c9d-2d7d-4e7d-97b3-b57b18683306 req-900cbcf9-e900-4c15-aad3-dc09ea59a6dc tempest-AttachVolumeShelveTestJSON-1172915835 tempest-AttachVolumeShelveTestJSON-1172915835-project] 10.222.0.62 "GET /v2.0/security-groups?id=f1ca24d9-0a31-470d-a1d5-fa7059df0141&fields=id&fields=name HTTP/1.1" status: 200 len: 311 time: 0.0696888 Nov 23 19:38:06.630989 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.plugins.ml2.managers [req-fa9d14d4-c672-4208-9f51-9e8c0194e990 req-27e5c1c9-7cb8-426d-bf9d-dcbf17dfdbdc service neutron] Attempting to bind port bbafb0bb-163c-43f4-8d2c-2f5304e0bd04 on host hv-cinder-81901 for vnic_type normal with profile {{(pid=102992) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 23 19:38:06.631597 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.plugins.ml2.managers [req-fa9d14d4-c672-4208-9f51-9e8c0194e990 req-27e5c1c9-7cb8-426d-bf9d-dcbf17dfdbdc service neutron] Attempting to bind port bbafb0bb-163c-43f4-8d2c-2f5304e0bd04 by drivers openvswitch,hyperv on host hv-cinder-81901 at level 0 using segments [{'id': '5c30b9a1-7b41-4664-aa24-084baf66a2d5', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 817, 'network_id': '87e46ab6-0f90-430f-930f-9ea1580c04c3'}] {{(pid=102992) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 23 19:38:06.632704 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-fa9d14d4-c672-4208-9f51-9e8c0194e990 req-27e5c1c9-7cb8-426d-bf9d-dcbf17dfdbdc service neutron] Attempting to bind port bbafb0bb-163c-43f4-8d2c-2f5304e0bd04 on network 87e46ab6-0f90-430f-930f-9ea1580c04c3 {{(pid=102992) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 23 19:38:06.638797 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-fa9d14d4-c672-4208-9f51-9e8c0194e990 req-27e5c1c9-7cb8-426d-bf9d-dcbf17dfdbdc service neutron] Port bbafb0bb-163c-43f4-8d2c-2f5304e0bd04 on network 87e46ab6-0f90-430f-930f-9ea1580c04c3 not bound, no agent of type Open vSwitch agent registered on host hv-cinder-81901 {{(pid=102992) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Nov 23 19:38:06.639610 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-fa9d14d4-c672-4208-9f51-9e8c0194e990 req-27e5c1c9-7cb8-426d-bf9d-dcbf17dfdbdc service neutron] Attempting to bind port bbafb0bb-163c-43f4-8d2c-2f5304e0bd04 on network 87e46ab6-0f90-430f-930f-9ea1580c04c3 {{(pid=102992) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 23 19:38:06.649876 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-fa9d14d4-c672-4208-9f51-9e8c0194e990 req-27e5c1c9-7cb8-426d-bf9d-dcbf17dfdbdc service neutron] Checking agent: {'id': '14e5d049-431d-466a-8d1c-264e5129d376', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-81901', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 23, 19, 31, 29), 'started_at': datetime.datetime(2021, 11, 23, 19, 31, 29), 'heartbeat_timestamp': datetime.datetime(2021, 11, 23, 19, 38), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=102992) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 23 19:38:06.650502 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-fa9d14d4-c672-4208-9f51-9e8c0194e990 req-27e5c1c9-7cb8-426d-bf9d-dcbf17dfdbdc service neutron] Checking segment: {'id': '5c30b9a1-7b41-4664-aa24-084baf66a2d5', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 817, 'network_id': '87e46ab6-0f90-430f-930f-9ea1580c04c3'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102992) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 23 19:38:06.654043 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-fa9d14d4-c672-4208-9f51-9e8c0194e990 req-27e5c1c9-7cb8-426d-bf9d-dcbf17dfdbdc service neutron] Bound using segment: {'id': '5c30b9a1-7b41-4664-aa24-084baf66a2d5', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 817, 'network_id': '87e46ab6-0f90-430f-930f-9ea1580c04c3'} {{(pid=102992) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 23 19:38:06.654043 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.plugins.ml2.managers [req-fa9d14d4-c672-4208-9f51-9e8c0194e990 req-27e5c1c9-7cb8-426d-bf9d-dcbf17dfdbdc service neutron] Bound port: bbafb0bb-163c-43f4-8d2c-2f5304e0bd04, host: hv-cinder-81901, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '5c30b9a1-7b41-4664-aa24-084baf66a2d5', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 817, 'network_id': '87e46ab6-0f90-430f-930f-9ea1580c04c3'}}] {{(pid=102992) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 23 19:38:06.654043 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [req-fa9d14d4-c672-4208-9f51-9e8c0194e990 req-27e5c1c9-7cb8-426d-bf9d-dcbf17dfdbdc service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7921281'] for port, before_update {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:38:06.778814 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.plugins.ml2.db [req-fa9d14d4-c672-4208-9f51-9e8c0194e990 req-27e5c1c9-7cb8-426d-bf9d-dcbf17dfdbdc service neutron] For port bbafb0bb-163c-43f4-8d2c-2f5304e0bd04, host hv-cinder-81901, cleared binding levels {{(pid=102992) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 23 19:38:06.786203 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.plugins.ml2.db [req-fa9d14d4-c672-4208-9f51-9e8c0194e990 req-27e5c1c9-7cb8-426d-bf9d-dcbf17dfdbdc service neutron] For port bbafb0bb-163c-43f4-8d2c-2f5304e0bd04, host hv-cinder-81901, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81901',level=0,port_id=bbafb0bb-163c-43f4-8d2c-2f5304e0bd04,segment=NetworkSegment(5c30b9a1-7b41-4664-aa24-084baf66a2d5),segment_id=5c30b9a1-7b41-4664-aa24-084baf66a2d5)] {{(pid=102992) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 23 19:38:06.851535 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [req-fa9d14d4-c672-4208-9f51-9e8c0194e990 req-27e5c1c9-7cb8-426d-bf9d-dcbf17dfdbdc service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7918660', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-15067', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560168', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8783631423946', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8783631008732', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8783631008750', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-25199748'] for port, after_update {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:38:06.903564 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fa9d14d4-c672-4208-9f51-9e8c0194e990 req-27e5c1c9-7cb8-426d-bf9d-dcbf17dfdbdc service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102992) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:38:06.904323 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [req-fa9d14d4-c672-4208-9f51-9e8c0194e990 req-27e5c1c9-7cb8-426d-bf9d-dcbf17dfdbdc service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-514902'] for port, before_response {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:38:06.906034 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-fa9d14d4-c672-4208-9f51-9e8c0194e990 req-27e5c1c9-7cb8-426d-bf9d-dcbf17dfdbdc service neutron] 10.222.0.41 "PUT /v2.0/ports/bbafb0bb-163c-43f4-8d2c-2f5304e0bd04 HTTP/1.1" status: 200 len: 1094 time: 1.1915770 Nov 23 19:38:06.907520 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'b504cdb2-6182-4c24-9b46-6dc0f85da342', 'tag': 'bbafb0bb-163c-43f4-8d2c-2f5304e0bd04'}] {{(pid=102992) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 23 19:38:06.909348 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.62/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}f86c332b591ae691ababa4b64e0601cbf242a448242f95367ce03daabfb7e1ce" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-68c3102d-28c0-4e4e-9910-abb88f446c1e" -d '{"events": [{"name": "network-changed", "server_uuid": "b504cdb2-6182-4c24-9b46-6dc0f85da342", "tag": "bbafb0bb-163c-43f4-8d2c-2f5304e0bd04"}]}' {{(pid=102992) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 23 19:38:06.953770 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-27e5c1c9-7cb8-426d-bf9d-dcbf17dfdbdc service neutron] Pushing event updated for resources: {'Port': ['ID=bbafb0bb-163c-43f4-8d2c-2f5304e0bd04,revision_number=3']} {{(pid=102992) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 23 19:38:06.997026 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Tue, 23 Nov 2021 19:38:06 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-9ba73e2d-e774-4318-9c89-75f2d97a6988 x-openstack-request-id: req-9ba73e2d-e774-4318-9c89-75f2d97a6988 {{(pid=102992) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 23 19:38:06.997397 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "b504cdb2-6182-4c24-9b46-6dc0f85da342", "tag": "bbafb0bb-163c-43f4-8d2c-2f5304e0bd04", "status": "completed", "code": 200}]} {{(pid=102992) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 23 19:38:06.997758 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.62/compute/v2.1/os-server-external-events used request id req-9ba73e2d-e774-4318-9c89-75f2d97a6988 {{(pid=102992) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 23 19:38:06.998246 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'b504cdb2-6182-4c24-9b46-6dc0f85da342', 'tag': 'bbafb0bb-163c-43f4-8d2c-2f5304e0bd04', 'status': 'completed', 'code': 200} Nov 23 19:38:07.099582 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fa9d14d4-c672-4208-9f51-9e8c0194e990 req-ca090d11-e175-4255-b3b9-1b2e92086bbe service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102992) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:38:07.101484 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-fa9d14d4-c672-4208-9f51-9e8c0194e990 req-ca090d11-e175-4255-b3b9-1b2e92086bbe service neutron] 10.222.0.41 "GET /v2.0/ports?tenant_id=35f8a5017a27449084aabd12f27f5a8a&device_id=b504cdb2-6182-4c24-9b46-6dc0f85da342 HTTP/1.1" status: 200 len: 1097 time: 0.0859170 Nov 23 19:38:07.169394 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-fa9d14d4-c672-4208-9f51-9e8c0194e990 req-6387c9db-06f7-4805-b80e-9950ad272a47 service neutron] 10.222.0.41 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.13&port_id=bbafb0bb-163c-43f4-8d2c-2f5304e0bd04 HTTP/1.1" status: 200 len: 217 time: 0.0565474 Nov 23 19:38:07.337000 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fa9d14d4-c672-4208-9f51-9e8c0194e990 req-994854e9-a16d-4b85-8c76-985c6b82931d service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102992) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:38:07.339415 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-fa9d14d4-c672-4208-9f51-9e8c0194e990 req-994854e9-a16d-4b85-8c76-985c6b82931d service neutron] 10.222.0.41 "GET /v2.0/subnets?id=afa5bc59-f70c-409d-8c15-be2dcdce66a3 HTTP/1.1" status: 200 len: 847 time: 0.1542413 Nov 23 19:38:07.355757 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-459f85ce-749d-4561-8c58-59efa642dc8d req-d4640b33-3d3b-440a-bf2b-7102d6891846 tempest-TestShelveInstance-292550524 tempest-TestShelveInstance-292550524-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102992) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:38:07.366016 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-459f85ce-749d-4561-8c58-59efa642dc8d req-d4640b33-3d3b-440a-bf2b-7102d6891846 tempest-TestShelveInstance-292550524 tempest-TestShelveInstance-292550524-project] 10.222.0.62 "GET /v2.0/ports?device_id=b504cdb2-6182-4c24-9b46-6dc0f85da342 HTTP/1.1" status: 200 len: 944 time: 0.1114717 Nov 23 19:38:07.457766 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fa9d14d4-c672-4208-9f51-9e8c0194e990 req-a790d737-253e-483d-9d5c-84dd0ea6931f service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102992) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:38:07.459590 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-fa9d14d4-c672-4208-9f51-9e8c0194e990 req-a790d737-253e-483d-9d5c-84dd0ea6931f service neutron] 10.222.0.41 "GET /v2.0/ports?network_id=87e46ab6-0f90-430f-930f-9ea1580c04c3&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0922995 Nov 23 19:38:07.493965 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-459f85ce-749d-4561-8c58-59efa642dc8d req-d5928895-c5f2-47b4-bbe5-4fb6a26f1493 tempest-TestShelveInstance-292550524 tempest-TestShelveInstance-292550524-project] 10.222.0.62 "GET /v2.0/security-groups?id=7fe194e6-71c3-47a9-8f36-0dbb24d1f72d&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1178944 Nov 23 19:38:07.594689 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-fa9d14d4-c672-4208-9f51-9e8c0194e990 req-692d5d44-0ec8-4d88-bd77-e04e76cefa16 service neutron] 10.222.0.41 "GET /v2.0/networks/87e46ab6-0f90-430f-930f-9ea1580c04c3?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1177731 Nov 23 19:38:07.753233 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-fa9d14d4-c672-4208-9f51-9e8c0194e990 req-4a5b661e-fe85-4bb9-83a3-6be3cc57fd8a service neutron] 10.222.0.41 "GET /v2.0/networks/87e46ab6-0f90-430f-930f-9ea1580c04c3?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1480367 Nov 23 19:38:07.775188 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-165f5408-535a-43ff-b8da-9f4797ee9bdd req-67467e25-3806-4d3b-a825-f72d2a3f18c5 tempest-AttachVolumeShelveTestJSON-1172915835 tempest-AttachVolumeShelveTestJSON-1172915835-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102992) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:38:07.775188 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-165f5408-535a-43ff-b8da-9f4797ee9bdd req-67467e25-3806-4d3b-a825-f72d2a3f18c5 tempest-AttachVolumeShelveTestJSON-1172915835 tempest-AttachVolumeShelveTestJSON-1172915835-project] 10.222.0.62 "GET /v2.0/ports?device_id=85ea3d72-6c17-4ea2-82b7-90cce01633bd HTTP/1.1" status: 200 len: 946 time: 0.0860150 Nov 23 19:38:07.856393 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-165f5408-535a-43ff-b8da-9f4797ee9bdd req-0137a262-f2fa-4fee-af07-b59435c6f5cb tempest-AttachVolumeShelveTestJSON-1172915835 tempest-AttachVolumeShelveTestJSON-1172915835-project] 10.222.0.62 "GET /v2.0/security-groups?id=f1ca24d9-0a31-470d-a1d5-fa7059df0141&fields=id&fields=name HTTP/1.1" status: 200 len: 311 time: 0.0726099 Nov 23 19:38:07.955503 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-68c3102d-28c0-4e4e-9910-abb88f446c1e req-0b3a7b20-f5b1-46f3-b63a-68e699115d35 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102992) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:38:07.957213 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-68c3102d-28c0-4e4e-9910-abb88f446c1e req-0b3a7b20-f5b1-46f3-b63a-68e699115d35 service neutron] 10.222.0.41 "GET /v2.0/ports?tenant_id=35f8a5017a27449084aabd12f27f5a8a&device_id=b504cdb2-6182-4c24-9b46-6dc0f85da342 HTTP/1.1" status: 200 len: 1097 time: 0.0507259 Nov 23 19:38:08.063756 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-68c3102d-28c0-4e4e-9910-abb88f446c1e req-2b00a07a-3070-4b82-a1ef-77fefabbd777 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102992) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:38:08.066506 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-68c3102d-28c0-4e4e-9910-abb88f446c1e req-2b00a07a-3070-4b82-a1ef-77fefabbd777 service neutron] 10.222.0.41 "GET /v2.0/networks?id=87e46ab6-0f90-430f-930f-9ea1580c04c3 HTTP/1.1" status: 200 len: 909 time: 0.1002469 Nov 23 19:38:08.110199 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-68c3102d-28c0-4e4e-9910-abb88f446c1e req-021249bb-f4a1-42db-99c8-de1a7b4acaef service neutron] 10.222.0.41 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.13&port_id=bbafb0bb-163c-43f4-8d2c-2f5304e0bd04 HTTP/1.1" status: 200 len: 217 time: 0.0349059 Nov 23 19:38:08.177385 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-68c3102d-28c0-4e4e-9910-abb88f446c1e req-1e86efa7-df41-46a9-8e82-374ce971bc13 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102992) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:38:08.181550 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-68c3102d-28c0-4e4e-9910-abb88f446c1e req-1e86efa7-df41-46a9-8e82-374ce971bc13 service neutron] 10.222.0.41 "GET /v2.0/subnets?id=afa5bc59-f70c-409d-8c15-be2dcdce66a3 HTTP/1.1" status: 200 len: 847 time: 0.0628800 Nov 23 19:38:08.248545 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-68c3102d-28c0-4e4e-9910-abb88f446c1e req-c75eff10-1784-48c6-9085-f3594e974781 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102992) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:38:08.250383 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-68c3102d-28c0-4e4e-9910-abb88f446c1e req-c75eff10-1784-48c6-9085-f3594e974781 service neutron] 10.222.0.41 "GET /v2.0/ports?network_id=87e46ab6-0f90-430f-930f-9ea1580c04c3&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0564671 Nov 23 19:38:08.358223 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-68c3102d-28c0-4e4e-9910-abb88f446c1e req-04b55b6d-1cb7-45e3-8b65-464239a4e862 service neutron] 10.222.0.41 "GET /v2.0/networks/87e46ab6-0f90-430f-930f-9ea1580c04c3?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0943711 Nov 23 19:38:08.464446 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-68c3102d-28c0-4e4e-9910-abb88f446c1e req-38f95acb-61f9-4d55-82b3-640a2dbd20f7 service neutron] 10.222.0.41 "GET /v2.0/networks/87e46ab6-0f90-430f-930f-9ea1580c04c3?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0944591 Nov 23 19:38:08.477687 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0cd4cb82-6b05-4ef9-90ce-48f3dd0693e2 req-e8063b72-4020-480d-986b-01bedee7ba8a tempest-AttachVolumeShelveTestJSON-1172915835 tempest-AttachVolumeShelveTestJSON-1172915835-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102993) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:38:08.482115 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-0cd4cb82-6b05-4ef9-90ce-48f3dd0693e2 req-e8063b72-4020-480d-986b-01bedee7ba8a tempest-AttachVolumeShelveTestJSON-1172915835 tempest-AttachVolumeShelveTestJSON-1172915835-project] 10.222.0.41 "GET /v2.0/ports?device_id=85ea3d72-6c17-4ea2-82b7-90cce01633bd HTTP/1.1" status: 200 len: 946 time: 0.0668709 Nov 23 19:38:08.630722 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.plugins.ml2.plugin [req-0cd4cb82-6b05-4ef9-90ce-48f3dd0693e2 req-31d04780-c224-4da5-aa91-8e1fcbafdd27 tempest-AttachVolumeShelveTestJSON-1172915835 tempest-AttachVolumeShelveTestJSON-1172915835-project] Deleting port 4b380ab6-f3ec-4e12-9a2a-b5a20828969d {{(pid=102993) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 23 19:38:08.631089 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [req-0cd4cb82-6b05-4ef9-90ce-48f3dd0693e2 req-31d04780-c224-4da5-aa91-8e1fcbafdd27 tempest-AttachVolumeShelveTestJSON-1172915835 tempest-AttachVolumeShelveTestJSON-1172915835-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8783631423070'] for port, before_delete {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:38:08.752448 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.plugins.ml2.db [req-0cd4cb82-6b05-4ef9-90ce-48f3dd0693e2 req-31d04780-c224-4da5-aa91-8e1fcbafdd27 tempest-AttachVolumeShelveTestJSON-1172915835 tempest-AttachVolumeShelveTestJSON-1172915835-project] For port 4b380ab6-f3ec-4e12-9a2a-b5a20828969d, host hv-cinder-81901, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81901',level=0,port_id=4b380ab6-f3ec-4e12-9a2a-b5a20828969d,segment=NetworkSegment(b4453f21-ac7f-498c-8316-73b738820700),segment_id=b4453f21-ac7f-498c-8316-73b738820700)] {{(pid=102993) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 23 19:38:08.753157 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [req-0cd4cb82-6b05-4ef9-90ce-48f3dd0693e2 req-31d04780-c224-4da5-aa91-8e1fcbafdd27 tempest-AttachVolumeShelveTestJSON-1172915835 tempest-AttachVolumeShelveTestJSON-1172915835-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-927332'] for port, precommit_delete {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:38:08.993874 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [req-0cd4cb82-6b05-4ef9-90ce-48f3dd0693e2 req-31d04780-c224-4da5-aa91-8e1fcbafdd27 tempest-AttachVolumeShelveTestJSON-1172915835 tempest-AttachVolumeShelveTestJSON-1172915835-project] Publish callbacks [] for floatingip, precommit_update {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:38:08.994412 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [req-0cd4cb82-6b05-4ef9-90ce-48f3dd0693e2 req-31d04780-c224-4da5-aa91-8e1fcbafdd27 tempest-AttachVolumeShelveTestJSON-1172915835 tempest-AttachVolumeShelveTestJSON-1172915835-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-926531'] for floatingip, after_update {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:38:08.994822 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.db.l3_db [req-0cd4cb82-6b05-4ef9-90ce-48f3dd0693e2 req-31d04780-c224-4da5-aa91-8e1fcbafdd27 tempest-AttachVolumeShelveTestJSON-1172915835 tempest-AttachVolumeShelveTestJSON-1172915835-project] Floating IP 688c5865-c524-4e4a-9ee8-836f2272655b disassociated. External IP: 172.27.1.211, port: 4b380ab6-f3ec-4e12-9a2a-b5a20828969d. Nov 23 19:38:08.995262 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.plugins.ml2.plugin [req-0cd4cb82-6b05-4ef9-90ce-48f3dd0693e2 req-31d04780-c224-4da5-aa91-8e1fcbafdd27 tempest-AttachVolumeShelveTestJSON-1172915835 tempest-AttachVolumeShelveTestJSON-1172915835-project] Calling delete_port for 4b380ab6-f3ec-4e12-9a2a-b5a20828969d owned by compute:nova {{(pid=102993) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 23 19:38:09.011803 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-18baefcf-eefe-4d22-93a8-01451e73d533 req-8d730dd6-fd8d-474d-9345-7512592d04a3 tempest-TestShelveInstance-292550524 tempest-TestShelveInstance-292550524-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102993) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:38:09.019448 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-18baefcf-eefe-4d22-93a8-01451e73d533 req-8d730dd6-fd8d-474d-9345-7512592d04a3 tempest-TestShelveInstance-292550524 tempest-TestShelveInstance-292550524-project] 10.222.0.62 "GET /v2.0/ports?device_id=b504cdb2-6182-4c24-9b46-6dc0f85da342 HTTP/1.1" status: 200 len: 944 time: 0.4006462 Nov 23 19:38:09.045672 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bec829ee-8a8c-4311-a00d-1172414ac21d req-bfcc2e50-26e9-4642-ae48-359e48458716 tempest-AttachVolumeShelveTestJSON-1172915835 tempest-AttachVolumeShelveTestJSON-1172915835-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102992) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:38:09.053706 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-bec829ee-8a8c-4311-a00d-1172414ac21d req-bfcc2e50-26e9-4642-ae48-359e48458716 tempest-AttachVolumeShelveTestJSON-1172915835 tempest-AttachVolumeShelveTestJSON-1172915835-project] 10.222.0.62 "GET /v2.0/ports?device_id=85ea3d72-6c17-4ea2-82b7-90cce01633bd HTTP/1.1" status: 200 len: 946 time: 0.0848877 Nov 23 19:38:09.120777 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-bec829ee-8a8c-4311-a00d-1172414ac21d req-42bb55bc-2139-4089-8b36-c282f62faef1 tempest-AttachVolumeShelveTestJSON-1172915835 tempest-AttachVolumeShelveTestJSON-1172915835-project] 10.222.0.62 "GET /v2.0/security-groups?id=f1ca24d9-0a31-470d-a1d5-fa7059df0141&fields=id&fields=name HTTP/1.1" status: 200 len: 311 time: 0.0622089 Nov 23 19:38:09.121029 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-18baefcf-eefe-4d22-93a8-01451e73d533 req-82d9c1dd-3047-4b97-bc02-e35e9b67868d tempest-TestShelveInstance-292550524 tempest-TestShelveInstance-292550524-project] 10.222.0.62 "GET /v2.0/security-groups?id=7fe194e6-71c3-47a9-8f36-0dbb24d1f72d&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1007140 Nov 23 19:38:09.262121 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [req-0cd4cb82-6b05-4ef9-90ce-48f3dd0693e2 req-31d04780-c224-4da5-aa91-8e1fcbafdd27 tempest-AttachVolumeShelveTestJSON-1172915835 tempest-AttachVolumeShelveTestJSON-1172915835-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7918660', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-15067', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560168', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8783631424624', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8783631008723', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-17257496'] for port, after_delete {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:38:09.293769 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-31d04780-c224-4da5-aa91-8e1fcbafdd27 tempest-AttachVolumeShelveTestJSON-1172915835 tempest-AttachVolumeShelveTestJSON-1172915835-project] Pushing event deleted for resources: {'Port': ['ID=4b380ab6-f3ec-4e12-9a2a-b5a20828969d,revision_number=None']} {{(pid=102993) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 23 19:38:09.433664 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.scheduler.l3_agent_scheduler [req-0cd4cb82-6b05-4ef9-90ce-48f3dd0693e2 req-31d04780-c224-4da5-aa91-8e1fcbafdd27 tempest-AttachVolumeShelveTestJSON-1172915835 tempest-AttachVolumeShelveTestJSON-1172915835-project] Router 01438284-e62a-4056-8ee2-4899a051e144 has already been hosted by L3 agent 1b20f2c4-70b6-43c3-b9bd-0062cc9e57ac {{(pid=102993) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 23 19:38:09.559765 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [req-0cd4cb82-6b05-4ef9-90ce-48f3dd0693e2 req-31d04780-c224-4da5-aa91-8e1fcbafdd27 tempest-AttachVolumeShelveTestJSON-1172915835 tempest-AttachVolumeShelveTestJSON-1172915835-project] Notify agent at l3_agent.dv-cinder-819011-1-iscsi the message routers_updated {{(pid=102993) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 23 19:38:09.570845 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-18765cb2-9f56-4281-a117-873a670e6075 None None] Sync routers for ids ['01438284-e62a-4056-8ee2-4899a051e144'] in dv-cinder-819011-1-iscsi {{(pid=102994) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 23 19:38:09.581563 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.db.l3_dvrscheduler_db [None req-18765cb2-9f56-4281-a117-873a670e6075 None None] Routers {'01438284-e62a-4056-8ee2-4899a051e144'} bound to L3 agent in host dv-cinder-819011-1-iscsi {{(pid=102994) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 23 19:38:09.582330 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.db.l3_hamode_db [None req-18765cb2-9f56-4281-a117-873a670e6075 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-819011-1-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 7, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 7, "log_agent_heartbeats": false, "routers": 7},created_at=2021-11-23T19:25:14Z,description=,heartbeat_timestamp=2021-11-23T19:37:44Z,host='dv-cinder-819011-1-iscsi',id=1b20f2c4-70b6-43c3-b9bd-0062cc9e57ac,load=0,resource_versions=,resources_synced=,started_at=2021-11-23T19:25:15Z,topic='l3_agent')) {'router_ids': ['01438284-e62a-4056-8ee2-4899a051e144'], 'active': True} {{(pid=102994) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 23 19:38:09.605459 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.db.l3_dvrscheduler_db [req-0cd4cb82-6b05-4ef9-90ce-48f3dd0693e2 req-31d04780-c224-4da5-aa91-8e1fcbafdd27 tempest-AttachVolumeShelveTestJSON-1172915835 tempest-AttachVolumeShelveTestJSON-1172915835-project] No DVR routers for this DVR port 4b380ab6-f3ec-4e12-9a2a-b5a20828969d on host hv-cinder-81901 {{(pid=102993) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 23 19:38:09.608126 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [req-0cd4cb82-6b05-4ef9-90ce-48f3dd0693e2 req-31d04780-c224-4da5-aa91-8e1fcbafdd27 tempest-AttachVolumeShelveTestJSON-1172915835 tempest-AttachVolumeShelveTestJSON-1172915835-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-514902'] for port, before_response {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:38:09.613015 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-0cd4cb82-6b05-4ef9-90ce-48f3dd0693e2 req-31d04780-c224-4da5-aa91-8e1fcbafdd27 tempest-AttachVolumeShelveTestJSON-1172915835 tempest-AttachVolumeShelveTestJSON-1172915835-project] 10.222.0.41 "DELETE /v2.0/ports/4b380ab6-f3ec-4e12-9a2a-b5a20828969d HTTP/1.1" status: 204 len: 173 time: 1.1220636 Nov 23 19:38:09.739921 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '85ea3d72-6c17-4ea2-82b7-90cce01633bd', 'name': 'network-vif-deleted', 'tag': '4b380ab6-f3ec-4e12-9a2a-b5a20828969d'}] {{(pid=102993) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 23 19:38:09.739921 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.62/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}9b10b92acbee16fb695be1efeed0b68f7c36a5b215ec004a8d9d707fa3d35b2c" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-bf016f9d-02c7-44de-a30a-f2b15a3659ce" -d '{"events": [{"server_uuid": "85ea3d72-6c17-4ea2-82b7-90cce01633bd", "name": "network-vif-deleted", "tag": "4b380ab6-f3ec-4e12-9a2a-b5a20828969d"}]}' {{(pid=102993) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 23 19:38:09.739921 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 23 Nov 2021 19:38:09 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-ddc02db4-832e-4ad7-aa29-db03768e77d1 x-openstack-request-id: req-ddc02db4-832e-4ad7-aa29-db03768e77d1 {{(pid=102993) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 23 19:38:09.739921 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "85ea3d72-6c17-4ea2-82b7-90cce01633bd", "name": "network-vif-deleted", "tag": "4b380ab6-f3ec-4e12-9a2a-b5a20828969d", "status": "completed", "code": 200}]} {{(pid=102993) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 23 19:38:09.739921 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.62/compute/v2.1/os-server-external-events used request id req-ddc02db4-832e-4ad7-aa29-db03768e77d1 {{(pid=102993) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 23 19:38:09.739921 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '85ea3d72-6c17-4ea2-82b7-90cce01633bd', 'name': 'network-vif-deleted', 'tag': '4b380ab6-f3ec-4e12-9a2a-b5a20828969d', 'status': 'completed', 'code': 200} Nov 23 19:38:09.741491 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.db.l3_dvr_db [None req-18765cb2-9f56-4281-a117-873a670e6075 None None] Set router 01438284-e62a-4056-8ee2-4899a051e144 gateway port host: dv-cinder-819011-1-iscsi {{(pid=102994) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 23 19:38:09.944659 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.db.l3_hamode_db [None req-18765cb2-9f56-4281-a117-873a670e6075 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '01438284-e62a-4056-8ee2-4899a051e144', 'name': 'tempest-AttachVolumeShelveTestJSON-1609224522-router', 'tenant_id': '2d925fb59ba34355aa85758374d76928', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'a93e254e-aac9-4233-9e4d-4290fd0458e4', 'external_fixed_ips': [{'subnet_id': 'e0b32f3d-83d6-439a-bbed-01df7cf01051', 'ip_address': '172.27.1.99'}], 'enable_snat': True}, 'gw_port_id': 'a6140c41-82e2-4d62-8e5f-f3fc119a374e', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-23T19:33:21Z', 'updated_at': '2021-11-23T19:33:28Z', 'revision_number': 4, 'project_id': '2d925fb59ba34355aa85758374d76928', 'gw_port': {'id': 'a6140c41-82e2-4d62-8e5f-f3fc119a374e', 'name': '', 'network_id': 'a93e254e-aac9-4233-9e4d-4290fd0458e4', 'tenant_id': '', 'mac_address': 'fa:16:3e:32:52:e2', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '01438284-e62a-4056-8ee2-4899a051e144', 'device_owner': 'network:router_gateway', 'standard_attr_id': 59, 'fixed_ips': [{'subnet_id': 'e0b32f3d-83d6-439a-bbed-01df7cf01051', 'ip_address': '172.27.1.99', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-819011-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-23T19:33:22Z', 'updated_at': '2021-11-23T19:33:30Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'e0b32f3d-83d6-439a-bbed-01df7cf01051', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-819011-1-iscsi', '_interfaces': [{'id': 'c96e4c46-b1fa-4e6c-9fe8-9c516c4ee278', 'name': '', 'network_id': 'fc901312-2937-4784-8a6d-c046666e8bf8', 'tenant_id': '2d925fb59ba34355aa85758374d76928', 'mac_address': 'fa:16:3e:b7:43:ca', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '01438284-e62a-4056-8ee2-4899a051e144', 'device_owner': 'network:router_interface', 'standard_attr_id': 71, 'fixed_ips': [{'subnet_id': '2caca985-6ed6-4ef7-ba49-7b7410bea160', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-819011-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-23T19:33:26Z', 'updated_at': '2021-11-23T19:33:35Z', 'revision_number': 5, 'project_id': '2d925fb59ba34355aa85758374d76928', 'subnets': [{'id': '2caca985-6ed6-4ef7-ba49-7b7410bea160', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-819011-1-iscsi', False) {} {{(pid=102994) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 23 19:38:09.978826 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-18765cb2-9f56-4281-a117-873a670e6075 None None] Checking router: 01438284-e62a-4056-8ee2-4899a051e144 for host: dv-cinder-819011-1-iscsi {{(pid=102994) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 23 19:38:09.992485 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.db.l3_dvrscheduler_db [None req-18765cb2-9f56-4281-a117-873a670e6075 None None] Routers {'01438284-e62a-4056-8ee2-4899a051e144'} bound to L3 agent in host dv-cinder-819011-1-iscsi {{(pid=102994) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 23 19:38:09.993731 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.db.l3_hamode_db [None req-18765cb2-9f56-4281-a117-873a670e6075 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-819011-1-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 7, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 7, "log_agent_heartbeats": false, "routers": 7},created_at=2021-11-23T19:25:14Z,description=,heartbeat_timestamp=2021-11-23T19:37:44Z,host='dv-cinder-819011-1-iscsi',id=1b20f2c4-70b6-43c3-b9bd-0062cc9e57ac,load=0,resource_versions=,resources_synced=,started_at=2021-11-23T19:25:15Z,topic='l3_agent')) {'router_ids': ['01438284-e62a-4056-8ee2-4899a051e144'], 'active': True} {{(pid=102994) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 23 19:38:10.009725 dv-cinder-819011-1-iscsi neutron-server[102995]: DEBUG neutron.db.agents_db [None req-84bdc9b2-57ea-4bdb-a245-07c78d37cea8 None None] Agent healthcheck: found 6 active agents {{(pid=102995) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 23 19:38:10.145485 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.db.l3_dvr_db [None req-18765cb2-9f56-4281-a117-873a670e6075 None None] Set router 01438284-e62a-4056-8ee2-4899a051e144 gateway port host: dv-cinder-819011-1-iscsi {{(pid=102994) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 23 19:38:10.268104 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d0053b16-fb42-44ec-9e62-b29400f1d403 req-c791bc80-59bd-40a5-83df-c1658d107492 tempest-TestShelveInstance-292550524 tempest-TestShelveInstance-292550524-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102993) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:38:10.274327 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-1243d58e-a069-4f20-8957-eaf27573eed9 req-606113bc-1aa2-41e3-9d17-d91086004164 tempest-AttachVolumeShelveTestJSON-1172915835 tempest-AttachVolumeShelveTestJSON-1172915835-project] 10.222.0.62 "GET /v2.0/ports?device_id=85ea3d72-6c17-4ea2-82b7-90cce01633bd HTTP/1.1" status: 200 len: 210 time: 0.0487835 Nov 23 19:38:10.276465 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-d0053b16-fb42-44ec-9e62-b29400f1d403 req-c791bc80-59bd-40a5-83df-c1658d107492 tempest-TestShelveInstance-292550524 tempest-TestShelveInstance-292550524-project] 10.222.0.62 "GET /v2.0/ports?device_id=b504cdb2-6182-4c24-9b46-6dc0f85da342 HTTP/1.1" status: 200 len: 944 time: 0.0589356 Nov 23 19:38:10.335022 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-d0053b16-fb42-44ec-9e62-b29400f1d403 req-f03a42d9-d128-463b-baae-71a862c496a1 tempest-TestShelveInstance-292550524 tempest-TestShelveInstance-292550524-project] 10.222.0.62 "GET /v2.0/security-groups?id=7fe194e6-71c3-47a9-8f36-0dbb24d1f72d&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0573127 Nov 23 19:38:10.427818 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.db.l3_hamode_db [None req-18765cb2-9f56-4281-a117-873a670e6075 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '01438284-e62a-4056-8ee2-4899a051e144', 'name': 'tempest-AttachVolumeShelveTestJSON-1609224522-router', 'tenant_id': '2d925fb59ba34355aa85758374d76928', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'a93e254e-aac9-4233-9e4d-4290fd0458e4', 'external_fixed_ips': [{'subnet_id': 'e0b32f3d-83d6-439a-bbed-01df7cf01051', 'ip_address': '172.27.1.99'}], 'enable_snat': True}, 'gw_port_id': 'a6140c41-82e2-4d62-8e5f-f3fc119a374e', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-23T19:33:21Z', 'updated_at': '2021-11-23T19:33:28Z', 'revision_number': 4, 'project_id': '2d925fb59ba34355aa85758374d76928', 'gw_port': {'id': 'a6140c41-82e2-4d62-8e5f-f3fc119a374e', 'name': '', 'network_id': 'a93e254e-aac9-4233-9e4d-4290fd0458e4', 'tenant_id': '', 'mac_address': 'fa:16:3e:32:52:e2', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '01438284-e62a-4056-8ee2-4899a051e144', 'device_owner': 'network:router_gateway', 'standard_attr_id': 59, 'fixed_ips': [{'subnet_id': 'e0b32f3d-83d6-439a-bbed-01df7cf01051', 'ip_address': '172.27.1.99', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-819011-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-23T19:33:22Z', 'updated_at': '2021-11-23T19:33:30Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'e0b32f3d-83d6-439a-bbed-01df7cf01051', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-819011-1-iscsi', '_interfaces': [{'id': 'c96e4c46-b1fa-4e6c-9fe8-9c516c4ee278', 'name': '', 'network_id': 'fc901312-2937-4784-8a6d-c046666e8bf8', 'tenant_id': '2d925fb59ba34355aa85758374d76928', 'mac_address': 'fa:16:3e:b7:43:ca', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '01438284-e62a-4056-8ee2-4899a051e144', 'device_owner': 'network:router_interface', 'standard_attr_id': 71, 'fixed_ips': [{'subnet_id': '2caca985-6ed6-4ef7-ba49-7b7410bea160', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-819011-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-23T19:33:26Z', 'updated_at': '2021-11-23T19:33:35Z', 'revision_number': 5, 'project_id': '2d925fb59ba34355aa85758374d76928', 'subnets': [{'id': '2caca985-6ed6-4ef7-ba49-7b7410bea160', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-819011-1-iscsi', False) {} {{(pid=102994) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 23 19:38:10.455589 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-18765cb2-9f56-4281-a117-873a670e6075 None None] The sync data for ids ['01438284-e62a-4056-8ee2-4899a051e144'] in dv-cinder-819011-1-iscsi is: [{'id': '01438284-e62a-4056-8ee2-4899a051e144', 'name': 'tempest-AttachVolumeShelveTestJSON-1609224522-router', 'tenant_id': '2d925fb59ba34355aa85758374d76928', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'a93e254e-aac9-4233-9e4d-4290fd0458e4', 'external_fixed_ips': [{'subnet_id': 'e0b32f3d-83d6-439a-bbed-01df7cf01051', 'ip_address': '172.27.1.99'}], 'enable_snat': True}, 'gw_port_id': 'a6140c41-82e2-4d62-8e5f-f3fc119a374e', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-23T19:33:21Z', 'updated_at': '2021-11-23T19:33:28Z', 'revision_number': 4, 'project_id': '2d925fb59ba34355aa85758374d76928', 'gw_port': {'id': 'a6140c41-82e2-4d62-8e5f-f3fc119a374e', 'name': '', 'network_id': 'a93e254e-aac9-4233-9e4d-4290fd0458e4', 'tenant_id': '', 'mac_address': 'fa:16:3e:32:52:e2', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '01438284-e62a-4056-8ee2-4899a051e144', 'device_owner': 'network:router_gateway', 'standard_attr_id': 59, 'fixed_ips': [{'subnet_id': 'e0b32f3d-83d6-439a-bbed-01df7cf01051', 'ip_address': '172.27.1.99', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-819011-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-23T19:33:22Z', 'updated_at': '2021-11-23T19:33:30Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'e0b32f3d-83d6-439a-bbed-01df7cf01051', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-819011-1-iscsi', '_interfaces': [{'id': 'c96e4c46-b1fa-4e6c-9fe8-9c516c4ee278', 'name': '', 'network_id': 'fc901312-2937-4784-8a6d-c046666e8bf8', 'tenant_id': '2d925fb59ba34355aa85758374d76928', 'mac_address': 'fa:16:3e:b7:43:ca', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '01438284-e62a-4056-8ee2-4899a051e144', 'device_owner': 'network:router_interface', 'standard_attr_id': 71, 'fixed_ips': [{'subnet_id': '2caca985-6ed6-4ef7-ba49-7b7410bea160', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-819011-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-23T19:33:26Z', 'updated_at': '2021-11-23T19:33:35Z', 'revision_number': 5, 'project_id': '2d925fb59ba34355aa85758374d76928', 'subnets': [{'id': '2caca985-6ed6-4ef7-ba49-7b7410bea160', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=102994) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 23 19:38:10.707961 dv-cinder-819011-1-iscsi neutron-server[102995]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-b784e1d7-09fa-4e3a-aaea-3d01341e708e None None] New status for floating IP 688c5865-c524-4e4a-9ee8-836f2272655b: DOWN {{(pid=102995) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Nov 23 19:38:11.412388 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.wsgi [-] (102992) accepted ('10.222.0.62', 48912) {{(pid=102992) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 23 19:38:11.517790 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [None req-8897b64e-e0bb-4a1f-9b6b-571f256081bd tempest-AttachVolumeShelveTestJSON-1172915835 tempest-AttachVolumeShelveTestJSON-1172915835-project] Publish callbacks [] for security_group, before_delete {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:38:11.543649 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0ac509ef-3216-4022-b7d5-d3f826bd53ed req-a6af63c9-23ce-4226-8560-e246ece0be65 tempest-TestShelveInstance-292550524 tempest-TestShelveInstance-292550524-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102992) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:38:11.545128 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-0ac509ef-3216-4022-b7d5-d3f826bd53ed req-a6af63c9-23ce-4226-8560-e246ece0be65 tempest-TestShelveInstance-292550524 tempest-TestShelveInstance-292550524-project] 10.222.0.62 "GET /v2.0/ports?device_id=b504cdb2-6182-4c24-9b46-6dc0f85da342 HTTP/1.1" status: 200 len: 944 time: 0.0759053 Nov 23 19:38:11.554959 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [None req-8897b64e-e0bb-4a1f-9b6b-571f256081bd tempest-AttachVolumeShelveTestJSON-1172915835 tempest-AttachVolumeShelveTestJSON-1172915835-project] Publish callbacks [] for security_group, precommit_delete {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:38:11.629278 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-0ac509ef-3216-4022-b7d5-d3f826bd53ed req-7efd3111-fe4d-4de2-bbf0-a4e4d2983a45 tempest-TestShelveInstance-292550524 tempest-TestShelveInstance-292550524-project] 10.222.0.62 "GET /v2.0/security-groups?id=7fe194e6-71c3-47a9-8f36-0dbb24d1f72d&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0763266 Nov 23 19:38:11.707452 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [None req-8897b64e-e0bb-4a1f-9b6b-571f256081bd tempest-AttachVolumeShelveTestJSON-1172915835 tempest-AttachVolumeShelveTestJSON-1172915835-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-623933'] for security_group, after_delete {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:38:11.710646 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [None req-8897b64e-e0bb-4a1f-9b6b-571f256081bd tempest-AttachVolumeShelveTestJSON-1172915835 tempest-AttachVolumeShelveTestJSON-1172915835-project] Publish callbacks [] for security_group, before_response {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:38:11.712018 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [None req-8897b64e-e0bb-4a1f-9b6b-571f256081bd tempest-AttachVolumeShelveTestJSON-1172915835 tempest-AttachVolumeShelveTestJSON-1172915835-project] 10.222.0.62 "DELETE /v2.0/security-groups/f1ca24d9-0a31-470d-a1d5-fa7059df0141 HTTP/1.1" status: 204 len: 168 time: 0.2979598 Nov 23 19:38:11.715962 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.wsgi [-] (102992) accepted ('10.222.0.62', 48926) {{(pid=102992) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 23 19:38:11.730932 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron_lib.callbacks.manager [None req-59807165-321a-41ba-9271-c628618912d7 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8783631323329', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7978582'] for agent, after_update {{(pid=102994) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:38:11.736046 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8897b64e-e0bb-4a1f-9b6b-571f256081bd tempest-AttachVolumeShelveTestJSON-1172915835 tempest-AttachVolumeShelveTestJSON-1172915835-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=f1ca24d9-0a31-470d-a1d5-fa7059df0141,revision_number=None']} {{(pid=102992) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 23 19:38:11.739087 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.api.v2.resource [None req-969700f0-22ed-4796-9094-c4649dceb00d tempest-AttachVolumeShelveTestJSON-1172915835 tempest-AttachVolumeShelveTestJSON-1172915835-project] show failed (client error): The resource could not be found. Nov 23 19:38:11.743608 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [None req-969700f0-22ed-4796-9094-c4649dceb00d tempest-AttachVolumeShelveTestJSON-1172915835 tempest-AttachVolumeShelveTestJSON-1172915835-project] 10.222.0.62 "GET /v2.0/security-groups/f1ca24d9-0a31-470d-a1d5-fa7059df0141 HTTP/1.1" status: 404 len: 347 time: 0.0233324 Nov 23 19:38:11.743608 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.wsgi [-] (102992) accepted ('10.222.0.62', 48928) {{(pid=102992) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 23 19:38:11.851880 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-25d70870-677f-4316-b6d5-56864df3f7fd req-0e5717c9-ce15-40d2-b3c5-cceadb9ef2fd tempest-TestMinimumBasicScenario-716536904 tempest-TestMinimumBasicScenario-716536904-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=102993) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:38:11.853555 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-25d70870-677f-4316-b6d5-56864df3f7fd req-0e5717c9-ce15-40d2-b3c5-cceadb9ef2fd tempest-TestMinimumBasicScenario-716536904 tempest-TestMinimumBasicScenario-716536904-project] 10.222.0.62 "GET /v2.0/networks?id=96f89427-8150-464f-a280-f07cf823b4fd HTTP/1.1" status: 200 len: 814 time: 0.1404803 Nov 23 19:38:11.869576 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-25d70870-677f-4316-b6d5-56864df3f7fd req-2c4f51bb-a4ef-47d8-a053-09732a5f5f5c tempest-TestMinimumBasicScenario-716536904 tempest-TestMinimumBasicScenario-716536904-project] 10.222.0.62 "GET /v2.0/quotas/ed0d906c96b540a7b11d508615543890 HTTP/1.1" status: 200 len: 375 time: 0.0099649 Nov 23 19:38:11.894057 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.plugins.ml2.plugin [None req-18dcfdaa-7118-467d-8c2a-cd93ec1cb1bf tempest-AttachVolumeShelveTestJSON-1172915835 tempest-AttachVolumeShelveTestJSON-1172915835-project] Deleting port 63d8ec9c-d152-4c6f-9ac7-7d9ca3bd5f11 {{(pid=102992) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 23 19:38:11.894404 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [None req-18dcfdaa-7118-467d-8c2a-cd93ec1cb1bf tempest-AttachVolumeShelveTestJSON-1172915835 tempest-AttachVolumeShelveTestJSON-1172915835-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8783631423070'] for port, before_delete {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:38:11.925486 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-25d70870-677f-4316-b6d5-56864df3f7fd req-db36d3ab-5f84-4ed7-a27f-2097cb5c019d tempest-TestMinimumBasicScenario-716536904 tempest-TestMinimumBasicScenario-716536904-project] 10.222.0.62 "GET /v2.0/ports?tenant_id=ed0d906c96b540a7b11d508615543890&fields=id HTTP/1.1" status: 200 len: 302 time: 0.0499377 Nov 23 19:38:12.000408 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [None req-18dcfdaa-7118-467d-8c2a-cd93ec1cb1bf tempest-AttachVolumeShelveTestJSON-1172915835 tempest-AttachVolumeShelveTestJSON-1172915835-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-927332'] for port, precommit_delete {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:38:12.000739 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [None req-18dcfdaa-7118-467d-8c2a-cd93ec1cb1bf tempest-AttachVolumeShelveTestJSON-1172915835 tempest-AttachVolumeShelveTestJSON-1172915835-project] Publish callbacks [] for floatingip, precommit_delete {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:38:12.014650 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.plugins.ml2.plugin [None req-18dcfdaa-7118-467d-8c2a-cd93ec1cb1bf tempest-AttachVolumeShelveTestJSON-1172915835 tempest-AttachVolumeShelveTestJSON-1172915835-project] Calling delete_port for 63d8ec9c-d152-4c6f-9ac7-7d9ca3bd5f11 owned by network:floatingip {{(pid=102992) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 23 19:38:12.046031 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-25d70870-677f-4316-b6d5-56864df3f7fd req-fe46fa75-fe12-45ca-8cba-7c0b32bd0560 service neutron] 10.222.0.62 "GET /v2.0/networks/96f89427-8150-464f-a280-f07cf823b4fd?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1069090 Nov 23 19:38:12.139836 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-25d70870-677f-4316-b6d5-56864df3f7fd req-e16d0a0f-0a4a-413d-a517-8e9db8dc0f96 service neutron] 10.222.0.62 "GET /v2.0/networks/96f89427-8150-464f-a280-f07cf823b4fd?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0907559 Nov 23 19:38:12.427039 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-43675595-122b-4775-b4f0-2a65cce78694 req-386aeb04-e489-4c14-8b26-394bbd379e84 tempest-TestMinimumBasicScenario-716536904 tempest-TestMinimumBasicScenario-716536904-project] 10.222.0.62 "GET /v2.0/ports?device_id=b5fed716-ff16-48c0-8e89-95731739f55c HTTP/1.1" status: 200 len: 210 time: 0.0323756 Nov 23 19:38:12.503412 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [None req-18dcfdaa-7118-467d-8c2a-cd93ec1cb1bf tempest-AttachVolumeShelveTestJSON-1172915835 tempest-AttachVolumeShelveTestJSON-1172915835-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7918660', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-15067', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560168', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8783631424624', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8783631008723', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-25199805'] for port, after_delete {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:38:12.528200 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-18dcfdaa-7118-467d-8c2a-cd93ec1cb1bf tempest-AttachVolumeShelveTestJSON-1172915835 tempest-AttachVolumeShelveTestJSON-1172915835-project] Pushing event deleted for resources: {'Port': ['ID=63d8ec9c-d152-4c6f-9ac7-7d9ca3bd5f11,revision_number=None']} {{(pid=102992) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 23 19:38:12.599141 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [None req-18dcfdaa-7118-467d-8c2a-cd93ec1cb1bf tempest-AttachVolumeShelveTestJSON-1172915835 tempest-AttachVolumeShelveTestJSON-1172915835-project] Publish callbacks [] for floatingip, after_delete {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:38:12.601832 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [None req-18dcfdaa-7118-467d-8c2a-cd93ec1cb1bf tempest-AttachVolumeShelveTestJSON-1172915835 tempest-AttachVolumeShelveTestJSON-1172915835-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-514902'] for floatingip, before_response {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:38:12.606800 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [None req-18dcfdaa-7118-467d-8c2a-cd93ec1cb1bf tempest-AttachVolumeShelveTestJSON-1172915835 tempest-AttachVolumeShelveTestJSON-1172915835-project] 10.222.0.62 "DELETE /v2.0/floatingips/688c5865-c524-4e4a-9ee8-836f2272655b HTTP/1.1" status: 204 len: 168 time: 0.8593931 Nov 23 19:38:12.763537 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-58c68cc5-da5d-4970-a21c-589759e6d008 req-db9eb20a-eacf-48f7-a477-723a1d3cc49f tempest-TestShelveInstance-292550524 tempest-TestShelveInstance-292550524-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102992) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:38:12.765105 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-58c68cc5-da5d-4970-a21c-589759e6d008 req-db9eb20a-eacf-48f7-a477-723a1d3cc49f tempest-TestShelveInstance-292550524 tempest-TestShelveInstance-292550524-project] 10.222.0.62 "GET /v2.0/ports?device_id=b504cdb2-6182-4c24-9b46-6dc0f85da342 HTTP/1.1" status: 200 len: 944 time: 0.0510130 Nov 23 19:38:12.822858 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-58c68cc5-da5d-4970-a21c-589759e6d008 req-1a665831-3717-444a-9369-5e9995f43c3f tempest-TestShelveInstance-292550524 tempest-TestShelveInstance-292550524-project] 10.222.0.62 "GET /v2.0/security-groups?id=7fe194e6-71c3-47a9-8f36-0dbb24d1f72d&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0485430 Nov 23 19:38:13.088360 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.wsgi [-] (102993) accepted ('10.222.0.62', 48968) {{(pid=102993) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 23 19:38:13.093226 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.api.v2.base [None req-214070c5-93b1-44e3-a45b-5b1ea4f39f09 tempest-AttachVolumeShelveTestJSON-1172915835 tempest-AttachVolumeShelveTestJSON-1172915835-project] Request body: {'security_group': {'name': 'tempest-securitygroup--1260517831', 'description': 'tempest-description--879246483'}} {{(pid=102993) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 23 19:38:13.198793 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-214070c5-93b1-44e3-a45b-5b1ea4f39f09 tempest-AttachVolumeShelveTestJSON-1172915835 tempest-AttachVolumeShelveTestJSON-1172915835-project] Publish callbacks [] for security_group, before_create {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:38:13.263478 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-214070c5-93b1-44e3-a45b-5b1ea4f39f09 tempest-AttachVolumeShelveTestJSON-1172915835 tempest-AttachVolumeShelveTestJSON-1172915835-project] Publish callbacks [] for security_group, precommit_create {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:38:13.318204 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-214070c5-93b1-44e3-a45b-5b1ea4f39f09 tempest-AttachVolumeShelveTestJSON-1172915835 tempest-AttachVolumeShelveTestJSON-1172915835-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-623933'] for security_group, after_create {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:38:13.346681 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-214070c5-93b1-44e3-a45b-5b1ea4f39f09 tempest-AttachVolumeShelveTestJSON-1172915835 tempest-AttachVolumeShelveTestJSON-1172915835-project] Pushing event updated for resources: {'SecurityGroup': ['ID=a246a431-7eb4-441f-b1e6-9c9c351ee888,revision_number=1']} {{(pid=102993) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 23 19:38:13.405894 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-214070c5-93b1-44e3-a45b-5b1ea4f39f09 tempest-AttachVolumeShelveTestJSON-1172915835 tempest-AttachVolumeShelveTestJSON-1172915835-project] Publish callbacks [] for security_group, before_response {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:38:13.407151 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [None req-214070c5-93b1-44e3-a45b-5b1ea4f39f09 tempest-AttachVolumeShelveTestJSON-1172915835 tempest-AttachVolumeShelveTestJSON-1172915835-project] 10.222.0.62 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1796 time: 0.3176160 Nov 23 19:38:13.410205 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.wsgi [-] (102993) accepted ('10.222.0.62', 48970) {{(pid=102993) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 23 19:38:13.414516 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.api.v2.base [None req-d7d090a5-3ff2-4427-b5c3-6d08ecf99f4a tempest-AttachVolumeShelveTestJSON-1172915835 tempest-AttachVolumeShelveTestJSON-1172915835-project] Request body: {'security_group_rule': {'security_group_id': 'a246a431-7eb4-441f-b1e6-9c9c351ee888', 'protocol': 'tcp', 'ethertype': 'IPv4', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'ingress'}} {{(pid=102993) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 23 19:38:13.529944 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-6bf68df7-3db7-4e0a-a7da-c6d11bddc4ff req-776c7cce-dbdf-4a46-9c63-1f4b15460a42 tempest-TestMinimumBasicScenario-716536904 tempest-TestMinimumBasicScenario-716536904-project] 10.222.0.62 "GET /v2.0/ports?device_id=b5fed716-ff16-48c0-8e89-95731739f55c HTTP/1.1" status: 200 len: 210 time: 0.0331430 Nov 23 19:38:13.530682 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-d7d090a5-3ff2-4427-b5c3-6d08ecf99f4a tempest-AttachVolumeShelveTestJSON-1172915835 tempest-AttachVolumeShelveTestJSON-1172915835-project] Publish callbacks [] for security_group_rule, before_create {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:38:13.579491 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-d7d090a5-3ff2-4427-b5c3-6d08ecf99f4a tempest-AttachVolumeShelveTestJSON-1172915835 tempest-AttachVolumeShelveTestJSON-1172915835-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:38:13.724078 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-d7d090a5-3ff2-4427-b5c3-6d08ecf99f4a tempest-AttachVolumeShelveTestJSON-1172915835 tempest-AttachVolumeShelveTestJSON-1172915835-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-601991'] for security_group_rule, after_create {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:38:13.743308 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d7d090a5-3ff2-4427-b5c3-6d08ecf99f4a tempest-AttachVolumeShelveTestJSON-1172915835 tempest-AttachVolumeShelveTestJSON-1172915835-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=8af1289c-50f4-4aaf-9c0e-9bf9bba30792,revision_number=0']} {{(pid=102993) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 23 19:38:13.817738 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-d7d090a5-3ff2-4427-b5c3-6d08ecf99f4a tempest-AttachVolumeShelveTestJSON-1172915835 tempest-AttachVolumeShelveTestJSON-1172915835-project] Publish callbacks [] for security_group_rule, before_response {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:38:13.818995 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [None req-d7d090a5-3ff2-4427-b5c3-6d08ecf99f4a tempest-AttachVolumeShelveTestJSON-1172915835 tempest-AttachVolumeShelveTestJSON-1172915835-project] 10.222.0.62 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 764 time: 0.4078770 Nov 23 19:38:13.822455 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.wsgi [-] (102993) accepted ('10.222.0.62', 48978) {{(pid=102993) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 23 19:38:13.826403 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.api.v2.base [None req-ee9f3df2-6e91-4e93-9ddc-e3249b2db162 tempest-AttachVolumeShelveTestJSON-1172915835 tempest-AttachVolumeShelveTestJSON-1172915835-project] Request body: {'security_group_rule': {'security_group_id': 'a246a431-7eb4-441f-b1e6-9c9c351ee888', 'protocol': 'icmp', 'ethertype': 'IPv4', 'direction': 'ingress'}} {{(pid=102993) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 23 19:38:13.889503 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-ee9f3df2-6e91-4e93-9ddc-e3249b2db162 tempest-AttachVolumeShelveTestJSON-1172915835 tempest-AttachVolumeShelveTestJSON-1172915835-project] Publish callbacks [] for security_group_rule, before_create {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:38:13.952841 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-ee9f3df2-6e91-4e93-9ddc-e3249b2db162 tempest-AttachVolumeShelveTestJSON-1172915835 tempest-AttachVolumeShelveTestJSON-1172915835-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:38:13.956425 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-89d5d48d-3762-4454-aa3a-20f85a4e0a51 req-caad121a-f2c0-4acc-9a5b-60a84f9335a1 tempest-TestShelveInstance-292550524 tempest-TestShelveInstance-292550524-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102992) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:38:13.957972 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-89d5d48d-3762-4454-aa3a-20f85a4e0a51 req-caad121a-f2c0-4acc-9a5b-60a84f9335a1 tempest-TestShelveInstance-292550524 tempest-TestShelveInstance-292550524-project] 10.222.0.62 "GET /v2.0/ports?device_id=b504cdb2-6182-4c24-9b46-6dc0f85da342 HTTP/1.1" status: 200 len: 944 time: 0.0608985 Nov 23 19:38:13.996853 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.plugins.ml2.rpc [None req-4bf48ff4-ecfb-4168-8b63-249b8c6e9f04 None None] Device 4b380ab6-f3ec-4e12-9a2a-b5a20828969d no longer exists at agent hyperv_hv-cinder-81901 {{(pid=102994) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 23 19:38:14.009742 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-ee9f3df2-6e91-4e93-9ddc-e3249b2db162 tempest-AttachVolumeShelveTestJSON-1172915835 tempest-AttachVolumeShelveTestJSON-1172915835-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-601991'] for security_group_rule, after_create {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:38:14.010972 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-89d5d48d-3762-4454-aa3a-20f85a4e0a51 req-40b82cff-a6a3-4e56-ad4d-36efaa9a644f tempest-TestShelveInstance-292550524 tempest-TestShelveInstance-292550524-project] 10.222.0.62 "GET /v2.0/security-groups?id=7fe194e6-71c3-47a9-8f36-0dbb24d1f72d&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0470047 Nov 23 19:38:14.020464 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.plugins.ml2.plugin [None req-4bf48ff4-ecfb-4168-8b63-249b8c6e9f04 None None] No Port match for: 4b380ab6-f3ec-4e12-9a2a-b5a20828969d {{(pid=102994) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 23 19:38:14.020464 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.plugins.ml2.rpc [None req-4bf48ff4-ecfb-4168-8b63-249b8c6e9f04 None None] Device 4b380ab6-f3ec-4e12-9a2a-b5a20828969d not bound to the agent host hv-cinder-81901 {{(pid=102994) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 23 19:38:14.033577 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ee9f3df2-6e91-4e93-9ddc-e3249b2db162 tempest-AttachVolumeShelveTestJSON-1172915835 tempest-AttachVolumeShelveTestJSON-1172915835-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=8c09c7a6-4b7c-4340-993d-0d4862ed9141,revision_number=0']} {{(pid=102993) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 23 19:38:14.103458 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-ee9f3df2-6e91-4e93-9ddc-e3249b2db162 tempest-AttachVolumeShelveTestJSON-1172915835 tempest-AttachVolumeShelveTestJSON-1172915835-project] Publish callbacks [] for security_group_rule, before_response {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:38:14.104758 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [None req-ee9f3df2-6e91-4e93-9ddc-e3249b2db162 tempest-AttachVolumeShelveTestJSON-1172915835 tempest-AttachVolumeShelveTestJSON-1172915835-project] 10.222.0.62 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 769 time: 0.2817714 Nov 23 19:38:14.107966 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.wsgi [-] (102993) accepted ('10.222.0.62', 48984) {{(pid=102993) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 23 19:38:14.113065 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.api.v2.base [None req-4d8953c9-a3be-44f2-9d62-21c47868d755 tempest-AttachVolumeShelveTestJSON-1172915835 tempest-AttachVolumeShelveTestJSON-1172915835-project] Request body: {'floatingip': {'floating_network_id': 'a93e254e-aac9-4233-9e4d-4290fd0458e4'}} {{(pid=102993) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 23 19:38:14.181394 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron_lib.callbacks.manager [None req-ba0526d2-252d-4156-9136-d99ef74345e3 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8783631323329', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7978582'] for agent, after_update {{(pid=102994) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:38:14.181627 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-4d8953c9-a3be-44f2-9d62-21c47868d755 tempest-AttachVolumeShelveTestJSON-1172915835 tempest-AttachVolumeShelveTestJSON-1172915835-project] Publish callbacks [] for floatingip, before_create {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:38:14.573572 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-4d8953c9-a3be-44f2-9d62-21c47868d755 tempest-AttachVolumeShelveTestJSON-1172915835 tempest-AttachVolumeShelveTestJSON-1172915835-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7921281'] for port, before_create {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:38:14.630022 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-52669dfb-b3a2-48e1-a3a0-56f1ff349441 req-843c0fa4-3ebf-444f-ac46-268b35867eb8 tempest-TestMinimumBasicScenario-716536904 tempest-TestMinimumBasicScenario-716536904-project] 10.222.0.62 "GET /v2.0/ports?device_id=b5fed716-ff16-48c0-8e89-95731739f55c HTTP/1.1" status: 200 len: 210 time: 0.0308533 Nov 23 19:38:14.678913 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-25d70870-677f-4316-b6d5-56864df3f7fd req-48e4f478-d622-4461-bb60-25ef38c0bd73 tempest-TestMinimumBasicScenario-716536904 tempest-TestMinimumBasicScenario-716536904-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=102993) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:38:14.680331 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-25d70870-677f-4316-b6d5-56864df3f7fd req-48e4f478-d622-4461-bb60-25ef38c0bd73 tempest-TestMinimumBasicScenario-716536904 tempest-TestMinimumBasicScenario-716536904-project] 10.222.0.41 "GET /v2.0/networks?id=96f89427-8150-464f-a280-f07cf823b4fd HTTP/1.1" status: 200 len: 814 time: 0.1495473 Nov 23 19:38:14.697478 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.api.v2.base [req-25d70870-677f-4316-b6d5-56864df3f7fd req-0d7bb49b-7cfc-4a56-a0fa-3d1e4a865eea tempest-TestMinimumBasicScenario-716536904 tempest-TestMinimumBasicScenario-716536904-project] Request body: {'port': {'device_id': 'b5fed716-ff16-48c0-8e89-95731739f55c', 'network_id': '96f89427-8150-464f-a280-f07cf823b4fd', 'admin_state_up': True, 'tenant_id': 'ed0d906c96b540a7b11d508615543890'}} {{(pid=102993) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 23 19:38:14.807645 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.db.db_base_plugin_common [None req-4d8953c9-a3be-44f2-9d62-21c47868d755 tempest-AttachVolumeShelveTestJSON-1172915835 tempest-AttachVolumeShelveTestJSON-1172915835-project] Allocated IP 172.27.1.207 (a93e254e-aac9-4233-9e4d-4290fd0458e4/e0b32f3d-83d6-439a-bbed-01df7cf01051/79115858-b9f6-4f07-a55f-3b61fc43a874) {{(pid=102993) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 23 19:38:14.935014 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.wsgi [-] (102992) accepted ('10.222.0.62', 48996) {{(pid=102992) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 23 19:38:14.939533 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-4d8953c9-a3be-44f2-9d62-21c47868d755 tempest-AttachVolumeShelveTestJSON-1172915835 tempest-AttachVolumeShelveTestJSON-1172915835-project] Publish callbacks [] for port, precommit_create {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:38:14.975592 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-25d70870-677f-4316-b6d5-56864df3f7fd req-0d7bb49b-7cfc-4a56-a0fa-3d1e4a865eea tempest-TestMinimumBasicScenario-716536904 tempest-TestMinimumBasicScenario-716536904-project] Made reservation on behalf of ed0d906c96b540a7b11d508615543890 for: {'port': 1} {{(pid=102993) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 23 19:38:14.979243 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [req-25d70870-677f-4316-b6d5-56864df3f7fd req-0d7bb49b-7cfc-4a56-a0fa-3d1e4a865eea tempest-TestMinimumBasicScenario-716536904 tempest-TestMinimumBasicScenario-716536904-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7921281'] for port, before_create {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:38:14.980396 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.db.db_base_plugin_v2 [None req-fd2909a4-346a-4bc7-a9fa-847d67483d1f admin admin] Deleting subnet cf93b200-5fcb-4538-8ce7-95612047c22a {{(pid=102992) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Nov 23 19:38:14.983692 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [None req-fd2909a4-346a-4bc7-a9fa-847d67483d1f admin admin] Publish callbacks [] for subnet, before_delete {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:38:15.029781 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [None req-fd2909a4-346a-4bc7-a9fa-847d67483d1f admin admin] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-25272549'] for subnet, precommit_delete_associations {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:38:15.040629 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-4d8953c9-a3be-44f2-9d62-21c47868d755 tempest-AttachVolumeShelveTestJSON-1172915835 tempest-AttachVolumeShelveTestJSON-1172915835-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7918660', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-15067', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560168', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8783631008714', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-17257496'] for port, after_create {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:38:15.085753 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron_lib.callbacks.manager [None req-8346ef05-f685-4c3d-af3d-a159b683bec2 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8783631323329', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7978582'] for agent, after_update {{(pid=102994) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:38:15.093551 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [None req-fd2909a4-346a-4bc7-a9fa-847d67483d1f admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-7975863'] for subnet, precommit_delete {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:38:15.104235 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-4d8953c9-a3be-44f2-9d62-21c47868d755 tempest-AttachVolumeShelveTestJSON-1172915835 tempest-AttachVolumeShelveTestJSON-1172915835-project] Network a93e254e-aac9-4233-9e4d-4290fd0458e4 is already hosted by enough agents. {{(pid=102993) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 23 19:38:15.127499 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.scheduler.base_scheduler [None req-4d8953c9-a3be-44f2-9d62-21c47868d755 tempest-AttachVolumeShelveTestJSON-1172915835 tempest-AttachVolumeShelveTestJSON-1172915835-project] Resources bound (agent type, host, resource id): {{(pid=102993) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 23 19:38:15.162829 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.db.l3_dvrscheduler_db [None req-4d8953c9-a3be-44f2-9d62-21c47868d755 tempest-AttachVolumeShelveTestJSON-1172915835 tempest-AttachVolumeShelveTestJSON-1172915835-project] Received port after_create {{(pid=102993) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 23 19:38:15.198517 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4d8953c9-a3be-44f2-9d62-21c47868d755 tempest-AttachVolumeShelveTestJSON-1172915835 tempest-AttachVolumeShelveTestJSON-1172915835-project] Pushing event updated for resources: {'Port': ['ID=79115858-b9f6-4f07-a55f-3b61fc43a874,revision_number=1']} {{(pid=102993) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 23 19:38:15.227579 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [None req-fd2909a4-346a-4bc7-a9fa-847d67483d1f admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-7982148', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-554858', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560168', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-25199822', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-25999729'] for subnet, after_delete {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:38:15.237556 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.db.db_base_plugin_common [req-25d70870-677f-4316-b6d5-56864df3f7fd req-0d7bb49b-7cfc-4a56-a0fa-3d1e4a865eea tempest-TestMinimumBasicScenario-716536904 tempest-TestMinimumBasicScenario-716536904-project] Allocated IP 172.20.0.7 (96f89427-8150-464f-a280-f07cf823b4fd/bfa70c12-21c8-4b7f-8a30-da7ff37b80b8/733eac81-0446-4e4c-b1d5-b8c491dcbeb4) {{(pid=102993) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 23 19:38:15.257391 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [None req-fd2909a4-346a-4bc7-a9fa-847d67483d1f admin admin] Publish callbacks [] for subnet, before_response {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:38:15.259391 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-09f1e975-9edf-47e1-917a-d20825ff32d2 req-0df2f5a6-956e-4525-8506-1282bcc036c1 tempest-TestShelveInstance-292550524 tempest-TestShelveInstance-292550524-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102993) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:38:15.260704 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-09f1e975-9edf-47e1-917a-d20825ff32d2 req-0df2f5a6-956e-4525-8506-1282bcc036c1 tempest-TestShelveInstance-292550524 tempest-TestShelveInstance-292550524-project] 10.222.0.62 "GET /v2.0/ports?device_id=b504cdb2-6182-4c24-9b46-6dc0f85da342 HTTP/1.1" status: 200 len: 944 time: 0.1553888 Nov 23 19:38:15.264699 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [None req-fd2909a4-346a-4bc7-a9fa-847d67483d1f admin admin] 10.222.0.62 "DELETE /v2.0/subnets/cf93b200-5fcb-4538-8ce7-95612047c22a HTTP/1.1" status: 204 len: 168 time: 0.3262708 Nov 23 19:38:15.264699 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fd2909a4-346a-4bc7-a9fa-847d67483d1f admin admin] Pushing event deleted for resources: {'Subnet': ['ID=cf93b200-5fcb-4538-8ce7-95612047c22a,revision_number=None']} {{(pid=102992) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 23 19:38:15.265566 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.wsgi [-] (102993) accepted ('10.222.0.62', 49016) {{(pid=102993) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 23 19:38:15.435081 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-a5291417-c1a4-48b2-9dc7-dcd81bda79c7 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-8133038'] for network, before_delete {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:38:15.442128 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-4d8953c9-a3be-44f2-9d62-21c47868d755 tempest-AttachVolumeShelveTestJSON-1172915835 tempest-AttachVolumeShelveTestJSON-1172915835-project] Publish callbacks [] for floatingip, precommit_create {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:38:15.497836 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-09f1e975-9edf-47e1-917a-d20825ff32d2 req-32f34e0a-17b1-4f86-8555-095d776162c4 tempest-TestShelveInstance-292550524 tempest-TestShelveInstance-292550524-project] 10.222.0.62 "GET /v2.0/security-groups?id=7fe194e6-71c3-47a9-8f36-0dbb24d1f72d&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1883759 Nov 23 19:38:15.647592 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-4d8953c9-a3be-44f2-9d62-21c47868d755 tempest-AttachVolumeShelveTestJSON-1172915835 tempest-AttachVolumeShelveTestJSON-1172915835-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7921281'] for port, before_update {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:38:15.688050 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-a5291417-c1a4-48b2-9dc7-dcd81bda79c7 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-7977576', 'neutron.services.segments.db._delete_segments_for_network-8783631323320'] for network, precommit_delete {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:38:15.724120 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [req-25d70870-677f-4316-b6d5-56864df3f7fd req-0d7bb49b-7cfc-4a56-a0fa-3d1e4a865eea tempest-TestMinimumBasicScenario-716536904 tempest-TestMinimumBasicScenario-716536904-project] Publish callbacks [] for port, precommit_create {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:38:15.761344 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.services.segments.db [None req-a5291417-c1a4-48b2-9dc7-dcd81bda79c7 admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['6a5d33a0-25a4-4580-ae9f-e7aa9d768182']}} {{(pid=102993) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 23 19:38:15.790393 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-28e4eaa5-5953-4783-8e42-67204ef32d34 req-46cff328-d50c-4860-905d-aed2a3ed64ed tempest-TestMinimumBasicScenario-716536904 tempest-TestMinimumBasicScenario-716536904-project] 10.222.0.62 "GET /v2.0/ports?device_id=b5fed716-ff16-48c0-8e89-95731739f55c HTTP/1.1" status: 200 len: 210 time: 0.0630267 Nov 23 19:38:15.800010 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.services.segments.db [None req-a5291417-c1a4-48b2-9dc7-dcd81bda79c7 admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, 'b67642b4-1845-4b49-9392-51fd2c9bc8b8') {'for_net_delete': True} {{(pid=102993) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 23 19:38:15.800311 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.services.segments.db [None req-a5291417-c1a4-48b2-9dc7-dcd81bda79c7 admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, 'b67642b4-1845-4b49-9392-51fd2c9bc8b8') {} {{(pid=102993) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 23 19:38:15.821907 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-a5291417-c1a4-48b2-9dc7-dcd81bda79c7 admin admin] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8783631432524', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-16914685'] for segment, before_delete {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:38:15.866775 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-a5291417-c1a4-48b2-9dc7-dcd81bda79c7 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7982218'] for segment, precommit_delete {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:38:15.910174 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-a5291417-c1a4-48b2-9dc7-dcd81bda79c7 admin admin] Releasing vlan 815 on physical network physnet1 to pool {{(pid=102993) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Nov 23 19:38:15.910597 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-a5291417-c1a4-48b2-9dc7-dcd81bda79c7 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7982218', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-17258441'] for segment, after_delete {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:38:15.912430 dv-cinder-819011-1-iscsi neutron-server[102993]: Traceback (most recent call last): Nov 23 19:38:15.912430 dv-cinder-819011-1-iscsi neutron-server[102993]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Nov 23 19:38:15.912430 dv-cinder-819011-1-iscsi neutron-server[102993]: timer() Nov 23 19:38:15.912430 dv-cinder-819011-1-iscsi neutron-server[102993]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 23 19:38:15.912430 dv-cinder-819011-1-iscsi neutron-server[102993]: cb(*args, **kw) Nov 23 19:38:15.912430 dv-cinder-819011-1-iscsi neutron-server[102993]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Nov 23 19:38:15.912430 dv-cinder-819011-1-iscsi neutron-server[102993]: return func(*args, **kwargs) Nov 23 19:38:15.912430 dv-cinder-819011-1-iscsi neutron-server[102993]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 23 19:38:15.912430 dv-cinder-819011-1-iscsi neutron-server[102993]: self._notify() Nov 23 19:38:15.912430 dv-cinder-819011-1-iscsi neutron-server[102993]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 23 19:38:15.912430 dv-cinder-819011-1-iscsi neutron-server[102993]: self.callback(batched_events) Nov 23 19:38:15.912430 dv-cinder-819011-1-iscsi neutron-server[102993]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 23 19:38:15.912430 dv-cinder-819011-1-iscsi neutron-server[102993]: event.method(event) Nov 23 19:38:15.912430 dv-cinder-819011-1-iscsi neutron-server[102993]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Nov 23 19:38:15.912430 dv-cinder-819011-1-iscsi neutron-server[102993]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 23 19:38:15.912430 dv-cinder-819011-1-iscsi neutron-server[102993]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Nov 23 19:38:15.912430 dv-cinder-819011-1-iscsi neutron-server[102993]: aggregate_uuid = self.p_client.list_aggregates( Nov 23 19:38:15.912430 dv-cinder-819011-1-iscsi neutron-server[102993]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Nov 23 19:38:15.912430 dv-cinder-819011-1-iscsi neutron-server[102993]: return f(self, *a, **k) Nov 23 19:38:15.912430 dv-cinder-819011-1-iscsi neutron-server[102993]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 23 19:38:15.912430 dv-cinder-819011-1-iscsi neutron-server[102993]: return self._get(url).json() Nov 23 19:38:15.912430 dv-cinder-819011-1-iscsi neutron-server[102993]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 23 19:38:15.912430 dv-cinder-819011-1-iscsi neutron-server[102993]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 23 19:38:15.912430 dv-cinder-819011-1-iscsi neutron-server[102993]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Nov 23 19:38:15.912430 dv-cinder-819011-1-iscsi neutron-server[102993]: return self.request(url, 'GET', **kwargs) Nov 23 19:38:15.912430 dv-cinder-819011-1-iscsi neutron-server[102993]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Nov 23 19:38:15.912430 dv-cinder-819011-1-iscsi neutron-server[102993]: base_url = self.get_endpoint(auth, allow=allow, Nov 23 19:38:15.912430 dv-cinder-819011-1-iscsi neutron-server[102993]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Nov 23 19:38:15.912430 dv-cinder-819011-1-iscsi neutron-server[102993]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 23 19:38:15.912430 dv-cinder-819011-1-iscsi neutron-server[102993]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Nov 23 19:38:15.912430 dv-cinder-819011-1-iscsi neutron-server[102993]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 23 19:38:15.912430 dv-cinder-819011-1-iscsi neutron-server[102993]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 23 19:38:15.974934 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [req-25d70870-677f-4316-b6d5-56864df3f7fd req-0d7bb49b-7cfc-4a56-a0fa-3d1e4a865eea tempest-TestMinimumBasicScenario-716536904 tempest-TestMinimumBasicScenario-716536904-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7918660', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-15067', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560168', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8783631008714', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-17257496'] for port, after_create {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:38:16.002404 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.plugins.ml2.rpc [None req-4bf48ff4-ecfb-4168-8b63-249b8c6e9f04 None None] Device bbafb0bb-163c-43f4-8d2c-2f5304e0bd04 details requested by agent hyperv_hv-cinder-81901 with host hv-cinder-81901 {{(pid=102994) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Nov 23 19:38:16.056421 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-25d70870-677f-4316-b6d5-56864df3f7fd req-0d7bb49b-7cfc-4a56-a0fa-3d1e4a865eea tempest-TestMinimumBasicScenario-716536904 tempest-TestMinimumBasicScenario-716536904-project] Network 96f89427-8150-464f-a280-f07cf823b4fd is already hosted by enough agents. {{(pid=102993) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 23 19:38:16.066172 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.scheduler.base_scheduler [req-25d70870-677f-4316-b6d5-56864df3f7fd req-0d7bb49b-7cfc-4a56-a0fa-3d1e4a865eea tempest-TestMinimumBasicScenario-716536904 tempest-TestMinimumBasicScenario-716536904-project] Resources bound (agent type, host, resource id): {{(pid=102993) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 23 19:38:16.075022 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.db.l3_dvrscheduler_db [req-25d70870-677f-4316-b6d5-56864df3f7fd req-0d7bb49b-7cfc-4a56-a0fa-3d1e4a865eea tempest-TestMinimumBasicScenario-716536904 tempest-TestMinimumBasicScenario-716536904-project] Received port after_create {{(pid=102993) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 23 19:38:16.088713 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0d7bb49b-7cfc-4a56-a0fa-3d1e4a865eea tempest-TestMinimumBasicScenario-716536904 tempest-TestMinimumBasicScenario-716536904-project] Pushing event updated for resources: {'Port': ['ID=733eac81-0446-4e4c-b1d5-b8c491dcbeb4,revision_number=1']} {{(pid=102993) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 23 19:38:16.114677 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-a5291417-c1a4-48b2-9dc7-dcd81bda79c7 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-7977567', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-554949', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560168', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-926557'] for network, after_delete {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:38:16.123181 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-4d8953c9-a3be-44f2-9d62-21c47868d755 tempest-AttachVolumeShelveTestJSON-1172915835 tempest-AttachVolumeShelveTestJSON-1172915835-project] Publish callbacks [] for port, precommit_update {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:38:16.144467 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.plugins.ml2.db [None req-4bf48ff4-ecfb-4168-8b63-249b8c6e9f04 None None] For port bbafb0bb-163c-43f4-8d2c-2f5304e0bd04, host hv-cinder-81901, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81901',level=0,port_id=bbafb0bb-163c-43f4-8d2c-2f5304e0bd04,segment=NetworkSegment(5c30b9a1-7b41-4664-aa24-084baf66a2d5),segment_id=5c30b9a1-7b41-4664-aa24-084baf66a2d5)] {{(pid=102994) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 23 19:38:16.159395 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a5291417-c1a4-48b2-9dc7-dcd81bda79c7 admin admin] Pushing event deleted for resources: {'Network': ['ID=6a5d33a0-25a4-4580-ae9f-e7aa9d768182,revision_number=None']} {{(pid=102993) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 23 19:38:16.167075 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-a5291417-c1a4-48b2-9dc7-dcd81bda79c7 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-560186'] for network, before_response {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:38:16.168504 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.plugins.ml2.rpc [None req-4bf48ff4-ecfb-4168-8b63-249b8c6e9f04 None None] Returning: {'device': 'bbafb0bb-163c-43f4-8d2c-2f5304e0bd04', 'network_id': '87e46ab6-0f90-430f-930f-9ea1580c04c3', 'port_id': 'bbafb0bb-163c-43f4-8d2c-2f5304e0bd04', 'mac_address': 'fa:16:3e:3d:cc:c0', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 817, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'afa5bc59-f70c-409d-8c15-be2dcdce66a3', 'ip_address': '172.20.0.13'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=102994) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Nov 23 19:38:16.177319 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [None req-a5291417-c1a4-48b2-9dc7-dcd81bda79c7 admin admin] 10.222.0.62 "DELETE /v2.0/networks/6a5d33a0-25a4-4580-ae9f-e7aa9d768182 HTTP/1.1" status: 204 len: 168 time: 0.9094825 Nov 23 19:38:16.190597 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-25d70870-677f-4316-b6d5-56864df3f7fd req-0d7bb49b-7cfc-4a56-a0fa-3d1e4a865eea tempest-TestMinimumBasicScenario-716536904 tempest-TestMinimumBasicScenario-716536904-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=102993) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:38:16.191251 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [req-25d70870-677f-4316-b6d5-56864df3f7fd req-0d7bb49b-7cfc-4a56-a0fa-3d1e4a865eea tempest-TestMinimumBasicScenario-716536904 tempest-TestMinimumBasicScenario-716536904-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-514902'] for port, before_response {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:38:16.221948 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-4d8953c9-a3be-44f2-9d62-21c47868d755 tempest-AttachVolumeShelveTestJSON-1172915835 tempest-AttachVolumeShelveTestJSON-1172915835-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7918660', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-15067', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560168', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8783631423946', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8783631008732', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8783631008750', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-17257505'] for port, after_update {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:38:16.251935 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron_lib.callbacks.manager [None req-4bf48ff4-ecfb-4168-8b63-249b8c6e9f04 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7921281'] for port, before_update {{(pid=102994) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:38:16.281217 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.notifiers.nova [None req-4bf48ff4-ecfb-4168-8b63-249b8c6e9f04 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id bbafb0bb-163c-43f4-8d2c-2f5304e0bd04 {{(pid=102994) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 23 19:38:16.325943 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.plugins.ml2.db [None req-4bf48ff4-ecfb-4168-8b63-249b8c6e9f04 None None] For port bbafb0bb-163c-43f4-8d2c-2f5304e0bd04, host hv-cinder-81901, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81901',level=0,port_id=bbafb0bb-163c-43f4-8d2c-2f5304e0bd04,segment=NetworkSegment(5c30b9a1-7b41-4664-aa24-084baf66a2d5),segment_id=5c30b9a1-7b41-4664-aa24-084baf66a2d5)] {{(pid=102994) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 23 19:38:16.350292 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4d8953c9-a3be-44f2-9d62-21c47868d755 tempest-AttachVolumeShelveTestJSON-1172915835 tempest-AttachVolumeShelveTestJSON-1172915835-project] Pushing event updated for resources: {'Port': ['ID=79115858-b9f6-4f07-a55f-3b61fc43a874,revision_number=2']} {{(pid=102993) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 23 19:38:16.379562 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-25d70870-677f-4316-b6d5-56864df3f7fd req-0d7bb49b-7cfc-4a56-a0fa-3d1e4a865eea tempest-TestMinimumBasicScenario-716536904 tempest-TestMinimumBasicScenario-716536904-project] 10.222.0.41 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 1.6842864 Nov 23 19:38:16.379796 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-4d8953c9-a3be-44f2-9d62-21c47868d755 tempest-AttachVolumeShelveTestJSON-1172915835 tempest-AttachVolumeShelveTestJSON-1172915835-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-926531'] for floatingip, after_create {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:38:16.405905 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.db.provisioning_blocks [None req-ecafaa2c-4cbb-45ff-b7f0-6d138afd63ab None None] Provisioning complete for port 733eac81-0446-4e4c-b1d5-b8c491dcbeb4 triggered by entity DHCP. {{(pid=102994) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 23 19:38:16.406487 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron_lib.callbacks.manager [None req-ecafaa2c-4cbb-45ff-b7f0-6d138afd63ab None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-8355713'] for port, provisioning_complete {{(pid=102994) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:38:16.439570 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron_lib.callbacks.manager [None req-4bf48ff4-ecfb-4168-8b63-249b8c6e9f04 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7918660', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-15067', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560168', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8783631423946', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8783631008732', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8783631008750'] for port, after_update {{(pid=102994) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:38:16.468152 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.plugins.ml2.plugin [None req-ecafaa2c-4cbb-45ff-b7f0-6d138afd63ab None None] Port 733eac81-0446-4e4c-b1d5-b8c491dcbeb4 cannot update to ACTIVE because it is not bound. {{(pid=102994) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 23 19:38:16.470325 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-4d8953c9-a3be-44f2-9d62-21c47868d755 tempest-AttachVolumeShelveTestJSON-1172915835 tempest-AttachVolumeShelveTestJSON-1172915835-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-514902'] for floatingip, before_response {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:38:16.472026 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [None req-4d8953c9-a3be-44f2-9d62-21c47868d755 tempest-AttachVolumeShelveTestJSON-1172915835 tempest-AttachVolumeShelveTestJSON-1172915835-project] 10.222.0.62 "POST /v2.0/floatingips HTTP/1.1" status: 201 len: 693 time: 2.3628390 Nov 23 19:38:16.536010 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4bf48ff4-ecfb-4168-8b63-249b8c6e9f04 None None] Pushing event updated for resources: {'Port': ['ID=bbafb0bb-163c-43f4-8d2c-2f5304e0bd04,revision_number=4']} {{(pid=102994) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 23 19:38:16.632562 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron_lib.callbacks.manager [None req-785c1d26-11ba-42d8-b5a6-51a8b3daeef0 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8783631323329', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7978582'] for agent, after_update {{(pid=102994) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:38:16.649203 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ad96325f-c2e7-4e7f-9e8e-df8a3280c53c req-be9b24f6-0ab7-46cb-9a33-6ff35155e024 tempest-TestShelveInstance-292550524 tempest-TestShelveInstance-292550524-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102993) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:38:16.650783 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-ad96325f-c2e7-4e7f-9e8e-df8a3280c53c req-be9b24f6-0ab7-46cb-9a33-6ff35155e024 tempest-TestShelveInstance-292550524 tempest-TestShelveInstance-292550524-project] 10.222.0.62 "GET /v2.0/ports?device_id=b504cdb2-6182-4c24-9b46-6dc0f85da342 HTTP/1.1" status: 200 len: 945 time: 0.0607493 Nov 23 19:38:16.709773 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-ad96325f-c2e7-4e7f-9e8e-df8a3280c53c req-a6b3184e-1549-48e6-a078-9faa92f9bf6a tempest-TestShelveInstance-292550524 tempest-TestShelveInstance-292550524-project] 10.222.0.62 "GET /v2.0/security-groups?id=7fe194e6-71c3-47a9-8f36-0dbb24d1f72d&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0523827 Nov 23 19:38:16.741377 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.plugins.ml2.db [None req-4bf48ff4-ecfb-4168-8b63-249b8c6e9f04 None None] get_ports_and_sgs() called for port_ids ['bbafb0bb-163c-43f4-8d2c-2f5304e0bd04'] {{(pid=102994) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 23 19:38:16.742889 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.wsgi [-] (102992) accepted ('10.222.0.62', 49030) {{(pid=102992) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 23 19:38:16.808730 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [None req-71a00418-2b70-4b75-92b5-1179ebb8457b admin admin] 10.222.0.62 "GET /v2.0/security-groups?tenant_id=766c6a829b9945cfb36bad289566c0ad&name=default HTTP/1.1" status: 200 len: 2996 time: 0.0643106 Nov 23 19:38:16.811368 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.wsgi [-] (102992) accepted ('10.222.0.62', 49040) {{(pid=102992) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 23 19:38:16.866882 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-f4ff229d-24c6-425e-9f3f-06324830fee1 req-d7fcd111-888f-43ed-a614-340f9cbb7eee tempest-AttachVolumeShelveTestJSON-1172915835 tempest-AttachVolumeShelveTestJSON-1172915835-project] 10.222.0.62 "GET /v2.0/security-groups?name=tempest-securitygroup--1260517831&fields=id&tenant_id=2d925fb59ba34355aa85758374d76928 HTTP/1.1" status: 200 len: 267 time: 0.0547347 Nov 23 19:38:16.880461 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [None req-0a303a03-e9c2-40d5-8fa0-0e7a198186bb admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:38:16.908141 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [None req-0a303a03-e9c2-40d5-8fa0-0e7a198186bb admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:38:17.025350 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f4ff229d-24c6-425e-9f3f-06324830fee1 req-f84a665d-16d4-4085-ba58-5ed55d825fba tempest-AttachVolumeShelveTestJSON-1172915835 tempest-AttachVolumeShelveTestJSON-1172915835-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=102993) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:38:17.026895 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [None req-0a303a03-e9c2-40d5-8fa0-0e7a198186bb admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-623933'] for security_group, after_delete {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:38:17.029972 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [None req-0a303a03-e9c2-40d5-8fa0-0e7a198186bb admin admin] Publish callbacks [] for security_group, before_response {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:38:17.030096 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-f4ff229d-24c6-425e-9f3f-06324830fee1 req-f84a665d-16d4-4085-ba58-5ed55d825fba tempest-AttachVolumeShelveTestJSON-1172915835 tempest-AttachVolumeShelveTestJSON-1172915835-project] 10.222.0.62 "GET /v2.0/networks?id=fc901312-2937-4784-8a6d-c046666e8bf8 HTTP/1.1" status: 200 len: 817 time: 0.1568558 Nov 23 19:38:17.031461 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [None req-0a303a03-e9c2-40d5-8fa0-0e7a198186bb admin admin] 10.222.0.62 "DELETE /v2.0/security-groups/2fd4bf42-f1cd-4ab5-94a3-e2347f7bb016 HTTP/1.1" status: 204 len: 168 time: 0.2192962 Nov 23 19:38:17.043094 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0a303a03-e9c2-40d5-8fa0-0e7a198186bb admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=2fd4bf42-f1cd-4ab5-94a3-e2347f7bb016,revision_number=None']} {{(pid=102992) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 23 19:38:17.058889 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-f4ff229d-24c6-425e-9f3f-06324830fee1 req-adb85c19-b58b-4703-a1de-ca6dd9e5c40c tempest-AttachVolumeShelveTestJSON-1172915835 tempest-AttachVolumeShelveTestJSON-1172915835-project] 10.222.0.62 "GET /v2.0/quotas/2d925fb59ba34355aa85758374d76928 HTTP/1.1" status: 200 len: 375 time: 0.0141466 Nov 23 19:38:17.143418 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-f4ff229d-24c6-425e-9f3f-06324830fee1 req-7b908c7c-4352-4fa5-8717-d880f849d0b2 tempest-AttachVolumeShelveTestJSON-1172915835 tempest-AttachVolumeShelveTestJSON-1172915835-project] 10.222.0.62 "GET /v2.0/ports?tenant_id=2d925fb59ba34355aa85758374d76928&fields=id HTTP/1.1" status: 200 len: 302 time: 0.0682096 Nov 23 19:38:17.249960 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-f4ff229d-24c6-425e-9f3f-06324830fee1 req-469a1536-0f0b-48e3-a677-f904e4d78c55 service neutron] 10.222.0.62 "GET /v2.0/networks/fc901312-2937-4784-8a6d-c046666e8bf8?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0918579 Nov 23 19:38:17.331985 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron_lib.callbacks.manager [None req-eb87b2c3-3339-4249-8b85-e695b5b4e1f9 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8783631323329', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7978582'] for agent, after_update {{(pid=102994) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:38:17.352384 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-f4ff229d-24c6-425e-9f3f-06324830fee1 req-7d0231d2-0d35-486c-af7b-861e4a37afeb service neutron] 10.222.0.62 "GET /v2.0/networks/fc901312-2937-4784-8a6d-c046666e8bf8?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0951076 Nov 23 19:38:17.676178 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-504fed7b-93c8-4356-8757-cd155966f334 req-bcf6ab36-470e-499b-a3d6-a8aa03d20afe tempest-TestMinimumBasicScenario-716536904 tempest-TestMinimumBasicScenario-716536904-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102993) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:38:17.677915 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-504fed7b-93c8-4356-8757-cd155966f334 req-bcf6ab36-470e-499b-a3d6-a8aa03d20afe tempest-TestMinimumBasicScenario-716536904 tempest-TestMinimumBasicScenario-716536904-project] 10.222.0.62 "GET /v2.0/ports?device_id=b5fed716-ff16-48c0-8e89-95731739f55c HTTP/1.1" status: 200 len: 931 time: 0.0567462 Nov 23 19:38:17.749040 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-504fed7b-93c8-4356-8757-cd155966f334 req-8a6e984f-df21-4c33-ab70-05953b640e2b tempest-TestMinimumBasicScenario-716536904 tempest-TestMinimumBasicScenario-716536904-project] 10.222.0.62 "GET /v2.0/security-groups?id=d09b4044-91d5-4432-9faa-4b7a40b1627d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0637364 Nov 23 19:38:17.817942 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-839764e6-db56-4d36-adab-252823bbf702 req-3af2d5ab-56d8-4d08-a115-35094ae3168c tempest-AttachVolumeShelveTestJSON-1172915835 tempest-AttachVolumeShelveTestJSON-1172915835-project] 10.222.0.62 "GET /v2.0/ports?device_id=627eaac3-8c43-4aa3-a81c-7a6bfb58dbb5 HTTP/1.1" status: 200 len: 210 time: 0.0266247 Nov 23 19:38:17.948949 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-05fddf26-dcf1-452b-8dbc-d1fff83cf27a req-5dc88f15-78a1-4b71-89e4-1315a061c2d6 tempest-TestShelveInstance-292550524 tempest-TestShelveInstance-292550524-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102993) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:38:17.950546 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-05fddf26-dcf1-452b-8dbc-d1fff83cf27a req-5dc88f15-78a1-4b71-89e4-1315a061c2d6 tempest-TestShelveInstance-292550524 tempest-TestShelveInstance-292550524-project] 10.222.0.62 "GET /v2.0/ports?device_id=b504cdb2-6182-4c24-9b46-6dc0f85da342 HTTP/1.1" status: 200 len: 945 time: 0.0576260 Nov 23 19:38:18.011165 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-05fddf26-dcf1-452b-8dbc-d1fff83cf27a req-fb09f8a7-ec5b-41e4-9ff0-94b1701725b7 tempest-TestShelveInstance-292550524 tempest-TestShelveInstance-292550524-project] 10.222.0.62 "GET /v2.0/security-groups?id=7fe194e6-71c3-47a9-8f36-0dbb24d1f72d&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0537791 Nov 23 19:38:18.011684 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.plugins.ml2.rpc [None req-4bf48ff4-ecfb-4168-8b63-249b8c6e9f04 None None] Device bbafb0bb-163c-43f4-8d2c-2f5304e0bd04 up at agent hyperv_hv-cinder-81901 {{(pid=102994) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 23 19:38:18.135517 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.db.provisioning_blocks [None req-4bf48ff4-ecfb-4168-8b63-249b8c6e9f04 None None] Provisioning for port bbafb0bb-163c-43f4-8d2c-2f5304e0bd04 completed by entity L2. {{(pid=102994) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 23 19:38:18.140051 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.db.provisioning_blocks [None req-4bf48ff4-ecfb-4168-8b63-249b8c6e9f04 None None] Provisioning complete for port bbafb0bb-163c-43f4-8d2c-2f5304e0bd04 triggered by entity L2. {{(pid=102994) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 23 19:38:18.140603 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron_lib.callbacks.manager [None req-4bf48ff4-ecfb-4168-8b63-249b8c6e9f04 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-8355713'] for port, provisioning_complete {{(pid=102994) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:38:18.232679 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron_lib.callbacks.manager [None req-4bf48ff4-ecfb-4168-8b63-249b8c6e9f04 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7921281'] for port, before_update {{(pid=102994) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:38:18.258644 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'b504cdb2-6182-4c24-9b46-6dc0f85da342', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'bbafb0bb-163c-43f4-8d2c-2f5304e0bd04'}] {{(pid=102994) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 23 19:38:18.260967 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.62/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}09a7511da0d2ba1d728b27e36a8467ec5289399952f0059588048a7cb66d3a43" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-dad043f5-bfe2-4af1-ac12-89f944bb4fb0" -d '{"events": [{"server_uuid": "b504cdb2-6182-4c24-9b46-6dc0f85da342", "name": "network-vif-plugged", "status": "completed", "tag": "bbafb0bb-163c-43f4-8d2c-2f5304e0bd04"}]}' {{(pid=102994) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 23 19:38:18.281753 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.plugins.ml2.db [None req-4bf48ff4-ecfb-4168-8b63-249b8c6e9f04 None None] For port bbafb0bb-163c-43f4-8d2c-2f5304e0bd04, host hv-cinder-81901, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81901',level=0,port_id=bbafb0bb-163c-43f4-8d2c-2f5304e0bd04,segment=NetworkSegment(5c30b9a1-7b41-4664-aa24-084baf66a2d5),segment_id=5c30b9a1-7b41-4664-aa24-084baf66a2d5)] {{(pid=102994) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 23 19:38:18.311020 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 23 Nov 2021 19:38:18 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-1e06e0c0-708e-4bd6-be77-3ac5086ad5ad x-openstack-request-id: req-1e06e0c0-708e-4bd6-be77-3ac5086ad5ad {{(pid=102994) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 23 19:38:18.311340 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "b504cdb2-6182-4c24-9b46-6dc0f85da342", "name": "network-vif-plugged", "status": "completed", "tag": "bbafb0bb-163c-43f4-8d2c-2f5304e0bd04", "code": 200}]} {{(pid=102994) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 23 19:38:18.311606 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.62/compute/v2.1/os-server-external-events used request id req-1e06e0c0-708e-4bd6-be77-3ac5086ad5ad {{(pid=102994) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 23 19:38:18.312007 dv-cinder-819011-1-iscsi neutron-server[102994]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'b504cdb2-6182-4c24-9b46-6dc0f85da342', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'bbafb0bb-163c-43f4-8d2c-2f5304e0bd04', 'code': 200} Nov 23 19:38:18.375365 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron_lib.callbacks.manager [None req-4bf48ff4-ecfb-4168-8b63-249b8c6e9f04 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7918660', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-15067', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560168', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8783631423946', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8783631008732', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8783631008750'] for port, after_update {{(pid=102994) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:38:18.427148 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4bf48ff4-ecfb-4168-8b63-249b8c6e9f04 None None] Pushing event updated for resources: {'Port': ['ID=bbafb0bb-163c-43f4-8d2c-2f5304e0bd04,revision_number=5']} {{(pid=102994) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 23 19:38:18.877820 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-90c53c60-895d-405b-b96e-4b3894bcec14 req-61e0cfa1-905d-4d6f-9f26-d848aa711053 tempest-TestMinimumBasicScenario-716536904 tempest-TestMinimumBasicScenario-716536904-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102993) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:38:18.879609 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-90c53c60-895d-405b-b96e-4b3894bcec14 req-61e0cfa1-905d-4d6f-9f26-d848aa711053 tempest-TestMinimumBasicScenario-716536904 tempest-TestMinimumBasicScenario-716536904-project] 10.222.0.62 "GET /v2.0/ports?device_id=b5fed716-ff16-48c0-8e89-95731739f55c HTTP/1.1" status: 200 len: 931 time: 0.0534682 Nov 23 19:38:18.930809 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-90c53c60-895d-405b-b96e-4b3894bcec14 req-94194289-6fa5-4c88-af94-e4aa3536dc0a tempest-TestMinimumBasicScenario-716536904 tempest-TestMinimumBasicScenario-716536904-project] 10.222.0.62 "GET /v2.0/security-groups?id=d09b4044-91d5-4432-9faa-4b7a40b1627d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0448136 Nov 23 19:38:19.012032 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-c6764308-852f-4422-8068-ea95c27d1fdb req-da1251cd-820c-446c-9fde-38f81a6d565a tempest-AttachVolumeShelveTestJSON-1172915835 tempest-AttachVolumeShelveTestJSON-1172915835-project] 10.222.0.62 "GET /v2.0/ports?device_id=627eaac3-8c43-4aa3-a81c-7a6bfb58dbb5 HTTP/1.1" status: 200 len: 210 time: 0.0275371 Nov 23 19:38:19.150780 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a785d46f-fd5c-43a6-936e-40a641bcffea req-fc30f9f4-c683-48d3-ab73-b535b0e82eeb tempest-TestShelveInstance-292550524 tempest-TestShelveInstance-292550524-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102993) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:38:19.152269 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-a785d46f-fd5c-43a6-936e-40a641bcffea req-fc30f9f4-c683-48d3-ab73-b535b0e82eeb tempest-TestShelveInstance-292550524 tempest-TestShelveInstance-292550524-project] 10.222.0.62 "GET /v2.0/ports?device_id=b504cdb2-6182-4c24-9b46-6dc0f85da342 HTTP/1.1" status: 200 len: 946 time: 0.0524414 Nov 23 19:38:19.203149 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-a785d46f-fd5c-43a6-936e-40a641bcffea req-9bbe1e85-98eb-4078-93d4-0fcd0a2478b6 tempest-TestShelveInstance-292550524 tempest-TestShelveInstance-292550524-project] 10.222.0.62 "GET /v2.0/security-groups?id=7fe194e6-71c3-47a9-8f36-0dbb24d1f72d&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0444903 Nov 23 19:38:20.261749 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3b997a8b-611f-4f07-88bf-1655f35450f7 req-0d782e54-44a6-42fe-ba4f-fc4a5f725453 tempest-TestMinimumBasicScenario-716536904 tempest-TestMinimumBasicScenario-716536904-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102993) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:38:20.263193 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-3b997a8b-611f-4f07-88bf-1655f35450f7 req-0d782e54-44a6-42fe-ba4f-fc4a5f725453 tempest-TestMinimumBasicScenario-716536904 tempest-TestMinimumBasicScenario-716536904-project] 10.222.0.62 "GET /v2.0/ports?device_id=b5fed716-ff16-48c0-8e89-95731739f55c HTTP/1.1" status: 200 len: 931 time: 0.2606661 Nov 23 19:38:20.314779 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-3b997a8b-611f-4f07-88bf-1655f35450f7 req-1bdfecae-da4a-4217-a1ad-aac1dbed843d tempest-TestMinimumBasicScenario-716536904 tempest-TestMinimumBasicScenario-716536904-project] 10.222.0.62 "GET /v2.0/security-groups?id=d09b4044-91d5-4432-9faa-4b7a40b1627d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0440481 Nov 23 19:38:20.397262 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-0f55e4ad-2f11-492c-af35-bc3e6daab325 req-57c1413a-0f47-48fd-ae79-da8cded21314 tempest-AttachVolumeShelveTestJSON-1172915835 tempest-AttachVolumeShelveTestJSON-1172915835-project] 10.222.0.62 "GET /v2.0/ports?device_id=627eaac3-8c43-4aa3-a81c-7a6bfb58dbb5 HTTP/1.1" status: 200 len: 210 time: 0.0282025 Nov 23 19:38:20.508413 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a768f0f1-1d10-4c41-8857-555d46000a06 req-2881a5bd-1d97-48f0-a76a-182045136d5b tempest-TestShelveInstance-292550524 tempest-TestShelveInstance-292550524-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102993) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:38:20.510089 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-a768f0f1-1d10-4c41-8857-555d46000a06 req-2881a5bd-1d97-48f0-a76a-182045136d5b tempest-TestShelveInstance-292550524 tempest-TestShelveInstance-292550524-project] 10.222.0.62 "GET /v2.0/ports?device_id=b504cdb2-6182-4c24-9b46-6dc0f85da342 HTTP/1.1" status: 200 len: 946 time: 0.0539708 Nov 23 19:38:20.564568 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-a768f0f1-1d10-4c41-8857-555d46000a06 req-49628900-50b3-471f-a94c-66fd5d9a049c tempest-TestShelveInstance-292550524 tempest-TestShelveInstance-292550524-project] 10.222.0.62 "GET /v2.0/security-groups?id=7fe194e6-71c3-47a9-8f36-0dbb24d1f72d&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0480986 Nov 23 19:38:21.432403 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5739dca8-bbb1-4e2f-ae31-1b3c9ca0f790 req-597e8bb2-4807-4540-b452-7595c470180e tempest-TestMinimumBasicScenario-716536904 tempest-TestMinimumBasicScenario-716536904-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102993) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:38:21.433993 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-5739dca8-bbb1-4e2f-ae31-1b3c9ca0f790 req-597e8bb2-4807-4540-b452-7595c470180e tempest-TestMinimumBasicScenario-716536904 tempest-TestMinimumBasicScenario-716536904-project] 10.222.0.62 "GET /v2.0/ports?device_id=b5fed716-ff16-48c0-8e89-95731739f55c HTTP/1.1" status: 200 len: 931 time: 0.0525224 Nov 23 19:38:21.488036 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-5739dca8-bbb1-4e2f-ae31-1b3c9ca0f790 req-e3567ac4-9112-4b66-98db-8600ec7c3688 tempest-TestMinimumBasicScenario-716536904 tempest-TestMinimumBasicScenario-716536904-project] 10.222.0.62 "GET /v2.0/security-groups?id=d09b4044-91d5-4432-9faa-4b7a40b1627d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0474575 Nov 23 19:38:21.587882 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-9c030b5e-61ef-4173-967f-b23ab7f3a3fc req-5e4995ec-8642-48c0-9000-7b7e46e10f32 tempest-AttachVolumeShelveTestJSON-1172915835 tempest-AttachVolumeShelveTestJSON-1172915835-project] 10.222.0.62 "GET /v2.0/ports?device_id=627eaac3-8c43-4aa3-a81c-7a6bfb58dbb5 HTTP/1.1" status: 200 len: 210 time: 0.0331268 Nov 23 19:38:21.716731 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-81f9264b-ad92-4c62-882c-0e67acb6eaf2 req-3b8aee58-23fd-4b10-adce-5e3a54313ea5 tempest-TestShelveInstance-292550524 tempest-TestShelveInstance-292550524-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102993) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:38:21.718791 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-81f9264b-ad92-4c62-882c-0e67acb6eaf2 req-3b8aee58-23fd-4b10-adce-5e3a54313ea5 tempest-TestShelveInstance-292550524 tempest-TestShelveInstance-292550524-project] 10.222.0.62 "GET /v2.0/ports?device_id=b504cdb2-6182-4c24-9b46-6dc0f85da342 HTTP/1.1" status: 200 len: 946 time: 0.0619895 Nov 23 19:38:21.790765 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-81f9264b-ad92-4c62-882c-0e67acb6eaf2 req-6a1ed1d9-015a-4462-baf5-a5ece6f4fe15 tempest-TestShelveInstance-292550524 tempest-TestShelveInstance-292550524-project] 10.222.0.62 "GET /v2.0/security-groups?id=7fe194e6-71c3-47a9-8f36-0dbb24d1f72d&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0581186 Nov 23 19:38:22.621430 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b01ddcac-9b3a-4884-94a6-2733162f47af req-2c11b463-7b99-442e-a33c-8e34523c7935 tempest-TestMinimumBasicScenario-716536904 tempest-TestMinimumBasicScenario-716536904-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102993) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:38:22.628354 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-b01ddcac-9b3a-4884-94a6-2733162f47af req-2c11b463-7b99-442e-a33c-8e34523c7935 tempest-TestMinimumBasicScenario-716536904 tempest-TestMinimumBasicScenario-716536904-project] 10.222.0.62 "GET /v2.0/ports?device_id=b5fed716-ff16-48c0-8e89-95731739f55c HTTP/1.1" status: 200 len: 931 time: 0.0581431 Nov 23 19:38:22.674782 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-b01ddcac-9b3a-4884-94a6-2733162f47af req-b532e548-fe2d-418c-9364-a6e05430ee1b tempest-TestMinimumBasicScenario-716536904 tempest-TestMinimumBasicScenario-716536904-project] 10.222.0.62 "GET /v2.0/security-groups?id=d09b4044-91d5-4432-9faa-4b7a40b1627d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0443037 Nov 23 19:38:22.760143 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-da7bdc67-f64d-4596-90b1-3213fc40307d req-7342b73e-abc3-4721-9a2c-fd509a60aeeb tempest-AttachVolumeShelveTestJSON-1172915835 tempest-AttachVolumeShelveTestJSON-1172915835-project] 10.222.0.62 "GET /v2.0/ports?device_id=627eaac3-8c43-4aa3-a81c-7a6bfb58dbb5 HTTP/1.1" status: 200 len: 210 time: 0.0276170 Nov 23 19:38:22.927598 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5f2bb379-eaee-453c-9426-f709d1225e1e req-1539aad2-adc4-417c-a6b3-05ddc78e50dc tempest-TestShelveInstance-292550524 tempest-TestShelveInstance-292550524-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102993) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:38:22.929240 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-5f2bb379-eaee-453c-9426-f709d1225e1e req-1539aad2-adc4-417c-a6b3-05ddc78e50dc tempest-TestShelveInstance-292550524 tempest-TestShelveInstance-292550524-project] 10.222.0.62 "GET /v2.0/ports?device_id=b504cdb2-6182-4c24-9b46-6dc0f85da342 HTTP/1.1" status: 200 len: 946 time: 0.0579312 Nov 23 19:38:22.981881 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-5f2bb379-eaee-453c-9426-f709d1225e1e req-255772e6-6da5-478f-b146-0ea31cd37ddb tempest-TestShelveInstance-292550524 tempest-TestShelveInstance-292550524-project] 10.222.0.62 "GET /v2.0/security-groups?id=7fe194e6-71c3-47a9-8f36-0dbb24d1f72d&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0465317 Nov 23 19:38:23.797255 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7daa419e-c2c7-481c-bca5-dbc8f67b12bd req-23ebda27-41d0-43a4-a15a-4af1ce208c25 tempest-TestMinimumBasicScenario-716536904 tempest-TestMinimumBasicScenario-716536904-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102993) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:38:23.799531 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-7daa419e-c2c7-481c-bca5-dbc8f67b12bd req-23ebda27-41d0-43a4-a15a-4af1ce208c25 tempest-TestMinimumBasicScenario-716536904 tempest-TestMinimumBasicScenario-716536904-project] 10.222.0.62 "GET /v2.0/ports?device_id=b5fed716-ff16-48c0-8e89-95731739f55c HTTP/1.1" status: 200 len: 931 time: 0.0520258 Nov 23 19:38:23.857676 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-7daa419e-c2c7-481c-bca5-dbc8f67b12bd req-0d1c9dd6-38da-48d2-a3a6-34ca3f5c74b6 tempest-TestMinimumBasicScenario-716536904 tempest-TestMinimumBasicScenario-716536904-project] 10.222.0.62 "GET /v2.0/security-groups?id=d09b4044-91d5-4432-9faa-4b7a40b1627d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0452011 Nov 23 19:38:23.941592 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-63d65934-d8ef-4dcc-9a3c-a95c3c49f782 req-cd9fc273-2892-423f-863d-13dc57528fb0 tempest-AttachVolumeShelveTestJSON-1172915835 tempest-AttachVolumeShelveTestJSON-1172915835-project] 10.222.0.62 "GET /v2.0/ports?device_id=627eaac3-8c43-4aa3-a81c-7a6bfb58dbb5 HTTP/1.1" status: 200 len: 210 time: 0.0264266 Nov 23 19:38:24.111684 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7f66f678-a1fb-4da4-8d13-eaf642ef8e2c req-2de156ad-c8e4-42c3-8b5f-ab5f4c11b0a7 tempest-TestShelveInstance-292550524 tempest-TestShelveInstance-292550524-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102993) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:38:24.113166 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-7f66f678-a1fb-4da4-8d13-eaf642ef8e2c req-2de156ad-c8e4-42c3-8b5f-ab5f4c11b0a7 tempest-TestShelveInstance-292550524 tempest-TestShelveInstance-292550524-project] 10.222.0.62 "GET /v2.0/ports?device_id=b504cdb2-6182-4c24-9b46-6dc0f85da342 HTTP/1.1" status: 200 len: 946 time: 0.0605567 Nov 23 19:38:24.166337 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-7f66f678-a1fb-4da4-8d13-eaf642ef8e2c req-5ab7ccc4-ca82-41be-9383-a9da177427fc tempest-TestShelveInstance-292550524 tempest-TestShelveInstance-292550524-project] 10.222.0.62 "GET /v2.0/security-groups?id=7fe194e6-71c3-47a9-8f36-0dbb24d1f72d&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0462844 Nov 23 19:38:24.978127 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8d0e291a-3253-4030-80a5-a022e2608c35 req-af98d6b2-39a7-4db7-85a3-a2b13b9f3f7b tempest-TestMinimumBasicScenario-716536904 tempest-TestMinimumBasicScenario-716536904-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102993) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:38:24.979686 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-8d0e291a-3253-4030-80a5-a022e2608c35 req-af98d6b2-39a7-4db7-85a3-a2b13b9f3f7b tempest-TestMinimumBasicScenario-716536904 tempest-TestMinimumBasicScenario-716536904-project] 10.222.0.62 "GET /v2.0/ports?device_id=b5fed716-ff16-48c0-8e89-95731739f55c HTTP/1.1" status: 200 len: 931 time: 0.0519748 Nov 23 19:38:25.033461 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-8d0e291a-3253-4030-80a5-a022e2608c35 req-8dbdedf4-2c6f-4867-a388-634345c0b8bc tempest-TestMinimumBasicScenario-716536904 tempest-TestMinimumBasicScenario-716536904-project] 10.222.0.62 "GET /v2.0/security-groups?id=d09b4044-91d5-4432-9faa-4b7a40b1627d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0453968 Nov 23 19:38:25.120060 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-a7c50b52-eb0f-4450-a6e0-a85dc1e29b71 req-0371d8c5-445e-4429-83be-7a1d1c2c33f4 tempest-AttachVolumeShelveTestJSON-1172915835 tempest-AttachVolumeShelveTestJSON-1172915835-project] 10.222.0.62 "GET /v2.0/ports?device_id=627eaac3-8c43-4aa3-a81c-7a6bfb58dbb5 HTTP/1.1" status: 200 len: 210 time: 0.0283647 Nov 23 19:38:25.286458 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-385539a5-3181-465d-95cb-5a26328969ca req-50bd3af0-ce1b-41cc-9211-69a6b6699310 tempest-TestShelveInstance-292550524 tempest-TestShelveInstance-292550524-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102993) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:38:25.287927 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-385539a5-3181-465d-95cb-5a26328969ca req-50bd3af0-ce1b-41cc-9211-69a6b6699310 tempest-TestShelveInstance-292550524 tempest-TestShelveInstance-292550524-project] 10.222.0.62 "GET /v2.0/ports?device_id=b504cdb2-6182-4c24-9b46-6dc0f85da342 HTTP/1.1" status: 200 len: 946 time: 0.0540376 Nov 23 19:38:25.337685 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-385539a5-3181-465d-95cb-5a26328969ca req-3154c340-4f32-43fc-8e67-a7f2aee48a6e tempest-TestShelveInstance-292550524 tempest-TestShelveInstance-292550524-project] 10.222.0.62 "GET /v2.0/security-groups?id=7fe194e6-71c3-47a9-8f36-0dbb24d1f72d&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0437412 Nov 23 19:38:26.001707 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.api.v2.base [req-25d70870-677f-4316-b6d5-56864df3f7fd req-64513f9e-5b66-432d-8c19-52080cfc8708 service neutron] Request body: {'port': {'device_id': 'b5fed716-ff16-48c0-8e89-95731739f55c', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-81901'}} {{(pid=102993) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 23 19:38:26.061289 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [req-25d70870-677f-4316-b6d5-56864df3f7fd req-64513f9e-5b66-432d-8c19-52080cfc8708 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7921281'] for port, before_update {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:38:26.214691 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5b2a1396-ceb5-473a-a575-a98dd9f7eca8 req-0b85b0c8-04bb-49f0-b841-9acf92333e51 tempest-TestMinimumBasicScenario-716536904 tempest-TestMinimumBasicScenario-716536904-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102993) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:38:26.216200 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-5b2a1396-ceb5-473a-a575-a98dd9f7eca8 req-0b85b0c8-04bb-49f0-b841-9acf92333e51 tempest-TestMinimumBasicScenario-716536904 tempest-TestMinimumBasicScenario-716536904-project] 10.222.0.62 "GET /v2.0/ports?device_id=b5fed716-ff16-48c0-8e89-95731739f55c HTTP/1.1" status: 200 len: 931 time: 0.1141164 Nov 23 19:38:26.303302 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-765aab54-b433-4725-b6cc-6afa38fe610a req-c221d0c1-04d0-45a6-9db5-a0da47a1db5c tempest-AttachVolumeShelveTestJSON-1172915835 tempest-AttachVolumeShelveTestJSON-1172915835-project] 10.222.0.62 "GET /v2.0/ports?device_id=627eaac3-8c43-4aa3-a81c-7a6bfb58dbb5 HTTP/1.1" status: 200 len: 210 time: 0.0956991 Nov 23 19:38:26.325658 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-5b2a1396-ceb5-473a-a575-a98dd9f7eca8 req-6d3f4ecf-db89-4a3c-a63e-57e5d67f11a5 tempest-TestMinimumBasicScenario-716536904 tempest-TestMinimumBasicScenario-716536904-project] 10.222.0.62 "GET /v2.0/security-groups?id=d09b4044-91d5-4432-9faa-4b7a40b1627d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1003208 Nov 23 19:38:26.411434 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.notifiers.nova [req-25d70870-677f-4316-b6d5-56864df3f7fd req-64513f9e-5b66-432d-8c19-52080cfc8708 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 733eac81-0446-4e4c-b1d5-b8c491dcbeb4 {{(pid=102993) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 23 19:38:26.419374 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [req-25d70870-677f-4316-b6d5-56864df3f7fd req-64513f9e-5b66-432d-8c19-52080cfc8708 service neutron] Publish callbacks [] for port, precommit_update {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:38:26.432744 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.db.provisioning_blocks [req-25d70870-677f-4316-b6d5-56864df3f7fd req-64513f9e-5b66-432d-8c19-52080cfc8708 service neutron] Transition to ACTIVE for port object 733eac81-0446-4e4c-b1d5-b8c491dcbeb4 will not be triggered until provisioned by entity L2. {{(pid=102993) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 23 19:38:26.463317 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4fe16625-7b6c-4c84-ab4d-53a2ce89baf9 req-a3df7b96-471b-421f-b5f4-db2ca69774d0 tempest-TestShelveInstance-292550524 tempest-TestShelveInstance-292550524-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102992) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:38:26.464830 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-4fe16625-7b6c-4c84-ab4d-53a2ce89baf9 req-a3df7b96-471b-421f-b5f4-db2ca69774d0 tempest-TestShelveInstance-292550524 tempest-TestShelveInstance-292550524-project] 10.222.0.62 "GET /v2.0/ports?device_id=b504cdb2-6182-4c24-9b46-6dc0f85da342 HTTP/1.1" status: 200 len: 946 time: 0.0553627 Nov 23 19:38:26.495023 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [req-25d70870-677f-4316-b6d5-56864df3f7fd req-64513f9e-5b66-432d-8c19-52080cfc8708 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7918660', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-15067', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560168', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8783631423946', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8783631008732', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8783631008750', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-17257505'] for port, after_update {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:38:26.538326 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a76da18c-f72e-4580-98fa-ea0e306675b1 req-f54a6052-ca3c-4ada-8032-e9662b08bc76 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102992) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:38:26.540655 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-a76da18c-f72e-4580-98fa-ea0e306675b1 req-f54a6052-ca3c-4ada-8032-e9662b08bc76 service neutron] 10.222.0.41 "GET /v2.0/ports?device_id=b504cdb2-6182-4c24-9b46-6dc0f85da342 HTTP/1.1" status: 200 len: 1099 time: 0.0723326 Nov 23 19:38:26.551904 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-4fe16625-7b6c-4c84-ab4d-53a2ce89baf9 req-f55c6236-7700-4534-91d1-22553131095d tempest-TestShelveInstance-292550524 tempest-TestShelveInstance-292550524-project] 10.222.0.62 "GET /v2.0/security-groups?id=7fe194e6-71c3-47a9-8f36-0dbb24d1f72d&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0754008 Nov 23 19:38:26.569187 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-64513f9e-5b66-432d-8c19-52080cfc8708 service neutron] Pushing event updated for resources: {'Port': ['ID=733eac81-0446-4e4c-b1d5-b8c491dcbeb4,revision_number=2']} {{(pid=102993) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 23 19:38:26.589130 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-64513f9e-5b66-432d-8c19-52080cfc8708 service neutron] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-819011-1-iscsi {{(pid=102993) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 23 19:38:26.589518 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-64513f9e-5b66-432d-8c19-52080cfc8708 service neutron] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-819011-1-iscsi {{(pid=102993) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 23 19:38:26.589887 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-64513f9e-5b66-432d-8c19-52080cfc8708 service neutron] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-819011-1-iscsi {{(pid=102993) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 23 19:38:26.590229 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-64513f9e-5b66-432d-8c19-52080cfc8708 service neutron] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-819011-1-iscsi {{(pid=102993) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 23 19:38:26.590569 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-64513f9e-5b66-432d-8c19-52080cfc8708 service neutron] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-819011-1-iscsi {{(pid=102993) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 23 19:38:26.590896 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-64513f9e-5b66-432d-8c19-52080cfc8708 service neutron] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-819011-1-iscsi {{(pid=102993) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 23 19:38:26.591265 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-64513f9e-5b66-432d-8c19-52080cfc8708 service neutron] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-819011-1-iscsi {{(pid=102993) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 23 19:38:26.591627 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-64513f9e-5b66-432d-8c19-52080cfc8708 service neutron] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-819011-1-iscsi {{(pid=102993) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 23 19:38:26.591963 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-64513f9e-5b66-432d-8c19-52080cfc8708 service neutron] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-819011-1-iscsi {{(pid=102993) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 23 19:38:26.592291 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-64513f9e-5b66-432d-8c19-52080cfc8708 service neutron] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-819011-1-iscsi {{(pid=102993) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 23 19:38:26.592620 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-64513f9e-5b66-432d-8c19-52080cfc8708 service neutron] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-819011-1-iscsi {{(pid=102993) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 23 19:38:26.592949 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-64513f9e-5b66-432d-8c19-52080cfc8708 service neutron] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-819011-1-iscsi {{(pid=102993) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 23 19:38:26.607140 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-a76da18c-f72e-4580-98fa-ea0e306675b1 req-2bf59fcb-0fe9-451b-aabf-f65fdd923d44 service neutron] 10.222.0.41 "GET /v2.0/security-groups?id=7fe194e6-71c3-47a9-8f36-0dbb24d1f72d&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0539801 Nov 23 19:38:26.643946 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.plugins.ml2.managers [req-25d70870-677f-4316-b6d5-56864df3f7fd req-64513f9e-5b66-432d-8c19-52080cfc8708 service neutron] Attempting to bind port 733eac81-0446-4e4c-b1d5-b8c491dcbeb4 on host hv-cinder-81901 for vnic_type normal with profile {{(pid=102993) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 23 19:38:26.644280 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.plugins.ml2.managers [req-25d70870-677f-4316-b6d5-56864df3f7fd req-64513f9e-5b66-432d-8c19-52080cfc8708 service neutron] Attempting to bind port 733eac81-0446-4e4c-b1d5-b8c491dcbeb4 by drivers openvswitch,hyperv on host hv-cinder-81901 at level 0 using segments [{'id': '81f92f0c-ea8d-4880-af1c-e4418f898de3', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 816, 'network_id': '96f89427-8150-464f-a280-f07cf823b4fd'}] {{(pid=102993) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 23 19:38:26.644606 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-25d70870-677f-4316-b6d5-56864df3f7fd req-64513f9e-5b66-432d-8c19-52080cfc8708 service neutron] Attempting to bind port 733eac81-0446-4e4c-b1d5-b8c491dcbeb4 on network 96f89427-8150-464f-a280-f07cf823b4fd {{(pid=102993) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 23 19:38:26.649141 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-25d70870-677f-4316-b6d5-56864df3f7fd req-64513f9e-5b66-432d-8c19-52080cfc8708 service neutron] Port 733eac81-0446-4e4c-b1d5-b8c491dcbeb4 on network 96f89427-8150-464f-a280-f07cf823b4fd not bound, no agent of type Open vSwitch agent registered on host hv-cinder-81901 {{(pid=102993) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Nov 23 19:38:26.649487 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-25d70870-677f-4316-b6d5-56864df3f7fd req-64513f9e-5b66-432d-8c19-52080cfc8708 service neutron] Attempting to bind port 733eac81-0446-4e4c-b1d5-b8c491dcbeb4 on network 96f89427-8150-464f-a280-f07cf823b4fd {{(pid=102993) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 23 19:38:26.654642 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-25d70870-677f-4316-b6d5-56864df3f7fd req-64513f9e-5b66-432d-8c19-52080cfc8708 service neutron] Checking agent: {'id': '14e5d049-431d-466a-8d1c-264e5129d376', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-81901', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 23, 19, 31, 29), 'started_at': datetime.datetime(2021, 11, 23, 19, 31, 29), 'heartbeat_timestamp': datetime.datetime(2021, 11, 23, 19, 38), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=102993) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 23 19:38:26.654841 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-25d70870-677f-4316-b6d5-56864df3f7fd req-64513f9e-5b66-432d-8c19-52080cfc8708 service neutron] Checking segment: {'id': '81f92f0c-ea8d-4880-af1c-e4418f898de3', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 816, 'network_id': '96f89427-8150-464f-a280-f07cf823b4fd'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102993) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 23 19:38:26.659312 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-25d70870-677f-4316-b6d5-56864df3f7fd req-64513f9e-5b66-432d-8c19-52080cfc8708 service neutron] Bound using segment: {'id': '81f92f0c-ea8d-4880-af1c-e4418f898de3', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 816, 'network_id': '96f89427-8150-464f-a280-f07cf823b4fd'} {{(pid=102993) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 23 19:38:26.659312 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.plugins.ml2.managers [req-25d70870-677f-4316-b6d5-56864df3f7fd req-64513f9e-5b66-432d-8c19-52080cfc8708 service neutron] Bound port: 733eac81-0446-4e4c-b1d5-b8c491dcbeb4, host: hv-cinder-81901, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '81f92f0c-ea8d-4880-af1c-e4418f898de3', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 816, 'network_id': '96f89427-8150-464f-a280-f07cf823b4fd'}}] {{(pid=102993) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 23 19:38:26.659312 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [req-25d70870-677f-4316-b6d5-56864df3f7fd req-64513f9e-5b66-432d-8c19-52080cfc8708 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7921281'] for port, before_update {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:38:26.722517 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.plugins.ml2.db [req-25d70870-677f-4316-b6d5-56864df3f7fd req-64513f9e-5b66-432d-8c19-52080cfc8708 service neutron] For port 733eac81-0446-4e4c-b1d5-b8c491dcbeb4, host hv-cinder-81901, cleared binding levels {{(pid=102993) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 23 19:38:26.725526 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.plugins.ml2.db [req-25d70870-677f-4316-b6d5-56864df3f7fd req-64513f9e-5b66-432d-8c19-52080cfc8708 service neutron] For port 733eac81-0446-4e4c-b1d5-b8c491dcbeb4, host hv-cinder-81901, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81901',level=0,port_id=733eac81-0446-4e4c-b1d5-b8c491dcbeb4,segment=NetworkSegment(81f92f0c-ea8d-4880-af1c-e4418f898de3),segment_id=81f92f0c-ea8d-4880-af1c-e4418f898de3)] {{(pid=102993) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 23 19:38:26.809691 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [req-25d70870-677f-4316-b6d5-56864df3f7fd req-64513f9e-5b66-432d-8c19-52080cfc8708 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7918660', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-15067', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560168', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8783631423946', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8783631008732', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8783631008750', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-17257505'] for port, after_update {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:38:26.847912 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-25d70870-677f-4316-b6d5-56864df3f7fd req-64513f9e-5b66-432d-8c19-52080cfc8708 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102993) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:38:26.848525 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [req-25d70870-677f-4316-b6d5-56864df3f7fd req-64513f9e-5b66-432d-8c19-52080cfc8708 service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-514902'] for port, before_response {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:38:26.849923 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-25d70870-677f-4316-b6d5-56864df3f7fd req-64513f9e-5b66-432d-8c19-52080cfc8708 service neutron] 10.222.0.41 "PUT /v2.0/ports/733eac81-0446-4e4c-b1d5-b8c491dcbeb4 HTTP/1.1" status: 200 len: 1093 time: 0.8527465 Nov 23 19:38:26.850362 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'b5fed716-ff16-48c0-8e89-95731739f55c', 'tag': '733eac81-0446-4e4c-b1d5-b8c491dcbeb4'}] {{(pid=102993) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 23 19:38:26.852576 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.62/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}9b10b92acbee16fb695be1efeed0b68f7c36a5b215ec004a8d9d707fa3d35b2c" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-38fecfde-d3a3-4d5b-8400-7c5fb0c2aadb" -d '{"events": [{"name": "network-changed", "server_uuid": "b5fed716-ff16-48c0-8e89-95731739f55c", "tag": "733eac81-0446-4e4c-b1d5-b8c491dcbeb4"}]}' {{(pid=102993) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 23 19:38:26.878046 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-64513f9e-5b66-432d-8c19-52080cfc8708 service neutron] Pushing event updated for resources: {'Port': ['ID=733eac81-0446-4e4c-b1d5-b8c491dcbeb4,revision_number=3']} {{(pid=102993) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 23 19:38:26.895722 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Tue, 23 Nov 2021 19:38:26 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-0acec17f-b513-4e43-a189-9ea1846de1e4 x-openstack-request-id: req-0acec17f-b513-4e43-a189-9ea1846de1e4 {{(pid=102993) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 23 19:38:26.896013 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "b5fed716-ff16-48c0-8e89-95731739f55c", "tag": "733eac81-0446-4e4c-b1d5-b8c491dcbeb4", "status": "completed", "code": 200}]} {{(pid=102993) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 23 19:38:26.896265 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.62/compute/v2.1/os-server-external-events used request id req-0acec17f-b513-4e43-a189-9ea1846de1e4 {{(pid=102993) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 23 19:38:26.896657 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'b5fed716-ff16-48c0-8e89-95731739f55c', 'tag': '733eac81-0446-4e4c-b1d5-b8c491dcbeb4', 'status': 'completed', 'code': 200} Nov 23 19:38:26.963539 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-38fecfde-d3a3-4d5b-8400-7c5fb0c2aadb req-637806ba-c7d5-4d08-8e5d-79a6306ef0ba service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102993) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:38:26.965061 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-38fecfde-d3a3-4d5b-8400-7c5fb0c2aadb req-637806ba-c7d5-4d08-8e5d-79a6306ef0ba service neutron] 10.222.0.41 "GET /v2.0/ports?tenant_id=ed0d906c96b540a7b11d508615543890&device_id=b5fed716-ff16-48c0-8e89-95731739f55c HTTP/1.1" status: 200 len: 1096 time: 0.0437388 Nov 23 19:38:27.073013 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-38fecfde-d3a3-4d5b-8400-7c5fb0c2aadb req-7c31b8f4-302a-4ed0-9604-1ae5372a52db service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102993) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:38:27.074536 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-38fecfde-d3a3-4d5b-8400-7c5fb0c2aadb req-7c31b8f4-302a-4ed0-9604-1ae5372a52db service neutron] 10.222.0.41 "GET /v2.0/networks?tenant_id=ed0d906c96b540a7b11d508615543890&shared=False HTTP/1.1" status: 200 len: 915 time: 0.0976512 Nov 23 19:38:27.183078 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-38fecfde-d3a3-4d5b-8400-7c5fb0c2aadb req-e86a9d1a-92c6-4c3c-bb73-922e6f3e5311 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102993) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:38:27.184647 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-38fecfde-d3a3-4d5b-8400-7c5fb0c2aadb req-e86a9d1a-92c6-4c3c-bb73-922e6f3e5311 service neutron] 10.222.0.41 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 870 time: 0.0949047 Nov 23 19:38:27.262874 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-25d70870-677f-4316-b6d5-56864df3f7fd req-2bc0eb54-bcbe-4077-b3f3-62ff1b8df321 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102993) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:38:27.264338 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-25d70870-677f-4316-b6d5-56864df3f7fd req-2bc0eb54-bcbe-4077-b3f3-62ff1b8df321 service neutron] 10.222.0.41 "GET /v2.0/ports?tenant_id=ed0d906c96b540a7b11d508615543890&device_id=b5fed716-ff16-48c0-8e89-95731739f55c HTTP/1.1" status: 200 len: 1096 time: 0.0398932 Nov 23 19:38:27.314646 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-25d70870-677f-4316-b6d5-56864df3f7fd req-b3e6d6bc-7734-4dae-9ff8-66a6633e5d44 service neutron] 10.222.0.41 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.7&port_id=733eac81-0446-4e4c-b1d5-b8c491dcbeb4 HTTP/1.1" status: 200 len: 217 time: 0.0374253 Nov 23 19:38:27.372686 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-25d70870-677f-4316-b6d5-56864df3f7fd req-d1778317-a204-4f71-8f5e-e4b631af5c67 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102993) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:38:27.374427 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-25d70870-677f-4316-b6d5-56864df3f7fd req-d1778317-a204-4f71-8f5e-e4b631af5c67 service neutron] 10.222.0.41 "GET /v2.0/subnets?id=bfa70c12-21c8-4b7f-8a30-da7ff37b80b8 HTTP/1.1" status: 200 len: 853 time: 0.0495925 Nov 23 19:38:27.433874 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-f6ddee59-6b93-4865-bac8-8ac7fc670def req-3bde2480-ca08-403b-b914-dce9cd839a16 tempest-AttachVolumeShelveTestJSON-1172915835 tempest-AttachVolumeShelveTestJSON-1172915835-project] 10.222.0.62 "GET /v2.0/ports?device_id=627eaac3-8c43-4aa3-a81c-7a6bfb58dbb5 HTTP/1.1" status: 200 len: 210 time: 0.0402482 Nov 23 19:38:27.450329 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-25d70870-677f-4316-b6d5-56864df3f7fd req-1668f22c-990f-4213-a4ad-cfd5f5a54eca service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102993) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:38:27.451858 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-25d70870-677f-4316-b6d5-56864df3f7fd req-1668f22c-990f-4213-a4ad-cfd5f5a54eca service neutron] 10.222.0.41 "GET /v2.0/ports?network_id=96f89427-8150-464f-a280-f07cf823b4fd&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0687664 Nov 23 19:38:27.497190 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f4ff229d-24c6-425e-9f3f-06324830fee1 req-3f7da43e-edb7-4c42-8649-5fd8f1c719f6 tempest-AttachVolumeShelveTestJSON-1172915835 tempest-AttachVolumeShelveTestJSON-1172915835-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=102992) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:38:27.498716 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-f4ff229d-24c6-425e-9f3f-06324830fee1 req-3f7da43e-edb7-4c42-8649-5fd8f1c719f6 tempest-AttachVolumeShelveTestJSON-1172915835 tempest-AttachVolumeShelveTestJSON-1172915835-project] 10.222.0.41 "GET /v2.0/networks?id=fc901312-2937-4784-8a6d-c046666e8bf8 HTTP/1.1" status: 200 len: 817 time: 0.1424198 Nov 23 19:38:27.507347 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b26194b0-3d46-4cda-8799-d85b4b0b2ba7 req-3b4a525c-67f7-4686-aaf4-25787b97eded tempest-TestMinimumBasicScenario-716536904 tempest-TestMinimumBasicScenario-716536904-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102992) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:38:27.509037 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-b26194b0-3d46-4cda-8799-d85b4b0b2ba7 req-3b4a525c-67f7-4686-aaf4-25787b97eded tempest-TestMinimumBasicScenario-716536904 tempest-TestMinimumBasicScenario-716536904-project] 10.222.0.62 "GET /v2.0/ports?device_id=b5fed716-ff16-48c0-8e89-95731739f55c HTTP/1.1" status: 200 len: 943 time: 0.0809720 Nov 23 19:38:27.556310 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-25d70870-677f-4316-b6d5-56864df3f7fd req-0a91b84c-7aad-4a03-a169-36c634d1d1f4 service neutron] 10.222.0.41 "GET /v2.0/networks/96f89427-8150-464f-a280-f07cf823b4fd?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0895045 Nov 23 19:38:27.597850 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-b26194b0-3d46-4cda-8799-d85b4b0b2ba7 req-bcb488ed-e27f-4a89-9b43-f9489cf83f11 tempest-TestMinimumBasicScenario-716536904 tempest-TestMinimumBasicScenario-716536904-project] 10.222.0.62 "GET /v2.0/security-groups?id=d09b4044-91d5-4432-9faa-4b7a40b1627d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0827084 Nov 23 19:38:27.604530 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-f4ff229d-24c6-425e-9f3f-06324830fee1 req-e91d7bde-163e-4d7d-b49e-38fe5777fe8d tempest-AttachVolumeShelveTestJSON-1172915835 tempest-AttachVolumeShelveTestJSON-1172915835-project] 10.222.0.41 "GET /v2.0/security-groups?fields=id&fields=name&tenant_id=2d925fb59ba34355aa85758374d76928 HTTP/1.1" status: 200 len: 380 time: 0.0905821 Nov 23 19:38:27.616927 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.api.v2.base [req-f4ff229d-24c6-425e-9f3f-06324830fee1 req-a8bdea6e-9748-49f3-afeb-dc5f61f64b1c tempest-AttachVolumeShelveTestJSON-1172915835 tempest-AttachVolumeShelveTestJSON-1172915835-project] Request body: {'port': {'device_id': '627eaac3-8c43-4aa3-a81c-7a6bfb58dbb5', 'network_id': 'fc901312-2937-4784-8a6d-c046666e8bf8', 'admin_state_up': True, 'tenant_id': '2d925fb59ba34355aa85758374d76928', 'security_groups': ['a246a431-7eb4-441f-b1e6-9c9c351ee888']}} {{(pid=102992) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 23 19:38:27.713367 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-98afbe86-2994-42bb-8366-469f1c1e18c1 req-5a32cec5-eba2-48b7-b146-43c73fde7074 tempest-TestShelveInstance-292550524 tempest-TestShelveInstance-292550524-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102993) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:38:27.714924 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-98afbe86-2994-42bb-8366-469f1c1e18c1 req-5a32cec5-eba2-48b7-b146-43c73fde7074 tempest-TestShelveInstance-292550524 tempest-TestShelveInstance-292550524-project] 10.222.0.62 "GET /v2.0/ports?device_id=b504cdb2-6182-4c24-9b46-6dc0f85da342 HTTP/1.1" status: 200 len: 946 time: 0.0691648 Nov 23 19:38:27.716749 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-25d70870-677f-4316-b6d5-56864df3f7fd req-e842888f-8c42-45ee-a52e-0daad64c1dc3 service neutron] 10.222.0.41 "GET /v2.0/networks/96f89427-8150-464f-a280-f07cf823b4fd?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1500034 Nov 23 19:38:27.768015 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-98afbe86-2994-42bb-8366-469f1c1e18c1 req-99ec0920-b870-4817-9cb9-3afa0f0f0c50 tempest-TestShelveInstance-292550524 tempest-TestShelveInstance-292550524-project] 10.222.0.62 "GET /v2.0/security-groups?id=7fe194e6-71c3-47a9-8f36-0dbb24d1f72d&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0456653 Nov 23 19:38:27.837774 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-f4ff229d-24c6-425e-9f3f-06324830fee1 req-a8bdea6e-9748-49f3-afeb-dc5f61f64b1c tempest-AttachVolumeShelveTestJSON-1172915835 tempest-AttachVolumeShelveTestJSON-1172915835-project] Made reservation on behalf of 2d925fb59ba34355aa85758374d76928 for: {'port': 1} {{(pid=102992) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 23 19:38:27.841535 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [req-f4ff229d-24c6-425e-9f3f-06324830fee1 req-a8bdea6e-9748-49f3-afeb-dc5f61f64b1c tempest-AttachVolumeShelveTestJSON-1172915835 tempest-AttachVolumeShelveTestJSON-1172915835-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7921281'] for port, before_create {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:38:27.973164 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.db.db_base_plugin_common [req-f4ff229d-24c6-425e-9f3f-06324830fee1 req-a8bdea6e-9748-49f3-afeb-dc5f61f64b1c tempest-AttachVolumeShelveTestJSON-1172915835 tempest-AttachVolumeShelveTestJSON-1172915835-project] Allocated IP 172.20.0.11 (fc901312-2937-4784-8a6d-c046666e8bf8/2caca985-6ed6-4ef7-ba49-7b7410bea160/895334df-08a6-40fc-9056-3c5fba79b18c) {{(pid=102992) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 23 19:38:28.111428 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [req-f4ff229d-24c6-425e-9f3f-06324830fee1 req-a8bdea6e-9748-49f3-afeb-dc5f61f64b1c tempest-AttachVolumeShelveTestJSON-1172915835 tempest-AttachVolumeShelveTestJSON-1172915835-project] Publish callbacks [] for port, precommit_create {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:38:28.198274 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [req-f4ff229d-24c6-425e-9f3f-06324830fee1 req-a8bdea6e-9748-49f3-afeb-dc5f61f64b1c tempest-AttachVolumeShelveTestJSON-1172915835 tempest-AttachVolumeShelveTestJSON-1172915835-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7918660', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-15067', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560168', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8783631008714', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-25199805'] for port, after_create {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:38:28.241909 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-f4ff229d-24c6-425e-9f3f-06324830fee1 req-a8bdea6e-9748-49f3-afeb-dc5f61f64b1c tempest-AttachVolumeShelveTestJSON-1172915835 tempest-AttachVolumeShelveTestJSON-1172915835-project] Network fc901312-2937-4784-8a6d-c046666e8bf8 is already hosted by enough agents. {{(pid=102992) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 23 19:38:28.244798 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.scheduler.base_scheduler [req-f4ff229d-24c6-425e-9f3f-06324830fee1 req-a8bdea6e-9748-49f3-afeb-dc5f61f64b1c tempest-AttachVolumeShelveTestJSON-1172915835 tempest-AttachVolumeShelveTestJSON-1172915835-project] Resources bound (agent type, host, resource id): {{(pid=102992) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 23 19:38:28.248367 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.db.l3_dvrscheduler_db [req-f4ff229d-24c6-425e-9f3f-06324830fee1 req-a8bdea6e-9748-49f3-afeb-dc5f61f64b1c tempest-AttachVolumeShelveTestJSON-1172915835 tempest-AttachVolumeShelveTestJSON-1172915835-project] Received port after_create {{(pid=102992) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 23 19:38:28.255550 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a8bdea6e-9748-49f3-afeb-dc5f61f64b1c tempest-AttachVolumeShelveTestJSON-1172915835 tempest-AttachVolumeShelveTestJSON-1172915835-project] Pushing event updated for resources: {'Port': ['ID=895334df-08a6-40fc-9056-3c5fba79b18c,revision_number=1']} {{(pid=102992) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 23 19:38:28.302316 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f4ff229d-24c6-425e-9f3f-06324830fee1 req-a8bdea6e-9748-49f3-afeb-dc5f61f64b1c tempest-AttachVolumeShelveTestJSON-1172915835 tempest-AttachVolumeShelveTestJSON-1172915835-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=102992) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:38:28.302953 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [req-f4ff229d-24c6-425e-9f3f-06324830fee1 req-a8bdea6e-9748-49f3-afeb-dc5f61f64b1c tempest-AttachVolumeShelveTestJSON-1172915835 tempest-AttachVolumeShelveTestJSON-1172915835-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-514902'] for port, before_response {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:38:28.366286 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-f4ff229d-24c6-425e-9f3f-06324830fee1 req-a8bdea6e-9748-49f3-afeb-dc5f61f64b1c tempest-AttachVolumeShelveTestJSON-1172915835 tempest-AttachVolumeShelveTestJSON-1172915835-project] 10.222.0.41 "POST /v2.0/ports HTTP/1.1" status: 201 len: 934 time: 0.7542205 Nov 23 19:38:28.381367 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.api.v2.base [req-f4ff229d-24c6-425e-9f3f-06324830fee1 req-20c86b72-31c1-46f3-8a81-60d70b095ff7 service neutron] Request body: {'port': {'device_id': '627eaac3-8c43-4aa3-a81c-7a6bfb58dbb5', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-81901'}} {{(pid=102992) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 23 19:38:28.439673 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [req-f4ff229d-24c6-425e-9f3f-06324830fee1 req-20c86b72-31c1-46f3-8a81-60d70b095ff7 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7921281'] for port, before_update {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:38:28.449692 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.db.provisioning_blocks [None req-505e30ca-7624-4329-9f05-af027cd4bfbd None None] Provisioning complete for port 895334df-08a6-40fc-9056-3c5fba79b18c triggered by entity DHCP. {{(pid=102994) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 23 19:38:28.450294 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron_lib.callbacks.manager [None req-505e30ca-7624-4329-9f05-af027cd4bfbd None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-8355713'] for port, provisioning_complete {{(pid=102994) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:38:28.491390 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.plugins.ml2.plugin [None req-505e30ca-7624-4329-9f05-af027cd4bfbd None None] Port 895334df-08a6-40fc-9056-3c5fba79b18c cannot update to ACTIVE because it is not bound. {{(pid=102994) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 23 19:38:28.560693 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a70fcd62-3f5b-4926-ae77-7ecc535d3b2d req-cc031da9-e82b-4b6b-845d-cf7a3c3366dc tempest-AttachVolumeShelveTestJSON-1172915835 tempest-AttachVolumeShelveTestJSON-1172915835-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102993) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:38:28.562317 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-a70fcd62-3f5b-4926-ae77-7ecc535d3b2d req-cc031da9-e82b-4b6b-845d-cf7a3c3366dc tempest-AttachVolumeShelveTestJSON-1172915835 tempest-AttachVolumeShelveTestJSON-1172915835-project] 10.222.0.62 "GET /v2.0/ports?device_id=627eaac3-8c43-4aa3-a81c-7a6bfb58dbb5 HTTP/1.1" status: 200 len: 932 time: 0.0489957 Nov 23 19:38:28.612970 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-a70fcd62-3f5b-4926-ae77-7ecc535d3b2d req-6565832b-ee8e-4d50-975e-b42c9af49985 tempest-AttachVolumeShelveTestJSON-1172915835 tempest-AttachVolumeShelveTestJSON-1172915835-project] 10.222.0.62 "GET /v2.0/security-groups?id=a246a431-7eb4-441f-b1e6-9c9c351ee888&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0434108 Nov 23 19:38:28.735992 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.notifiers.nova [req-f4ff229d-24c6-425e-9f3f-06324830fee1 req-20c86b72-31c1-46f3-8a81-60d70b095ff7 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 895334df-08a6-40fc-9056-3c5fba79b18c {{(pid=102992) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 23 19:38:28.745689 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [req-f4ff229d-24c6-425e-9f3f-06324830fee1 req-20c86b72-31c1-46f3-8a81-60d70b095ff7 service neutron] Publish callbacks [] for port, precommit_update {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:38:28.768737 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-91b077a7-a4d7-4d39-8709-9f79d336e925 req-e0a18441-97a4-4d15-8457-201e86c8936a tempest-TestMinimumBasicScenario-716536904 tempest-TestMinimumBasicScenario-716536904-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102992) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:38:28.772441 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-91b077a7-a4d7-4d39-8709-9f79d336e925 req-e0a18441-97a4-4d15-8457-201e86c8936a tempest-TestMinimumBasicScenario-716536904 tempest-TestMinimumBasicScenario-716536904-project] 10.222.0.62 "GET /v2.0/ports?device_id=b5fed716-ff16-48c0-8e89-95731739f55c HTTP/1.1" status: 200 len: 943 time: 0.0751700 Nov 23 19:38:28.775761 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.db.provisioning_blocks [req-f4ff229d-24c6-425e-9f3f-06324830fee1 req-20c86b72-31c1-46f3-8a81-60d70b095ff7 service neutron] Transition to ACTIVE for port object 895334df-08a6-40fc-9056-3c5fba79b18c will not be triggered until provisioned by entity L2. {{(pid=102992) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 23 19:38:28.823338 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-91b077a7-a4d7-4d39-8709-9f79d336e925 req-db6ab132-2528-44a7-bbb7-6d55f5cb9319 tempest-TestMinimumBasicScenario-716536904 tempest-TestMinimumBasicScenario-716536904-project] 10.222.0.62 "GET /v2.0/security-groups?id=d09b4044-91d5-4432-9faa-4b7a40b1627d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0463393 Nov 23 19:38:28.855061 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [req-f4ff229d-24c6-425e-9f3f-06324830fee1 req-20c86b72-31c1-46f3-8a81-60d70b095ff7 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7918660', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-15067', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560168', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8783631423946', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8783631008732', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8783631008750', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-25199748'] for port, after_update {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:38:28.899150 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-20c86b72-31c1-46f3-8a81-60d70b095ff7 service neutron] Pushing event updated for resources: {'Port': ['ID=895334df-08a6-40fc-9056-3c5fba79b18c,revision_number=2']} {{(pid=102992) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 23 19:38:28.934975 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c8bbf975-34a6-4a83-9d8c-5f716d7cf0e0 req-966fddca-eede-4539-87b9-4515864680df tempest-TestShelveInstance-292550524 tempest-TestShelveInstance-292550524-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102993) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:38:28.943483 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-c8bbf975-34a6-4a83-9d8c-5f716d7cf0e0 req-966fddca-eede-4539-87b9-4515864680df tempest-TestShelveInstance-292550524 tempest-TestShelveInstance-292550524-project] 10.222.0.62 "GET /v2.0/ports?device_id=b504cdb2-6182-4c24-9b46-6dc0f85da342 HTTP/1.1" status: 200 len: 946 time: 0.0882416 Nov 23 19:38:28.989984 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.plugins.ml2.managers [req-f4ff229d-24c6-425e-9f3f-06324830fee1 req-20c86b72-31c1-46f3-8a81-60d70b095ff7 service neutron] Attempting to bind port 895334df-08a6-40fc-9056-3c5fba79b18c on host hv-cinder-81901 for vnic_type normal with profile {{(pid=102992) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 23 19:38:28.989984 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.plugins.ml2.managers [req-f4ff229d-24c6-425e-9f3f-06324830fee1 req-20c86b72-31c1-46f3-8a81-60d70b095ff7 service neutron] Attempting to bind port 895334df-08a6-40fc-9056-3c5fba79b18c by drivers openvswitch,hyperv on host hv-cinder-81901 at level 0 using segments [{'id': 'b4453f21-ac7f-498c-8316-73b738820700', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 825, 'network_id': 'fc901312-2937-4784-8a6d-c046666e8bf8'}] {{(pid=102992) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 23 19:38:28.990333 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-f4ff229d-24c6-425e-9f3f-06324830fee1 req-20c86b72-31c1-46f3-8a81-60d70b095ff7 service neutron] Attempting to bind port 895334df-08a6-40fc-9056-3c5fba79b18c on network fc901312-2937-4784-8a6d-c046666e8bf8 {{(pid=102992) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 23 19:38:28.994834 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-f4ff229d-24c6-425e-9f3f-06324830fee1 req-20c86b72-31c1-46f3-8a81-60d70b095ff7 service neutron] Port 895334df-08a6-40fc-9056-3c5fba79b18c on network fc901312-2937-4784-8a6d-c046666e8bf8 not bound, no agent of type Open vSwitch agent registered on host hv-cinder-81901 {{(pid=102992) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Nov 23 19:38:28.995158 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-f4ff229d-24c6-425e-9f3f-06324830fee1 req-20c86b72-31c1-46f3-8a81-60d70b095ff7 service neutron] Attempting to bind port 895334df-08a6-40fc-9056-3c5fba79b18c on network fc901312-2937-4784-8a6d-c046666e8bf8 {{(pid=102992) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 23 19:38:28.995546 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-c8bbf975-34a6-4a83-9d8c-5f716d7cf0e0 req-76ed1cb5-bba9-46bb-9edd-8c68166d6af4 tempest-TestShelveInstance-292550524 tempest-TestShelveInstance-292550524-project] 10.222.0.62 "GET /v2.0/security-groups?id=7fe194e6-71c3-47a9-8f36-0dbb24d1f72d&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0511293 Nov 23 19:38:29.000943 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-f4ff229d-24c6-425e-9f3f-06324830fee1 req-20c86b72-31c1-46f3-8a81-60d70b095ff7 service neutron] Checking agent: {'id': '14e5d049-431d-466a-8d1c-264e5129d376', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-81901', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 23, 19, 31, 29), 'started_at': datetime.datetime(2021, 11, 23, 19, 31, 29), 'heartbeat_timestamp': datetime.datetime(2021, 11, 23, 19, 38), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=102992) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 23 19:38:29.001365 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-f4ff229d-24c6-425e-9f3f-06324830fee1 req-20c86b72-31c1-46f3-8a81-60d70b095ff7 service neutron] Checking segment: {'id': 'b4453f21-ac7f-498c-8316-73b738820700', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 825, 'network_id': 'fc901312-2937-4784-8a6d-c046666e8bf8'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102992) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 23 19:38:29.001963 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-f4ff229d-24c6-425e-9f3f-06324830fee1 req-20c86b72-31c1-46f3-8a81-60d70b095ff7 service neutron] Bound using segment: {'id': 'b4453f21-ac7f-498c-8316-73b738820700', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 825, 'network_id': 'fc901312-2937-4784-8a6d-c046666e8bf8'} {{(pid=102992) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 23 19:38:29.002392 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.plugins.ml2.managers [req-f4ff229d-24c6-425e-9f3f-06324830fee1 req-20c86b72-31c1-46f3-8a81-60d70b095ff7 service neutron] Bound port: 895334df-08a6-40fc-9056-3c5fba79b18c, host: hv-cinder-81901, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': 'b4453f21-ac7f-498c-8316-73b738820700', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 825, 'network_id': 'fc901312-2937-4784-8a6d-c046666e8bf8'}}] {{(pid=102992) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 23 19:38:29.003220 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [req-f4ff229d-24c6-425e-9f3f-06324830fee1 req-20c86b72-31c1-46f3-8a81-60d70b095ff7 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7921281'] for port, before_update {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:38:29.070270 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.plugins.ml2.db [req-f4ff229d-24c6-425e-9f3f-06324830fee1 req-20c86b72-31c1-46f3-8a81-60d70b095ff7 service neutron] For port 895334df-08a6-40fc-9056-3c5fba79b18c, host hv-cinder-81901, cleared binding levels {{(pid=102992) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 23 19:38:29.073607 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.plugins.ml2.db [req-f4ff229d-24c6-425e-9f3f-06324830fee1 req-20c86b72-31c1-46f3-8a81-60d70b095ff7 service neutron] For port 895334df-08a6-40fc-9056-3c5fba79b18c, host hv-cinder-81901, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81901',level=0,port_id=895334df-08a6-40fc-9056-3c5fba79b18c,segment=NetworkSegment(b4453f21-ac7f-498c-8316-73b738820700),segment_id=b4453f21-ac7f-498c-8316-73b738820700)] {{(pid=102992) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 23 19:38:29.125477 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-69591757-36ce-4e10-8f3b-f6968257937c req-bae9d6d4-9f94-4ea4-b245-4389d8423ad6 tempest-TestShelveInstance-292550524 tempest-TestShelveInstance-292550524-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102992) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:38:29.127058 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-69591757-36ce-4e10-8f3b-f6968257937c req-bae9d6d4-9f94-4ea4-b245-4389d8423ad6 tempest-TestShelveInstance-292550524 tempest-TestShelveInstance-292550524-project] 10.222.0.62 "GET /v2.0/ports?device_id=b504cdb2-6182-4c24-9b46-6dc0f85da342 HTTP/1.1" status: 200 len: 946 time: 0.0521469 Nov 23 19:38:29.177092 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-69591757-36ce-4e10-8f3b-f6968257937c req-da74b97f-7f25-44d1-b9b1-a425144e66e0 tempest-TestShelveInstance-292550524 tempest-TestShelveInstance-292550524-project] 10.222.0.62 "GET /v2.0/security-groups?id=7fe194e6-71c3-47a9-8f36-0dbb24d1f72d&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0439692 Nov 23 19:38:29.186141 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [req-f4ff229d-24c6-425e-9f3f-06324830fee1 req-20c86b72-31c1-46f3-8a81-60d70b095ff7 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7918660', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-15067', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560168', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8783631423946', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8783631008732', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8783631008750', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-25199748'] for port, after_update {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:38:29.198851 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.wsgi [-] (102993) accepted ('10.222.0.62', 49136) {{(pid=102993) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 23 19:38:29.222002 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f4ff229d-24c6-425e-9f3f-06324830fee1 req-20c86b72-31c1-46f3-8a81-60d70b095ff7 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102992) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:38:29.222631 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [req-f4ff229d-24c6-425e-9f3f-06324830fee1 req-20c86b72-31c1-46f3-8a81-60d70b095ff7 service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-514902'] for port, before_response {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:38:29.223997 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-f4ff229d-24c6-425e-9f3f-06324830fee1 req-20c86b72-31c1-46f3-8a81-60d70b095ff7 service neutron] 10.222.0.41 "PUT /v2.0/ports/895334df-08a6-40fc-9056-3c5fba79b18c HTTP/1.1" status: 200 len: 1094 time: 0.8474064 Nov 23 19:38:29.224541 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '627eaac3-8c43-4aa3-a81c-7a6bfb58dbb5', 'tag': '895334df-08a6-40fc-9056-3c5fba79b18c'}] {{(pid=102992) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 23 19:38:29.226734 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.62/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}f86c332b591ae691ababa4b64e0601cbf242a448242f95367ce03daabfb7e1ce" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-0592ba2b-6543-4951-b3d1-daf9a213945d" -d '{"events": [{"name": "network-changed", "server_uuid": "627eaac3-8c43-4aa3-a81c-7a6bfb58dbb5", "tag": "895334df-08a6-40fc-9056-3c5fba79b18c"}]}' {{(pid=102992) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 23 19:38:29.256246 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-20c86b72-31c1-46f3-8a81-60d70b095ff7 service neutron] Pushing event updated for resources: {'Port': ['ID=895334df-08a6-40fc-9056-3c5fba79b18c,revision_number=3']} {{(pid=102992) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 23 19:38:29.283027 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Tue, 23 Nov 2021 19:38:29 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-248683e9-13b5-48cf-b7de-a69076e351cf x-openstack-request-id: req-248683e9-13b5-48cf-b7de-a69076e351cf {{(pid=102992) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 23 19:38:29.283027 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "627eaac3-8c43-4aa3-a81c-7a6bfb58dbb5", "tag": "895334df-08a6-40fc-9056-3c5fba79b18c", "status": "completed", "code": 200}]} {{(pid=102992) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 23 19:38:29.283027 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.62/compute/v2.1/os-server-external-events used request id req-248683e9-13b5-48cf-b7de-a69076e351cf {{(pid=102992) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 23 19:38:29.283027 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '627eaac3-8c43-4aa3-a81c-7a6bfb58dbb5', 'tag': '895334df-08a6-40fc-9056-3c5fba79b18c', 'status': 'completed', 'code': 200} Nov 23 19:38:29.361706 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0592ba2b-6543-4951-b3d1-daf9a213945d req-58642f58-fc70-4b08-a71d-b78b527232d2 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102992) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:38:29.363552 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-0592ba2b-6543-4951-b3d1-daf9a213945d req-58642f58-fc70-4b08-a71d-b78b527232d2 service neutron] 10.222.0.41 "GET /v2.0/ports?tenant_id=2d925fb59ba34355aa85758374d76928&device_id=627eaac3-8c43-4aa3-a81c-7a6bfb58dbb5 HTTP/1.1" status: 200 len: 1097 time: 0.0550647 Nov 23 19:38:29.379319 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-28071cab-2f70-4c5d-b392-9c026e017df0 tempest-TestShelveInstance-1875140254 tempest-TestShelveInstance-1875140254-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102993) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:38:29.381456 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [None req-28071cab-2f70-4c5d-b392-9c026e017df0 tempest-TestShelveInstance-1875140254 tempest-TestShelveInstance-1875140254-project-admin] 10.222.0.62 "GET /v2.0/ports?device_id=b504cdb2-6182-4c24-9b46-6dc0f85da342 HTTP/1.1" status: 200 len: 1094 time: 0.1810215 Nov 23 19:38:29.383957 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.wsgi [-] (102993) accepted ('10.222.0.62', 49144) {{(pid=102993) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 23 19:38:29.388404 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.api.v2.base [None req-f350273b-df85-4eb4-a53f-340db36efc8d tempest-TestShelveInstance-292550524 tempest-TestShelveInstance-292550524-project] Request body: {'floatingip': {'floating_network_id': 'a93e254e-aac9-4233-9e4d-4290fd0458e4', 'port_id': 'bbafb0bb-163c-43f4-8d2c-2f5304e0bd04', 'tenant_id': '35f8a5017a27449084aabd12f27f5a8a', 'fixed_ip_address': '172.20.0.13'}} {{(pid=102993) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 23 19:38:29.472272 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-f350273b-df85-4eb4-a53f-340db36efc8d tempest-TestShelveInstance-292550524 tempest-TestShelveInstance-292550524-project] Publish callbacks [] for floatingip, before_create {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:38:29.486526 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0592ba2b-6543-4951-b3d1-daf9a213945d req-24b2bd77-640a-4e2d-a9c5-3d1fd4054c8e service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102992) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:38:29.488016 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-0592ba2b-6543-4951-b3d1-daf9a213945d req-24b2bd77-640a-4e2d-a9c5-3d1fd4054c8e service neutron] 10.222.0.41 "GET /v2.0/networks?tenant_id=2d925fb59ba34355aa85758374d76928&shared=False HTTP/1.1" status: 200 len: 918 time: 0.0996976 Nov 23 19:38:29.572941 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-f350273b-df85-4eb4-a53f-340db36efc8d tempest-TestShelveInstance-292550524 tempest-TestShelveInstance-292550524-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7921281'] for port, before_create {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:38:29.590433 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0592ba2b-6543-4951-b3d1-daf9a213945d req-11862c1e-ef06-442c-96c7-54e4dd94920c service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102992) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:38:29.592050 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-0592ba2b-6543-4951-b3d1-daf9a213945d req-11862c1e-ef06-442c-96c7-54e4dd94920c service neutron] 10.222.0.41 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 870 time: 0.0955892 Nov 23 19:38:29.672596 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f4ff229d-24c6-425e-9f3f-06324830fee1 req-e4f04da2-465f-467f-93fc-6a3405d91f91 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102992) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:38:29.674340 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-f4ff229d-24c6-425e-9f3f-06324830fee1 req-e4f04da2-465f-467f-93fc-6a3405d91f91 service neutron] 10.222.0.41 "GET /v2.0/ports?tenant_id=2d925fb59ba34355aa85758374d76928&device_id=627eaac3-8c43-4aa3-a81c-7a6bfb58dbb5 HTTP/1.1" status: 200 len: 1097 time: 0.0432446 Nov 23 19:38:29.683592 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.db.db_base_plugin_common [None req-f350273b-df85-4eb4-a53f-340db36efc8d tempest-TestShelveInstance-292550524 tempest-TestShelveInstance-292550524-project] Allocated IP 172.27.1.163 (a93e254e-aac9-4233-9e4d-4290fd0458e4/e0b32f3d-83d6-439a-bbed-01df7cf01051/2924f18b-4542-476c-b3fa-0e833f92b914) {{(pid=102993) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 23 19:38:29.723282 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-f4ff229d-24c6-425e-9f3f-06324830fee1 req-37e0aaab-6e81-4827-9d08-2d065bf222f6 service neutron] 10.222.0.41 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.11&port_id=895334df-08a6-40fc-9056-3c5fba79b18c HTTP/1.1" status: 200 len: 217 time: 0.0344846 Nov 23 19:38:29.774824 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron_lib.callbacks.manager [None req-4bf48ff4-ecfb-4168-8b63-249b8c6e9f04 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8783631323329', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7978582'] for agent, after_update {{(pid=102994) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:38:29.775614 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f4ff229d-24c6-425e-9f3f-06324830fee1 req-2ea253e9-8d98-4450-bafc-89d2fc253101 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102992) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:38:29.777026 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-f4ff229d-24c6-425e-9f3f-06324830fee1 req-2ea253e9-8d98-4450-bafc-89d2fc253101 service neutron] 10.222.0.41 "GET /v2.0/subnets?id=2caca985-6ed6-4ef7-ba49-7b7410bea160 HTTP/1.1" status: 200 len: 856 time: 0.0458117 Nov 23 19:38:29.841692 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f4ff229d-24c6-425e-9f3f-06324830fee1 req-31893041-807b-4748-b93d-d731068cc245 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102992) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:38:29.843242 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-f4ff229d-24c6-425e-9f3f-06324830fee1 req-31893041-807b-4748-b93d-d731068cc245 service neutron] 10.222.0.41 "GET /v2.0/ports?network_id=fc901312-2937-4784-8a6d-c046666e8bf8&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0529294 Nov 23 19:38:29.980143 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-f4ff229d-24c6-425e-9f3f-06324830fee1 req-84813a1f-6f33-4720-93da-def438aba91f service neutron] 10.222.0.41 "GET /v2.0/networks/fc901312-2937-4784-8a6d-c046666e8bf8?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1265161 Nov 23 19:38:29.989195 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-160bcf97-e86e-4366-9f2b-dc622d93304c req-b3e3a25c-409b-4f3e-a42d-33dd4656562e tempest-TestMinimumBasicScenario-716536904 tempest-TestMinimumBasicScenario-716536904-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102992) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:38:29.991069 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-160bcf97-e86e-4366-9f2b-dc622d93304c req-b3e3a25c-409b-4f3e-a42d-33dd4656562e tempest-TestMinimumBasicScenario-716536904 tempest-TestMinimumBasicScenario-716536904-project] 10.222.0.62 "GET /v2.0/ports?device_id=b5fed716-ff16-48c0-8e89-95731739f55c HTTP/1.1" status: 200 len: 943 time: 0.0770221 Nov 23 19:38:30.102567 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c91039b8-4307-4942-bf34-1c9d68f130a7 req-5569d577-2b5e-41ca-99e9-8e5642b26358 tempest-AttachVolumeShelveTestJSON-1172915835 tempest-AttachVolumeShelveTestJSON-1172915835-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102993) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:38:30.103961 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-c91039b8-4307-4942-bf34-1c9d68f130a7 req-5569d577-2b5e-41ca-99e9-8e5642b26358 tempest-AttachVolumeShelveTestJSON-1172915835 tempest-AttachVolumeShelveTestJSON-1172915835-project] 10.222.0.62 "GET /v2.0/ports?device_id=627eaac3-8c43-4aa3-a81c-7a6bfb58dbb5 HTTP/1.1" status: 200 len: 944 time: 0.0830581 Nov 23 19:38:30.105593 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-160bcf97-e86e-4366-9f2b-dc622d93304c req-364b783c-9fe8-4d19-b578-99b1d3fec621 tempest-TestMinimumBasicScenario-716536904 tempest-TestMinimumBasicScenario-716536904-project] 10.222.0.62 "GET /v2.0/security-groups?id=d09b4044-91d5-4432-9faa-4b7a40b1627d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1062021 Nov 23 19:38:30.106807 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-f350273b-df85-4eb4-a53f-340db36efc8d tempest-TestShelveInstance-292550524 tempest-TestShelveInstance-292550524-project] Publish callbacks [] for port, precommit_create {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:38:30.116599 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-f4ff229d-24c6-425e-9f3f-06324830fee1 req-6b342a65-8394-4636-97b0-a629ca8ac91f service neutron] 10.222.0.41 "GET /v2.0/networks/fc901312-2937-4784-8a6d-c046666e8bf8?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1245561 Nov 23 19:38:30.173713 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-c91039b8-4307-4942-bf34-1c9d68f130a7 req-698eafc4-824d-4049-aafb-45a2233a23a4 tempest-AttachVolumeShelveTestJSON-1172915835 tempest-AttachVolumeShelveTestJSON-1172915835-project] 10.222.0.62 "GET /v2.0/security-groups?id=a246a431-7eb4-441f-b1e6-9c9c351ee888&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0623832 Nov 23 19:38:30.255279 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-f350273b-df85-4eb4-a53f-340db36efc8d tempest-TestShelveInstance-292550524 tempest-TestShelveInstance-292550524-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7918660', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-15067', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560168', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8783631008714', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-17257496'] for port, after_create {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:38:30.298795 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-f350273b-df85-4eb4-a53f-340db36efc8d tempest-TestShelveInstance-292550524 tempest-TestShelveInstance-292550524-project] Network a93e254e-aac9-4233-9e4d-4290fd0458e4 is already hosted by enough agents. {{(pid=102993) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 23 19:38:30.301656 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.scheduler.base_scheduler [None req-f350273b-df85-4eb4-a53f-340db36efc8d tempest-TestShelveInstance-292550524 tempest-TestShelveInstance-292550524-project] Resources bound (agent type, host, resource id): {{(pid=102993) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 23 19:38:30.305087 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.db.l3_dvrscheduler_db [None req-f350273b-df85-4eb4-a53f-340db36efc8d tempest-TestShelveInstance-292550524 tempest-TestShelveInstance-292550524-project] Received port after_create {{(pid=102993) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 23 19:38:30.310541 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f350273b-df85-4eb4-a53f-340db36efc8d tempest-TestShelveInstance-292550524 tempest-TestShelveInstance-292550524-project] Pushing event updated for resources: {'Port': ['ID=2924f18b-4542-476c-b3fa-0e833f92b914,revision_number=1']} {{(pid=102993) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 23 19:38:30.664559 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-f350273b-df85-4eb4-a53f-340db36efc8d tempest-TestShelveInstance-292550524 tempest-TestShelveInstance-292550524-project] Publish callbacks [] for floatingip, precommit_create {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:38:30.816770 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-f350273b-df85-4eb4-a53f-340db36efc8d tempest-TestShelveInstance-292550524 tempest-TestShelveInstance-292550524-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7921281'] for port, before_update {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:38:30.963022 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-f350273b-df85-4eb4-a53f-340db36efc8d tempest-TestShelveInstance-292550524 tempest-TestShelveInstance-292550524-project] Publish callbacks [] for port, precommit_update {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:38:31.042971 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-f350273b-df85-4eb4-a53f-340db36efc8d tempest-TestShelveInstance-292550524 tempest-TestShelveInstance-292550524-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7918660', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-15067', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560168', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8783631423946', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8783631008732', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8783631008750', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-17257505'] for port, after_update {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:38:31.110074 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f350273b-df85-4eb4-a53f-340db36efc8d tempest-TestShelveInstance-292550524 tempest-TestShelveInstance-292550524-project] Pushing event updated for resources: {'Port': ['ID=2924f18b-4542-476c-b3fa-0e833f92b914,revision_number=2']} {{(pid=102993) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 23 19:38:31.121352 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-f350273b-df85-4eb4-a53f-340db36efc8d tempest-TestShelveInstance-292550524 tempest-TestShelveInstance-292550524-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-926531'] for floatingip, after_create {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:38:31.251454 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.db.l3_db [None req-f350273b-df85-4eb4-a53f-340db36efc8d tempest-TestShelveInstance-292550524 tempest-TestShelveInstance-292550524-project] Floating IP 70beee90-321a-4490-94e6-7cfb57c5d0a8 associated. External IP: 172.27.1.163, port: bbafb0bb-163c-43f4-8d2c-2f5304e0bd04. Nov 23 19:38:31.298813 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6e1b7d35-6805-46e6-af8c-9998b03dcecd req-ce8b5515-f784-4bc1-b493-9d2903bc2f6b tempest-TestMinimumBasicScenario-716536904 tempest-TestMinimumBasicScenario-716536904-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102993) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:38:31.299377 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0fb676ac-7767-48a3-986a-b1e92e208e5a req-6a530d73-435f-41f5-bfdc-f4999c9c4392 tempest-AttachVolumeShelveTestJSON-1172915835 tempest-AttachVolumeShelveTestJSON-1172915835-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102992) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:38:31.300308 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-6e1b7d35-6805-46e6-af8c-9998b03dcecd req-ce8b5515-f784-4bc1-b493-9d2903bc2f6b tempest-TestMinimumBasicScenario-716536904 tempest-TestMinimumBasicScenario-716536904-project] 10.222.0.62 "GET /v2.0/ports?device_id=b5fed716-ff16-48c0-8e89-95731739f55c HTTP/1.1" status: 200 len: 943 time: 0.1007929 Nov 23 19:38:31.300827 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-0fb676ac-7767-48a3-986a-b1e92e208e5a req-6a530d73-435f-41f5-bfdc-f4999c9c4392 tempest-AttachVolumeShelveTestJSON-1172915835 tempest-AttachVolumeShelveTestJSON-1172915835-project] 10.222.0.62 "GET /v2.0/ports?device_id=627eaac3-8c43-4aa3-a81c-7a6bfb58dbb5 HTTP/1.1" status: 200 len: 944 time: 0.0523012 Nov 23 19:38:31.350403 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-0fb676ac-7767-48a3-986a-b1e92e208e5a req-aa5fcd5e-746d-44f3-8a0c-c6589980fe38 tempest-AttachVolumeShelveTestJSON-1172915835 tempest-AttachVolumeShelveTestJSON-1172915835-project] 10.222.0.62 "GET /v2.0/security-groups?id=a246a431-7eb4-441f-b1e6-9c9c351ee888&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0421472 Nov 23 19:38:31.394292 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-6e1b7d35-6805-46e6-af8c-9998b03dcecd req-26b2b0c5-9bb8-4340-a38f-e952fa86a59f tempest-TestMinimumBasicScenario-716536904 tempest-TestMinimumBasicScenario-716536904-project] 10.222.0.62 "GET /v2.0/security-groups?id=d09b4044-91d5-4432-9faa-4b7a40b1627d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0851312 Nov 23 19:38:31.505720 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-f350273b-df85-4eb4-a53f-340db36efc8d tempest-TestShelveInstance-292550524 tempest-TestShelveInstance-292550524-project] Router 3524bcbc-06d6-4343-84f5-54d756e6dd80 has already been hosted by L3 agent 1b20f2c4-70b6-43c3-b9bd-0062cc9e57ac {{(pid=102993) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 23 19:38:31.614719 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-f350273b-df85-4eb4-a53f-340db36efc8d tempest-TestShelveInstance-292550524 tempest-TestShelveInstance-292550524-project] Notify agent at l3_agent.dv-cinder-819011-1-iscsi the message routers_updated {{(pid=102993) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 23 19:38:31.624422 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-7fb9a358-c8da-4efa-83fd-8aa00ae3191b None None] Sync routers for ids ['3524bcbc-06d6-4343-84f5-54d756e6dd80'] in dv-cinder-819011-1-iscsi {{(pid=102994) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 23 19:38:31.634659 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.db.l3_dvrscheduler_db [None req-7fb9a358-c8da-4efa-83fd-8aa00ae3191b None None] Routers {'3524bcbc-06d6-4343-84f5-54d756e6dd80'} bound to L3 agent in host dv-cinder-819011-1-iscsi {{(pid=102994) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 23 19:38:31.635279 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.db.l3_hamode_db [None req-7fb9a358-c8da-4efa-83fd-8aa00ae3191b None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-819011-1-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 9, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 9, "log_agent_heartbeats": false, "routers": 9},created_at=2021-11-23T19:25:14Z,description=,heartbeat_timestamp=2021-11-23T19:38:14Z,host='dv-cinder-819011-1-iscsi',id=1b20f2c4-70b6-43c3-b9bd-0062cc9e57ac,load=0,resource_versions=,resources_synced=,started_at=2021-11-23T19:25:15Z,topic='l3_agent')) {'router_ids': ['3524bcbc-06d6-4343-84f5-54d756e6dd80'], 'active': True} {{(pid=102994) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 23 19:38:31.667905 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-f350273b-df85-4eb4-a53f-340db36efc8d tempest-TestShelveInstance-292550524 tempest-TestShelveInstance-292550524-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-514902'] for floatingip, before_response {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:38:31.695485 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [None req-f350273b-df85-4eb4-a53f-340db36efc8d tempest-TestShelveInstance-292550524 tempest-TestShelveInstance-292550524-project] 10.222.0.62 "POST /v2.0/floatingips HTTP/1.1" status: 201 len: 997 time: 2.3104603 Nov 23 19:38:31.696102 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'b504cdb2-6182-4c24-9b46-6dc0f85da342', 'tag': 'bbafb0bb-163c-43f4-8d2c-2f5304e0bd04'}] {{(pid=102993) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 23 19:38:31.698356 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.62/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}9b10b92acbee16fb695be1efeed0b68f7c36a5b215ec004a8d9d707fa3d35b2c" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-729e0ecc-b7b7-465a-bcf5-9c7762b39c81" -d '{"events": [{"name": "network-changed", "server_uuid": "b504cdb2-6182-4c24-9b46-6dc0f85da342", "tag": "bbafb0bb-163c-43f4-8d2c-2f5304e0bd04"}]}' {{(pid=102993) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 23 19:38:31.737497 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Tue, 23 Nov 2021 19:38:31 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-6403432b-065a-4eef-adec-5ff636e75c90 x-openstack-request-id: req-6403432b-065a-4eef-adec-5ff636e75c90 {{(pid=102993) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 23 19:38:31.737802 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "b504cdb2-6182-4c24-9b46-6dc0f85da342", "tag": "bbafb0bb-163c-43f4-8d2c-2f5304e0bd04", "status": "completed", "code": 200}]} {{(pid=102993) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 23 19:38:31.738061 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.62/compute/v2.1/os-server-external-events used request id req-6403432b-065a-4eef-adec-5ff636e75c90 {{(pid=102993) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 23 19:38:31.738491 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'b504cdb2-6182-4c24-9b46-6dc0f85da342', 'tag': 'bbafb0bb-163c-43f4-8d2c-2f5304e0bd04', 'status': 'completed', 'code': 200} Nov 23 19:38:31.805502 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-729e0ecc-b7b7-465a-bcf5-9c7762b39c81 req-f8174661-4b11-4872-9e79-30472d343216 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102992) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:38:31.806950 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-729e0ecc-b7b7-465a-bcf5-9c7762b39c81 req-f8174661-4b11-4872-9e79-30472d343216 service neutron] 10.222.0.41 "GET /v2.0/ports?tenant_id=35f8a5017a27449084aabd12f27f5a8a&device_id=b504cdb2-6182-4c24-9b46-6dc0f85da342 HTTP/1.1" status: 200 len: 1099 time: 0.0435705 Nov 23 19:38:31.868358 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.db.l3_dvr_db [None req-7fb9a358-c8da-4efa-83fd-8aa00ae3191b None None] Set router 3524bcbc-06d6-4343-84f5-54d756e6dd80 gateway port host: dv-cinder-819011-1-iscsi {{(pid=102994) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 23 19:38:31.901092 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-729e0ecc-b7b7-465a-bcf5-9c7762b39c81 req-154c49eb-1959-4017-9275-c0827a499a8b service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102992) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:38:31.902716 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-729e0ecc-b7b7-465a-bcf5-9c7762b39c81 req-154c49eb-1959-4017-9275-c0827a499a8b service neutron] 10.222.0.41 "GET /v2.0/networks?id=87e46ab6-0f90-430f-930f-9ea1580c04c3 HTTP/1.1" status: 200 len: 909 time: 0.0882380 Nov 23 19:38:31.969755 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-729e0ecc-b7b7-465a-bcf5-9c7762b39c81 req-4429b78c-ad55-41a4-8d54-9e00c0a238ee service neutron] 10.222.0.41 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.13&port_id=bbafb0bb-163c-43f4-8d2c-2f5304e0bd04 HTTP/1.1" status: 200 len: 1000 time: 0.0587080 Nov 23 19:38:32.019203 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-729e0ecc-b7b7-465a-bcf5-9c7762b39c81 req-55cfa69d-bb07-40f0-bc0f-b410a749530c service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102992) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:38:32.020649 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-729e0ecc-b7b7-465a-bcf5-9c7762b39c81 req-55cfa69d-bb07-40f0-bc0f-b410a749530c service neutron] 10.222.0.41 "GET /v2.0/subnets?id=afa5bc59-f70c-409d-8c15-be2dcdce66a3 HTTP/1.1" status: 200 len: 847 time: 0.0430717 Nov 23 19:38:32.073159 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-729e0ecc-b7b7-465a-bcf5-9c7762b39c81 req-4fb51090-e66f-4333-99b1-0abcf1adfc2d service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102992) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:38:32.074589 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-729e0ecc-b7b7-465a-bcf5-9c7762b39c81 req-4fb51090-e66f-4333-99b1-0abcf1adfc2d service neutron] 10.222.0.41 "GET /v2.0/ports?network_id=87e46ab6-0f90-430f-930f-9ea1580c04c3&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0461152 Nov 23 19:38:32.082587 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.plugins.ml2.rpc [None req-4bf48ff4-ecfb-4168-8b63-249b8c6e9f04 None None] Device 733eac81-0446-4e4c-b1d5-b8c491dcbeb4 details requested by agent hyperv_hv-cinder-81901 with host hv-cinder-81901 {{(pid=102994) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Nov 23 19:38:32.136917 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.db.l3_hamode_db [None req-7fb9a358-c8da-4efa-83fd-8aa00ae3191b None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '3524bcbc-06d6-4343-84f5-54d756e6dd80', 'name': 'tempest-TestShelveInstance-670557749-router', 'tenant_id': '35f8a5017a27449084aabd12f27f5a8a', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'a93e254e-aac9-4233-9e4d-4290fd0458e4', 'external_fixed_ips': [{'subnet_id': 'e0b32f3d-83d6-439a-bbed-01df7cf01051', 'ip_address': '172.27.1.194'}], 'enable_snat': True}, 'gw_port_id': 'abd59c5e-8249-4aba-855f-bf3ed33724b6', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-23T19:37:15Z', 'updated_at': '2021-11-23T19:37:18Z', 'revision_number': 4, 'project_id': '35f8a5017a27449084aabd12f27f5a8a', 'gw_port': {'id': 'abd59c5e-8249-4aba-855f-bf3ed33724b6', 'name': '', 'network_id': 'a93e254e-aac9-4233-9e4d-4290fd0458e4', 'tenant_id': '', 'mac_address': 'fa:16:3e:d7:89:48', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '3524bcbc-06d6-4343-84f5-54d756e6dd80', 'device_owner': 'network:router_gateway', 'standard_attr_id': 515, 'fixed_ips': [{'subnet_id': 'e0b32f3d-83d6-439a-bbed-01df7cf01051', 'ip_address': '172.27.1.194', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-819011-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-23T19:37:16Z', 'updated_at': '2021-11-23T19:37:22Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'e0b32f3d-83d6-439a-bbed-01df7cf01051', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-819011-1-iscsi', '_floatingips': [{'id': '70beee90-321a-4490-94e6-7cfb57c5d0a8', 'tenant_id': '35f8a5017a27449084aabd12f27f5a8a', 'floating_ip_address': '172.27.1.163', 'floating_network_id': 'a93e254e-aac9-4233-9e4d-4290fd0458e4', 'router_id': '3524bcbc-06d6-4343-84f5-54d756e6dd80', 'port_id': 'bbafb0bb-163c-43f4-8d2c-2f5304e0bd04', 'fixed_ip_address': '172.20.0.13', 'status': 'DOWN', 'standard_attr_id': 579, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '87e46ab6-0f90-430f-930f-9ea1580c04c3', 'mac_address': 'fa:16:3e:3d:cc:c0', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'b504cdb2-6182-4c24-9b46-6dc0f85da342', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-23T19:38:30Z', 'updated_at': '2021-11-23T19:38:30Z', 'revision_number': 0, 'project_id': '35f8a5017a27449084aabd12f27f5a8a', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'e277d91a-2f3d-4a95-80af-b6e6c458ebab', 'name': '', 'network_id': '87e46ab6-0f90-430f-930f-9ea1580c04c3', 'tenant_id': '35f8a5017a27449084aabd12f27f5a8a', 'mac_address': 'fa:16:3e:42:84:c0', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '3524bcbc-06d6-4343-84f5-54d756e6dd80', 'device_owner': 'network:router_interface', 'standard_attr_id': 517, 'fixed_ips': [{'subnet_id': 'afa5bc59-f70c-409d-8c15-be2dcdce66a3', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-819011-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-23T19:37:18Z', 'updated_at': '2021-11-23T19:37:25Z', 'revision_number': 5, 'project_id': '35f8a5017a27449084aabd12f27f5a8a', 'subnets': [{'id': 'afa5bc59-f70c-409d-8c15-be2dcdce66a3', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-819011-1-iscsi', False) {} {{(pid=102994) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 23 19:38:32.167122 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-7fb9a358-c8da-4efa-83fd-8aa00ae3191b None None] Checking router: 3524bcbc-06d6-4343-84f5-54d756e6dd80 for host: dv-cinder-819011-1-iscsi {{(pid=102994) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 23 19:38:32.169296 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-729e0ecc-b7b7-465a-bcf5-9c7762b39c81 req-f729620e-81f0-47f7-9704-32e82445d1f5 service neutron] 10.222.0.41 "GET /v2.0/networks/87e46ab6-0f90-430f-930f-9ea1580c04c3?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0849206 Nov 23 19:38:32.209939 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.db.l3_dvrscheduler_db [None req-7fb9a358-c8da-4efa-83fd-8aa00ae3191b None None] Routers {'3524bcbc-06d6-4343-84f5-54d756e6dd80'} bound to L3 agent in host dv-cinder-819011-1-iscsi {{(pid=102994) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 23 19:38:32.210557 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.db.l3_hamode_db [None req-7fb9a358-c8da-4efa-83fd-8aa00ae3191b None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-819011-1-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 9, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 9, "log_agent_heartbeats": false, "routers": 9},created_at=2021-11-23T19:25:14Z,description=,heartbeat_timestamp=2021-11-23T19:38:14Z,host='dv-cinder-819011-1-iscsi',id=1b20f2c4-70b6-43c3-b9bd-0062cc9e57ac,load=0,resource_versions=,resources_synced=,started_at=2021-11-23T19:25:15Z,topic='l3_agent')) {'router_ids': ['3524bcbc-06d6-4343-84f5-54d756e6dd80'], 'active': True} {{(pid=102994) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 23 19:38:32.265110 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-729e0ecc-b7b7-465a-bcf5-9c7762b39c81 req-31294562-9686-4a2c-909d-51c0fa7d7fff service neutron] 10.222.0.41 "GET /v2.0/networks/87e46ab6-0f90-430f-930f-9ea1580c04c3?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0868871 Nov 23 19:38:32.268411 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.plugins.ml2.db [None req-4bf48ff4-ecfb-4168-8b63-249b8c6e9f04 None None] For port 733eac81-0446-4e4c-b1d5-b8c491dcbeb4, host hv-cinder-81901, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81901',level=0,port_id=733eac81-0446-4e4c-b1d5-b8c491dcbeb4,segment=NetworkSegment(81f92f0c-ea8d-4880-af1c-e4418f898de3),segment_id=81f92f0c-ea8d-4880-af1c-e4418f898de3)] {{(pid=102994) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 23 19:38:32.311089 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.plugins.ml2.rpc [None req-4bf48ff4-ecfb-4168-8b63-249b8c6e9f04 None None] Returning: {'device': '733eac81-0446-4e4c-b1d5-b8c491dcbeb4', 'network_id': '96f89427-8150-464f-a280-f07cf823b4fd', 'port_id': '733eac81-0446-4e4c-b1d5-b8c491dcbeb4', 'mac_address': 'fa:16:3e:1a:2b:21', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 816, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'bfa70c12-21c8-4b7f-8a30-da7ff37b80b8', 'ip_address': '172.20.0.7'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=102994) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Nov 23 19:38:32.367276 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.db.l3_dvr_db [None req-7fb9a358-c8da-4efa-83fd-8aa00ae3191b None None] Set router 3524bcbc-06d6-4343-84f5-54d756e6dd80 gateway port host: dv-cinder-819011-1-iscsi {{(pid=102994) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 23 19:38:32.395340 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron_lib.callbacks.manager [None req-4bf48ff4-ecfb-4168-8b63-249b8c6e9f04 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7921281'] for port, before_update {{(pid=102994) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:38:32.415109 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.notifiers.nova [None req-4bf48ff4-ecfb-4168-8b63-249b8c6e9f04 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 733eac81-0446-4e4c-b1d5-b8c491dcbeb4 {{(pid=102994) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 23 19:38:32.477357 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.plugins.ml2.db [None req-4bf48ff4-ecfb-4168-8b63-249b8c6e9f04 None None] For port 733eac81-0446-4e4c-b1d5-b8c491dcbeb4, host hv-cinder-81901, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81901',level=0,port_id=733eac81-0446-4e4c-b1d5-b8c491dcbeb4,segment=NetworkSegment(81f92f0c-ea8d-4880-af1c-e4418f898de3),segment_id=81f92f0c-ea8d-4880-af1c-e4418f898de3)] {{(pid=102994) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 23 19:38:32.478916 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-de5e3d9d-64b2-4a80-a9b6-f7e649893baf req-4ba318c3-75e3-4ab8-b3f5-cdd9468f60e9 tempest-AttachVolumeShelveTestJSON-1172915835 tempest-AttachVolumeShelveTestJSON-1172915835-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102992) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:38:32.480667 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-de5e3d9d-64b2-4a80-a9b6-f7e649893baf req-4ba318c3-75e3-4ab8-b3f5-cdd9468f60e9 tempest-AttachVolumeShelveTestJSON-1172915835 tempest-AttachVolumeShelveTestJSON-1172915835-project] 10.222.0.62 "GET /v2.0/ports?device_id=627eaac3-8c43-4aa3-a81c-7a6bfb58dbb5 HTTP/1.1" status: 200 len: 944 time: 0.0551150 Nov 23 19:38:32.522400 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f58f5ee3-1857-4302-bdf6-ffdb731889b3 req-58360cf3-a085-4903-90c9-f8a1794c0e9a tempest-TestMinimumBasicScenario-716536904 tempest-TestMinimumBasicScenario-716536904-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102993) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:38:32.524113 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-f58f5ee3-1857-4302-bdf6-ffdb731889b3 req-58360cf3-a085-4903-90c9-f8a1794c0e9a tempest-TestMinimumBasicScenario-716536904 tempest-TestMinimumBasicScenario-716536904-project] 10.222.0.62 "GET /v2.0/ports?device_id=b5fed716-ff16-48c0-8e89-95731739f55c HTTP/1.1" status: 200 len: 943 time: 0.0528815 Nov 23 19:38:32.541745 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-de5e3d9d-64b2-4a80-a9b6-f7e649893baf req-1d9d0b07-4a65-4f1c-a79b-bda8594d7b36 tempest-AttachVolumeShelveTestJSON-1172915835 tempest-AttachVolumeShelveTestJSON-1172915835-project] 10.222.0.62 "GET /v2.0/security-groups?id=a246a431-7eb4-441f-b1e6-9c9c351ee888&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0534983 Nov 23 19:38:32.550095 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron_lib.callbacks.manager [None req-4bf48ff4-ecfb-4168-8b63-249b8c6e9f04 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7918660', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-15067', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560168', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8783631423946', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8783631008732', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8783631008750'] for port, after_update {{(pid=102994) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:38:32.586494 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-f58f5ee3-1857-4302-bdf6-ffdb731889b3 req-3c2140c2-2193-4293-9be8-e68eb244459e tempest-TestMinimumBasicScenario-716536904 tempest-TestMinimumBasicScenario-716536904-project] 10.222.0.62 "GET /v2.0/security-groups?id=d09b4044-91d5-4432-9faa-4b7a40b1627d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0560937 Nov 23 19:38:32.643956 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4bf48ff4-ecfb-4168-8b63-249b8c6e9f04 None None] Pushing event updated for resources: {'Port': ['ID=733eac81-0446-4e4c-b1d5-b8c491dcbeb4,revision_number=4']} {{(pid=102994) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 23 19:38:32.675863 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.db.l3_hamode_db [None req-7fb9a358-c8da-4efa-83fd-8aa00ae3191b None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '3524bcbc-06d6-4343-84f5-54d756e6dd80', 'name': 'tempest-TestShelveInstance-670557749-router', 'tenant_id': '35f8a5017a27449084aabd12f27f5a8a', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'a93e254e-aac9-4233-9e4d-4290fd0458e4', 'external_fixed_ips': [{'subnet_id': 'e0b32f3d-83d6-439a-bbed-01df7cf01051', 'ip_address': '172.27.1.194'}], 'enable_snat': True}, 'gw_port_id': 'abd59c5e-8249-4aba-855f-bf3ed33724b6', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-23T19:37:15Z', 'updated_at': '2021-11-23T19:37:18Z', 'revision_number': 4, 'project_id': '35f8a5017a27449084aabd12f27f5a8a', 'gw_port': {'id': 'abd59c5e-8249-4aba-855f-bf3ed33724b6', 'name': '', 'network_id': 'a93e254e-aac9-4233-9e4d-4290fd0458e4', 'tenant_id': '', 'mac_address': 'fa:16:3e:d7:89:48', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '3524bcbc-06d6-4343-84f5-54d756e6dd80', 'device_owner': 'network:router_gateway', 'standard_attr_id': 515, 'fixed_ips': [{'subnet_id': 'e0b32f3d-83d6-439a-bbed-01df7cf01051', 'ip_address': '172.27.1.194', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-819011-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-23T19:37:16Z', 'updated_at': '2021-11-23T19:37:22Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'e0b32f3d-83d6-439a-bbed-01df7cf01051', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-819011-1-iscsi', '_floatingips': [{'id': '70beee90-321a-4490-94e6-7cfb57c5d0a8', 'tenant_id': '35f8a5017a27449084aabd12f27f5a8a', 'floating_ip_address': '172.27.1.163', 'floating_network_id': 'a93e254e-aac9-4233-9e4d-4290fd0458e4', 'router_id': '3524bcbc-06d6-4343-84f5-54d756e6dd80', 'port_id': 'bbafb0bb-163c-43f4-8d2c-2f5304e0bd04', 'fixed_ip_address': '172.20.0.13', 'status': 'DOWN', 'standard_attr_id': 579, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '87e46ab6-0f90-430f-930f-9ea1580c04c3', 'mac_address': 'fa:16:3e:3d:cc:c0', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'b504cdb2-6182-4c24-9b46-6dc0f85da342', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-23T19:38:30Z', 'updated_at': '2021-11-23T19:38:30Z', 'revision_number': 0, 'project_id': '35f8a5017a27449084aabd12f27f5a8a', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'e277d91a-2f3d-4a95-80af-b6e6c458ebab', 'name': '', 'network_id': '87e46ab6-0f90-430f-930f-9ea1580c04c3', 'tenant_id': '35f8a5017a27449084aabd12f27f5a8a', 'mac_address': 'fa:16:3e:42:84:c0', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '3524bcbc-06d6-4343-84f5-54d756e6dd80', 'device_owner': 'network:router_interface', 'standard_attr_id': 517, 'fixed_ips': [{'subnet_id': 'afa5bc59-f70c-409d-8c15-be2dcdce66a3', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-819011-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-23T19:37:18Z', 'updated_at': '2021-11-23T19:37:25Z', 'revision_number': 5, 'project_id': '35f8a5017a27449084aabd12f27f5a8a', 'subnets': [{'id': 'afa5bc59-f70c-409d-8c15-be2dcdce66a3', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-819011-1-iscsi', False) {} {{(pid=102994) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 23 19:38:32.703706 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-7fb9a358-c8da-4efa-83fd-8aa00ae3191b None None] The sync data for ids ['3524bcbc-06d6-4343-84f5-54d756e6dd80'] in dv-cinder-819011-1-iscsi is: [{'id': '3524bcbc-06d6-4343-84f5-54d756e6dd80', 'name': 'tempest-TestShelveInstance-670557749-router', 'tenant_id': '35f8a5017a27449084aabd12f27f5a8a', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'a93e254e-aac9-4233-9e4d-4290fd0458e4', 'external_fixed_ips': [{'subnet_id': 'e0b32f3d-83d6-439a-bbed-01df7cf01051', 'ip_address': '172.27.1.194'}], 'enable_snat': True}, 'gw_port_id': 'abd59c5e-8249-4aba-855f-bf3ed33724b6', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-23T19:37:15Z', 'updated_at': '2021-11-23T19:37:18Z', 'revision_number': 4, 'project_id': '35f8a5017a27449084aabd12f27f5a8a', 'gw_port': {'id': 'abd59c5e-8249-4aba-855f-bf3ed33724b6', 'name': '', 'network_id': 'a93e254e-aac9-4233-9e4d-4290fd0458e4', 'tenant_id': '', 'mac_address': 'fa:16:3e:d7:89:48', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '3524bcbc-06d6-4343-84f5-54d756e6dd80', 'device_owner': 'network:router_gateway', 'standard_attr_id': 515, 'fixed_ips': [{'subnet_id': 'e0b32f3d-83d6-439a-bbed-01df7cf01051', 'ip_address': '172.27.1.194', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-819011-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-23T19:37:16Z', 'updated_at': '2021-11-23T19:37:22Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'e0b32f3d-83d6-439a-bbed-01df7cf01051', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-819011-1-iscsi', '_floatingips': [{'id': '70beee90-321a-4490-94e6-7cfb57c5d0a8', 'tenant_id': '35f8a5017a27449084aabd12f27f5a8a', 'floating_ip_address': '172.27.1.163', 'floating_network_id': 'a93e254e-aac9-4233-9e4d-4290fd0458e4', 'router_id': '3524bcbc-06d6-4343-84f5-54d756e6dd80', 'port_id': 'bbafb0bb-163c-43f4-8d2c-2f5304e0bd04', 'fixed_ip_address': '172.20.0.13', 'status': 'DOWN', 'standard_attr_id': 579, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '87e46ab6-0f90-430f-930f-9ea1580c04c3', 'mac_address': 'fa:16:3e:3d:cc:c0', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'b504cdb2-6182-4c24-9b46-6dc0f85da342', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-23T19:38:30Z', 'updated_at': '2021-11-23T19:38:30Z', 'revision_number': 0, 'project_id': '35f8a5017a27449084aabd12f27f5a8a', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'e277d91a-2f3d-4a95-80af-b6e6c458ebab', 'name': '', 'network_id': '87e46ab6-0f90-430f-930f-9ea1580c04c3', 'tenant_id': '35f8a5017a27449084aabd12f27f5a8a', 'mac_address': 'fa:16:3e:42:84:c0', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '3524bcbc-06d6-4343-84f5-54d756e6dd80', 'device_owner': 'network:router_interface', 'standard_attr_id': 517, 'fixed_ips': [{'subnet_id': 'afa5bc59-f70c-409d-8c15-be2dcdce66a3', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-819011-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-23T19:37:18Z', 'updated_at': '2021-11-23T19:37:25Z', 'revision_number': 5, 'project_id': '35f8a5017a27449084aabd12f27f5a8a', 'subnets': [{'id': 'afa5bc59-f70c-409d-8c15-be2dcdce66a3', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=102994) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 23 19:38:32.842602 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.plugins.ml2.db [None req-4bf48ff4-ecfb-4168-8b63-249b8c6e9f04 None None] get_ports_and_sgs() called for port_ids ['733eac81-0446-4e4c-b1d5-b8c491dcbeb4'] {{(pid=102994) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 23 19:38:32.881539 dv-cinder-819011-1-iscsi neutron-server[102995]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-d97fa79d-0846-4172-bc57-59eef55ec016 None None] New status for floating IP 70beee90-321a-4490-94e6-7cfb57c5d0a8: ACTIVE {{(pid=102995) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Nov 23 19:38:33.665805 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bd43e6f0-322a-4805-98fd-708a06fc45ce req-04e2fc65-815a-42d0-8e5e-485a46c087db tempest-AttachVolumeShelveTestJSON-1172915835 tempest-AttachVolumeShelveTestJSON-1172915835-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102993) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:38:33.667376 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-bd43e6f0-322a-4805-98fd-708a06fc45ce req-04e2fc65-815a-42d0-8e5e-485a46c087db tempest-AttachVolumeShelveTestJSON-1172915835 tempest-AttachVolumeShelveTestJSON-1172915835-project] 10.222.0.62 "GET /v2.0/ports?device_id=627eaac3-8c43-4aa3-a81c-7a6bfb58dbb5 HTTP/1.1" status: 200 len: 944 time: 0.0500238 Nov 23 19:38:33.707121 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a9fa1957-fad6-4660-afc2-d37339c44186 req-6f4232fb-9345-4104-94de-9414a0f664ed tempest-TestMinimumBasicScenario-716536904 tempest-TestMinimumBasicScenario-716536904-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102992) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:38:33.708601 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-a9fa1957-fad6-4660-afc2-d37339c44186 req-6f4232fb-9345-4104-94de-9414a0f664ed tempest-TestMinimumBasicScenario-716536904 tempest-TestMinimumBasicScenario-716536904-project] 10.222.0.62 "GET /v2.0/ports?device_id=b5fed716-ff16-48c0-8e89-95731739f55c HTTP/1.1" status: 200 len: 944 time: 0.0531149 Nov 23 19:38:33.715718 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-bd43e6f0-322a-4805-98fd-708a06fc45ce req-54d69f70-0346-4c82-81de-2ec6694b7fee tempest-AttachVolumeShelveTestJSON-1172915835 tempest-AttachVolumeShelveTestJSON-1172915835-project] 10.222.0.62 "GET /v2.0/security-groups?id=a246a431-7eb4-441f-b1e6-9c9c351ee888&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0421114 Nov 23 19:38:33.756963 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-a9fa1957-fad6-4660-afc2-d37339c44186 req-1b273898-984e-4ba0-8265-ae6e735d0d86 tempest-TestMinimumBasicScenario-716536904 tempest-TestMinimumBasicScenario-716536904-project] 10.222.0.62 "GET /v2.0/security-groups?id=d09b4044-91d5-4432-9faa-4b7a40b1627d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0424495 Nov 23 19:38:34.086856 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.plugins.ml2.rpc [None req-4bf48ff4-ecfb-4168-8b63-249b8c6e9f04 None None] Device 895334df-08a6-40fc-9056-3c5fba79b18c details requested by agent hyperv_hv-cinder-81901 with host hv-cinder-81901 {{(pid=102994) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Nov 23 19:38:34.090876 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.plugins.ml2.rpc [None req-4bf48ff4-ecfb-4168-8b63-249b8c6e9f04 None None] Device 733eac81-0446-4e4c-b1d5-b8c491dcbeb4 up at agent hyperv_hv-cinder-81901 {{(pid=102994) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 23 19:38:34.229125 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.plugins.ml2.db [None req-4bf48ff4-ecfb-4168-8b63-249b8c6e9f04 None None] For port 895334df-08a6-40fc-9056-3c5fba79b18c, host hv-cinder-81901, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81901',level=0,port_id=895334df-08a6-40fc-9056-3c5fba79b18c,segment=NetworkSegment(b4453f21-ac7f-498c-8316-73b738820700),segment_id=b4453f21-ac7f-498c-8316-73b738820700)] {{(pid=102994) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 23 19:38:34.240410 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.plugins.ml2.rpc [None req-4bf48ff4-ecfb-4168-8b63-249b8c6e9f04 None None] Returning: {'device': '895334df-08a6-40fc-9056-3c5fba79b18c', 'network_id': 'fc901312-2937-4784-8a6d-c046666e8bf8', 'port_id': '895334df-08a6-40fc-9056-3c5fba79b18c', 'mac_address': 'fa:16:3e:83:a6:a3', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 825, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '2caca985-6ed6-4ef7-ba49-7b7410bea160', 'ip_address': '172.20.0.11'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=102994) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Nov 23 19:38:34.264210 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.db.provisioning_blocks [None req-4bf48ff4-ecfb-4168-8b63-249b8c6e9f04 None None] Provisioning for port 733eac81-0446-4e4c-b1d5-b8c491dcbeb4 completed by entity L2. {{(pid=102994) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 23 19:38:34.274921 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.db.provisioning_blocks [None req-4bf48ff4-ecfb-4168-8b63-249b8c6e9f04 None None] Provisioning complete for port 733eac81-0446-4e4c-b1d5-b8c491dcbeb4 triggered by entity L2. {{(pid=102994) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 23 19:38:34.275344 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron_lib.callbacks.manager [None req-4bf48ff4-ecfb-4168-8b63-249b8c6e9f04 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-8355713'] for port, provisioning_complete {{(pid=102994) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:38:34.302548 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron_lib.callbacks.manager [None req-4bf48ff4-ecfb-4168-8b63-249b8c6e9f04 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7921281'] for port, before_update {{(pid=102994) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:38:34.322943 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.notifiers.nova [None req-4bf48ff4-ecfb-4168-8b63-249b8c6e9f04 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 895334df-08a6-40fc-9056-3c5fba79b18c {{(pid=102994) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 23 19:38:34.348881 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.plugins.ml2.db [None req-4bf48ff4-ecfb-4168-8b63-249b8c6e9f04 None None] For port 895334df-08a6-40fc-9056-3c5fba79b18c, host hv-cinder-81901, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81901',level=0,port_id=895334df-08a6-40fc-9056-3c5fba79b18c,segment=NetworkSegment(b4453f21-ac7f-498c-8316-73b738820700),segment_id=b4453f21-ac7f-498c-8316-73b738820700)] {{(pid=102994) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 23 19:38:34.386115 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron_lib.callbacks.manager [None req-4bf48ff4-ecfb-4168-8b63-249b8c6e9f04 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7921281'] for port, before_update {{(pid=102994) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:38:34.409006 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'b5fed716-ff16-48c0-8e89-95731739f55c', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '733eac81-0446-4e4c-b1d5-b8c491dcbeb4'}] {{(pid=102994) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 23 19:38:34.411267 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.62/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}09a7511da0d2ba1d728b27e36a8467ec5289399952f0059588048a7cb66d3a43" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-7916da2b-ff43-48a1-a55e-9f183f2ea89b" -d '{"events": [{"server_uuid": "b5fed716-ff16-48c0-8e89-95731739f55c", "name": "network-vif-plugged", "status": "completed", "tag": "733eac81-0446-4e4c-b1d5-b8c491dcbeb4"}]}' {{(pid=102994) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 23 19:38:34.422524 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron_lib.callbacks.manager [None req-4bf48ff4-ecfb-4168-8b63-249b8c6e9f04 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7918660', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-15067', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560168', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8783631423946', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8783631008732', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8783631008750'] for port, after_update {{(pid=102994) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:38:34.425310 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.plugins.ml2.db [None req-4bf48ff4-ecfb-4168-8b63-249b8c6e9f04 None None] For port 733eac81-0446-4e4c-b1d5-b8c491dcbeb4, host hv-cinder-81901, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81901',level=0,port_id=733eac81-0446-4e4c-b1d5-b8c491dcbeb4,segment=NetworkSegment(81f92f0c-ea8d-4880-af1c-e4418f898de3),segment_id=81f92f0c-ea8d-4880-af1c-e4418f898de3)] {{(pid=102994) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 23 19:38:34.448885 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 23 Nov 2021 19:38:34 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-0cfe341b-d4e1-4af4-98d8-1f0b9e4b2e94 x-openstack-request-id: req-0cfe341b-d4e1-4af4-98d8-1f0b9e4b2e94 {{(pid=102994) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 23 19:38:34.449310 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "b5fed716-ff16-48c0-8e89-95731739f55c", "name": "network-vif-plugged", "status": "completed", "tag": "733eac81-0446-4e4c-b1d5-b8c491dcbeb4", "code": 200}]} {{(pid=102994) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 23 19:38:34.449601 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.62/compute/v2.1/os-server-external-events used request id req-0cfe341b-d4e1-4af4-98d8-1f0b9e4b2e94 {{(pid=102994) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 23 19:38:34.450033 dv-cinder-819011-1-iscsi neutron-server[102994]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'b5fed716-ff16-48c0-8e89-95731739f55c', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '733eac81-0446-4e4c-b1d5-b8c491dcbeb4', 'code': 200} Nov 23 19:38:34.475310 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4bf48ff4-ecfb-4168-8b63-249b8c6e9f04 None None] Pushing event updated for resources: {'Port': ['ID=895334df-08a6-40fc-9056-3c5fba79b18c,revision_number=4']} {{(pid=102994) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 23 19:38:34.534381 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron_lib.callbacks.manager [None req-4bf48ff4-ecfb-4168-8b63-249b8c6e9f04 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7918660', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-15067', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560168', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8783631423946', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8783631008732', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8783631008750'] for port, after_update {{(pid=102994) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:38:34.583409 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4bf48ff4-ecfb-4168-8b63-249b8c6e9f04 None None] Pushing event updated for resources: {'Port': ['ID=733eac81-0446-4e4c-b1d5-b8c491dcbeb4,revision_number=5']} {{(pid=102994) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 23 19:38:34.704075 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.plugins.ml2.db [None req-4bf48ff4-ecfb-4168-8b63-249b8c6e9f04 None None] get_ports_and_sgs() called for port_ids ['895334df-08a6-40fc-9056-3c5fba79b18c'] {{(pid=102994) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 23 19:38:34.766335 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4d138d5f-2313-4251-9130-1e17e4871bd2 req-b59a9a02-c857-46b7-b3dd-2f9143be0299 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102992) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:38:34.768039 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-4d138d5f-2313-4251-9130-1e17e4871bd2 req-b59a9a02-c857-46b7-b3dd-2f9143be0299 service neutron] 10.222.0.41 "GET /v2.0/ports?device_id=b5fed716-ff16-48c0-8e89-95731739f55c HTTP/1.1" status: 200 len: 1098 time: 0.0412228 Nov 23 19:38:34.845857 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-4d138d5f-2313-4251-9130-1e17e4871bd2 req-276bcfd5-6292-42f0-8a8e-b048bc9421db service neutron] 10.222.0.41 "GET /v2.0/security-groups?id=d09b4044-91d5-4432-9faa-4b7a40b1627d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0701535 Nov 23 19:38:34.859380 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c0dc4be6-61a5-4ea4-8e25-323a5f7d04c4 req-6c39baf6-0138-41cc-bf5a-4087fd696a2d tempest-AttachVolumeShelveTestJSON-1172915835 tempest-AttachVolumeShelveTestJSON-1172915835-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102993) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:38:34.862232 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-c0dc4be6-61a5-4ea4-8e25-323a5f7d04c4 req-6c39baf6-0138-41cc-bf5a-4087fd696a2d tempest-AttachVolumeShelveTestJSON-1172915835 tempest-AttachVolumeShelveTestJSON-1172915835-project] 10.222.0.62 "GET /v2.0/ports?device_id=627eaac3-8c43-4aa3-a81c-7a6bfb58dbb5 HTTP/1.1" status: 200 len: 945 time: 0.0647888 Nov 23 19:38:34.893323 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5fb703bb-6cac-4952-98ec-85f6f46eff45 req-69cefa4c-0030-412d-853b-92c8219ddedd tempest-TestMinimumBasicScenario-716536904 tempest-TestMinimumBasicScenario-716536904-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102992) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:38:34.894845 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-5fb703bb-6cac-4952-98ec-85f6f46eff45 req-69cefa4c-0030-412d-853b-92c8219ddedd tempest-TestMinimumBasicScenario-716536904 tempest-TestMinimumBasicScenario-716536904-project] 10.222.0.62 "GET /v2.0/ports?device_id=b5fed716-ff16-48c0-8e89-95731739f55c HTTP/1.1" status: 200 len: 945 time: 0.0524371 Nov 23 19:38:34.910408 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-c0dc4be6-61a5-4ea4-8e25-323a5f7d04c4 req-6ae220b2-2810-4297-a45c-6a8d96244c64 tempest-AttachVolumeShelveTestJSON-1172915835 tempest-AttachVolumeShelveTestJSON-1172915835-project] 10.222.0.62 "GET /v2.0/security-groups?id=a246a431-7eb4-441f-b1e6-9c9c351ee888&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0427833 Nov 23 19:38:34.947418 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-5fb703bb-6cac-4952-98ec-85f6f46eff45 req-c94ed227-ef73-4ebe-950b-6c0e21fcfbee tempest-TestMinimumBasicScenario-716536904 tempest-TestMinimumBasicScenario-716536904-project] 10.222.0.62 "GET /v2.0/security-groups?id=d09b4044-91d5-4432-9faa-4b7a40b1627d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0466077 Nov 23 19:38:36.035161 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d9344eb8-a34e-47c1-8ecf-51a592bcac98 req-06ab94f8-0f07-4935-849d-6ca7d0998d38 tempest-AttachVolumeShelveTestJSON-1172915835 tempest-AttachVolumeShelveTestJSON-1172915835-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102992) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:38:36.036801 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-d9344eb8-a34e-47c1-8ecf-51a592bcac98 req-06ab94f8-0f07-4935-849d-6ca7d0998d38 tempest-AttachVolumeShelveTestJSON-1172915835 tempest-AttachVolumeShelveTestJSON-1172915835-project] 10.222.0.62 "GET /v2.0/ports?device_id=627eaac3-8c43-4aa3-a81c-7a6bfb58dbb5 HTTP/1.1" status: 200 len: 945 time: 0.0525715 Nov 23 19:38:36.082474 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cb62fd2a-2189-4fee-99aa-5aa2be123e7d req-528f2f3b-5828-465f-bed2-009ce616feda tempest-TestMinimumBasicScenario-716536904 tempest-TestMinimumBasicScenario-716536904-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102993) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:38:36.084016 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-cb62fd2a-2189-4fee-99aa-5aa2be123e7d req-528f2f3b-5828-465f-bed2-009ce616feda tempest-TestMinimumBasicScenario-716536904 tempest-TestMinimumBasicScenario-716536904-project] 10.222.0.62 "GET /v2.0/ports?device_id=b5fed716-ff16-48c0-8e89-95731739f55c HTTP/1.1" status: 200 len: 945 time: 0.0640631 Nov 23 19:38:36.089206 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-d9344eb8-a34e-47c1-8ecf-51a592bcac98 req-8f2b134c-9c65-422e-8938-2dee73c789af tempest-AttachVolumeShelveTestJSON-1172915835 tempest-AttachVolumeShelveTestJSON-1172915835-project] 10.222.0.62 "GET /v2.0/security-groups?id=a246a431-7eb4-441f-b1e6-9c9c351ee888&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0462964 Nov 23 19:38:36.106592 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.plugins.ml2.rpc [None req-4bf48ff4-ecfb-4168-8b63-249b8c6e9f04 None None] Device 895334df-08a6-40fc-9056-3c5fba79b18c up at agent hyperv_hv-cinder-81901 {{(pid=102994) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 23 19:38:36.142086 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-cb62fd2a-2189-4fee-99aa-5aa2be123e7d req-bce966f8-7fd6-40f9-9a7f-96b437df09b6 tempest-TestMinimumBasicScenario-716536904 tempest-TestMinimumBasicScenario-716536904-project] 10.222.0.62 "GET /v2.0/security-groups?id=d09b4044-91d5-4432-9faa-4b7a40b1627d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0518670 Nov 23 19:38:36.248499 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.db.provisioning_blocks [None req-4bf48ff4-ecfb-4168-8b63-249b8c6e9f04 None None] Provisioning for port 895334df-08a6-40fc-9056-3c5fba79b18c completed by entity L2. {{(pid=102994) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 23 19:38:36.253053 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.db.provisioning_blocks [None req-4bf48ff4-ecfb-4168-8b63-249b8c6e9f04 None None] Provisioning complete for port 895334df-08a6-40fc-9056-3c5fba79b18c triggered by entity L2. {{(pid=102994) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 23 19:38:36.253456 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron_lib.callbacks.manager [None req-4bf48ff4-ecfb-4168-8b63-249b8c6e9f04 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-8355713'] for port, provisioning_complete {{(pid=102994) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:38:36.335248 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron_lib.callbacks.manager [None req-4bf48ff4-ecfb-4168-8b63-249b8c6e9f04 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7921281'] for port, before_update {{(pid=102994) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:38:36.367340 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.plugins.ml2.db [None req-4bf48ff4-ecfb-4168-8b63-249b8c6e9f04 None None] For port 895334df-08a6-40fc-9056-3c5fba79b18c, host hv-cinder-81901, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81901',level=0,port_id=895334df-08a6-40fc-9056-3c5fba79b18c,segment=NetworkSegment(b4453f21-ac7f-498c-8316-73b738820700),segment_id=b4453f21-ac7f-498c-8316-73b738820700)] {{(pid=102994) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 23 19:38:36.450883 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '627eaac3-8c43-4aa3-a81c-7a6bfb58dbb5', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '895334df-08a6-40fc-9056-3c5fba79b18c'}] {{(pid=102994) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 23 19:38:36.453773 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.62/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}09a7511da0d2ba1d728b27e36a8467ec5289399952f0059588048a7cb66d3a43" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-a4dcc6f6-9bac-4df0-b727-87d2dfb867f8" -d '{"events": [{"server_uuid": "627eaac3-8c43-4aa3-a81c-7a6bfb58dbb5", "name": "network-vif-plugged", "status": "completed", "tag": "895334df-08a6-40fc-9056-3c5fba79b18c"}]}' {{(pid=102994) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 23 19:38:36.459566 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron_lib.callbacks.manager [None req-4bf48ff4-ecfb-4168-8b63-249b8c6e9f04 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7918660', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-15067', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560168', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8783631423946', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8783631008732', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8783631008750'] for port, after_update {{(pid=102994) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:38:36.495131 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 23 Nov 2021 19:38:36 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-222385d0-a255-4829-bd99-7f068601b059 x-openstack-request-id: req-222385d0-a255-4829-bd99-7f068601b059 {{(pid=102994) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 23 19:38:36.497805 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "627eaac3-8c43-4aa3-a81c-7a6bfb58dbb5", "name": "network-vif-plugged", "status": "completed", "tag": "895334df-08a6-40fc-9056-3c5fba79b18c", "code": 200}]} {{(pid=102994) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 23 19:38:36.497805 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.62/compute/v2.1/os-server-external-events used request id req-222385d0-a255-4829-bd99-7f068601b059 {{(pid=102994) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 23 19:38:36.497805 dv-cinder-819011-1-iscsi neutron-server[102994]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '627eaac3-8c43-4aa3-a81c-7a6bfb58dbb5', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '895334df-08a6-40fc-9056-3c5fba79b18c', 'code': 200} Nov 23 19:38:36.513149 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4bf48ff4-ecfb-4168-8b63-249b8c6e9f04 None None] Pushing event updated for resources: {'Port': ['ID=895334df-08a6-40fc-9056-3c5fba79b18c,revision_number=5']} {{(pid=102994) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 23 19:38:36.862299 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-86baf58e-2781-4c91-a395-82b2a2d39f25 req-6f3f0db3-0193-4665-bb7d-83adac9d0d70 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102992) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:38:36.863742 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-86baf58e-2781-4c91-a395-82b2a2d39f25 req-6f3f0db3-0193-4665-bb7d-83adac9d0d70 service neutron] 10.222.0.41 "GET /v2.0/ports?device_id=627eaac3-8c43-4aa3-a81c-7a6bfb58dbb5 HTTP/1.1" status: 200 len: 1099 time: 0.0848494 Nov 23 19:38:36.907889 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-86baf58e-2781-4c91-a395-82b2a2d39f25 req-af7387be-8acb-4737-bfe5-0aa8b551ff88 service neutron] 10.222.0.41 "GET /v2.0/security-groups?id=a246a431-7eb4-441f-b1e6-9c9c351ee888&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0360172 Nov 23 19:38:37.218443 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-865440be-d3f6-4b4e-a88e-3052a1de4e7a req-b00e171a-318f-44f5-b567-00e05a5a41c6 tempest-AttachVolumeShelveTestJSON-1172915835 tempest-AttachVolumeShelveTestJSON-1172915835-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102992) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:38:37.220465 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-865440be-d3f6-4b4e-a88e-3052a1de4e7a req-b00e171a-318f-44f5-b567-00e05a5a41c6 tempest-AttachVolumeShelveTestJSON-1172915835 tempest-AttachVolumeShelveTestJSON-1172915835-project] 10.222.0.62 "GET /v2.0/ports?device_id=627eaac3-8c43-4aa3-a81c-7a6bfb58dbb5 HTTP/1.1" status: 200 len: 946 time: 0.0542965 Nov 23 19:38:37.255583 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-503d27be-bdb4-4da4-8cb2-d76d4fccd6c0 req-6ccdcc9e-122b-4cfa-967e-bd0948815798 tempest-TestMinimumBasicScenario-716536904 tempest-TestMinimumBasicScenario-716536904-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102993) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:38:37.257055 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-503d27be-bdb4-4da4-8cb2-d76d4fccd6c0 req-6ccdcc9e-122b-4cfa-967e-bd0948815798 tempest-TestMinimumBasicScenario-716536904 tempest-TestMinimumBasicScenario-716536904-project] 10.222.0.62 "GET /v2.0/ports?device_id=b5fed716-ff16-48c0-8e89-95731739f55c HTTP/1.1" status: 200 len: 945 time: 0.0483446 Nov 23 19:38:37.269142 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-865440be-d3f6-4b4e-a88e-3052a1de4e7a req-b1da6e8e-b40d-4175-9c4c-6d7cf13f0793 tempest-AttachVolumeShelveTestJSON-1172915835 tempest-AttachVolumeShelveTestJSON-1172915835-project] 10.222.0.62 "GET /v2.0/security-groups?id=a246a431-7eb4-441f-b1e6-9c9c351ee888&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0425253 Nov 23 19:38:37.307660 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-503d27be-bdb4-4da4-8cb2-d76d4fccd6c0 req-0be5b696-4175-4a04-98ef-0be0ce9e7882 tempest-TestMinimumBasicScenario-716536904 tempest-TestMinimumBasicScenario-716536904-project] 10.222.0.62 "GET /v2.0/security-groups?id=d09b4044-91d5-4432-9faa-4b7a40b1627d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0446181 Nov 23 19:38:37.422023 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bb51bb3a-0424-418b-bf7f-b571c460f531 req-83bb39c4-eeef-4979-9545-928f4fef6f3b tempest-TestMinimumBasicScenario-716536904 tempest-TestMinimumBasicScenario-716536904-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102993) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:38:37.423635 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-bb51bb3a-0424-418b-bf7f-b571c460f531 req-83bb39c4-eeef-4979-9545-928f4fef6f3b tempest-TestMinimumBasicScenario-716536904 tempest-TestMinimumBasicScenario-716536904-project] 10.222.0.62 "GET /v2.0/ports?device_id=b5fed716-ff16-48c0-8e89-95731739f55c HTTP/1.1" status: 200 len: 945 time: 0.0504000 Nov 23 19:38:37.477299 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-bb51bb3a-0424-418b-bf7f-b571c460f531 req-d47e5d9d-a67b-4b09-a73a-1f139ac9e805 tempest-TestMinimumBasicScenario-716536904 tempest-TestMinimumBasicScenario-716536904-project] 10.222.0.62 "GET /v2.0/security-groups?id=d09b4044-91d5-4432-9faa-4b7a40b1627d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0478532 Nov 23 19:38:37.636311 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-2fcccf11-5b85-4877-976a-c27f9eb63d50 req-b062df21-0076-4e83-8b55-aa7d625dda35 service neutron] 10.222.0.41 "GET /v2.0/ports?device_id=4ee0b7a3-f787-4a7c-816a-71f3a99b7193&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 275 time: 0.0396297 Nov 23 19:38:37.698330 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2fcccf11-5b85-4877-976a-c27f9eb63d50 req-1292d6fa-397f-498a-b02d-d563e81ea9b9 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102992) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:38:37.699796 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-2fcccf11-5b85-4877-976a-c27f9eb63d50 req-1292d6fa-397f-498a-b02d-d563e81ea9b9 service neutron] 10.222.0.41 "GET /v2.0/ports?tenant_id=257b0b2e531441b4bb745e99cfd799f3&device_id=4ee0b7a3-f787-4a7c-816a-71f3a99b7193 HTTP/1.1" status: 200 len: 1099 time: 0.0397570 Nov 23 19:38:37.803264 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-52587c93-77c8-4214-b10b-3159b2a33e73 req-b5569f3d-f073-427f-a019-571ccdde936b tempest-TestMinimumBasicScenario-716536904 tempest-TestMinimumBasicScenario-716536904-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102993) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:38:37.804939 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-52587c93-77c8-4214-b10b-3159b2a33e73 req-b5569f3d-f073-427f-a019-571ccdde936b tempest-TestMinimumBasicScenario-716536904 tempest-TestMinimumBasicScenario-716536904-project] 10.222.0.62 "GET /v2.0/ports?device_id=b5fed716-ff16-48c0-8e89-95731739f55c HTTP/1.1" status: 200 len: 945 time: 0.0488489 Nov 23 19:38:37.814125 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2fcccf11-5b85-4877-976a-c27f9eb63d50 req-70cc7cd9-365a-47b1-9551-a0e40f89c401 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102992) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:38:37.815849 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-2fcccf11-5b85-4877-976a-c27f9eb63d50 req-70cc7cd9-365a-47b1-9551-a0e40f89c401 service neutron] 10.222.0.41 "GET /v2.0/networks?id=226a519f-5f3e-4d80-bb8a-0e9fc4f64828 HTTP/1.1" status: 200 len: 911 time: 0.0912056 Nov 23 19:38:37.853132 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-52587c93-77c8-4214-b10b-3159b2a33e73 req-ac395b51-1831-4e57-afd4-6118b642b5c4 tempest-TestMinimumBasicScenario-716536904 tempest-TestMinimumBasicScenario-716536904-project] 10.222.0.62 "GET /v2.0/security-groups?id=d09b4044-91d5-4432-9faa-4b7a40b1627d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0418451 Nov 23 19:38:37.881858 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-2fcccf11-5b85-4877-976a-c27f9eb63d50 req-5f7939ef-77b0-489a-ab26-6dda83f8b629 service neutron] 10.222.0.41 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.14&port_id=1a0a2345-c03d-4159-89a8-35402d8d2448 HTTP/1.1" status: 200 len: 1002 time: 0.0581365 Nov 23 19:38:37.938062 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2fcccf11-5b85-4877-976a-c27f9eb63d50 req-0cda6f50-d481-4eaa-8431-b90d2841c598 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102992) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:38:37.939512 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-2fcccf11-5b85-4877-976a-c27f9eb63d50 req-0cda6f50-d481-4eaa-8431-b90d2841c598 service neutron] 10.222.0.41 "GET /v2.0/subnets?id=88de785d-c540-4651-af1e-26f27ccaee3c HTTP/1.1" status: 200 len: 849 time: 0.0469909 Nov 23 19:38:37.995813 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2fcccf11-5b85-4877-976a-c27f9eb63d50 req-6d374b6f-962d-45df-a470-3a385d25891e service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102992) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:38:37.997296 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-2fcccf11-5b85-4877-976a-c27f9eb63d50 req-6d374b6f-962d-45df-a470-3a385d25891e service neutron] 10.222.0.41 "GET /v2.0/ports?network_id=226a519f-5f3e-4d80-bb8a-0e9fc4f64828&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0404210 Nov 23 19:38:38.104286 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-2fcccf11-5b85-4877-976a-c27f9eb63d50 req-d0f0ef34-7b32-4b94-a02b-fc5c340764cd service neutron] 10.222.0.41 "GET /v2.0/networks/226a519f-5f3e-4d80-bb8a-0e9fc4f64828?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0828724 Nov 23 19:38:38.210119 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-2fcccf11-5b85-4877-976a-c27f9eb63d50 req-4aa1425f-1a94-4785-93e9-8cf9335d2d0a service neutron] 10.222.0.41 "GET /v2.0/networks/226a519f-5f3e-4d80-bb8a-0e9fc4f64828?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0966651 Nov 23 19:38:38.417663 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-27e95f6e-009b-46d5-b4a7-ab03b73e7d02 req-dda9c6d3-52be-4dd4-ad02-ed67bfa7cf9a tempest-AttachVolumeShelveTestJSON-1172915835 tempest-AttachVolumeShelveTestJSON-1172915835-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102992) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:38:38.419212 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-27e95f6e-009b-46d5-b4a7-ab03b73e7d02 req-dda9c6d3-52be-4dd4-ad02-ed67bfa7cf9a tempest-AttachVolumeShelveTestJSON-1172915835 tempest-AttachVolumeShelveTestJSON-1172915835-project] 10.222.0.62 "GET /v2.0/ports?device_id=627eaac3-8c43-4aa3-a81c-7a6bfb58dbb5 HTTP/1.1" status: 200 len: 946 time: 0.0726519 Nov 23 19:38:38.466320 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-27e95f6e-009b-46d5-b4a7-ab03b73e7d02 req-a438412f-97b2-4b41-b151-ceb402d50780 tempest-AttachVolumeShelveTestJSON-1172915835 tempest-AttachVolumeShelveTestJSON-1172915835-project] 10.222.0.62 "GET /v2.0/security-groups?id=a246a431-7eb4-441f-b1e6-9c9c351ee888&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0400691 Nov 23 19:38:39.589191 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8c97d2cc-ed22-45d1-bb9c-9042f3befd34 req-47f56583-9cb0-48be-a338-4899be022896 tempest-AttachVolumeShelveTestJSON-1172915835 tempest-AttachVolumeShelveTestJSON-1172915835-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102993) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:38:39.590751 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-8c97d2cc-ed22-45d1-bb9c-9042f3befd34 req-47f56583-9cb0-48be-a338-4899be022896 tempest-AttachVolumeShelveTestJSON-1172915835 tempest-AttachVolumeShelveTestJSON-1172915835-project] 10.222.0.62 "GET /v2.0/ports?device_id=627eaac3-8c43-4aa3-a81c-7a6bfb58dbb5 HTTP/1.1" status: 200 len: 946 time: 0.0518672 Nov 23 19:38:39.640012 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-8c97d2cc-ed22-45d1-bb9c-9042f3befd34 req-c14ad8f0-4680-43b2-b567-bfeafe581fec tempest-AttachVolumeShelveTestJSON-1172915835 tempest-AttachVolumeShelveTestJSON-1172915835-project] 10.222.0.62 "GET /v2.0/security-groups?id=a246a431-7eb4-441f-b1e6-9c9c351ee888&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0427887 Nov 23 19:38:39.761479 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fccd68b4-6b17-4b3c-bab0-1d486f39f232 req-41a52e1a-ec90-4499-8faa-5a9746f9e967 tempest-AttachVolumeShelveTestJSON-1172915835 tempest-AttachVolumeShelveTestJSON-1172915835-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102993) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:38:39.762947 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-fccd68b4-6b17-4b3c-bab0-1d486f39f232 req-41a52e1a-ec90-4499-8faa-5a9746f9e967 tempest-AttachVolumeShelveTestJSON-1172915835 tempest-AttachVolumeShelveTestJSON-1172915835-project] 10.222.0.62 "GET /v2.0/ports?device_id=627eaac3-8c43-4aa3-a81c-7a6bfb58dbb5 HTTP/1.1" status: 200 len: 946 time: 0.0539165 Nov 23 19:38:39.772055 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.wsgi [-] (102993) accepted ('10.222.0.62', 49244) {{(pid=102993) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 23 19:38:39.776408 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.api.v2.base [None req-a685f64d-88e5-46b5-899b-130204c103fb tempest-AttachVolumeShelveTestJSON-1172915835 tempest-AttachVolumeShelveTestJSON-1172915835-project] Request body: {'floatingip': {'port_id': '895334df-08a6-40fc-9056-3c5fba79b18c'}} {{(pid=102993) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 23 19:38:39.815234 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-a685f64d-88e5-46b5-899b-130204c103fb tempest-AttachVolumeShelveTestJSON-1172915835 tempest-AttachVolumeShelveTestJSON-1172915835-project] Publish callbacks [] for floatingip, before_update {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:38:40.259965 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-a685f64d-88e5-46b5-899b-130204c103fb tempest-AttachVolumeShelveTestJSON-1172915835 tempest-AttachVolumeShelveTestJSON-1172915835-project] Publish callbacks [] for floatingip, precommit_update {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:38:40.374034 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-a685f64d-88e5-46b5-899b-130204c103fb tempest-AttachVolumeShelveTestJSON-1172915835 tempest-AttachVolumeShelveTestJSON-1172915835-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-926531'] for floatingip, after_update {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:38:40.480352 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.db.l3_db [None req-a685f64d-88e5-46b5-899b-130204c103fb tempest-AttachVolumeShelveTestJSON-1172915835 tempest-AttachVolumeShelveTestJSON-1172915835-project] Floating IP 25e15911-590c-423c-af10-5497434dba8d associated. External IP: 172.27.1.207, port: 895334df-08a6-40fc-9056-3c5fba79b18c. Nov 23 19:38:40.684115 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-a685f64d-88e5-46b5-899b-130204c103fb tempest-AttachVolumeShelveTestJSON-1172915835 tempest-AttachVolumeShelveTestJSON-1172915835-project] Router 01438284-e62a-4056-8ee2-4899a051e144 has already been hosted by L3 agent 1b20f2c4-70b6-43c3-b9bd-0062cc9e57ac {{(pid=102993) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 23 19:38:40.798461 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-a685f64d-88e5-46b5-899b-130204c103fb tempest-AttachVolumeShelveTestJSON-1172915835 tempest-AttachVolumeShelveTestJSON-1172915835-project] Notify agent at l3_agent.dv-cinder-819011-1-iscsi the message routers_updated {{(pid=102993) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 23 19:38:40.803437 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-a685f64d-88e5-46b5-899b-130204c103fb tempest-AttachVolumeShelveTestJSON-1172915835 tempest-AttachVolumeShelveTestJSON-1172915835-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-514902'] for floatingip, before_response {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:38:40.809786 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-c67ad74c-7d9e-472e-9260-8fbaf3587934 None None] Sync routers for ids ['01438284-e62a-4056-8ee2-4899a051e144'] in dv-cinder-819011-1-iscsi {{(pid=102994) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 23 19:38:40.820445 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.db.l3_dvrscheduler_db [None req-c67ad74c-7d9e-472e-9260-8fbaf3587934 None None] Routers {'01438284-e62a-4056-8ee2-4899a051e144'} bound to L3 agent in host dv-cinder-819011-1-iscsi {{(pid=102994) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 23 19:38:40.821438 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.db.l3_hamode_db [None req-c67ad74c-7d9e-472e-9260-8fbaf3587934 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-819011-1-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 9, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 9, "log_agent_heartbeats": false, "routers": 9},created_at=2021-11-23T19:25:14Z,description=,heartbeat_timestamp=2021-11-23T19:38:14Z,host='dv-cinder-819011-1-iscsi',id=1b20f2c4-70b6-43c3-b9bd-0062cc9e57ac,load=0,resource_versions=,resources_synced=,started_at=2021-11-23T19:25:15Z,topic='l3_agent')) {'router_ids': ['01438284-e62a-4056-8ee2-4899a051e144'], 'active': True} {{(pid=102994) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 23 19:38:40.835045 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [None req-a685f64d-88e5-46b5-899b-130204c103fb tempest-AttachVolumeShelveTestJSON-1172915835 tempest-AttachVolumeShelveTestJSON-1172915835-project] 10.222.0.62 "PUT /v2.0/floatingips/25e15911-590c-423c-af10-5497434dba8d HTTP/1.1" status: 200 len: 992 time: 1.0589819 Nov 23 19:38:40.835045 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '627eaac3-8c43-4aa3-a81c-7a6bfb58dbb5', 'tag': '895334df-08a6-40fc-9056-3c5fba79b18c'}] {{(pid=102993) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 23 19:38:40.838394 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.62/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}9b10b92acbee16fb695be1efeed0b68f7c36a5b215ec004a8d9d707fa3d35b2c" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-81ba5090-ac09-4a10-8023-f50b2721627b" -d '{"events": [{"name": "network-changed", "server_uuid": "627eaac3-8c43-4aa3-a81c-7a6bfb58dbb5", "tag": "895334df-08a6-40fc-9056-3c5fba79b18c"}]}' {{(pid=102993) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 23 19:38:40.878910 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Tue, 23 Nov 2021 19:38:40 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-e9fd11c2-5c2a-47f1-947d-c534642e9eb5 x-openstack-request-id: req-e9fd11c2-5c2a-47f1-947d-c534642e9eb5 {{(pid=102993) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 23 19:38:40.879366 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "627eaac3-8c43-4aa3-a81c-7a6bfb58dbb5", "tag": "895334df-08a6-40fc-9056-3c5fba79b18c", "status": "completed", "code": 200}]} {{(pid=102993) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 23 19:38:40.879687 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.62/compute/v2.1/os-server-external-events used request id req-e9fd11c2-5c2a-47f1-947d-c534642e9eb5 {{(pid=102993) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 23 19:38:40.880159 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '627eaac3-8c43-4aa3-a81c-7a6bfb58dbb5', 'tag': '895334df-08a6-40fc-9056-3c5fba79b18c', 'status': 'completed', 'code': 200} Nov 23 19:38:40.940412 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.db.l3_dvr_db [None req-c67ad74c-7d9e-472e-9260-8fbaf3587934 None None] Set router 01438284-e62a-4056-8ee2-4899a051e144 gateway port host: dv-cinder-819011-1-iscsi {{(pid=102994) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 23 19:38:40.957215 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-81ba5090-ac09-4a10-8023-f50b2721627b req-ca0ac420-4dc1-492c-bd32-30da2e4aac03 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102992) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:38:40.958849 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-81ba5090-ac09-4a10-8023-f50b2721627b req-ca0ac420-4dc1-492c-bd32-30da2e4aac03 service neutron] 10.222.0.41 "GET /v2.0/ports?tenant_id=2d925fb59ba34355aa85758374d76928&device_id=627eaac3-8c43-4aa3-a81c-7a6bfb58dbb5 HTTP/1.1" status: 200 len: 1099 time: 0.0469651 Nov 23 19:38:41.060502 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-81ba5090-ac09-4a10-8023-f50b2721627b req-9955192c-4673-4dad-94ae-f5a7f7d0fdb3 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102992) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:38:41.061925 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-81ba5090-ac09-4a10-8023-f50b2721627b req-9955192c-4673-4dad-94ae-f5a7f7d0fdb3 service neutron] 10.222.0.41 "GET /v2.0/networks?id=fc901312-2937-4784-8a6d-c046666e8bf8 HTTP/1.1" status: 200 len: 918 time: 0.0954704 Nov 23 19:38:41.136115 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-81ba5090-ac09-4a10-8023-f50b2721627b req-fea4f7ed-9b24-4903-b3db-041859b94247 service neutron] 10.222.0.41 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.11&port_id=895334df-08a6-40fc-9056-3c5fba79b18c HTTP/1.1" status: 200 len: 1000 time: 0.0635591 Nov 23 19:38:41.172359 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.db.l3_hamode_db [None req-c67ad74c-7d9e-472e-9260-8fbaf3587934 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '01438284-e62a-4056-8ee2-4899a051e144', 'name': 'tempest-AttachVolumeShelveTestJSON-1609224522-router', 'tenant_id': '2d925fb59ba34355aa85758374d76928', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'a93e254e-aac9-4233-9e4d-4290fd0458e4', 'external_fixed_ips': [{'subnet_id': 'e0b32f3d-83d6-439a-bbed-01df7cf01051', 'ip_address': '172.27.1.99'}], 'enable_snat': True}, 'gw_port_id': 'a6140c41-82e2-4d62-8e5f-f3fc119a374e', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-23T19:33:21Z', 'updated_at': '2021-11-23T19:33:28Z', 'revision_number': 4, 'project_id': '2d925fb59ba34355aa85758374d76928', 'gw_port': {'id': 'a6140c41-82e2-4d62-8e5f-f3fc119a374e', 'name': '', 'network_id': 'a93e254e-aac9-4233-9e4d-4290fd0458e4', 'tenant_id': '', 'mac_address': 'fa:16:3e:32:52:e2', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '01438284-e62a-4056-8ee2-4899a051e144', 'device_owner': 'network:router_gateway', 'standard_attr_id': 59, 'fixed_ips': [{'subnet_id': 'e0b32f3d-83d6-439a-bbed-01df7cf01051', 'ip_address': '172.27.1.99', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-819011-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-23T19:33:22Z', 'updated_at': '2021-11-23T19:33:30Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'e0b32f3d-83d6-439a-bbed-01df7cf01051', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-819011-1-iscsi', '_floatingips': [{'id': '25e15911-590c-423c-af10-5497434dba8d', 'tenant_id': '2d925fb59ba34355aa85758374d76928', 'floating_ip_address': '172.27.1.207', 'floating_network_id': 'a93e254e-aac9-4233-9e4d-4290fd0458e4', 'router_id': '01438284-e62a-4056-8ee2-4899a051e144', 'port_id': '895334df-08a6-40fc-9056-3c5fba79b18c', 'fixed_ip_address': '172.20.0.11', 'status': 'DOWN', 'standard_attr_id': 576, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': 'fc901312-2937-4784-8a6d-c046666e8bf8', 'mac_address': 'fa:16:3e:83:a6:a3', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '627eaac3-8c43-4aa3-a81c-7a6bfb58dbb5', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-23T19:38:15Z', 'updated_at': '2021-11-23T19:38:40Z', 'revision_number': 1, 'project_id': '2d925fb59ba34355aa85758374d76928', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'c96e4c46-b1fa-4e6c-9fe8-9c516c4ee278', 'name': '', 'network_id': 'fc901312-2937-4784-8a6d-c046666e8bf8', 'tenant_id': '2d925fb59ba34355aa85758374d76928', 'mac_address': 'fa:16:3e:b7:43:ca', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '01438284-e62a-4056-8ee2-4899a051e144', 'device_owner': 'network:router_interface', 'standard_attr_id': 71, 'fixed_ips': [{'subnet_id': '2caca985-6ed6-4ef7-ba49-7b7410bea160', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-819011-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-23T19:33:26Z', 'updated_at': '2021-11-23T19:33:35Z', 'revision_number': 5, 'project_id': '2d925fb59ba34355aa85758374d76928', 'subnets': [{'id': '2caca985-6ed6-4ef7-ba49-7b7410bea160', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-819011-1-iscsi', False) {} {{(pid=102994) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 23 19:38:41.185753 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-81ba5090-ac09-4a10-8023-f50b2721627b req-8acf8af0-e247-40e6-a809-edeff3a9f157 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102992) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:38:41.187230 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-81ba5090-ac09-4a10-8023-f50b2721627b req-8acf8af0-e247-40e6-a809-edeff3a9f157 service neutron] 10.222.0.41 "GET /v2.0/subnets?id=2caca985-6ed6-4ef7-ba49-7b7410bea160 HTTP/1.1" status: 200 len: 856 time: 0.0437787 Nov 23 19:38:41.198060 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-c67ad74c-7d9e-472e-9260-8fbaf3587934 None None] Checking router: 01438284-e62a-4056-8ee2-4899a051e144 for host: dv-cinder-819011-1-iscsi {{(pid=102994) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 23 19:38:41.207115 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.db.l3_dvrscheduler_db [None req-c67ad74c-7d9e-472e-9260-8fbaf3587934 None None] Routers {'01438284-e62a-4056-8ee2-4899a051e144'} bound to L3 agent in host dv-cinder-819011-1-iscsi {{(pid=102994) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 23 19:38:41.207724 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.db.l3_hamode_db [None req-c67ad74c-7d9e-472e-9260-8fbaf3587934 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-819011-1-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 9, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 9, "log_agent_heartbeats": false, "routers": 9},created_at=2021-11-23T19:25:14Z,description=,heartbeat_timestamp=2021-11-23T19:38:14Z,host='dv-cinder-819011-1-iscsi',id=1b20f2c4-70b6-43c3-b9bd-0062cc9e57ac,load=0,resource_versions=,resources_synced=,started_at=2021-11-23T19:25:15Z,topic='l3_agent')) {'router_ids': ['01438284-e62a-4056-8ee2-4899a051e144'], 'active': True} {{(pid=102994) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 23 19:38:41.235977 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-81ba5090-ac09-4a10-8023-f50b2721627b req-f667e9f0-aa1e-4061-b741-b9b2302bbf6a service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102992) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:38:41.237563 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-81ba5090-ac09-4a10-8023-f50b2721627b req-f667e9f0-aa1e-4061-b741-b9b2302bbf6a service neutron] 10.222.0.41 "GET /v2.0/ports?network_id=fc901312-2937-4784-8a6d-c046666e8bf8&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0413995 Nov 23 19:38:41.311144 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.db.l3_dvr_db [None req-c67ad74c-7d9e-472e-9260-8fbaf3587934 None None] Set router 01438284-e62a-4056-8ee2-4899a051e144 gateway port host: dv-cinder-819011-1-iscsi {{(pid=102994) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 23 19:38:41.335855 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-81ba5090-ac09-4a10-8023-f50b2721627b req-57545031-0cee-45dc-af0e-1913a6527dad service neutron] 10.222.0.41 "GET /v2.0/networks/fc901312-2937-4784-8a6d-c046666e8bf8?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0868573 Nov 23 19:38:41.431424 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-81ba5090-ac09-4a10-8023-f50b2721627b req-d8577c47-b0a5-4679-849b-c046dafaac13 service neutron] 10.222.0.41 "GET /v2.0/networks/fc901312-2937-4784-8a6d-c046666e8bf8?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0880449 Nov 23 19:38:41.541260 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.db.l3_hamode_db [None req-c67ad74c-7d9e-472e-9260-8fbaf3587934 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '01438284-e62a-4056-8ee2-4899a051e144', 'name': 'tempest-AttachVolumeShelveTestJSON-1609224522-router', 'tenant_id': '2d925fb59ba34355aa85758374d76928', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'a93e254e-aac9-4233-9e4d-4290fd0458e4', 'external_fixed_ips': [{'subnet_id': 'e0b32f3d-83d6-439a-bbed-01df7cf01051', 'ip_address': '172.27.1.99'}], 'enable_snat': True}, 'gw_port_id': 'a6140c41-82e2-4d62-8e5f-f3fc119a374e', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-23T19:33:21Z', 'updated_at': '2021-11-23T19:33:28Z', 'revision_number': 4, 'project_id': '2d925fb59ba34355aa85758374d76928', 'gw_port': {'id': 'a6140c41-82e2-4d62-8e5f-f3fc119a374e', 'name': '', 'network_id': 'a93e254e-aac9-4233-9e4d-4290fd0458e4', 'tenant_id': '', 'mac_address': 'fa:16:3e:32:52:e2', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '01438284-e62a-4056-8ee2-4899a051e144', 'device_owner': 'network:router_gateway', 'standard_attr_id': 59, 'fixed_ips': [{'subnet_id': 'e0b32f3d-83d6-439a-bbed-01df7cf01051', 'ip_address': '172.27.1.99', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-819011-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-23T19:33:22Z', 'updated_at': '2021-11-23T19:33:30Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'e0b32f3d-83d6-439a-bbed-01df7cf01051', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-819011-1-iscsi', '_floatingips': [{'id': '25e15911-590c-423c-af10-5497434dba8d', 'tenant_id': '2d925fb59ba34355aa85758374d76928', 'floating_ip_address': '172.27.1.207', 'floating_network_id': 'a93e254e-aac9-4233-9e4d-4290fd0458e4', 'router_id': '01438284-e62a-4056-8ee2-4899a051e144', 'port_id': '895334df-08a6-40fc-9056-3c5fba79b18c', 'fixed_ip_address': '172.20.0.11', 'status': 'DOWN', 'standard_attr_id': 576, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': 'fc901312-2937-4784-8a6d-c046666e8bf8', 'mac_address': 'fa:16:3e:83:a6:a3', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '627eaac3-8c43-4aa3-a81c-7a6bfb58dbb5', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-23T19:38:15Z', 'updated_at': '2021-11-23T19:38:40Z', 'revision_number': 1, 'project_id': '2d925fb59ba34355aa85758374d76928', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'c96e4c46-b1fa-4e6c-9fe8-9c516c4ee278', 'name': '', 'network_id': 'fc901312-2937-4784-8a6d-c046666e8bf8', 'tenant_id': '2d925fb59ba34355aa85758374d76928', 'mac_address': 'fa:16:3e:b7:43:ca', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '01438284-e62a-4056-8ee2-4899a051e144', 'device_owner': 'network:router_interface', 'standard_attr_id': 71, 'fixed_ips': [{'subnet_id': '2caca985-6ed6-4ef7-ba49-7b7410bea160', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-819011-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-23T19:33:26Z', 'updated_at': '2021-11-23T19:33:35Z', 'revision_number': 5, 'project_id': '2d925fb59ba34355aa85758374d76928', 'subnets': [{'id': '2caca985-6ed6-4ef7-ba49-7b7410bea160', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-819011-1-iscsi', False) {} {{(pid=102994) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 23 19:38:41.567875 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-c67ad74c-7d9e-472e-9260-8fbaf3587934 None None] The sync data for ids ['01438284-e62a-4056-8ee2-4899a051e144'] in dv-cinder-819011-1-iscsi is: [{'id': '01438284-e62a-4056-8ee2-4899a051e144', 'name': 'tempest-AttachVolumeShelveTestJSON-1609224522-router', 'tenant_id': '2d925fb59ba34355aa85758374d76928', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'a93e254e-aac9-4233-9e4d-4290fd0458e4', 'external_fixed_ips': [{'subnet_id': 'e0b32f3d-83d6-439a-bbed-01df7cf01051', 'ip_address': '172.27.1.99'}], 'enable_snat': True}, 'gw_port_id': 'a6140c41-82e2-4d62-8e5f-f3fc119a374e', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-23T19:33:21Z', 'updated_at': '2021-11-23T19:33:28Z', 'revision_number': 4, 'project_id': '2d925fb59ba34355aa85758374d76928', 'gw_port': {'id': 'a6140c41-82e2-4d62-8e5f-f3fc119a374e', 'name': '', 'network_id': 'a93e254e-aac9-4233-9e4d-4290fd0458e4', 'tenant_id': '', 'mac_address': 'fa:16:3e:32:52:e2', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '01438284-e62a-4056-8ee2-4899a051e144', 'device_owner': 'network:router_gateway', 'standard_attr_id': 59, 'fixed_ips': [{'subnet_id': 'e0b32f3d-83d6-439a-bbed-01df7cf01051', 'ip_address': '172.27.1.99', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-819011-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-23T19:33:22Z', 'updated_at': '2021-11-23T19:33:30Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'e0b32f3d-83d6-439a-bbed-01df7cf01051', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-819011-1-iscsi', '_floatingips': [{'id': '25e15911-590c-423c-af10-5497434dba8d', 'tenant_id': '2d925fb59ba34355aa85758374d76928', 'floating_ip_address': '172.27.1.207', 'floating_network_id': 'a93e254e-aac9-4233-9e4d-4290fd0458e4', 'router_id': '01438284-e62a-4056-8ee2-4899a051e144', 'port_id': '895334df-08a6-40fc-9056-3c5fba79b18c', 'fixed_ip_address': '172.20.0.11', 'status': 'DOWN', 'standard_attr_id': 576, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': 'fc901312-2937-4784-8a6d-c046666e8bf8', 'mac_address': 'fa:16:3e:83:a6:a3', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '627eaac3-8c43-4aa3-a81c-7a6bfb58dbb5', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-23T19:38:15Z', 'updated_at': '2021-11-23T19:38:40Z', 'revision_number': 1, 'project_id': '2d925fb59ba34355aa85758374d76928', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'c96e4c46-b1fa-4e6c-9fe8-9c516c4ee278', 'name': '', 'network_id': 'fc901312-2937-4784-8a6d-c046666e8bf8', 'tenant_id': '2d925fb59ba34355aa85758374d76928', 'mac_address': 'fa:16:3e:b7:43:ca', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '01438284-e62a-4056-8ee2-4899a051e144', 'device_owner': 'network:router_interface', 'standard_attr_id': 71, 'fixed_ips': [{'subnet_id': '2caca985-6ed6-4ef7-ba49-7b7410bea160', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-819011-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-23T19:33:26Z', 'updated_at': '2021-11-23T19:33:35Z', 'revision_number': 5, 'project_id': '2d925fb59ba34355aa85758374d76928', 'subnets': [{'id': '2caca985-6ed6-4ef7-ba49-7b7410bea160', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=102994) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 23 19:38:41.728121 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron_lib.callbacks.manager [None req-4ee4d8eb-96f8-4a2d-b583-99a01ee17763 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8783631323329', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7978582'] for agent, after_update {{(pid=102994) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:38:41.756207 dv-cinder-819011-1-iscsi neutron-server[102995]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-b184c516-cc06-4338-ac6c-29f21e58a8ad None None] New status for floating IP 25e15911-590c-423c-af10-5497434dba8d: ACTIVE {{(pid=102995) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Nov 23 19:38:44.196532 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron_lib.callbacks.manager [None req-c1f30009-0223-4ffa-b0fa-5f7e906e3998 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8783631323329', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7978582'] for agent, after_update {{(pid=102994) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:38:45.111461 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron_lib.callbacks.manager [None req-8346ef05-f685-4c3d-af3d-a159b683bec2 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8783631323329', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7978582'] for agent, after_update {{(pid=102994) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:38:46.561922 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron_lib.callbacks.manager [None req-785c1d26-11ba-42d8-b5a6-51a8b3daeef0 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8783631323329', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7978582'] for agent, after_update {{(pid=102994) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:38:47.008238 dv-cinder-819011-1-iscsi neutron-server[102995]: DEBUG neutron.db.agents_db [None req-84bdc9b2-57ea-4bdb-a245-07c78d37cea8 None None] Agent healthcheck: found 6 active agents {{(pid=102995) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 23 19:38:47.327764 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron_lib.callbacks.manager [None req-eb87b2c3-3339-4249-8b85-e695b5b4e1f9 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8783631323329', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7978582'] for agent, after_update {{(pid=102994) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:38:47.920708 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-26f520c3-a3a7-4075-ad1b-b35e4f6de0ff req-e91e00b6-5475-4806-b271-860dac74cd85 tempest-TestMinimumBasicScenario-716536904 tempest-TestMinimumBasicScenario-716536904-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102993) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:38:47.922213 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-26f520c3-a3a7-4075-ad1b-b35e4f6de0ff req-e91e00b6-5475-4806-b271-860dac74cd85 tempest-TestMinimumBasicScenario-716536904 tempest-TestMinimumBasicScenario-716536904-project] 10.222.0.62 "GET /v2.0/ports?device_id=b5fed716-ff16-48c0-8e89-95731739f55c HTTP/1.1" status: 200 len: 945 time: 0.0487604 Nov 23 19:38:47.969864 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-26f520c3-a3a7-4075-ad1b-b35e4f6de0ff req-cec13ed4-ae53-44c8-9584-27323d0fdde1 tempest-TestMinimumBasicScenario-716536904 tempest-TestMinimumBasicScenario-716536904-project] 10.222.0.62 "GET /v2.0/security-groups?id=d09b4044-91d5-4432-9faa-4b7a40b1627d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0416491 Nov 23 19:38:47.992205 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.wsgi [-] (102993) accepted ('10.222.0.62', 49314) {{(pid=102993) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 23 19:38:48.126967 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-493e3790-3ce0-4e81-b6ed-c3d7c3db9faa tempest-TestMinimumBasicScenario-1379441721 tempest-TestMinimumBasicScenario-1379441721-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102993) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:38:48.128594 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [None req-493e3790-3ce0-4e81-b6ed-c3d7c3db9faa tempest-TestMinimumBasicScenario-1379441721 tempest-TestMinimumBasicScenario-1379441721-project-admin] 10.222.0.62 "GET /v2.0/ports?device_id=b5fed716-ff16-48c0-8e89-95731739f55c HTTP/1.1" status: 200 len: 1093 time: 0.1353836 Nov 23 19:38:48.131714 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.wsgi [-] (102993) accepted ('10.222.0.62', 49318) {{(pid=102993) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 23 19:38:48.135996 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.api.v2.base [None req-84812c8f-4a6f-4a73-9592-43ea56319e8c tempest-TestMinimumBasicScenario-716536904 tempest-TestMinimumBasicScenario-716536904-project] Request body: {'floatingip': {'floating_network_id': 'a93e254e-aac9-4233-9e4d-4290fd0458e4', 'port_id': '733eac81-0446-4e4c-b1d5-b8c491dcbeb4', 'tenant_id': 'ed0d906c96b540a7b11d508615543890', 'fixed_ip_address': '172.20.0.7'}} {{(pid=102993) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 23 19:38:48.191382 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-84812c8f-4a6f-4a73-9592-43ea56319e8c tempest-TestMinimumBasicScenario-716536904 tempest-TestMinimumBasicScenario-716536904-project] Publish callbacks [] for floatingip, before_create {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:38:48.287929 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-84812c8f-4a6f-4a73-9592-43ea56319e8c tempest-TestMinimumBasicScenario-716536904 tempest-TestMinimumBasicScenario-716536904-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7921281'] for port, before_create {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:38:48.394394 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.db.db_base_plugin_common [None req-84812c8f-4a6f-4a73-9592-43ea56319e8c tempest-TestMinimumBasicScenario-716536904 tempest-TestMinimumBasicScenario-716536904-project] Allocated IP 172.27.1.233 (a93e254e-aac9-4233-9e4d-4290fd0458e4/e0b32f3d-83d6-439a-bbed-01df7cf01051/11671f81-d3a8-4a70-aab9-e1bd9607a27a) {{(pid=102993) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 23 19:38:48.493174 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-84812c8f-4a6f-4a73-9592-43ea56319e8c tempest-TestMinimumBasicScenario-716536904 tempest-TestMinimumBasicScenario-716536904-project] Publish callbacks [] for port, precommit_create {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:38:48.591097 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-84812c8f-4a6f-4a73-9592-43ea56319e8c tempest-TestMinimumBasicScenario-716536904 tempest-TestMinimumBasicScenario-716536904-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7918660', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-15067', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560168', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8783631008714', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-17257496'] for port, after_create {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:38:48.632758 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-84812c8f-4a6f-4a73-9592-43ea56319e8c tempest-TestMinimumBasicScenario-716536904 tempest-TestMinimumBasicScenario-716536904-project] Network a93e254e-aac9-4233-9e4d-4290fd0458e4 is already hosted by enough agents. {{(pid=102993) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 23 19:38:48.635599 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.scheduler.base_scheduler [None req-84812c8f-4a6f-4a73-9592-43ea56319e8c tempest-TestMinimumBasicScenario-716536904 tempest-TestMinimumBasicScenario-716536904-project] Resources bound (agent type, host, resource id): {{(pid=102993) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 23 19:38:48.638092 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.db.l3_dvrscheduler_db [None req-84812c8f-4a6f-4a73-9592-43ea56319e8c tempest-TestMinimumBasicScenario-716536904 tempest-TestMinimumBasicScenario-716536904-project] Received port after_create {{(pid=102993) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 23 19:38:48.919870 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-84812c8f-4a6f-4a73-9592-43ea56319e8c tempest-TestMinimumBasicScenario-716536904 tempest-TestMinimumBasicScenario-716536904-project] Pushing event updated for resources: {'Port': ['ID=11671f81-d3a8-4a70-aab9-e1bd9607a27a,revision_number=1']} {{(pid=102993) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 23 19:38:49.258747 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-84812c8f-4a6f-4a73-9592-43ea56319e8c tempest-TestMinimumBasicScenario-716536904 tempest-TestMinimumBasicScenario-716536904-project] Publish callbacks [] for floatingip, precommit_create {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:38:49.390391 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-84812c8f-4a6f-4a73-9592-43ea56319e8c tempest-TestMinimumBasicScenario-716536904 tempest-TestMinimumBasicScenario-716536904-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7921281'] for port, before_update {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:38:49.534469 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-84812c8f-4a6f-4a73-9592-43ea56319e8c tempest-TestMinimumBasicScenario-716536904 tempest-TestMinimumBasicScenario-716536904-project] Publish callbacks [] for port, precommit_update {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:38:49.619161 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-84812c8f-4a6f-4a73-9592-43ea56319e8c tempest-TestMinimumBasicScenario-716536904 tempest-TestMinimumBasicScenario-716536904-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7918660', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-15067', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560168', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8783631423946', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8783631008732', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8783631008750', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-17257505'] for port, after_update {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:38:49.699766 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-84812c8f-4a6f-4a73-9592-43ea56319e8c tempest-TestMinimumBasicScenario-716536904 tempest-TestMinimumBasicScenario-716536904-project] Pushing event updated for resources: {'Port': ['ID=11671f81-d3a8-4a70-aab9-e1bd9607a27a,revision_number=2']} {{(pid=102993) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 23 19:38:49.705276 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-84812c8f-4a6f-4a73-9592-43ea56319e8c tempest-TestMinimumBasicScenario-716536904 tempest-TestMinimumBasicScenario-716536904-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-926531'] for floatingip, after_create {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:38:49.808574 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.db.l3_db [None req-84812c8f-4a6f-4a73-9592-43ea56319e8c tempest-TestMinimumBasicScenario-716536904 tempest-TestMinimumBasicScenario-716536904-project] Floating IP e1c3ef82-f958-4d03-8d87-5247ae26ec2a associated. External IP: 172.27.1.233, port: 733eac81-0446-4e4c-b1d5-b8c491dcbeb4. Nov 23 19:38:50.012290 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-84812c8f-4a6f-4a73-9592-43ea56319e8c tempest-TestMinimumBasicScenario-716536904 tempest-TestMinimumBasicScenario-716536904-project] Router dea93f43-8b8f-439e-820e-4269a0926491 has already been hosted by L3 agent 1b20f2c4-70b6-43c3-b9bd-0062cc9e57ac {{(pid=102993) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 23 19:38:50.119239 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-84812c8f-4a6f-4a73-9592-43ea56319e8c tempest-TestMinimumBasicScenario-716536904 tempest-TestMinimumBasicScenario-716536904-project] Notify agent at l3_agent.dv-cinder-819011-1-iscsi the message routers_updated {{(pid=102993) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 23 19:38:50.129429 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-cf8e08b6-0aa4-4f76-94a0-9ea79f157987 None None] Sync routers for ids ['dea93f43-8b8f-439e-820e-4269a0926491'] in dv-cinder-819011-1-iscsi {{(pid=102994) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 23 19:38:50.138328 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.db.l3_dvrscheduler_db [None req-cf8e08b6-0aa4-4f76-94a0-9ea79f157987 None None] Routers {'dea93f43-8b8f-439e-820e-4269a0926491'} bound to L3 agent in host dv-cinder-819011-1-iscsi {{(pid=102994) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 23 19:38:50.138934 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.db.l3_hamode_db [None req-cf8e08b6-0aa4-4f76-94a0-9ea79f157987 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-819011-1-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 9, "extensions": [], "floating_ips": 4, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 9, "log_agent_heartbeats": false, "routers": 9},created_at=2021-11-23T19:25:14Z,description=,heartbeat_timestamp=2021-11-23T19:38:44Z,host='dv-cinder-819011-1-iscsi',id=1b20f2c4-70b6-43c3-b9bd-0062cc9e57ac,load=0,resource_versions=,resources_synced=,started_at=2021-11-23T19:25:15Z,topic='l3_agent')) {'router_ids': ['dea93f43-8b8f-439e-820e-4269a0926491'], 'active': True} {{(pid=102994) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 23 19:38:50.193714 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-84812c8f-4a6f-4a73-9592-43ea56319e8c tempest-TestMinimumBasicScenario-716536904 tempest-TestMinimumBasicScenario-716536904-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-514902'] for floatingip, before_response {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:38:50.221281 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [None req-84812c8f-4a6f-4a73-9592-43ea56319e8c tempest-TestMinimumBasicScenario-716536904 tempest-TestMinimumBasicScenario-716536904-project] 10.222.0.62 "POST /v2.0/floatingips HTTP/1.1" status: 201 len: 996 time: 2.0880086 Nov 23 19:38:50.222023 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'b5fed716-ff16-48c0-8e89-95731739f55c', 'tag': '733eac81-0446-4e4c-b1d5-b8c491dcbeb4'}] {{(pid=102993) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 23 19:38:50.223987 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.wsgi [-] (102992) accepted ('10.222.0.62', 49330) {{(pid=102992) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 23 19:38:50.224497 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.62/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}9b10b92acbee16fb695be1efeed0b68f7c36a5b215ec004a8d9d707fa3d35b2c" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-18dacfba-6f42-4ccb-900b-57c71f2d75ab" -d '{"events": [{"name": "network-changed", "server_uuid": "b5fed716-ff16-48c0-8e89-95731739f55c", "tag": "733eac81-0446-4e4c-b1d5-b8c491dcbeb4"}]}' {{(pid=102993) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 23 19:38:50.229484 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.api.v2.base [None req-a6288c58-a0e1-4733-97a7-a2134368a0b6 tempest-TestMinimumBasicScenario-716536904 tempest-TestMinimumBasicScenario-716536904-project] Request body: {'security_group': {'name': 'tempest-secgroup-smoke-1929938272', 'description': 'tempest-secgroup-smoke-1929938272 description', 'project_id': 'ed0d906c96b540a7b11d508615543890'}} {{(pid=102992) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 23 19:38:50.249475 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.db.l3_dvr_db [None req-cf8e08b6-0aa4-4f76-94a0-9ea79f157987 None None] Set router dea93f43-8b8f-439e-820e-4269a0926491 gateway port host: dv-cinder-819011-1-iscsi {{(pid=102994) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 23 19:38:50.327557 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Tue, 23 Nov 2021 19:38:50 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-32d0482f-f53f-4f99-9514-f38532feb950 x-openstack-request-id: req-32d0482f-f53f-4f99-9514-f38532feb950 {{(pid=102993) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 23 19:38:50.328076 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "b5fed716-ff16-48c0-8e89-95731739f55c", "tag": "733eac81-0446-4e4c-b1d5-b8c491dcbeb4", "status": "completed", "code": 200}]} {{(pid=102993) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 23 19:38:50.328076 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.62/compute/v2.1/os-server-external-events used request id req-32d0482f-f53f-4f99-9514-f38532feb950 {{(pid=102993) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 23 19:38:50.328395 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'b5fed716-ff16-48c0-8e89-95731739f55c', 'tag': '733eac81-0446-4e4c-b1d5-b8c491dcbeb4', 'status': 'completed', 'code': 200} Nov 23 19:38:50.328492 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [None req-a6288c58-a0e1-4733-97a7-a2134368a0b6 tempest-TestMinimumBasicScenario-716536904 tempest-TestMinimumBasicScenario-716536904-project] Publish callbacks [] for security_group, before_create {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:38:50.421830 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-18dacfba-6f42-4ccb-900b-57c71f2d75ab req-d7bef33c-e8bb-43f6-98e8-7b61c2c35a26 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102992) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:38:50.423222 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-18dacfba-6f42-4ccb-900b-57c71f2d75ab req-d7bef33c-e8bb-43f6-98e8-7b61c2c35a26 service neutron] 10.222.0.41 "GET /v2.0/ports?tenant_id=ed0d906c96b540a7b11d508615543890&device_id=b5fed716-ff16-48c0-8e89-95731739f55c HTTP/1.1" status: 200 len: 1098 time: 0.0688548 Nov 23 19:38:50.434402 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [None req-a6288c58-a0e1-4733-97a7-a2134368a0b6 tempest-TestMinimumBasicScenario-716536904 tempest-TestMinimumBasicScenario-716536904-project] Publish callbacks [] for security_group, precommit_create {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:38:50.477817 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.db.l3_hamode_db [None req-cf8e08b6-0aa4-4f76-94a0-9ea79f157987 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'dea93f43-8b8f-439e-820e-4269a0926491', 'name': 'tempest-TestMinimumBasicScenario-387750355-router', 'tenant_id': 'ed0d906c96b540a7b11d508615543890', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'a93e254e-aac9-4233-9e4d-4290fd0458e4', 'external_fixed_ips': [{'subnet_id': 'e0b32f3d-83d6-439a-bbed-01df7cf01051', 'ip_address': '172.27.1.102'}], 'enable_snat': True}, 'gw_port_id': '80f6861a-4aab-4ba4-a058-5c03b253434a', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-23T19:37:47Z', 'updated_at': '2021-11-23T19:37:50Z', 'revision_number': 4, 'project_id': 'ed0d906c96b540a7b11d508615543890', 'gw_port': {'id': '80f6861a-4aab-4ba4-a058-5c03b253434a', 'name': '', 'network_id': 'a93e254e-aac9-4233-9e4d-4290fd0458e4', 'tenant_id': '', 'mac_address': 'fa:16:3e:d4:39:b5', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'dea93f43-8b8f-439e-820e-4269a0926491', 'device_owner': 'network:router_gateway', 'standard_attr_id': 554, 'fixed_ips': [{'subnet_id': 'e0b32f3d-83d6-439a-bbed-01df7cf01051', 'ip_address': '172.27.1.102', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-819011-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-23T19:37:48Z', 'updated_at': '2021-11-23T19:37:52Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'e0b32f3d-83d6-439a-bbed-01df7cf01051', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-819011-1-iscsi', '_floatingips': [{'id': 'e1c3ef82-f958-4d03-8d87-5247ae26ec2a', 'tenant_id': 'ed0d906c96b540a7b11d508615543890', 'floating_ip_address': '172.27.1.233', 'floating_network_id': 'a93e254e-aac9-4233-9e4d-4290fd0458e4', 'router_id': 'dea93f43-8b8f-439e-820e-4269a0926491', 'port_id': '733eac81-0446-4e4c-b1d5-b8c491dcbeb4', 'fixed_ip_address': '172.20.0.7', 'status': 'DOWN', 'standard_attr_id': 581, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '96f89427-8150-464f-a280-f07cf823b4fd', 'mac_address': 'fa:16:3e:1a:2b:21', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'b5fed716-ff16-48c0-8e89-95731739f55c', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-23T19:38:49Z', 'updated_at': '2021-11-23T19:38:49Z', 'revision_number': 0, 'project_id': 'ed0d906c96b540a7b11d508615543890', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '35d7927f-9541-4e91-b520-51ae3ab623f1', 'name': '', 'network_id': '96f89427-8150-464f-a280-f07cf823b4fd', 'tenant_id': 'ed0d906c96b540a7b11d508615543890', 'mac_address': 'fa:16:3e:00:20:e6', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'dea93f43-8b8f-439e-820e-4269a0926491', 'device_owner': 'network:router_interface', 'standard_attr_id': 555, 'fixed_ips': [{'subnet_id': 'bfa70c12-21c8-4b7f-8a30-da7ff37b80b8', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-819011-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-23T19:37:50Z', 'updated_at': '2021-11-23T19:37:54Z', 'revision_number': 5, 'project_id': 'ed0d906c96b540a7b11d508615543890', 'subnets': [{'id': 'bfa70c12-21c8-4b7f-8a30-da7ff37b80b8', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-819011-1-iscsi', False) {} {{(pid=102994) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 23 19:38:50.507968 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-cf8e08b6-0aa4-4f76-94a0-9ea79f157987 None None] Checking router: dea93f43-8b8f-439e-820e-4269a0926491 for host: dv-cinder-819011-1-iscsi {{(pid=102994) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 23 19:38:50.516596 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.db.l3_dvrscheduler_db [None req-cf8e08b6-0aa4-4f76-94a0-9ea79f157987 None None] Routers {'dea93f43-8b8f-439e-820e-4269a0926491'} bound to L3 agent in host dv-cinder-819011-1-iscsi {{(pid=102994) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 23 19:38:50.517208 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.db.l3_hamode_db [None req-cf8e08b6-0aa4-4f76-94a0-9ea79f157987 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-819011-1-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 9, "extensions": [], "floating_ips": 4, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 9, "log_agent_heartbeats": false, "routers": 9},created_at=2021-11-23T19:25:14Z,description=,heartbeat_timestamp=2021-11-23T19:38:44Z,host='dv-cinder-819011-1-iscsi',id=1b20f2c4-70b6-43c3-b9bd-0062cc9e57ac,load=0,resource_versions=,resources_synced=,started_at=2021-11-23T19:25:15Z,topic='l3_agent')) {'router_ids': ['dea93f43-8b8f-439e-820e-4269a0926491'], 'active': True} {{(pid=102994) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 23 19:38:50.526530 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [None req-a6288c58-a0e1-4733-97a7-a2134368a0b6 tempest-TestMinimumBasicScenario-716536904 tempest-TestMinimumBasicScenario-716536904-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-623933'] for security_group, after_create {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:38:50.550728 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-18dacfba-6f42-4ccb-900b-57c71f2d75ab req-2c1506ec-48f3-484b-a765-b5d16093b320 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102992) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:38:50.552179 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-18dacfba-6f42-4ccb-900b-57c71f2d75ab req-2c1506ec-48f3-484b-a765-b5d16093b320 service neutron] 10.222.0.41 "GET /v2.0/networks?id=96f89427-8150-464f-a280-f07cf823b4fd HTTP/1.1" status: 200 len: 915 time: 0.1018035 Nov 23 19:38:50.602557 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a6288c58-a0e1-4733-97a7-a2134368a0b6 tempest-TestMinimumBasicScenario-716536904 tempest-TestMinimumBasicScenario-716536904-project] Pushing event updated for resources: {'SecurityGroup': ['ID=04706b6c-202a-4225-af46-0d450ab58a7b,revision_number=1']} {{(pid=102992) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 23 19:38:50.616880 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a6288c58-a0e1-4733-97a7-a2134368a0b6 tempest-TestMinimumBasicScenario-716536904 tempest-TestMinimumBasicScenario-716536904-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-819011-1-iscsi {{(pid=102992) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 23 19:38:50.617229 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a6288c58-a0e1-4733-97a7-a2134368a0b6 tempest-TestMinimumBasicScenario-716536904 tempest-TestMinimumBasicScenario-716536904-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-819011-1-iscsi {{(pid=102992) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 23 19:38:50.617597 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a6288c58-a0e1-4733-97a7-a2134368a0b6 tempest-TestMinimumBasicScenario-716536904 tempest-TestMinimumBasicScenario-716536904-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-819011-1-iscsi {{(pid=102992) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 23 19:38:50.617934 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a6288c58-a0e1-4733-97a7-a2134368a0b6 tempest-TestMinimumBasicScenario-716536904 tempest-TestMinimumBasicScenario-716536904-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-819011-1-iscsi {{(pid=102992) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 23 19:38:50.618290 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a6288c58-a0e1-4733-97a7-a2134368a0b6 tempest-TestMinimumBasicScenario-716536904 tempest-TestMinimumBasicScenario-716536904-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-819011-1-iscsi {{(pid=102992) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 23 19:38:50.618594 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a6288c58-a0e1-4733-97a7-a2134368a0b6 tempest-TestMinimumBasicScenario-716536904 tempest-TestMinimumBasicScenario-716536904-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-819011-1-iscsi {{(pid=102992) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 23 19:38:50.618923 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a6288c58-a0e1-4733-97a7-a2134368a0b6 tempest-TestMinimumBasicScenario-716536904 tempest-TestMinimumBasicScenario-716536904-project] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-819011-1-iscsi {{(pid=102992) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 23 19:38:50.619251 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a6288c58-a0e1-4733-97a7-a2134368a0b6 tempest-TestMinimumBasicScenario-716536904 tempest-TestMinimumBasicScenario-716536904-project] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-819011-1-iscsi {{(pid=102992) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 23 19:38:50.619576 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a6288c58-a0e1-4733-97a7-a2134368a0b6 tempest-TestMinimumBasicScenario-716536904 tempest-TestMinimumBasicScenario-716536904-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-819011-1-iscsi {{(pid=102992) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 23 19:38:50.619902 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a6288c58-a0e1-4733-97a7-a2134368a0b6 tempest-TestMinimumBasicScenario-716536904 tempest-TestMinimumBasicScenario-716536904-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-819011-1-iscsi {{(pid=102992) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 23 19:38:50.620226 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a6288c58-a0e1-4733-97a7-a2134368a0b6 tempest-TestMinimumBasicScenario-716536904 tempest-TestMinimumBasicScenario-716536904-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-819011-1-iscsi {{(pid=102992) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 23 19:38:50.620551 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a6288c58-a0e1-4733-97a7-a2134368a0b6 tempest-TestMinimumBasicScenario-716536904 tempest-TestMinimumBasicScenario-716536904-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-819011-1-iscsi {{(pid=102992) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 23 19:38:50.631539 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.db.l3_dvr_db [None req-cf8e08b6-0aa4-4f76-94a0-9ea79f157987 None None] Set router dea93f43-8b8f-439e-820e-4269a0926491 gateway port host: dv-cinder-819011-1-iscsi {{(pid=102994) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 23 19:38:50.640781 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-18dacfba-6f42-4ccb-900b-57c71f2d75ab req-fed27f1f-23f4-47e6-86e9-00ea51af15d7 service neutron] 10.222.0.41 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.7&port_id=733eac81-0446-4e4c-b1d5-b8c491dcbeb4 HTTP/1.1" status: 200 len: 999 time: 0.0787911 Nov 23 19:38:50.681228 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [None req-a6288c58-a0e1-4733-97a7-a2134368a0b6 tempest-TestMinimumBasicScenario-716536904 tempest-TestMinimumBasicScenario-716536904-project] Publish callbacks [] for security_group, before_response {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:38:50.682396 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [None req-a6288c58-a0e1-4733-97a7-a2134368a0b6 tempest-TestMinimumBasicScenario-716536904 tempest-TestMinimumBasicScenario-716536904-project] 10.222.0.62 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1811 time: 0.4573317 Nov 23 19:38:50.685397 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.wsgi [-] (102993) accepted ('10.222.0.62', 49340) {{(pid=102993) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 23 19:38:50.691218 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.api.v2.base [None req-518f5a28-d921-42cd-a4d7-c546829d39ea tempest-TestMinimumBasicScenario-716536904 tempest-TestMinimumBasicScenario-716536904-project] Request body: {'security_group_rule': {'security_group_id': '04706b6c-202a-4225-af46-0d450ab58a7b', 'project_id': 'ed0d906c96b540a7b11d508615543890', 'protocol': 'tcp', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'ingress'}} {{(pid=102993) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 23 19:38:50.709268 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-18dacfba-6f42-4ccb-900b-57c71f2d75ab req-1ec532cb-ba99-48ac-91e0-1e3f0b2924a9 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102992) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:38:50.711196 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-18dacfba-6f42-4ccb-900b-57c71f2d75ab req-1ec532cb-ba99-48ac-91e0-1e3f0b2924a9 service neutron] 10.222.0.41 "GET /v2.0/subnets?id=bfa70c12-21c8-4b7f-8a30-da7ff37b80b8 HTTP/1.1" status: 200 len: 853 time: 0.0601346 Nov 23 19:38:50.762488 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-18dacfba-6f42-4ccb-900b-57c71f2d75ab req-5924b8fb-fa76-4b70-b32b-a13df9c60eed service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102992) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:38:50.763974 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-18dacfba-6f42-4ccb-900b-57c71f2d75ab req-5924b8fb-fa76-4b70-b32b-a13df9c60eed service neutron] 10.222.0.41 "GET /v2.0/ports?network_id=96f89427-8150-464f-a280-f07cf823b4fd&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0419316 Nov 23 19:38:50.778376 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-518f5a28-d921-42cd-a4d7-c546829d39ea tempest-TestMinimumBasicScenario-716536904 tempest-TestMinimumBasicScenario-716536904-project] Publish callbacks [] for security_group_rule, before_create {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:38:50.843974 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-518f5a28-d921-42cd-a4d7-c546829d39ea tempest-TestMinimumBasicScenario-716536904 tempest-TestMinimumBasicScenario-716536904-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:38:50.872118 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-18dacfba-6f42-4ccb-900b-57c71f2d75ab req-4c2a5410-0c16-4eda-a799-0cbd6a62568f service neutron] 10.222.0.41 "GET /v2.0/networks/96f89427-8150-464f-a280-f07cf823b4fd?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0936265 Nov 23 19:38:50.875266 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.db.l3_hamode_db [None req-cf8e08b6-0aa4-4f76-94a0-9ea79f157987 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'dea93f43-8b8f-439e-820e-4269a0926491', 'name': 'tempest-TestMinimumBasicScenario-387750355-router', 'tenant_id': 'ed0d906c96b540a7b11d508615543890', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'a93e254e-aac9-4233-9e4d-4290fd0458e4', 'external_fixed_ips': [{'subnet_id': 'e0b32f3d-83d6-439a-bbed-01df7cf01051', 'ip_address': '172.27.1.102'}], 'enable_snat': True}, 'gw_port_id': '80f6861a-4aab-4ba4-a058-5c03b253434a', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-23T19:37:47Z', 'updated_at': '2021-11-23T19:37:50Z', 'revision_number': 4, 'project_id': 'ed0d906c96b540a7b11d508615543890', 'gw_port': {'id': '80f6861a-4aab-4ba4-a058-5c03b253434a', 'name': '', 'network_id': 'a93e254e-aac9-4233-9e4d-4290fd0458e4', 'tenant_id': '', 'mac_address': 'fa:16:3e:d4:39:b5', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'dea93f43-8b8f-439e-820e-4269a0926491', 'device_owner': 'network:router_gateway', 'standard_attr_id': 554, 'fixed_ips': [{'subnet_id': 'e0b32f3d-83d6-439a-bbed-01df7cf01051', 'ip_address': '172.27.1.102', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-819011-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-23T19:37:48Z', 'updated_at': '2021-11-23T19:37:52Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'e0b32f3d-83d6-439a-bbed-01df7cf01051', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-819011-1-iscsi', '_floatingips': [{'id': 'e1c3ef82-f958-4d03-8d87-5247ae26ec2a', 'tenant_id': 'ed0d906c96b540a7b11d508615543890', 'floating_ip_address': '172.27.1.233', 'floating_network_id': 'a93e254e-aac9-4233-9e4d-4290fd0458e4', 'router_id': 'dea93f43-8b8f-439e-820e-4269a0926491', 'port_id': '733eac81-0446-4e4c-b1d5-b8c491dcbeb4', 'fixed_ip_address': '172.20.0.7', 'status': 'DOWN', 'standard_attr_id': 581, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '96f89427-8150-464f-a280-f07cf823b4fd', 'mac_address': 'fa:16:3e:1a:2b:21', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'b5fed716-ff16-48c0-8e89-95731739f55c', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-23T19:38:49Z', 'updated_at': '2021-11-23T19:38:49Z', 'revision_number': 0, 'project_id': 'ed0d906c96b540a7b11d508615543890', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '35d7927f-9541-4e91-b520-51ae3ab623f1', 'name': '', 'network_id': '96f89427-8150-464f-a280-f07cf823b4fd', 'tenant_id': 'ed0d906c96b540a7b11d508615543890', 'mac_address': 'fa:16:3e:00:20:e6', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'dea93f43-8b8f-439e-820e-4269a0926491', 'device_owner': 'network:router_interface', 'standard_attr_id': 555, 'fixed_ips': [{'subnet_id': 'bfa70c12-21c8-4b7f-8a30-da7ff37b80b8', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-819011-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-23T19:37:50Z', 'updated_at': '2021-11-23T19:37:54Z', 'revision_number': 5, 'project_id': 'ed0d906c96b540a7b11d508615543890', 'subnets': [{'id': 'bfa70c12-21c8-4b7f-8a30-da7ff37b80b8', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-819011-1-iscsi', False) {} {{(pid=102994) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 23 19:38:50.933833 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-518f5a28-d921-42cd-a4d7-c546829d39ea tempest-TestMinimumBasicScenario-716536904 tempest-TestMinimumBasicScenario-716536904-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-601991'] for security_group_rule, after_create {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:38:50.962866 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-518f5a28-d921-42cd-a4d7-c546829d39ea tempest-TestMinimumBasicScenario-716536904 tempest-TestMinimumBasicScenario-716536904-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=a99f91ac-4fb5-4f75-b31b-166b37620546,revision_number=0']} {{(pid=102993) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 23 19:38:50.976361 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-18dacfba-6f42-4ccb-900b-57c71f2d75ab req-d21ac01e-6b64-4cd1-9b3b-fc3c1891a08f service neutron] 10.222.0.41 "GET /v2.0/networks/96f89427-8150-464f-a280-f07cf823b4fd?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0940731 Nov 23 19:38:51.010349 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-518f5a28-d921-42cd-a4d7-c546829d39ea tempest-TestMinimumBasicScenario-716536904 tempest-TestMinimumBasicScenario-716536904-project] Publish callbacks [] for security_group_rule, before_response {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:38:51.011602 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [None req-518f5a28-d921-42cd-a4d7-c546829d39ea tempest-TestMinimumBasicScenario-716536904 tempest-TestMinimumBasicScenario-716536904-project] 10.222.0.62 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 764 time: 0.3251219 Nov 23 19:38:51.014626 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.wsgi [-] (102993) accepted ('10.222.0.62', 49342) {{(pid=102993) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 23 19:38:51.020088 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.api.v2.base [None req-a4598506-30eb-41b9-aadc-5362d672268e tempest-TestMinimumBasicScenario-716536904 tempest-TestMinimumBasicScenario-716536904-project] Request body: {'security_group_rule': {'security_group_id': '04706b6c-202a-4225-af46-0d450ab58a7b', 'project_id': 'ed0d906c96b540a7b11d508615543890', 'protocol': 'tcp', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'egress'}} {{(pid=102993) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 23 19:38:51.027853 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-cf8e08b6-0aa4-4f76-94a0-9ea79f157987 None None] The sync data for ids ['dea93f43-8b8f-439e-820e-4269a0926491'] in dv-cinder-819011-1-iscsi is: [{'id': 'dea93f43-8b8f-439e-820e-4269a0926491', 'name': 'tempest-TestMinimumBasicScenario-387750355-router', 'tenant_id': 'ed0d906c96b540a7b11d508615543890', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'a93e254e-aac9-4233-9e4d-4290fd0458e4', 'external_fixed_ips': [{'subnet_id': 'e0b32f3d-83d6-439a-bbed-01df7cf01051', 'ip_address': '172.27.1.102'}], 'enable_snat': True}, 'gw_port_id': '80f6861a-4aab-4ba4-a058-5c03b253434a', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-23T19:37:47Z', 'updated_at': '2021-11-23T19:37:50Z', 'revision_number': 4, 'project_id': 'ed0d906c96b540a7b11d508615543890', 'gw_port': {'id': '80f6861a-4aab-4ba4-a058-5c03b253434a', 'name': '', 'network_id': 'a93e254e-aac9-4233-9e4d-4290fd0458e4', 'tenant_id': '', 'mac_address': 'fa:16:3e:d4:39:b5', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'dea93f43-8b8f-439e-820e-4269a0926491', 'device_owner': 'network:router_gateway', 'standard_attr_id': 554, 'fixed_ips': [{'subnet_id': 'e0b32f3d-83d6-439a-bbed-01df7cf01051', 'ip_address': '172.27.1.102', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-819011-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-23T19:37:48Z', 'updated_at': '2021-11-23T19:37:52Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'e0b32f3d-83d6-439a-bbed-01df7cf01051', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-819011-1-iscsi', '_floatingips': [{'id': 'e1c3ef82-f958-4d03-8d87-5247ae26ec2a', 'tenant_id': 'ed0d906c96b540a7b11d508615543890', 'floating_ip_address': '172.27.1.233', 'floating_network_id': 'a93e254e-aac9-4233-9e4d-4290fd0458e4', 'router_id': 'dea93f43-8b8f-439e-820e-4269a0926491', 'port_id': '733eac81-0446-4e4c-b1d5-b8c491dcbeb4', 'fixed_ip_address': '172.20.0.7', 'status': 'DOWN', 'standard_attr_id': 581, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '96f89427-8150-464f-a280-f07cf823b4fd', 'mac_address': 'fa:16:3e:1a:2b:21', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'b5fed716-ff16-48c0-8e89-95731739f55c', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-23T19:38:49Z', 'updated_at': '2021-11-23T19:38:49Z', 'revision_number': 0, 'project_id': 'ed0d906c96b540a7b11d508615543890', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '35d7927f-9541-4e91-b520-51ae3ab623f1', 'name': '', 'network_id': '96f89427-8150-464f-a280-f07cf823b4fd', 'tenant_id': 'ed0d906c96b540a7b11d508615543890', 'mac_address': 'fa:16:3e:00:20:e6', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'dea93f43-8b8f-439e-820e-4269a0926491', 'device_owner': 'network:router_interface', 'standard_attr_id': 555, 'fixed_ips': [{'subnet_id': 'bfa70c12-21c8-4b7f-8a30-da7ff37b80b8', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-819011-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-23T19:37:50Z', 'updated_at': '2021-11-23T19:37:54Z', 'revision_number': 5, 'project_id': 'ed0d906c96b540a7b11d508615543890', 'subnets': [{'id': 'bfa70c12-21c8-4b7f-8a30-da7ff37b80b8', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=102994) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 23 19:38:51.104358 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-a4598506-30eb-41b9-aadc-5362d672268e tempest-TestMinimumBasicScenario-716536904 tempest-TestMinimumBasicScenario-716536904-project] Publish callbacks [] for security_group_rule, before_create {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:38:51.164993 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-a4598506-30eb-41b9-aadc-5362d672268e tempest-TestMinimumBasicScenario-716536904 tempest-TestMinimumBasicScenario-716536904-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:38:51.225172 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-a4598506-30eb-41b9-aadc-5362d672268e tempest-TestMinimumBasicScenario-716536904 tempest-TestMinimumBasicScenario-716536904-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-601991'] for security_group_rule, after_create {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:38:51.230113 dv-cinder-819011-1-iscsi neutron-server[102995]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-96f5f5a9-b475-435d-bc49-f7d3f2217203 None None] New status for floating IP e1c3ef82-f958-4d03-8d87-5247ae26ec2a: ACTIVE {{(pid=102995) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Nov 23 19:38:51.244446 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a4598506-30eb-41b9-aadc-5362d672268e tempest-TestMinimumBasicScenario-716536904 tempest-TestMinimumBasicScenario-716536904-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=d99ec365-904a-4dee-90d4-e857211ae628,revision_number=0']} {{(pid=102993) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 23 19:38:51.319788 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-a4598506-30eb-41b9-aadc-5362d672268e tempest-TestMinimumBasicScenario-716536904 tempest-TestMinimumBasicScenario-716536904-project] Publish callbacks [] for security_group_rule, before_response {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:38:51.321211 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [None req-a4598506-30eb-41b9-aadc-5362d672268e tempest-TestMinimumBasicScenario-716536904 tempest-TestMinimumBasicScenario-716536904-project] 10.222.0.62 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 763 time: 0.3055906 Nov 23 19:38:51.323917 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.wsgi [-] (102993) accepted ('10.222.0.62', 49346) {{(pid=102993) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 23 19:38:51.328442 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.api.v2.base [None req-84b8c175-3df3-4995-bbfc-3fe42e631139 tempest-TestMinimumBasicScenario-716536904 tempest-TestMinimumBasicScenario-716536904-project] Request body: {'security_group_rule': {'security_group_id': '04706b6c-202a-4225-af46-0d450ab58a7b', 'project_id': 'ed0d906c96b540a7b11d508615543890', 'protocol': 'icmp', 'direction': 'ingress'}} {{(pid=102993) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 23 19:38:51.407406 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-84b8c175-3df3-4995-bbfc-3fe42e631139 tempest-TestMinimumBasicScenario-716536904 tempest-TestMinimumBasicScenario-716536904-project] Publish callbacks [] for security_group_rule, before_create {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:38:51.467320 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-84b8c175-3df3-4995-bbfc-3fe42e631139 tempest-TestMinimumBasicScenario-716536904 tempest-TestMinimumBasicScenario-716536904-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:38:51.533545 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-84b8c175-3df3-4995-bbfc-3fe42e631139 tempest-TestMinimumBasicScenario-716536904 tempest-TestMinimumBasicScenario-716536904-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-601991'] for security_group_rule, after_create {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:38:51.553231 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-84b8c175-3df3-4995-bbfc-3fe42e631139 tempest-TestMinimumBasicScenario-716536904 tempest-TestMinimumBasicScenario-716536904-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=8feae810-4366-46d5-9a59-7875e19a60d7,revision_number=0']} {{(pid=102993) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 23 19:38:51.637998 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-84b8c175-3df3-4995-bbfc-3fe42e631139 tempest-TestMinimumBasicScenario-716536904 tempest-TestMinimumBasicScenario-716536904-project] Publish callbacks [] for security_group_rule, before_response {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:38:51.639208 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [None req-84b8c175-3df3-4995-bbfc-3fe42e631139 tempest-TestMinimumBasicScenario-716536904 tempest-TestMinimumBasicScenario-716536904-project] 10.222.0.62 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 769 time: 0.3142779 Nov 23 19:38:51.641983 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.wsgi [-] (102993) accepted ('10.222.0.62', 49348) {{(pid=102993) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 23 19:38:51.646345 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.api.v2.base [None req-8c2375eb-2f41-4a17-a3d9-7ee1b789caef tempest-TestMinimumBasicScenario-716536904 tempest-TestMinimumBasicScenario-716536904-project] Request body: {'security_group_rule': {'security_group_id': '04706b6c-202a-4225-af46-0d450ab58a7b', 'project_id': 'ed0d906c96b540a7b11d508615543890', 'protocol': 'icmp', 'direction': 'egress'}} {{(pid=102993) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 23 19:38:51.738771 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-8c2375eb-2f41-4a17-a3d9-7ee1b789caef tempest-TestMinimumBasicScenario-716536904 tempest-TestMinimumBasicScenario-716536904-project] Publish callbacks [] for security_group_rule, before_create {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:38:51.794375 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-8c2375eb-2f41-4a17-a3d9-7ee1b789caef tempest-TestMinimumBasicScenario-716536904 tempest-TestMinimumBasicScenario-716536904-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:38:51.847764 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-8c2375eb-2f41-4a17-a3d9-7ee1b789caef tempest-TestMinimumBasicScenario-716536904 tempest-TestMinimumBasicScenario-716536904-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-601991'] for security_group_rule, after_create {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:38:51.866061 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8c2375eb-2f41-4a17-a3d9-7ee1b789caef tempest-TestMinimumBasicScenario-716536904 tempest-TestMinimumBasicScenario-716536904-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=10a84149-0657-4cea-91e5-069621b9583f,revision_number=0']} {{(pid=102993) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 23 19:38:51.912449 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-8c2375eb-2f41-4a17-a3d9-7ee1b789caef tempest-TestMinimumBasicScenario-716536904 tempest-TestMinimumBasicScenario-716536904-project] Publish callbacks [] for security_group_rule, before_response {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:38:51.913729 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [None req-8c2375eb-2f41-4a17-a3d9-7ee1b789caef tempest-TestMinimumBasicScenario-716536904 tempest-TestMinimumBasicScenario-716536904-project] 10.222.0.62 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 768 time: 0.2706857 Nov 23 19:38:51.916453 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.wsgi [-] (102993) accepted ('10.222.0.62', 49352) {{(pid=102993) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 23 19:38:51.920753 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.api.v2.base [None req-1aafa6d0-afcc-4804-b495-6fdabc2124ff tempest-TestMinimumBasicScenario-716536904 tempest-TestMinimumBasicScenario-716536904-project] Request body: {'security_group_rule': {'security_group_id': '04706b6c-202a-4225-af46-0d450ab58a7b', 'project_id': 'ed0d906c96b540a7b11d508615543890', 'protocol': 'icmp', 'ethertype': 'IPv6', 'direction': 'ingress'}} {{(pid=102993) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 23 19:38:51.990644 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.db.securitygroups_db [None req-1aafa6d0-afcc-4804-b495-6fdabc2124ff tempest-TestMinimumBasicScenario-716536904 tempest-TestMinimumBasicScenario-716536904-project] Project ed0d906c96b540a7b11d508615543890 added a security group rule with legacy IPv6 ICMP protocol name icmp, ipv6-icmp should be used instead. It was automatically converted. Nov 23 19:38:51.995832 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-1aafa6d0-afcc-4804-b495-6fdabc2124ff tempest-TestMinimumBasicScenario-716536904 tempest-TestMinimumBasicScenario-716536904-project] Publish callbacks [] for security_group_rule, before_create {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:38:52.054985 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-1aafa6d0-afcc-4804-b495-6fdabc2124ff tempest-TestMinimumBasicScenario-716536904 tempest-TestMinimumBasicScenario-716536904-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:38:52.087428 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-1aafa6d0-afcc-4804-b495-6fdabc2124ff tempest-TestMinimumBasicScenario-716536904 tempest-TestMinimumBasicScenario-716536904-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-601991'] for security_group_rule, after_create {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:38:52.105657 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1aafa6d0-afcc-4804-b495-6fdabc2124ff tempest-TestMinimumBasicScenario-716536904 tempest-TestMinimumBasicScenario-716536904-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=3b0b9eed-aa9b-49cb-8444-208071801ff5,revision_number=0']} {{(pid=102993) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 23 19:38:52.152447 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-1aafa6d0-afcc-4804-b495-6fdabc2124ff tempest-TestMinimumBasicScenario-716536904 tempest-TestMinimumBasicScenario-716536904-project] Publish callbacks [] for security_group_rule, before_response {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:38:52.153686 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [None req-1aafa6d0-afcc-4804-b495-6fdabc2124ff tempest-TestMinimumBasicScenario-716536904 tempest-TestMinimumBasicScenario-716536904-project] 10.222.0.62 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 774 time: 0.2362604 Nov 23 19:38:52.156408 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.wsgi [-] (102993) accepted ('10.222.0.62', 49354) {{(pid=102993) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 23 19:38:52.161292 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.api.v2.base [None req-c92624e5-db9a-47d1-9c42-e1965b11cfb3 tempest-TestMinimumBasicScenario-716536904 tempest-TestMinimumBasicScenario-716536904-project] Request body: {'security_group_rule': {'security_group_id': '04706b6c-202a-4225-af46-0d450ab58a7b', 'project_id': 'ed0d906c96b540a7b11d508615543890', 'protocol': 'icmp', 'ethertype': 'IPv6', 'direction': 'egress'}} {{(pid=102993) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 23 19:38:52.230248 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.db.securitygroups_db [None req-c92624e5-db9a-47d1-9c42-e1965b11cfb3 tempest-TestMinimumBasicScenario-716536904 tempest-TestMinimumBasicScenario-716536904-project] Project ed0d906c96b540a7b11d508615543890 added a security group rule with legacy IPv6 ICMP protocol name icmp, ipv6-icmp should be used instead. It was automatically converted. Nov 23 19:38:52.235404 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-c92624e5-db9a-47d1-9c42-e1965b11cfb3 tempest-TestMinimumBasicScenario-716536904 tempest-TestMinimumBasicScenario-716536904-project] Publish callbacks [] for security_group_rule, before_create {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:38:52.296652 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-c92624e5-db9a-47d1-9c42-e1965b11cfb3 tempest-TestMinimumBasicScenario-716536904 tempest-TestMinimumBasicScenario-716536904-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:38:52.350182 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-c92624e5-db9a-47d1-9c42-e1965b11cfb3 tempest-TestMinimumBasicScenario-716536904 tempest-TestMinimumBasicScenario-716536904-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-601991'] for security_group_rule, after_create {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:38:52.368574 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c92624e5-db9a-47d1-9c42-e1965b11cfb3 tempest-TestMinimumBasicScenario-716536904 tempest-TestMinimumBasicScenario-716536904-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=2496335e-1a29-4925-b27b-4575942c7513,revision_number=0']} {{(pid=102993) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 23 19:38:52.415413 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-c92624e5-db9a-47d1-9c42-e1965b11cfb3 tempest-TestMinimumBasicScenario-716536904 tempest-TestMinimumBasicScenario-716536904-project] Publish callbacks [] for security_group_rule, before_response {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:38:52.416680 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [None req-c92624e5-db9a-47d1-9c42-e1965b11cfb3 tempest-TestMinimumBasicScenario-716536904 tempest-TestMinimumBasicScenario-716536904-project] 10.222.0.62 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 773 time: 0.2593615 Nov 23 19:38:52.508297 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-7a781b85-11dc-489b-8292-00e3d54cb4c5 req-8be13996-7035-4269-9a05-1bce75dcbc6c tempest-TestMinimumBasicScenario-716536904 tempest-TestMinimumBasicScenario-716536904-project] 10.222.0.62 "GET /v2.0/security-groups?name=tempest-secgroup-smoke-1929938272&fields=id&tenant_id=ed0d906c96b540a7b11d508615543890 HTTP/1.1" status: 200 len: 267 time: 0.0441511 Nov 23 19:38:52.559660 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7a781b85-11dc-489b-8292-00e3d54cb4c5 req-c4281139-abb0-4312-9a07-7e31106b205e tempest-TestMinimumBasicScenario-716536904 tempest-TestMinimumBasicScenario-716536904-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102993) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:38:52.561070 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-7a781b85-11dc-489b-8292-00e3d54cb4c5 req-c4281139-abb0-4312-9a07-7e31106b205e tempest-TestMinimumBasicScenario-716536904 tempest-TestMinimumBasicScenario-716536904-project] 10.222.0.62 "GET /v2.0/ports?device_id=b5fed716-ff16-48c0-8e89-95731739f55c HTTP/1.1" status: 200 len: 945 time: 0.0471694 Nov 23 19:38:52.573257 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.api.v2.base [req-7a781b85-11dc-489b-8292-00e3d54cb4c5 req-dd25cfac-6653-49ab-80d2-8bcfa510f7bc tempest-TestMinimumBasicScenario-716536904 tempest-TestMinimumBasicScenario-716536904-project] Request body: {'port': {'security_groups': ['d09b4044-91d5-4432-9faa-4b7a40b1627d', '04706b6c-202a-4225-af46-0d450ab58a7b']}} {{(pid=102993) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 23 19:38:52.637586 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [req-7a781b85-11dc-489b-8292-00e3d54cb4c5 req-dd25cfac-6653-49ab-80d2-8bcfa510f7bc tempest-TestMinimumBasicScenario-716536904 tempest-TestMinimumBasicScenario-716536904-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7921281'] for port, before_update {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:38:52.818618 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.plugins.ml2.db [req-7a781b85-11dc-489b-8292-00e3d54cb4c5 req-dd25cfac-6653-49ab-80d2-8bcfa510f7bc tempest-TestMinimumBasicScenario-716536904 tempest-TestMinimumBasicScenario-716536904-project] For port 733eac81-0446-4e4c-b1d5-b8c491dcbeb4, host hv-cinder-81901, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81901',level=0,port_id=733eac81-0446-4e4c-b1d5-b8c491dcbeb4,segment=NetworkSegment(81f92f0c-ea8d-4880-af1c-e4418f898de3),segment_id=81f92f0c-ea8d-4880-af1c-e4418f898de3)] {{(pid=102993) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 23 19:38:52.848109 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [req-7a781b85-11dc-489b-8292-00e3d54cb4c5 req-dd25cfac-6653-49ab-80d2-8bcfa510f7bc tempest-TestMinimumBasicScenario-716536904 tempest-TestMinimumBasicScenario-716536904-project] Publish callbacks [] for port, precommit_update {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:38:52.939450 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [req-7a781b85-11dc-489b-8292-00e3d54cb4c5 req-dd25cfac-6653-49ab-80d2-8bcfa510f7bc tempest-TestMinimumBasicScenario-716536904 tempest-TestMinimumBasicScenario-716536904-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7918660', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-15067', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560168', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8783631423946', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8783631008732', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8783631008750', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-17257505'] for port, after_update {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:38:52.952305 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.plugins.ml2.db [None req-4bf48ff4-ecfb-4168-8b63-249b8c6e9f04 None None] get_ports_and_sgs() called for port_ids ['733eac81-0446-4e4c-b1d5-b8c491dcbeb4'] {{(pid=102994) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 23 19:38:52.983253 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7a781b85-11dc-489b-8292-00e3d54cb4c5 req-dd25cfac-6653-49ab-80d2-8bcfa510f7bc tempest-TestMinimumBasicScenario-716536904 tempest-TestMinimumBasicScenario-716536904-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102993) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:38:52.983880 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [req-7a781b85-11dc-489b-8292-00e3d54cb4c5 req-dd25cfac-6653-49ab-80d2-8bcfa510f7bc tempest-TestMinimumBasicScenario-716536904 tempest-TestMinimumBasicScenario-716536904-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-514902'] for port, before_response {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:38:52.985433 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-7a781b85-11dc-489b-8292-00e3d54cb4c5 req-dd25cfac-6653-49ab-80d2-8bcfa510f7bc tempest-TestMinimumBasicScenario-716536904 tempest-TestMinimumBasicScenario-716536904-project] 10.222.0.62 "PUT /v2.0/ports/733eac81-0446-4e4c-b1d5-b8c491dcbeb4 HTTP/1.1" status: 200 len: 981 time: 0.4166377 Nov 23 19:38:52.985762 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'b5fed716-ff16-48c0-8e89-95731739f55c', 'tag': '733eac81-0446-4e4c-b1d5-b8c491dcbeb4'}] {{(pid=102993) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 23 19:38:52.988289 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.62/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}9b10b92acbee16fb695be1efeed0b68f7c36a5b215ec004a8d9d707fa3d35b2c" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-83a440e2-9e40-44f0-a811-b0736bbef2cd" -d '{"events": [{"name": "network-changed", "server_uuid": "b5fed716-ff16-48c0-8e89-95731739f55c", "tag": "733eac81-0446-4e4c-b1d5-b8c491dcbeb4"}]}' {{(pid=102993) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 23 19:38:53.031386 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-dd25cfac-6653-49ab-80d2-8bcfa510f7bc tempest-TestMinimumBasicScenario-716536904 tempest-TestMinimumBasicScenario-716536904-project] Pushing event updated for resources: {'Port': ['ID=733eac81-0446-4e4c-b1d5-b8c491dcbeb4,revision_number=6']} {{(pid=102993) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 23 19:38:53.036440 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Tue, 23 Nov 2021 19:38:52 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-de97b088-64a6-46f2-bff8-aea80c3406c8 x-openstack-request-id: req-de97b088-64a6-46f2-bff8-aea80c3406c8 {{(pid=102993) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 23 19:38:53.036738 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "b5fed716-ff16-48c0-8e89-95731739f55c", "tag": "733eac81-0446-4e4c-b1d5-b8c491dcbeb4", "status": "completed", "code": 200}]} {{(pid=102993) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 23 19:38:53.037002 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.62/compute/v2.1/os-server-external-events used request id req-de97b088-64a6-46f2-bff8-aea80c3406c8 {{(pid=102993) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 23 19:38:53.037428 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'b5fed716-ff16-48c0-8e89-95731739f55c', 'tag': '733eac81-0446-4e4c-b1d5-b8c491dcbeb4', 'status': 'completed', 'code': 200} Nov 23 19:38:53.125210 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.plugins.ml2.db [None req-4bf48ff4-ecfb-4168-8b63-249b8c6e9f04 None None] get_ports_and_sgs() called for port_ids ['733eac81-0446-4e4c-b1d5-b8c491dcbeb4'] {{(pid=102994) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 23 19:38:53.128745 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-83a440e2-9e40-44f0-a811-b0736bbef2cd req-e732e314-5021-4cce-9300-8585a7e5c16a service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102992) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:38:53.130315 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-83a440e2-9e40-44f0-a811-b0736bbef2cd req-e732e314-5021-4cce-9300-8585a7e5c16a service neutron] 10.222.0.41 "GET /v2.0/ports?tenant_id=ed0d906c96b540a7b11d508615543890&device_id=b5fed716-ff16-48c0-8e89-95731739f55c HTTP/1.1" status: 200 len: 1137 time: 0.0652709 Nov 23 19:38:53.141258 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0d58125a-aa19-4139-9159-be5697a9708a req-bf8261a4-1cf4-4ff2-8664-e6e6e658a561 tempest-TestMinimumBasicScenario-716536904 tempest-TestMinimumBasicScenario-716536904-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102992) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:38:53.147983 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-0d58125a-aa19-4139-9159-be5697a9708a req-bf8261a4-1cf4-4ff2-8664-e6e6e658a561 tempest-TestMinimumBasicScenario-716536904 tempest-TestMinimumBasicScenario-716536904-project] 10.222.0.62 "GET /v2.0/ports?device_id=b5fed716-ff16-48c0-8e89-95731739f55c HTTP/1.1" status: 200 len: 984 time: 0.0935454 Nov 23 19:38:53.264989 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-0d58125a-aa19-4139-9159-be5697a9708a req-0be91e22-5392-4f00-8b6f-0b3e9ceff0fb tempest-TestMinimumBasicScenario-716536904 tempest-TestMinimumBasicScenario-716536904-project] 10.222.0.62 "GET /v2.0/security-groups?id=d09b4044-91d5-4432-9faa-4b7a40b1627d&id=04706b6c-202a-4225-af46-0d450ab58a7b&fields=id&fields=name HTTP/1.1" status: 200 len: 380 time: 0.1146076 Nov 23 19:38:53.281388 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-83a440e2-9e40-44f0-a811-b0736bbef2cd req-8d569792-1d92-40e1-b3a5-0028eae0ab72 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102992) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:38:53.283433 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-83a440e2-9e40-44f0-a811-b0736bbef2cd req-8d569792-1d92-40e1-b3a5-0028eae0ab72 service neutron] 10.222.0.41 "GET /v2.0/networks?id=96f89427-8150-464f-a280-f07cf823b4fd HTTP/1.1" status: 200 len: 915 time: 0.1339500 Nov 23 19:38:53.286617 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.db.provisioning_blocks [None req-8ba03883-3e54-4293-8738-bcee9b81e480 None None] Provisioning complete for port 733eac81-0446-4e4c-b1d5-b8c491dcbeb4 triggered by entity DHCP. {{(pid=102994) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 23 19:38:53.287056 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron_lib.callbacks.manager [None req-8ba03883-3e54-4293-8738-bcee9b81e480 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-8355713'] for port, provisioning_complete {{(pid=102994) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:38:53.355034 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-83a440e2-9e40-44f0-a811-b0736bbef2cd req-81fb7412-ed78-4223-85e2-39f54aa67b5f service neutron] 10.222.0.41 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.7&port_id=733eac81-0446-4e4c-b1d5-b8c491dcbeb4 HTTP/1.1" status: 200 len: 1001 time: 0.0592649 Nov 23 19:38:53.409667 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-83a440e2-9e40-44f0-a811-b0736bbef2cd req-5e5b9cd5-79a9-40bd-a5ba-f4e422cd590b service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102992) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:38:53.411417 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-83a440e2-9e40-44f0-a811-b0736bbef2cd req-5e5b9cd5-79a9-40bd-a5ba-f4e422cd590b service neutron] 10.222.0.41 "GET /v2.0/subnets?id=bfa70c12-21c8-4b7f-8a30-da7ff37b80b8 HTTP/1.1" status: 200 len: 853 time: 0.0480683 Nov 23 19:38:53.468939 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-83a440e2-9e40-44f0-a811-b0736bbef2cd req-9371a469-b285-42fe-b211-c3f77a4466ff service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102992) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:38:53.470725 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-83a440e2-9e40-44f0-a811-b0736bbef2cd req-9371a469-b285-42fe-b211-c3f77a4466ff service neutron] 10.222.0.41 "GET /v2.0/ports?network_id=96f89427-8150-464f-a280-f07cf823b4fd&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0510380 Nov 23 19:38:53.563431 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-83a440e2-9e40-44f0-a811-b0736bbef2cd req-eae55ec3-96ac-4ab9-8915-c44dbf24eb1f service neutron] 10.222.0.41 "GET /v2.0/networks/96f89427-8150-464f-a280-f07cf823b4fd?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0835395 Nov 23 19:38:53.658823 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-83a440e2-9e40-44f0-a811-b0736bbef2cd req-9dbc429d-69bc-4ca5-9e88-aaac9ee72809 service neutron] 10.222.0.41 "GET /v2.0/networks/96f89427-8150-464f-a280-f07cf823b4fd?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0859993 Nov 23 19:38:55.951290 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-22d41dc1-00cd-4ee4-a141-f39adf558245 req-952c3cdf-272a-4748-aa8a-8a96c23d5765 tempest-AttachVolumeTestJSON-1120920040 tempest-AttachVolumeTestJSON-1120920040-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102992) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:38:55.952740 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-22d41dc1-00cd-4ee4-a141-f39adf558245 req-952c3cdf-272a-4748-aa8a-8a96c23d5765 tempest-AttachVolumeTestJSON-1120920040 tempest-AttachVolumeTestJSON-1120920040-project] 10.222.0.62 "GET /v2.0/ports?device_id=029fedce-3168-4d1d-992e-a9466fe3e886 HTTP/1.1" status: 200 len: 945 time: 0.0495186 Nov 23 19:38:56.001317 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-22d41dc1-00cd-4ee4-a141-f39adf558245 req-d2bb05a4-24ef-449f-ab8d-70e026956490 tempest-AttachVolumeTestJSON-1120920040 tempest-AttachVolumeTestJSON-1120920040-project] 10.222.0.62 "GET /v2.0/security-groups?id=f8cf4027-ad94-4b78-b429-c3f2d7f9d324&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0415356 Nov 23 19:38:57.121761 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-633f202e-1a1e-4aaf-8dea-f3ebc45f7b79 req-5b11e8dd-a55f-42c8-82d3-252a0f040a86 tempest-AttachVolumeTestJSON-1120920040 tempest-AttachVolumeTestJSON-1120920040-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102992) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:38:57.123136 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-633f202e-1a1e-4aaf-8dea-f3ebc45f7b79 req-5b11e8dd-a55f-42c8-82d3-252a0f040a86 tempest-AttachVolumeTestJSON-1120920040 tempest-AttachVolumeTestJSON-1120920040-project] 10.222.0.62 "GET /v2.0/ports?device_id=029fedce-3168-4d1d-992e-a9466fe3e886 HTTP/1.1" status: 200 len: 945 time: 0.0516117 Nov 23 19:38:57.169583 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-633f202e-1a1e-4aaf-8dea-f3ebc45f7b79 req-4fcf39e2-a560-40a4-8bff-3d1c9ae9d7c9 tempest-AttachVolumeTestJSON-1120920040 tempest-AttachVolumeTestJSON-1120920040-project] 10.222.0.62 "GET /v2.0/security-groups?id=f8cf4027-ad94-4b78-b429-c3f2d7f9d324&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0397668 Nov 23 19:38:58.286336 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-36ffab22-4c2e-47e4-95ec-222740b29db5 req-8a041c73-c35b-43c6-988c-774da1322a2f tempest-AttachVolumeTestJSON-1120920040 tempest-AttachVolumeTestJSON-1120920040-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102992) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:38:58.287803 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-36ffab22-4c2e-47e4-95ec-222740b29db5 req-8a041c73-c35b-43c6-988c-774da1322a2f tempest-AttachVolumeTestJSON-1120920040 tempest-AttachVolumeTestJSON-1120920040-project] 10.222.0.62 "GET /v2.0/ports?device_id=029fedce-3168-4d1d-992e-a9466fe3e886 HTTP/1.1" status: 200 len: 945 time: 0.0484424 Nov 23 19:38:58.333910 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-36ffab22-4c2e-47e4-95ec-222740b29db5 req-6ec91f89-d081-44cd-8862-45ec21ea3447 tempest-AttachVolumeTestJSON-1120920040 tempest-AttachVolumeTestJSON-1120920040-project] 10.222.0.62 "GET /v2.0/security-groups?id=f8cf4027-ad94-4b78-b429-c3f2d7f9d324&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0402541 Nov 23 19:38:59.450674 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7db5673a-77a0-45cb-9f12-5daedebbebc8 req-c97f86a7-1042-4333-b8e9-af783401eeac tempest-AttachVolumeTestJSON-1120920040 tempest-AttachVolumeTestJSON-1120920040-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102992) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:38:59.452120 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-7db5673a-77a0-45cb-9f12-5daedebbebc8 req-c97f86a7-1042-4333-b8e9-af783401eeac tempest-AttachVolumeTestJSON-1120920040 tempest-AttachVolumeTestJSON-1120920040-project] 10.222.0.62 "GET /v2.0/ports?device_id=029fedce-3168-4d1d-992e-a9466fe3e886 HTTP/1.1" status: 200 len: 945 time: 0.0502949 Nov 23 19:38:59.733335 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-7db5673a-77a0-45cb-9f12-5daedebbebc8 req-f5846b04-1a61-4441-b9bd-d5faa317fd94 tempest-AttachVolumeTestJSON-1120920040 tempest-AttachVolumeTestJSON-1120920040-project] 10.222.0.62 "GET /v2.0/security-groups?id=f8cf4027-ad94-4b78-b429-c3f2d7f9d324&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.2742226 Nov 23 19:38:59.744173 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron_lib.callbacks.manager [None req-4bf48ff4-ecfb-4168-8b63-249b8c6e9f04 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8783631323329', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7978582'] for agent, after_update {{(pid=102994) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:39:00.848725 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d843925d-c828-4936-a66e-74dcb64957b4 req-fe4e5fae-b6ab-495f-bee7-6602ca42d58d tempest-AttachVolumeTestJSON-1120920040 tempest-AttachVolumeTestJSON-1120920040-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102992) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:39:00.850156 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-d843925d-c828-4936-a66e-74dcb64957b4 req-fe4e5fae-b6ab-495f-bee7-6602ca42d58d tempest-AttachVolumeTestJSON-1120920040 tempest-AttachVolumeTestJSON-1120920040-project] 10.222.0.62 "GET /v2.0/ports?device_id=029fedce-3168-4d1d-992e-a9466fe3e886 HTTP/1.1" status: 200 len: 945 time: 0.0475993 Nov 23 19:39:00.896387 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-d843925d-c828-4936-a66e-74dcb64957b4 req-8e760366-a8eb-4798-9f32-cb1f2ed01309 tempest-AttachVolumeTestJSON-1120920040 tempest-AttachVolumeTestJSON-1120920040-project] 10.222.0.62 "GET /v2.0/security-groups?id=f8cf4027-ad94-4b78-b429-c3f2d7f9d324&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0404408 Nov 23 19:39:02.010357 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-aa3152a3-3cfb-43fb-ba85-7253025e482a req-2cdcc896-3e1c-404b-962d-c70b6c32678a tempest-AttachVolumeTestJSON-1120920040 tempest-AttachVolumeTestJSON-1120920040-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102992) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:39:02.011823 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-aa3152a3-3cfb-43fb-ba85-7253025e482a req-2cdcc896-3e1c-404b-962d-c70b6c32678a tempest-AttachVolumeTestJSON-1120920040 tempest-AttachVolumeTestJSON-1120920040-project] 10.222.0.62 "GET /v2.0/ports?device_id=029fedce-3168-4d1d-992e-a9466fe3e886 HTTP/1.1" status: 200 len: 945 time: 0.0480578 Nov 23 19:39:02.061584 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-aa3152a3-3cfb-43fb-ba85-7253025e482a req-2465177c-807a-4387-bc1c-b8d406dc505d tempest-AttachVolumeTestJSON-1120920040 tempest-AttachVolumeTestJSON-1120920040-project] 10.222.0.62 "GET /v2.0/security-groups?id=f8cf4027-ad94-4b78-b429-c3f2d7f9d324&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0438449 Nov 23 19:39:03.175727 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4518d02a-ffb6-495c-941d-a5d86b1feb04 req-9058ec9f-0e11-458a-8754-ba24c1a4fcbe tempest-AttachVolumeTestJSON-1120920040 tempest-AttachVolumeTestJSON-1120920040-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102992) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:39:03.177190 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-4518d02a-ffb6-495c-941d-a5d86b1feb04 req-9058ec9f-0e11-458a-8754-ba24c1a4fcbe tempest-AttachVolumeTestJSON-1120920040 tempest-AttachVolumeTestJSON-1120920040-project] 10.222.0.62 "GET /v2.0/ports?device_id=029fedce-3168-4d1d-992e-a9466fe3e886 HTTP/1.1" status: 200 len: 945 time: 0.0475526 Nov 23 19:39:03.224486 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-4518d02a-ffb6-495c-941d-a5d86b1feb04 req-dced91e7-a454-4d1d-b749-01d8554451dc tempest-AttachVolumeTestJSON-1120920040 tempest-AttachVolumeTestJSON-1120920040-project] 10.222.0.62 "GET /v2.0/security-groups?id=f8cf4027-ad94-4b78-b429-c3f2d7f9d324&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0414801 Nov 23 19:39:04.340859 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3065792b-fe6d-492f-94ad-1a55def1ae56 req-a04d4784-b262-4f03-b98c-63a95fa0f134 tempest-AttachVolumeTestJSON-1120920040 tempest-AttachVolumeTestJSON-1120920040-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102992) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:39:04.342391 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-3065792b-fe6d-492f-94ad-1a55def1ae56 req-a04d4784-b262-4f03-b98c-63a95fa0f134 tempest-AttachVolumeTestJSON-1120920040 tempest-AttachVolumeTestJSON-1120920040-project] 10.222.0.62 "GET /v2.0/ports?device_id=029fedce-3168-4d1d-992e-a9466fe3e886 HTTP/1.1" status: 200 len: 945 time: 0.0478833 Nov 23 19:39:04.388528 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-3065792b-fe6d-492f-94ad-1a55def1ae56 req-5f67a3c1-0ded-49b8-a829-c335a9765432 tempest-AttachVolumeTestJSON-1120920040 tempest-AttachVolumeTestJSON-1120920040-project] 10.222.0.62 "GET /v2.0/security-groups?id=f8cf4027-ad94-4b78-b429-c3f2d7f9d324&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0396788 Nov 23 19:39:05.506550 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3e73214a-fe82-4e96-9e36-51a499a0b2c3 req-98ac5cfb-62dc-449d-827d-dde76b16668d tempest-AttachVolumeTestJSON-1120920040 tempest-AttachVolumeTestJSON-1120920040-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102992) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:39:05.508017 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-3e73214a-fe82-4e96-9e36-51a499a0b2c3 req-98ac5cfb-62dc-449d-827d-dde76b16668d tempest-AttachVolumeTestJSON-1120920040 tempest-AttachVolumeTestJSON-1120920040-project] 10.222.0.62 "GET /v2.0/ports?device_id=029fedce-3168-4d1d-992e-a9466fe3e886 HTTP/1.1" status: 200 len: 945 time: 0.0523236 Nov 23 19:39:05.555276 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-3e73214a-fe82-4e96-9e36-51a499a0b2c3 req-12f19216-c897-4da5-954a-7db2f482b565 tempest-AttachVolumeTestJSON-1120920040 tempest-AttachVolumeTestJSON-1120920040-project] 10.222.0.62 "GET /v2.0/security-groups?id=f8cf4027-ad94-4b78-b429-c3f2d7f9d324&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0411716 Nov 23 19:39:06.670952 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ec2d3cf1-dd46-4acb-aeb4-8f8daf511a24 req-7eafd335-8655-46f6-8e05-c86ff6cb65dc tempest-AttachVolumeTestJSON-1120920040 tempest-AttachVolumeTestJSON-1120920040-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102992) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:39:06.672402 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-ec2d3cf1-dd46-4acb-aeb4-8f8daf511a24 req-7eafd335-8655-46f6-8e05-c86ff6cb65dc tempest-AttachVolumeTestJSON-1120920040 tempest-AttachVolumeTestJSON-1120920040-project] 10.222.0.62 "GET /v2.0/ports?device_id=029fedce-3168-4d1d-992e-a9466fe3e886 HTTP/1.1" status: 200 len: 945 time: 0.0481377 Nov 23 19:39:06.719586 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-ec2d3cf1-dd46-4acb-aeb4-8f8daf511a24 req-31e3275f-2a40-4e93-a5fc-90d91107208f tempest-AttachVolumeTestJSON-1120920040 tempest-AttachVolumeTestJSON-1120920040-project] 10.222.0.62 "GET /v2.0/security-groups?id=f8cf4027-ad94-4b78-b429-c3f2d7f9d324&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0410943 Nov 23 19:39:07.836231 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-057f79c9-0087-45f8-aada-868ee6546938 req-c06534aa-e8b9-4b4f-8a60-0f4ecc59ed80 tempest-AttachVolumeTestJSON-1120920040 tempest-AttachVolumeTestJSON-1120920040-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102992) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:39:07.837723 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-057f79c9-0087-45f8-aada-868ee6546938 req-c06534aa-e8b9-4b4f-8a60-0f4ecc59ed80 tempest-AttachVolumeTestJSON-1120920040 tempest-AttachVolumeTestJSON-1120920040-project] 10.222.0.62 "GET /v2.0/ports?device_id=029fedce-3168-4d1d-992e-a9466fe3e886 HTTP/1.1" status: 200 len: 945 time: 0.0485320 Nov 23 19:39:07.886608 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-057f79c9-0087-45f8-aada-868ee6546938 req-4639a5da-9272-4376-a951-5219448a7999 tempest-AttachVolumeTestJSON-1120920040 tempest-AttachVolumeTestJSON-1120920040-project] 10.222.0.62 "GET /v2.0/security-groups?id=f8cf4027-ad94-4b78-b429-c3f2d7f9d324&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0430052 Nov 23 19:39:09.020054 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-75ca4ff1-a2ad-4a0d-9932-993f0d168554 req-dce93169-76d8-48cc-b6f0-8490ea3c7637 tempest-AttachVolumeTestJSON-1120920040 tempest-AttachVolumeTestJSON-1120920040-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102992) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:39:09.021664 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-75ca4ff1-a2ad-4a0d-9932-993f0d168554 req-dce93169-76d8-48cc-b6f0-8490ea3c7637 tempest-AttachVolumeTestJSON-1120920040 tempest-AttachVolumeTestJSON-1120920040-project] 10.222.0.62 "GET /v2.0/ports?device_id=029fedce-3168-4d1d-992e-a9466fe3e886 HTTP/1.1" status: 200 len: 945 time: 0.0559099 Nov 23 19:39:09.074907 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-75ca4ff1-a2ad-4a0d-9932-993f0d168554 req-ecafb8de-23b0-4421-81ef-f93883771e84 tempest-AttachVolumeTestJSON-1120920040 tempest-AttachVolumeTestJSON-1120920040-project] 10.222.0.62 "GET /v2.0/security-groups?id=f8cf4027-ad94-4b78-b429-c3f2d7f9d324&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0429473 Nov 23 19:39:10.188735 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e7d51e13-9973-4442-933b-a693f36998d4 req-3c26374e-94f6-45b8-9412-b1e603f2f979 tempest-AttachVolumeTestJSON-1120920040 tempest-AttachVolumeTestJSON-1120920040-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102992) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:39:10.190148 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-e7d51e13-9973-4442-933b-a693f36998d4 req-3c26374e-94f6-45b8-9412-b1e603f2f979 tempest-AttachVolumeTestJSON-1120920040 tempest-AttachVolumeTestJSON-1120920040-project] 10.222.0.62 "GET /v2.0/ports?device_id=029fedce-3168-4d1d-992e-a9466fe3e886 HTTP/1.1" status: 200 len: 945 time: 0.0478661 Nov 23 19:39:10.236372 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-e7d51e13-9973-4442-933b-a693f36998d4 req-6df4c2b1-2fbd-412e-a38e-8485707ced3f tempest-AttachVolumeTestJSON-1120920040 tempest-AttachVolumeTestJSON-1120920040-project] 10.222.0.62 "GET /v2.0/security-groups?id=f8cf4027-ad94-4b78-b429-c3f2d7f9d324&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0399919 Nov 23 19:39:11.355300 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-48056944-8234-4b20-b9ae-ac7a7c7f61f5 req-3d0f9aa5-5f80-459a-a562-98e9d07d9458 tempest-AttachVolumeTestJSON-1120920040 tempest-AttachVolumeTestJSON-1120920040-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102992) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:39:11.356730 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-48056944-8234-4b20-b9ae-ac7a7c7f61f5 req-3d0f9aa5-5f80-459a-a562-98e9d07d9458 tempest-AttachVolumeTestJSON-1120920040 tempest-AttachVolumeTestJSON-1120920040-project] 10.222.0.62 "GET /v2.0/ports?device_id=029fedce-3168-4d1d-992e-a9466fe3e886 HTTP/1.1" status: 200 len: 945 time: 0.0512631 Nov 23 19:39:11.405134 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-48056944-8234-4b20-b9ae-ac7a7c7f61f5 req-bbb81e58-0d73-42f9-abe5-916faa514b65 tempest-AttachVolumeTestJSON-1120920040 tempest-AttachVolumeTestJSON-1120920040-project] 10.222.0.62 "GET /v2.0/security-groups?id=f8cf4027-ad94-4b78-b429-c3f2d7f9d324&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0424719 Nov 23 19:39:11.709533 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron_lib.callbacks.manager [None req-23d54449-9853-4fb4-9b93-734170160f19 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8783631323329', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7978582'] for agent, after_update {{(pid=102994) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:39:12.517292 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-61caaa3f-6ef3-4600-b5b3-916b38207885 req-04e938ff-25d4-42ee-9f1f-a996c8df0ca4 tempest-AttachVolumeTestJSON-1120920040 tempest-AttachVolumeTestJSON-1120920040-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102992) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:39:12.519387 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-61caaa3f-6ef3-4600-b5b3-916b38207885 req-04e938ff-25d4-42ee-9f1f-a996c8df0ca4 tempest-AttachVolumeTestJSON-1120920040 tempest-AttachVolumeTestJSON-1120920040-project] 10.222.0.62 "GET /v2.0/ports?device_id=029fedce-3168-4d1d-992e-a9466fe3e886 HTTP/1.1" status: 200 len: 945 time: 0.0474799 Nov 23 19:39:12.566126 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-61caaa3f-6ef3-4600-b5b3-916b38207885 req-6918a351-4cc1-4e59-990f-dc245c85eb40 tempest-AttachVolumeTestJSON-1120920040 tempest-AttachVolumeTestJSON-1120920040-project] 10.222.0.62 "GET /v2.0/security-groups?id=f8cf4027-ad94-4b78-b429-c3f2d7f9d324&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0404332 Nov 23 19:39:13.682726 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d67e278e-049a-414f-9b7b-716582b92155 req-988a7245-ac2a-4a95-aa47-3e3f83fdc2a1 tempest-AttachVolumeTestJSON-1120920040 tempest-AttachVolumeTestJSON-1120920040-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102992) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:39:13.684192 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-d67e278e-049a-414f-9b7b-716582b92155 req-988a7245-ac2a-4a95-aa47-3e3f83fdc2a1 tempest-AttachVolumeTestJSON-1120920040 tempest-AttachVolumeTestJSON-1120920040-project] 10.222.0.62 "GET /v2.0/ports?device_id=029fedce-3168-4d1d-992e-a9466fe3e886 HTTP/1.1" status: 200 len: 945 time: 0.0513668 Nov 23 19:39:13.730879 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-d67e278e-049a-414f-9b7b-716582b92155 req-45034375-3f07-44a8-b45d-9a695fda46e7 tempest-AttachVolumeTestJSON-1120920040 tempest-AttachVolumeTestJSON-1120920040-project] 10.222.0.62 "GET /v2.0/security-groups?id=f8cf4027-ad94-4b78-b429-c3f2d7f9d324&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0408282 Nov 23 19:39:14.194888 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron_lib.callbacks.manager [None req-9ba4e1db-0167-48fb-9d83-13cfe92f681a None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8783631323329', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7978582'] for agent, after_update {{(pid=102994) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:39:14.846269 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0a4a8592-6dd3-42a0-8af5-ff50d38e104e req-c8ff65b5-a254-4327-aec6-c0e1bf7ed793 tempest-AttachVolumeTestJSON-1120920040 tempest-AttachVolumeTestJSON-1120920040-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102992) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:39:14.848181 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-0a4a8592-6dd3-42a0-8af5-ff50d38e104e req-c8ff65b5-a254-4327-aec6-c0e1bf7ed793 tempest-AttachVolumeTestJSON-1120920040 tempest-AttachVolumeTestJSON-1120920040-project] 10.222.0.62 "GET /v2.0/ports?device_id=029fedce-3168-4d1d-992e-a9466fe3e886 HTTP/1.1" status: 200 len: 945 time: 0.0501420 Nov 23 19:39:14.895174 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-0a4a8592-6dd3-42a0-8af5-ff50d38e104e req-e393e543-e764-4e75-8460-562eadc9a500 tempest-AttachVolumeTestJSON-1120920040 tempest-AttachVolumeTestJSON-1120920040-project] 10.222.0.62 "GET /v2.0/security-groups?id=f8cf4027-ad94-4b78-b429-c3f2d7f9d324&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0411339 Nov 23 19:39:15.091916 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron_lib.callbacks.manager [None req-8346ef05-f685-4c3d-af3d-a159b683bec2 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8783631323329', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7978582'] for agent, after_update {{(pid=102994) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:39:16.010603 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-57ab8bda-2de3-4404-9206-610d3d741f37 req-2e6ba09a-ff08-44f6-bf73-04eb58c3a458 tempest-AttachVolumeTestJSON-1120920040 tempest-AttachVolumeTestJSON-1120920040-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102992) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:39:16.012153 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-57ab8bda-2de3-4404-9206-610d3d741f37 req-2e6ba09a-ff08-44f6-bf73-04eb58c3a458 tempest-AttachVolumeTestJSON-1120920040 tempest-AttachVolumeTestJSON-1120920040-project] 10.222.0.62 "GET /v2.0/ports?device_id=029fedce-3168-4d1d-992e-a9466fe3e886 HTTP/1.1" status: 200 len: 945 time: 0.0486038 Nov 23 19:39:16.063088 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-57ab8bda-2de3-4404-9206-610d3d741f37 req-a380792a-a9e7-461c-bcfb-c6d94f939f42 tempest-AttachVolumeTestJSON-1120920040 tempest-AttachVolumeTestJSON-1120920040-project] 10.222.0.62 "GET /v2.0/security-groups?id=f8cf4027-ad94-4b78-b429-c3f2d7f9d324&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0450900 Nov 23 19:39:16.566504 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron_lib.callbacks.manager [None req-785c1d26-11ba-42d8-b5a6-51a8b3daeef0 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8783631323329', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7978582'] for agent, after_update {{(pid=102994) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:39:17.178411 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-01ff5a01-abf7-43cf-b7a0-4fa3467b4ea8 req-1ef529d5-8ec6-48c5-b16c-e89a02337b11 tempest-AttachVolumeTestJSON-1120920040 tempest-AttachVolumeTestJSON-1120920040-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102992) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:39:17.179866 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-01ff5a01-abf7-43cf-b7a0-4fa3467b4ea8 req-1ef529d5-8ec6-48c5-b16c-e89a02337b11 tempest-AttachVolumeTestJSON-1120920040 tempest-AttachVolumeTestJSON-1120920040-project] 10.222.0.62 "GET /v2.0/ports?device_id=029fedce-3168-4d1d-992e-a9466fe3e886 HTTP/1.1" status: 200 len: 945 time: 0.0493124 Nov 23 19:39:17.227283 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-01ff5a01-abf7-43cf-b7a0-4fa3467b4ea8 req-35e990d1-3c8d-437c-bfea-32d9b2b3ac79 tempest-AttachVolumeTestJSON-1120920040 tempest-AttachVolumeTestJSON-1120920040-project] 10.222.0.62 "GET /v2.0/security-groups?id=f8cf4027-ad94-4b78-b429-c3f2d7f9d324&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0415530 Nov 23 19:39:17.343927 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron_lib.callbacks.manager [None req-eb87b2c3-3339-4249-8b85-e695b5b4e1f9 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8783631323329', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7978582'] for agent, after_update {{(pid=102994) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:39:18.341989 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d00143b5-5b4c-4fc4-bfdf-9b7ca8851681 req-1f0fc247-71c7-4ccf-8896-d21b47c5b0dd tempest-AttachVolumeTestJSON-1120920040 tempest-AttachVolumeTestJSON-1120920040-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102992) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:39:18.343387 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-d00143b5-5b4c-4fc4-bfdf-9b7ca8851681 req-1f0fc247-71c7-4ccf-8896-d21b47c5b0dd tempest-AttachVolumeTestJSON-1120920040 tempest-AttachVolumeTestJSON-1120920040-project] 10.222.0.62 "GET /v2.0/ports?device_id=029fedce-3168-4d1d-992e-a9466fe3e886 HTTP/1.1" status: 200 len: 945 time: 0.0493000 Nov 23 19:39:18.389447 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-d00143b5-5b4c-4fc4-bfdf-9b7ca8851681 req-a5b1edfb-b66a-4ed6-bd27-1687dc900246 tempest-AttachVolumeTestJSON-1120920040 tempest-AttachVolumeTestJSON-1120920040-project] 10.222.0.62 "GET /v2.0/security-groups?id=f8cf4027-ad94-4b78-b429-c3f2d7f9d324&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0395248 Nov 23 19:39:19.508840 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-947022e9-9bb9-4273-a0e3-9325d1e8d5f3 req-94fdd65a-c026-46d3-ad9f-e69d06d1cf7a tempest-AttachVolumeTestJSON-1120920040 tempest-AttachVolumeTestJSON-1120920040-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102992) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:39:19.510349 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-947022e9-9bb9-4273-a0e3-9325d1e8d5f3 req-94fdd65a-c026-46d3-ad9f-e69d06d1cf7a tempest-AttachVolumeTestJSON-1120920040 tempest-AttachVolumeTestJSON-1120920040-project] 10.222.0.62 "GET /v2.0/ports?device_id=029fedce-3168-4d1d-992e-a9466fe3e886 HTTP/1.1" status: 200 len: 945 time: 0.0536416 Nov 23 19:39:19.558888 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-947022e9-9bb9-4273-a0e3-9325d1e8d5f3 req-cb36d0b3-ea64-4cf6-8296-b7e8be614af7 tempest-AttachVolumeTestJSON-1120920040 tempest-AttachVolumeTestJSON-1120920040-project] 10.222.0.62 "GET /v2.0/security-groups?id=f8cf4027-ad94-4b78-b429-c3f2d7f9d324&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0426748 Nov 23 19:39:20.676222 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ebfc7809-e7d9-4df3-8744-33955d809600 req-f31e8e3f-84b9-4ac6-a8fd-441231430fc9 tempest-AttachVolumeTestJSON-1120920040 tempest-AttachVolumeTestJSON-1120920040-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102992) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:39:20.677703 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-ebfc7809-e7d9-4df3-8744-33955d809600 req-f31e8e3f-84b9-4ac6-a8fd-441231430fc9 tempest-AttachVolumeTestJSON-1120920040 tempest-AttachVolumeTestJSON-1120920040-project] 10.222.0.62 "GET /v2.0/ports?device_id=029fedce-3168-4d1d-992e-a9466fe3e886 HTTP/1.1" status: 200 len: 945 time: 0.0499740 Nov 23 19:39:20.725188 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-ebfc7809-e7d9-4df3-8744-33955d809600 req-349672ff-44bc-4346-8eb8-c890b0eaeaf0 tempest-AttachVolumeTestJSON-1120920040 tempest-AttachVolumeTestJSON-1120920040-project] 10.222.0.62 "GET /v2.0/security-groups?id=f8cf4027-ad94-4b78-b429-c3f2d7f9d324&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0416470 Nov 23 19:39:21.841371 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6359fb4b-8241-459a-b4b6-f463e04abb0e req-b953b745-cba4-4701-80e6-bd3ee93a2ac1 tempest-AttachVolumeTestJSON-1120920040 tempest-AttachVolumeTestJSON-1120920040-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102992) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:39:21.842898 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-6359fb4b-8241-459a-b4b6-f463e04abb0e req-b953b745-cba4-4701-80e6-bd3ee93a2ac1 tempest-AttachVolumeTestJSON-1120920040 tempest-AttachVolumeTestJSON-1120920040-project] 10.222.0.62 "GET /v2.0/ports?device_id=029fedce-3168-4d1d-992e-a9466fe3e886 HTTP/1.1" status: 200 len: 945 time: 0.0503104 Nov 23 19:39:21.892997 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-6359fb4b-8241-459a-b4b6-f463e04abb0e req-2c78a5a7-2213-4cd9-94f0-159d267a6994 tempest-AttachVolumeTestJSON-1120920040 tempest-AttachVolumeTestJSON-1120920040-project] 10.222.0.62 "GET /v2.0/security-groups?id=f8cf4027-ad94-4b78-b429-c3f2d7f9d324&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0440195 Nov 23 19:39:22.193769 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d4d52dfa-df82-4d0d-86dd-31678b1693ca req-9e1111c6-880f-4760-b280-7d20788b5a8c tempest-AttachVolumeTestJSON-1120920040 tempest-AttachVolumeTestJSON-1120920040-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102992) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:39:22.195313 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-d4d52dfa-df82-4d0d-86dd-31678b1693ca req-9e1111c6-880f-4760-b280-7d20788b5a8c tempest-AttachVolumeTestJSON-1120920040 tempest-AttachVolumeTestJSON-1120920040-project] 10.222.0.62 "GET /v2.0/ports?device_id=029fedce-3168-4d1d-992e-a9466fe3e886 HTTP/1.1" status: 200 len: 945 time: 0.0509112 Nov 23 19:39:22.242859 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-d4d52dfa-df82-4d0d-86dd-31678b1693ca req-7eae5956-d0d0-4cd8-bafc-2b8469fdb4b1 tempest-AttachVolumeTestJSON-1120920040 tempest-AttachVolumeTestJSON-1120920040-project] 10.222.0.62 "GET /v2.0/security-groups?id=f8cf4027-ad94-4b78-b429-c3f2d7f9d324&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0414166 Nov 23 19:39:22.304803 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7dbbb1e4-aab7-45a7-bfcb-20d31a4cb990 req-61ce2264-c5c0-4940-a62f-55219583f1e8 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102992) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:39:22.306608 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-7dbbb1e4-aab7-45a7-bfcb-20d31a4cb990 req-61ce2264-c5c0-4940-a62f-55219583f1e8 service neutron] 10.222.0.41 "GET /v2.0/ports?tenant_id=c9d53f0599374b679185cc73383b417c&device_id=029fedce-3168-4d1d-992e-a9466fe3e886 HTTP/1.1" status: 200 len: 1098 time: 0.0457180 Nov 23 19:39:22.401565 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7dbbb1e4-aab7-45a7-bfcb-20d31a4cb990 req-bc49c172-a1ec-4423-b26e-34aaf7d52bf0 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102992) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:39:22.402912 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-7dbbb1e4-aab7-45a7-bfcb-20d31a4cb990 req-bc49c172-a1ec-4423-b26e-34aaf7d52bf0 service neutron] 10.222.0.41 "GET /v2.0/networks?id=41fa5020-8aad-49ce-b2a6-39d87c9e6042 HTTP/1.1" status: 200 len: 912 time: 0.0867450 Nov 23 19:39:22.470320 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-7dbbb1e4-aab7-45a7-bfcb-20d31a4cb990 req-9cf2e623-34c0-498f-9ee1-317bc6e1a6f8 service neutron] 10.222.0.41 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.6&port_id=2872cb22-0134-49c4-b6d7-034ca4132327 HTTP/1.1" status: 200 len: 1001 time: 0.0555563 Nov 23 19:39:22.525192 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7dbbb1e4-aab7-45a7-bfcb-20d31a4cb990 req-aa21fb1d-eb11-4ac7-824f-538ac7dfc2de service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102992) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:39:22.526746 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-7dbbb1e4-aab7-45a7-bfcb-20d31a4cb990 req-aa21fb1d-eb11-4ac7-824f-538ac7dfc2de service neutron] 10.222.0.41 "GET /v2.0/subnets?id=8f74a1ae-f892-4057-89a5-ca78a259b1bd HTTP/1.1" status: 200 len: 850 time: 0.0465777 Nov 23 19:39:22.573683 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7dbbb1e4-aab7-45a7-bfcb-20d31a4cb990 req-14a6198a-3093-4d10-9ebf-a2b5c12d00c5 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102992) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:39:22.575121 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-7dbbb1e4-aab7-45a7-bfcb-20d31a4cb990 req-14a6198a-3093-4d10-9ebf-a2b5c12d00c5 service neutron] 10.222.0.41 "GET /v2.0/ports?network_id=41fa5020-8aad-49ce-b2a6-39d87c9e6042&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0392654 Nov 23 19:39:22.664059 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-7dbbb1e4-aab7-45a7-bfcb-20d31a4cb990 req-bffbded2-91c5-4ab2-a740-98293328d778 service neutron] 10.222.0.41 "GET /v2.0/networks/41fa5020-8aad-49ce-b2a6-39d87c9e6042?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0797167 Nov 23 19:39:22.760478 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-7dbbb1e4-aab7-45a7-bfcb-20d31a4cb990 req-98ea3d16-642a-4f1e-9b35-b7ba90aa7acf service neutron] 10.222.0.41 "GET /v2.0/networks/41fa5020-8aad-49ce-b2a6-39d87c9e6042?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0869961 Nov 23 19:39:23.357875 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-25c589a3-b150-4c3f-a805-f355cc21ba01 req-f1f38a56-d92e-4a89-9b27-ff33ee378846 tempest-AttachVolumeTestJSON-1120920040 tempest-AttachVolumeTestJSON-1120920040-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102992) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:39:23.360195 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-25c589a3-b150-4c3f-a805-f355cc21ba01 req-f1f38a56-d92e-4a89-9b27-ff33ee378846 tempest-AttachVolumeTestJSON-1120920040 tempest-AttachVolumeTestJSON-1120920040-project] 10.222.0.62 "GET /v2.0/ports?device_id=029fedce-3168-4d1d-992e-a9466fe3e886 HTTP/1.1" status: 200 len: 945 time: 0.0491483 Nov 23 19:39:23.408673 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-25c589a3-b150-4c3f-a805-f355cc21ba01 req-2c01011e-9b5f-4ac5-888d-61a2d7eb9ae3 tempest-AttachVolumeTestJSON-1120920040 tempest-AttachVolumeTestJSON-1120920040-project] 10.222.0.62 "GET /v2.0/security-groups?id=f8cf4027-ad94-4b78-b429-c3f2d7f9d324&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0415227 Nov 23 19:39:24.008162 dv-cinder-819011-1-iscsi neutron-server[102995]: DEBUG neutron.db.agents_db [None req-84bdc9b2-57ea-4bdb-a245-07c78d37cea8 None None] Agent healthcheck: found 6 active agents {{(pid=102995) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 23 19:39:24.527314 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5c53098c-4902-49ad-b360-32f6486059cb req-f867eba9-6568-4dda-8f74-3ade30171012 tempest-AttachVolumeTestJSON-1120920040 tempest-AttachVolumeTestJSON-1120920040-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102993) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:39:24.528789 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-5c53098c-4902-49ad-b360-32f6486059cb req-f867eba9-6568-4dda-8f74-3ade30171012 tempest-AttachVolumeTestJSON-1120920040 tempest-AttachVolumeTestJSON-1120920040-project] 10.222.0.62 "GET /v2.0/ports?device_id=029fedce-3168-4d1d-992e-a9466fe3e886 HTTP/1.1" status: 200 len: 945 time: 0.0491161 Nov 23 19:39:24.576043 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-5c53098c-4902-49ad-b360-32f6486059cb req-5f01bb43-cc08-4809-94d9-fe5387c67a8a tempest-AttachVolumeTestJSON-1120920040 tempest-AttachVolumeTestJSON-1120920040-project] 10.222.0.62 "GET /v2.0/security-groups?id=f8cf4027-ad94-4b78-b429-c3f2d7f9d324&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0412469 Nov 23 19:39:24.687562 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6577bdc9-789e-48b0-bf68-d85fdb6cfce3 req-3ecd8eb3-b732-4797-9d27-1beca1bf0ac3 tempest-TestMinimumBasicScenario-716536904 tempest-TestMinimumBasicScenario-716536904-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102992) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:39:24.688983 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-6577bdc9-789e-48b0-bf68-d85fdb6cfce3 req-3ecd8eb3-b732-4797-9d27-1beca1bf0ac3 tempest-TestMinimumBasicScenario-716536904 tempest-TestMinimumBasicScenario-716536904-project] 10.222.0.62 "GET /v2.0/ports?device_id=b5fed716-ff16-48c0-8e89-95731739f55c HTTP/1.1" status: 200 len: 984 time: 0.0559824 Nov 23 19:39:24.778400 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-6577bdc9-789e-48b0-bf68-d85fdb6cfce3 req-aac15439-162b-44e5-b617-893ae49143ae tempest-TestMinimumBasicScenario-716536904 tempest-TestMinimumBasicScenario-716536904-project] 10.222.0.62 "GET /v2.0/security-groups?id=d09b4044-91d5-4432-9faa-4b7a40b1627d&id=04706b6c-202a-4225-af46-0d450ab58a7b&fields=id&fields=name HTTP/1.1" status: 200 len: 380 time: 0.0824232 Nov 23 19:39:24.781098 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f495f32c-bc76-4bff-8e83-5ef393429969 req-d9082bab-f6bf-4177-abf5-79911996ccc8 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102992) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:39:24.782502 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-f495f32c-bc76-4bff-8e83-5ef393429969 req-d9082bab-f6bf-4177-abf5-79911996ccc8 service neutron] 10.222.0.41 "GET /v2.0/ports?tenant_id=ed0d906c96b540a7b11d508615543890&device_id=b5fed716-ff16-48c0-8e89-95731739f55c HTTP/1.1" status: 200 len: 1137 time: 0.0794821 Nov 23 19:39:24.877262 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f495f32c-bc76-4bff-8e83-5ef393429969 req-54f0ec9e-091a-4c47-9045-bd869a3e7ef5 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102992) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:39:24.879612 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-f495f32c-bc76-4bff-8e83-5ef393429969 req-54f0ec9e-091a-4c47-9045-bd869a3e7ef5 service neutron] 10.222.0.41 "GET /v2.0/networks?id=96f89427-8150-464f-a280-f07cf823b4fd HTTP/1.1" status: 200 len: 915 time: 0.0878325 Nov 23 19:39:24.945742 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-f495f32c-bc76-4bff-8e83-5ef393429969 req-3367077d-c614-472f-a0ba-c546401a3480 service neutron] 10.222.0.41 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.7&port_id=733eac81-0446-4e4c-b1d5-b8c491dcbeb4 HTTP/1.1" status: 200 len: 1001 time: 0.0579591 Nov 23 19:39:24.994286 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f495f32c-bc76-4bff-8e83-5ef393429969 req-e421d9f7-be2d-4557-acac-e0a63224f015 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102992) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:39:24.995707 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-f495f32c-bc76-4bff-8e83-5ef393429969 req-e421d9f7-be2d-4557-acac-e0a63224f015 service neutron] 10.222.0.41 "GET /v2.0/subnets?id=bfa70c12-21c8-4b7f-8a30-da7ff37b80b8 HTTP/1.1" status: 200 len: 853 time: 0.0428534 Nov 23 19:39:25.053917 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f495f32c-bc76-4bff-8e83-5ef393429969 req-378e277f-763c-4037-aa5e-c55bd89c298f service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102992) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:39:25.055493 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-f495f32c-bc76-4bff-8e83-5ef393429969 req-378e277f-763c-4037-aa5e-c55bd89c298f service neutron] 10.222.0.41 "GET /v2.0/ports?network_id=96f89427-8150-464f-a280-f07cf823b4fd&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0461061 Nov 23 19:39:25.149206 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-f495f32c-bc76-4bff-8e83-5ef393429969 req-dab161a6-f00a-43e5-a6df-cff7371b7bb0 service neutron] 10.222.0.41 "GET /v2.0/networks/96f89427-8150-464f-a280-f07cf823b4fd?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0836260 Nov 23 19:39:25.259634 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-f495f32c-bc76-4bff-8e83-5ef393429969 req-59c47c9d-eea4-4f73-b351-9aa0cd2bd830 service neutron] 10.222.0.41 "GET /v2.0/networks/96f89427-8150-464f-a280-f07cf823b4fd?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0910380 Nov 23 19:39:25.893072 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0ebb2137-3a7d-4f34-a0f2-17b08841face req-79521a95-2354-497e-8365-97162c04eb75 tempest-TestMinimumBasicScenario-716536904 tempest-TestMinimumBasicScenario-716536904-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102992) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:39:25.895191 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-0ebb2137-3a7d-4f34-a0f2-17b08841face req-79521a95-2354-497e-8365-97162c04eb75 tempest-TestMinimumBasicScenario-716536904 tempest-TestMinimumBasicScenario-716536904-project] 10.222.0.62 "GET /v2.0/ports?device_id=b5fed716-ff16-48c0-8e89-95731739f55c HTTP/1.1" status: 200 len: 984 time: 0.0496142 Nov 23 19:39:25.954365 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-0ebb2137-3a7d-4f34-a0f2-17b08841face req-5ee49c54-75f8-491f-8956-9c6c1d7a33e4 tempest-TestMinimumBasicScenario-716536904 tempest-TestMinimumBasicScenario-716536904-project] 10.222.0.62 "GET /v2.0/security-groups?id=d09b4044-91d5-4432-9faa-4b7a40b1627d&id=04706b6c-202a-4225-af46-0d450ab58a7b&fields=id&fields=name HTTP/1.1" status: 200 len: 380 time: 0.0532575 Nov 23 19:39:27.074305 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ab08611b-e7fb-4610-928d-d94efd45f2be req-dfff1f60-df8b-4b16-8714-b21fbdeec78a tempest-TestMinimumBasicScenario-716536904 tempest-TestMinimumBasicScenario-716536904-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102992) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:39:27.075666 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-ab08611b-e7fb-4610-928d-d94efd45f2be req-dfff1f60-df8b-4b16-8714-b21fbdeec78a tempest-TestMinimumBasicScenario-716536904 tempest-TestMinimumBasicScenario-716536904-project] 10.222.0.62 "GET /v2.0/ports?device_id=b5fed716-ff16-48c0-8e89-95731739f55c HTTP/1.1" status: 200 len: 984 time: 0.0533056 Nov 23 19:39:27.134036 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-ab08611b-e7fb-4610-928d-d94efd45f2be req-3f462ef9-ecd2-4358-a109-4d747746fc70 tempest-TestMinimumBasicScenario-716536904 tempest-TestMinimumBasicScenario-716536904-project] 10.222.0.62 "GET /v2.0/security-groups?id=d09b4044-91d5-4432-9faa-4b7a40b1627d&id=04706b6c-202a-4225-af46-0d450ab58a7b&fields=id&fields=name HTTP/1.1" status: 200 len: 380 time: 0.0525069 Nov 23 19:39:28.254626 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a3b4c037-d243-444f-a01f-7fe8536d3712 req-28e6c850-7f7b-4402-893a-b6a611e5264b tempest-TestMinimumBasicScenario-716536904 tempest-TestMinimumBasicScenario-716536904-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102992) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:39:28.256080 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-a3b4c037-d243-444f-a01f-7fe8536d3712 req-28e6c850-7f7b-4402-893a-b6a611e5264b tempest-TestMinimumBasicScenario-716536904 tempest-TestMinimumBasicScenario-716536904-project] 10.222.0.62 "GET /v2.0/ports?device_id=b5fed716-ff16-48c0-8e89-95731739f55c HTTP/1.1" status: 200 len: 984 time: 0.0488703 Nov 23 19:39:28.314825 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-a3b4c037-d243-444f-a01f-7fe8536d3712 req-b8cda3e4-861c-4257-a56d-d441c384da9f tempest-TestMinimumBasicScenario-716536904 tempest-TestMinimumBasicScenario-716536904-project] 10.222.0.62 "GET /v2.0/security-groups?id=d09b4044-91d5-4432-9faa-4b7a40b1627d&id=04706b6c-202a-4225-af46-0d450ab58a7b&fields=id&fields=name HTTP/1.1" status: 200 len: 380 time: 0.0525420 Nov 23 19:39:29.431653 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e6014601-5dd3-47a6-8f7d-f5b8b7a7eca3 req-cdbf5dad-d48e-4d75-8408-9d3b31dc43ab tempest-TestMinimumBasicScenario-716536904 tempest-TestMinimumBasicScenario-716536904-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102992) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:39:29.433144 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-e6014601-5dd3-47a6-8f7d-f5b8b7a7eca3 req-cdbf5dad-d48e-4d75-8408-9d3b31dc43ab tempest-TestMinimumBasicScenario-716536904 tempest-TestMinimumBasicScenario-716536904-project] 10.222.0.62 "GET /v2.0/ports?device_id=b5fed716-ff16-48c0-8e89-95731739f55c HTTP/1.1" status: 200 len: 984 time: 0.0499601 Nov 23 19:39:29.501115 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-e6014601-5dd3-47a6-8f7d-f5b8b7a7eca3 req-6f106cd6-3c99-4512-9467-99ddb8cf8eeb tempest-TestMinimumBasicScenario-716536904 tempest-TestMinimumBasicScenario-716536904-project] 10.222.0.62 "GET /v2.0/security-groups?id=d09b4044-91d5-4432-9faa-4b7a40b1627d&id=04706b6c-202a-4225-af46-0d450ab58a7b&fields=id&fields=name HTTP/1.1" status: 200 len: 380 time: 0.0578263 Nov 23 19:39:29.748480 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron_lib.callbacks.manager [None req-4bf48ff4-ecfb-4168-8b63-249b8c6e9f04 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8783631323329', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7978582'] for agent, after_update {{(pid=102994) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:39:30.629749 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c06f8591-5554-43f1-a3bb-28ea4379908b req-1305adaf-dde0-4cd6-8b24-0352de8bc301 tempest-TestMinimumBasicScenario-716536904 tempest-TestMinimumBasicScenario-716536904-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102993) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:39:30.631253 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-c06f8591-5554-43f1-a3bb-28ea4379908b req-1305adaf-dde0-4cd6-8b24-0352de8bc301 tempest-TestMinimumBasicScenario-716536904 tempest-TestMinimumBasicScenario-716536904-project] 10.222.0.62 "GET /v2.0/ports?device_id=b5fed716-ff16-48c0-8e89-95731739f55c HTTP/1.1" status: 200 len: 984 time: 0.0571594 Nov 23 19:39:30.636146 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-15c9002a-60c0-4513-b1b2-f7bc678463bb req-5cfb228b-8e16-4eb1-97f6-3ae9db465d41 tempest-TestVolumeBootPattern-147141705 tempest-TestVolumeBootPattern-147141705-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102992) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:39:30.637638 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-15c9002a-60c0-4513-b1b2-f7bc678463bb req-5cfb228b-8e16-4eb1-97f6-3ae9db465d41 tempest-TestVolumeBootPattern-147141705 tempest-TestVolumeBootPattern-147141705-project] 10.222.0.62 "GET /v2.0/ports?device_id=4ee0b7a3-f787-4a7c-816a-71f3a99b7193 HTTP/1.1" status: 200 len: 946 time: 0.0493820 Nov 23 19:39:30.687750 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-15c9002a-60c0-4513-b1b2-f7bc678463bb req-6ee53495-cb78-44f2-8083-7dfe5aa41b93 tempest-TestVolumeBootPattern-147141705 tempest-TestVolumeBootPattern-147141705-project] 10.222.0.62 "GET /v2.0/security-groups?id=a6e2b133-1a9b-4dde-a188-1ce8bcdb7b5c&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0440476 Nov 23 19:39:30.694226 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-c06f8591-5554-43f1-a3bb-28ea4379908b req-9cc27e78-920b-425d-8bca-836ec12fbe79 tempest-TestMinimumBasicScenario-716536904 tempest-TestMinimumBasicScenario-716536904-project] 10.222.0.62 "GET /v2.0/security-groups?id=d09b4044-91d5-4432-9faa-4b7a40b1627d&id=04706b6c-202a-4225-af46-0d450ab58a7b&fields=id&fields=name HTTP/1.1" status: 200 len: 380 time: 0.0564358 Nov 23 19:39:31.804576 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fe7749a7-c82e-4cc4-be31-2d6788ee3505 req-0c457425-87e2-4284-8e4c-5283e4a465cb tempest-TestVolumeBootPattern-147141705 tempest-TestVolumeBootPattern-147141705-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102992) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:39:31.806126 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-fe7749a7-c82e-4cc4-be31-2d6788ee3505 req-0c457425-87e2-4284-8e4c-5283e4a465cb tempest-TestVolumeBootPattern-147141705 tempest-TestVolumeBootPattern-147141705-project] 10.222.0.62 "GET /v2.0/ports?device_id=4ee0b7a3-f787-4a7c-816a-71f3a99b7193 HTTP/1.1" status: 200 len: 946 time: 0.0499086 Nov 23 19:39:31.813782 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2dbaed79-eb94-49ef-85a4-51f03d3a2bf9 req-1fc0c8d5-5871-4308-9328-9390267ae850 tempest-TestMinimumBasicScenario-716536904 tempest-TestMinimumBasicScenario-716536904-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102993) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:39:31.815409 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-2dbaed79-eb94-49ef-85a4-51f03d3a2bf9 req-1fc0c8d5-5871-4308-9328-9390267ae850 tempest-TestMinimumBasicScenario-716536904 tempest-TestMinimumBasicScenario-716536904-project] 10.222.0.62 "GET /v2.0/ports?device_id=b5fed716-ff16-48c0-8e89-95731739f55c HTTP/1.1" status: 200 len: 984 time: 0.0537314 Nov 23 19:39:31.855986 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-fe7749a7-c82e-4cc4-be31-2d6788ee3505 req-cd405dab-8317-47fa-9413-1ce38ff2de98 tempest-TestVolumeBootPattern-147141705 tempest-TestVolumeBootPattern-147141705-project] 10.222.0.62 "GET /v2.0/security-groups?id=a6e2b133-1a9b-4dde-a188-1ce8bcdb7b5c&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0437422 Nov 23 19:39:31.881875 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-2dbaed79-eb94-49ef-85a4-51f03d3a2bf9 req-727b2565-58bf-4033-a497-31ddef02e0c0 tempest-TestMinimumBasicScenario-716536904 tempest-TestMinimumBasicScenario-716536904-project] 10.222.0.62 "GET /v2.0/security-groups?id=d09b4044-91d5-4432-9faa-4b7a40b1627d&id=04706b6c-202a-4225-af46-0d450ab58a7b&fields=id&fields=name HTTP/1.1" status: 200 len: 380 time: 0.0596323 Nov 23 19:39:32.373360 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-db7ebd13-9c68-4d53-a652-5bc783b9304c req-63d1db88-5c51-4f90-a0f2-f82eda9e7605 tempest-TestVolumeBootPattern-147141705 tempest-TestVolumeBootPattern-147141705-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102992) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:39:32.374841 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-db7ebd13-9c68-4d53-a652-5bc783b9304c req-63d1db88-5c51-4f90-a0f2-f82eda9e7605 tempest-TestVolumeBootPattern-147141705 tempest-TestVolumeBootPattern-147141705-project] 10.222.0.41 "GET /v2.0/ports?device_id=4ee0b7a3-f787-4a7c-816a-71f3a99b7193 HTTP/1.1" status: 200 len: 946 time: 0.0594177 Nov 23 19:39:32.474550 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.plugins.ml2.plugin [req-db7ebd13-9c68-4d53-a652-5bc783b9304c req-60a8d245-5ee0-4b0f-a83c-398f7074b23d tempest-TestVolumeBootPattern-147141705 tempest-TestVolumeBootPattern-147141705-project] Deleting port 1a0a2345-c03d-4159-89a8-35402d8d2448 {{(pid=102992) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 23 19:39:32.474913 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [req-db7ebd13-9c68-4d53-a652-5bc783b9304c req-60a8d245-5ee0-4b0f-a83c-398f7074b23d tempest-TestVolumeBootPattern-147141705 tempest-TestVolumeBootPattern-147141705-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8783631423070'] for port, before_delete {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:39:32.575625 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-564248bf-3f92-471f-bbd4-b31325a73fe7 req-2a2e95c4-c769-4963-bff4-dfff6c1e2fec tempest-AttachVolumeShelveTestJSON-1172915835 tempest-AttachVolumeShelveTestJSON-1172915835-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102993) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:39:32.576008 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.plugins.ml2.db [req-db7ebd13-9c68-4d53-a652-5bc783b9304c req-60a8d245-5ee0-4b0f-a83c-398f7074b23d tempest-TestVolumeBootPattern-147141705 tempest-TestVolumeBootPattern-147141705-project] For port 1a0a2345-c03d-4159-89a8-35402d8d2448, host hv-cinder-81901, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81901',level=0,port_id=1a0a2345-c03d-4159-89a8-35402d8d2448,segment=NetworkSegment(56316385-5b81-43f5-84db-b708b46f04eb),segment_id=56316385-5b81-43f5-84db-b708b46f04eb)] {{(pid=102992) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 23 19:39:32.576372 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [req-db7ebd13-9c68-4d53-a652-5bc783b9304c req-60a8d245-5ee0-4b0f-a83c-398f7074b23d tempest-TestVolumeBootPattern-147141705 tempest-TestVolumeBootPattern-147141705-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-927332'] for port, precommit_delete {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:39:32.576998 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-564248bf-3f92-471f-bbd4-b31325a73fe7 req-2a2e95c4-c769-4963-bff4-dfff6c1e2fec tempest-AttachVolumeShelveTestJSON-1172915835 tempest-AttachVolumeShelveTestJSON-1172915835-project] 10.222.0.62 "GET /v2.0/ports?device_id=627eaac3-8c43-4aa3-a81c-7a6bfb58dbb5 HTTP/1.1" status: 200 len: 946 time: 0.0521381 Nov 23 19:39:32.627858 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-564248bf-3f92-471f-bbd4-b31325a73fe7 req-31ae45f8-c44f-4b40-8ee6-ed6b5834881f tempest-AttachVolumeShelveTestJSON-1172915835 tempest-AttachVolumeShelveTestJSON-1172915835-project] 10.222.0.62 "GET /v2.0/security-groups?id=a246a431-7eb4-441f-b1e6-9c9c351ee888&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0441382 Nov 23 19:39:32.792606 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [req-db7ebd13-9c68-4d53-a652-5bc783b9304c req-60a8d245-5ee0-4b0f-a83c-398f7074b23d tempest-TestVolumeBootPattern-147141705 tempest-TestVolumeBootPattern-147141705-project] Publish callbacks [] for floatingip, precommit_update {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:39:32.792959 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [req-db7ebd13-9c68-4d53-a652-5bc783b9304c req-60a8d245-5ee0-4b0f-a83c-398f7074b23d tempest-TestVolumeBootPattern-147141705 tempest-TestVolumeBootPattern-147141705-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-926531'] for floatingip, after_update {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:39:32.793272 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.db.l3_db [req-db7ebd13-9c68-4d53-a652-5bc783b9304c req-60a8d245-5ee0-4b0f-a83c-398f7074b23d tempest-TestVolumeBootPattern-147141705 tempest-TestVolumeBootPattern-147141705-project] Floating IP 58aefccd-9c9d-4966-bba8-80772da95277 disassociated. External IP: 172.27.1.101, port: 1a0a2345-c03d-4159-89a8-35402d8d2448. Nov 23 19:39:32.793635 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.plugins.ml2.plugin [req-db7ebd13-9c68-4d53-a652-5bc783b9304c req-60a8d245-5ee0-4b0f-a83c-398f7074b23d tempest-TestVolumeBootPattern-147141705 tempest-TestVolumeBootPattern-147141705-project] Calling delete_port for 1a0a2345-c03d-4159-89a8-35402d8d2448 owned by compute:nova {{(pid=102992) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 23 19:39:32.961859 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [req-db7ebd13-9c68-4d53-a652-5bc783b9304c req-60a8d245-5ee0-4b0f-a83c-398f7074b23d tempest-TestVolumeBootPattern-147141705 tempest-TestVolumeBootPattern-147141705-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7918660', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-15067', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560168', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8783631424624', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8783631008723', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-25199805'] for port, after_delete {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:39:32.995313 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-60a8d245-5ee0-4b0f-a83c-398f7074b23d tempest-TestVolumeBootPattern-147141705 tempest-TestVolumeBootPattern-147141705-project] Pushing event deleted for resources: {'Port': ['ID=1a0a2345-c03d-4159-89a8-35402d8d2448,revision_number=None']} {{(pid=102992) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 23 19:39:33.017086 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-faf856ee-f074-4076-beb3-fd461fd7d5d8 req-9c89d4fd-4be2-4664-b103-235e1ba29487 tempest-TestVolumeBootPattern-147141705 tempest-TestVolumeBootPattern-147141705-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102992) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:39:33.024547 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-65475763-eed8-4a40-b0bc-07813c2aa7d7 req-2f5b63a6-47c8-4c26-826a-c2b6b9b5d838 tempest-TestMinimumBasicScenario-716536904 tempest-TestMinimumBasicScenario-716536904-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102993) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:39:33.025341 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-faf856ee-f074-4076-beb3-fd461fd7d5d8 req-9c89d4fd-4be2-4664-b103-235e1ba29487 tempest-TestVolumeBootPattern-147141705 tempest-TestVolumeBootPattern-147141705-project] 10.222.0.62 "GET /v2.0/ports?device_id=4ee0b7a3-f787-4a7c-816a-71f3a99b7193 HTTP/1.1" status: 200 len: 867 time: 0.0895743 Nov 23 19:39:33.025493 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-65475763-eed8-4a40-b0bc-07813c2aa7d7 req-2f5b63a6-47c8-4c26-826a-c2b6b9b5d838 tempest-TestMinimumBasicScenario-716536904 tempest-TestMinimumBasicScenario-716536904-project] 10.222.0.62 "GET /v2.0/ports?device_id=b5fed716-ff16-48c0-8e89-95731739f55c HTTP/1.1" status: 200 len: 984 time: 0.0539622 Nov 23 19:39:33.082049 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-65475763-eed8-4a40-b0bc-07813c2aa7d7 req-4313edd2-b4e4-4e52-9805-ee44b92d1348 tempest-TestMinimumBasicScenario-716536904 tempest-TestMinimumBasicScenario-716536904-project] 10.222.0.62 "GET /v2.0/security-groups?id=d09b4044-91d5-4432-9faa-4b7a40b1627d&id=04706b6c-202a-4225-af46-0d450ab58a7b&fields=id&fields=name HTTP/1.1" status: 200 len: 380 time: 0.0557916 Nov 23 19:39:33.144327 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-faf856ee-f074-4076-beb3-fd461fd7d5d8 req-74fc50f5-3b4f-4ed6-8891-a0aa2b1c3a4c tempest-TestVolumeBootPattern-147141705 tempest-TestVolumeBootPattern-147141705-project] 10.222.0.62 "GET /v2.0/security-groups?id=a6e2b133-1a9b-4dde-a188-1ce8bcdb7b5c&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0908375 Nov 23 19:39:33.162772 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.scheduler.l3_agent_scheduler [req-db7ebd13-9c68-4d53-a652-5bc783b9304c req-60a8d245-5ee0-4b0f-a83c-398f7074b23d tempest-TestVolumeBootPattern-147141705 tempest-TestVolumeBootPattern-147141705-project] Router 0534bcc4-1e12-4026-90ce-1406543c7662 has already been hosted by L3 agent 1b20f2c4-70b6-43c3-b9bd-0062cc9e57ac {{(pid=102992) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 23 19:39:33.268441 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [req-db7ebd13-9c68-4d53-a652-5bc783b9304c req-60a8d245-5ee0-4b0f-a83c-398f7074b23d tempest-TestVolumeBootPattern-147141705 tempest-TestVolumeBootPattern-147141705-project] Notify agent at l3_agent.dv-cinder-819011-1-iscsi the message routers_updated {{(pid=102992) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 23 19:39:33.278421 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-ba28e5aa-9505-4a36-ba2d-08eed97d296e None None] Sync routers for ids ['0534bcc4-1e12-4026-90ce-1406543c7662'] in dv-cinder-819011-1-iscsi {{(pid=102994) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 23 19:39:33.289031 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.db.l3_dvrscheduler_db [None req-ba28e5aa-9505-4a36-ba2d-08eed97d296e None None] Routers {'0534bcc4-1e12-4026-90ce-1406543c7662'} bound to L3 agent in host dv-cinder-819011-1-iscsi {{(pid=102994) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 23 19:39:33.289672 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.db.l3_hamode_db [None req-ba28e5aa-9505-4a36-ba2d-08eed97d296e None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-819011-1-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 9, "extensions": [], "floating_ips": 5, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 9, "log_agent_heartbeats": false, "routers": 9},created_at=2021-11-23T19:25:14Z,description=,heartbeat_timestamp=2021-11-23T19:39:14Z,host='dv-cinder-819011-1-iscsi',id=1b20f2c4-70b6-43c3-b9bd-0062cc9e57ac,load=0,resource_versions=,resources_synced=,started_at=2021-11-23T19:25:15Z,topic='l3_agent')) {'router_ids': ['0534bcc4-1e12-4026-90ce-1406543c7662'], 'active': True} {{(pid=102994) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 23 19:39:33.308178 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.db.l3_dvrscheduler_db [req-db7ebd13-9c68-4d53-a652-5bc783b9304c req-60a8d245-5ee0-4b0f-a83c-398f7074b23d tempest-TestVolumeBootPattern-147141705 tempest-TestVolumeBootPattern-147141705-project] No DVR routers for this DVR port 1a0a2345-c03d-4159-89a8-35402d8d2448 on host hv-cinder-81901 {{(pid=102992) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 23 19:39:33.310870 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [req-db7ebd13-9c68-4d53-a652-5bc783b9304c req-60a8d245-5ee0-4b0f-a83c-398f7074b23d tempest-TestVolumeBootPattern-147141705 tempest-TestVolumeBootPattern-147141705-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-514902'] for port, before_response {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:39:33.314549 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-db7ebd13-9c68-4d53-a652-5bc783b9304c req-60a8d245-5ee0-4b0f-a83c-398f7074b23d tempest-TestVolumeBootPattern-147141705 tempest-TestVolumeBootPattern-147141705-project] 10.222.0.41 "DELETE /v2.0/ports/1a0a2345-c03d-4159-89a8-35402d8d2448 HTTP/1.1" status: 204 len: 173 time: 0.9317238 Nov 23 19:39:33.315010 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '4ee0b7a3-f787-4a7c-816a-71f3a99b7193', 'name': 'network-vif-deleted', 'tag': '1a0a2345-c03d-4159-89a8-35402d8d2448'}] {{(pid=102992) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 23 19:39:33.318173 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.62/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}f86c332b591ae691ababa4b64e0601cbf242a448242f95367ce03daabfb7e1ce" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-1e5216b2-4e17-49fb-9595-8694b7c1a8c4" -d '{"events": [{"server_uuid": "4ee0b7a3-f787-4a7c-816a-71f3a99b7193", "name": "network-vif-deleted", "tag": "1a0a2345-c03d-4159-89a8-35402d8d2448"}]}' {{(pid=102992) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 23 19:39:33.414814 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.db.l3_dvr_db [None req-ba28e5aa-9505-4a36-ba2d-08eed97d296e None None] Set router 0534bcc4-1e12-4026-90ce-1406543c7662 gateway port host: dv-cinder-819011-1-iscsi {{(pid=102994) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 23 19:39:33.420411 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 23 Nov 2021 19:39:33 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-ea16d7cc-75df-45ad-9c5e-3e4a11237e68 x-openstack-request-id: req-ea16d7cc-75df-45ad-9c5e-3e4a11237e68 {{(pid=102992) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 23 19:39:33.420411 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "4ee0b7a3-f787-4a7c-816a-71f3a99b7193", "name": "network-vif-deleted", "tag": "1a0a2345-c03d-4159-89a8-35402d8d2448", "status": "completed", "code": 200}]} {{(pid=102992) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 23 19:39:33.420411 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.62/compute/v2.1/os-server-external-events used request id req-ea16d7cc-75df-45ad-9c5e-3e4a11237e68 {{(pid=102992) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 23 19:39:33.420411 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '4ee0b7a3-f787-4a7c-816a-71f3a99b7193', 'name': 'network-vif-deleted', 'tag': '1a0a2345-c03d-4159-89a8-35402d8d2448', 'status': 'completed', 'code': 200} Nov 23 19:39:33.627266 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.db.l3_hamode_db [None req-ba28e5aa-9505-4a36-ba2d-08eed97d296e None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '0534bcc4-1e12-4026-90ce-1406543c7662', 'name': 'tempest-TestVolumeBootPattern-84632531-router', 'tenant_id': '257b0b2e531441b4bb745e99cfd799f3', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'a93e254e-aac9-4233-9e4d-4290fd0458e4', 'external_fixed_ips': [{'subnet_id': 'e0b32f3d-83d6-439a-bbed-01df7cf01051', 'ip_address': '172.27.1.154'}], 'enable_snat': True}, 'gw_port_id': 'c7996293-6188-4690-b614-395448e4dc25', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-23T19:35:29Z', 'updated_at': '2021-11-23T19:35:33Z', 'revision_number': 4, 'project_id': '257b0b2e531441b4bb745e99cfd799f3', 'gw_port': {'id': 'c7996293-6188-4690-b614-395448e4dc25', 'name': '', 'network_id': 'a93e254e-aac9-4233-9e4d-4290fd0458e4', 'tenant_id': '', 'mac_address': 'fa:16:3e:52:67:5e', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '0534bcc4-1e12-4026-90ce-1406543c7662', 'device_owner': 'network:router_gateway', 'standard_attr_id': 392, 'fixed_ips': [{'subnet_id': 'e0b32f3d-83d6-439a-bbed-01df7cf01051', 'ip_address': '172.27.1.154', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-819011-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-23T19:35:30Z', 'updated_at': '2021-11-23T19:35:34Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'e0b32f3d-83d6-439a-bbed-01df7cf01051', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-819011-1-iscsi', '_interfaces': [{'id': '854821af-61e0-47e7-a603-95f500a49030', 'name': '', 'network_id': '226a519f-5f3e-4d80-bb8a-0e9fc4f64828', 'tenant_id': '257b0b2e531441b4bb745e99cfd799f3', 'mac_address': 'fa:16:3e:90:11:65', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '0534bcc4-1e12-4026-90ce-1406543c7662', 'device_owner': 'network:router_interface', 'standard_attr_id': 393, 'fixed_ips': [{'subnet_id': '88de785d-c540-4651-af1e-26f27ccaee3c', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-819011-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-23T19:35:32Z', 'updated_at': '2021-11-23T19:35:37Z', 'revision_number': 5, 'project_id': '257b0b2e531441b4bb745e99cfd799f3', 'subnets': [{'id': '88de785d-c540-4651-af1e-26f27ccaee3c', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-819011-1-iscsi', False) {} {{(pid=102994) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 23 19:39:33.652355 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-ba28e5aa-9505-4a36-ba2d-08eed97d296e None None] Checking router: 0534bcc4-1e12-4026-90ce-1406543c7662 for host: dv-cinder-819011-1-iscsi {{(pid=102994) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 23 19:39:33.661248 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.db.l3_dvrscheduler_db [None req-ba28e5aa-9505-4a36-ba2d-08eed97d296e None None] Routers {'0534bcc4-1e12-4026-90ce-1406543c7662'} bound to L3 agent in host dv-cinder-819011-1-iscsi {{(pid=102994) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 23 19:39:33.662319 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.db.l3_hamode_db [None req-ba28e5aa-9505-4a36-ba2d-08eed97d296e None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-819011-1-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 9, "extensions": [], "floating_ips": 5, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 9, "log_agent_heartbeats": false, "routers": 9},created_at=2021-11-23T19:25:14Z,description=,heartbeat_timestamp=2021-11-23T19:39:14Z,host='dv-cinder-819011-1-iscsi',id=1b20f2c4-70b6-43c3-b9bd-0062cc9e57ac,load=0,resource_versions=,resources_synced=,started_at=2021-11-23T19:25:15Z,topic='l3_agent')) {'router_ids': ['0534bcc4-1e12-4026-90ce-1406543c7662'], 'active': True} {{(pid=102994) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 23 19:39:33.751458 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d69dd35c-e545-4c2b-9b43-33d2e8b5fedb req-a0018cb0-fb51-4bc5-850e-ea2686951b7d tempest-AttachVolumeShelveTestJSON-1172915835 tempest-AttachVolumeShelveTestJSON-1172915835-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102992) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:39:33.752989 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-d69dd35c-e545-4c2b-9b43-33d2e8b5fedb req-a0018cb0-fb51-4bc5-850e-ea2686951b7d tempest-AttachVolumeShelveTestJSON-1172915835 tempest-AttachVolumeShelveTestJSON-1172915835-project] 10.222.0.62 "GET /v2.0/ports?device_id=627eaac3-8c43-4aa3-a81c-7a6bfb58dbb5 HTTP/1.1" status: 200 len: 946 time: 0.0501475 Nov 23 19:39:33.772533 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.db.l3_dvr_db [None req-ba28e5aa-9505-4a36-ba2d-08eed97d296e None None] Set router 0534bcc4-1e12-4026-90ce-1406543c7662 gateway port host: dv-cinder-819011-1-iscsi {{(pid=102994) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 23 19:39:33.808909 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-d69dd35c-e545-4c2b-9b43-33d2e8b5fedb req-8559126d-25e8-493e-a75c-c61a158f1087 tempest-AttachVolumeShelveTestJSON-1172915835 tempest-AttachVolumeShelveTestJSON-1172915835-project] 10.222.0.62 "GET /v2.0/security-groups?id=a246a431-7eb4-441f-b1e6-9c9c351ee888&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0497694 Nov 23 19:39:33.981329 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.db.l3_hamode_db [None req-ba28e5aa-9505-4a36-ba2d-08eed97d296e None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '0534bcc4-1e12-4026-90ce-1406543c7662', 'name': 'tempest-TestVolumeBootPattern-84632531-router', 'tenant_id': '257b0b2e531441b4bb745e99cfd799f3', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'a93e254e-aac9-4233-9e4d-4290fd0458e4', 'external_fixed_ips': [{'subnet_id': 'e0b32f3d-83d6-439a-bbed-01df7cf01051', 'ip_address': '172.27.1.154'}], 'enable_snat': True}, 'gw_port_id': 'c7996293-6188-4690-b614-395448e4dc25', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-23T19:35:29Z', 'updated_at': '2021-11-23T19:35:33Z', 'revision_number': 4, 'project_id': '257b0b2e531441b4bb745e99cfd799f3', 'gw_port': {'id': 'c7996293-6188-4690-b614-395448e4dc25', 'name': '', 'network_id': 'a93e254e-aac9-4233-9e4d-4290fd0458e4', 'tenant_id': '', 'mac_address': 'fa:16:3e:52:67:5e', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '0534bcc4-1e12-4026-90ce-1406543c7662', 'device_owner': 'network:router_gateway', 'standard_attr_id': 392, 'fixed_ips': [{'subnet_id': 'e0b32f3d-83d6-439a-bbed-01df7cf01051', 'ip_address': '172.27.1.154', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-819011-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-23T19:35:30Z', 'updated_at': '2021-11-23T19:35:34Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'e0b32f3d-83d6-439a-bbed-01df7cf01051', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-819011-1-iscsi', '_interfaces': [{'id': '854821af-61e0-47e7-a603-95f500a49030', 'name': '', 'network_id': '226a519f-5f3e-4d80-bb8a-0e9fc4f64828', 'tenant_id': '257b0b2e531441b4bb745e99cfd799f3', 'mac_address': 'fa:16:3e:90:11:65', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '0534bcc4-1e12-4026-90ce-1406543c7662', 'device_owner': 'network:router_interface', 'standard_attr_id': 393, 'fixed_ips': [{'subnet_id': '88de785d-c540-4651-af1e-26f27ccaee3c', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-819011-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-23T19:35:32Z', 'updated_at': '2021-11-23T19:35:37Z', 'revision_number': 5, 'project_id': '257b0b2e531441b4bb745e99cfd799f3', 'subnets': [{'id': '88de785d-c540-4651-af1e-26f27ccaee3c', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-819011-1-iscsi', False) {} {{(pid=102994) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 23 19:39:34.011391 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-ba28e5aa-9505-4a36-ba2d-08eed97d296e None None] The sync data for ids ['0534bcc4-1e12-4026-90ce-1406543c7662'] in dv-cinder-819011-1-iscsi is: [{'id': '0534bcc4-1e12-4026-90ce-1406543c7662', 'name': 'tempest-TestVolumeBootPattern-84632531-router', 'tenant_id': '257b0b2e531441b4bb745e99cfd799f3', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'a93e254e-aac9-4233-9e4d-4290fd0458e4', 'external_fixed_ips': [{'subnet_id': 'e0b32f3d-83d6-439a-bbed-01df7cf01051', 'ip_address': '172.27.1.154'}], 'enable_snat': True}, 'gw_port_id': 'c7996293-6188-4690-b614-395448e4dc25', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-23T19:35:29Z', 'updated_at': '2021-11-23T19:35:33Z', 'revision_number': 4, 'project_id': '257b0b2e531441b4bb745e99cfd799f3', 'gw_port': {'id': 'c7996293-6188-4690-b614-395448e4dc25', 'name': '', 'network_id': 'a93e254e-aac9-4233-9e4d-4290fd0458e4', 'tenant_id': '', 'mac_address': 'fa:16:3e:52:67:5e', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '0534bcc4-1e12-4026-90ce-1406543c7662', 'device_owner': 'network:router_gateway', 'standard_attr_id': 392, 'fixed_ips': [{'subnet_id': 'e0b32f3d-83d6-439a-bbed-01df7cf01051', 'ip_address': '172.27.1.154', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-819011-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-23T19:35:30Z', 'updated_at': '2021-11-23T19:35:34Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'e0b32f3d-83d6-439a-bbed-01df7cf01051', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-819011-1-iscsi', '_interfaces': [{'id': '854821af-61e0-47e7-a603-95f500a49030', 'name': '', 'network_id': '226a519f-5f3e-4d80-bb8a-0e9fc4f64828', 'tenant_id': '257b0b2e531441b4bb745e99cfd799f3', 'mac_address': 'fa:16:3e:90:11:65', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '0534bcc4-1e12-4026-90ce-1406543c7662', 'device_owner': 'network:router_interface', 'standard_attr_id': 393, 'fixed_ips': [{'subnet_id': '88de785d-c540-4651-af1e-26f27ccaee3c', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-819011-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-23T19:35:32Z', 'updated_at': '2021-11-23T19:35:37Z', 'revision_number': 5, 'project_id': '257b0b2e531441b4bb745e99cfd799f3', 'subnets': [{'id': '88de785d-c540-4651-af1e-26f27ccaee3c', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=102994) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 23 19:39:34.208048 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0c1249e3-4f6e-4ea6-83bf-a732ededfd0c req-c71ad1bb-d1e1-4b95-8571-10901db6cdc6 tempest-TestMinimumBasicScenario-716536904 tempest-TestMinimumBasicScenario-716536904-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102993) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:39:34.209666 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-0c1249e3-4f6e-4ea6-83bf-a732ededfd0c req-c71ad1bb-d1e1-4b95-8571-10901db6cdc6 tempest-TestMinimumBasicScenario-716536904 tempest-TestMinimumBasicScenario-716536904-project] 10.222.0.62 "GET /v2.0/ports?device_id=b5fed716-ff16-48c0-8e89-95731739f55c HTTP/1.1" status: 200 len: 984 time: 0.0557473 Nov 23 19:39:34.235877 dv-cinder-819011-1-iscsi neutron-server[102995]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-2da0eb7b-d631-4085-acd9-c2921d797f3d None None] New status for floating IP 58aefccd-9c9d-4966-bba8-80772da95277: DOWN {{(pid=102995) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Nov 23 19:39:34.251881 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-5123b511-09ff-43da-a315-3868bb85bd0a req-874b8ca2-225f-4f8c-b8ce-59fc2f338d29 tempest-TestVolumeBootPattern-147141705 tempest-TestVolumeBootPattern-147141705-project] 10.222.0.62 "GET /v2.0/ports?device_id=4ee0b7a3-f787-4a7c-816a-71f3a99b7193 HTTP/1.1" status: 200 len: 210 time: 0.0250149 Nov 23 19:39:34.277275 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-0c1249e3-4f6e-4ea6-83bf-a732ededfd0c req-8f06c256-ff2e-48f4-80bf-bcd80bcbfcbc tempest-TestMinimumBasicScenario-716536904 tempest-TestMinimumBasicScenario-716536904-project] 10.222.0.62 "GET /v2.0/security-groups?id=d09b4044-91d5-4432-9faa-4b7a40b1627d&id=04706b6c-202a-4225-af46-0d450ab58a7b&fields=id&fields=name HTTP/1.1" status: 200 len: 380 time: 0.0610960 Nov 23 19:39:34.927264 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a823d92f-8635-4005-9c4b-5939196e0cf9 req-c0a8c447-b52c-439b-83fa-42fa4f63df8b tempest-AttachVolumeShelveTestJSON-1172915835 tempest-AttachVolumeShelveTestJSON-1172915835-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102992) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:39:34.928637 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-a823d92f-8635-4005-9c4b-5939196e0cf9 req-c0a8c447-b52c-439b-83fa-42fa4f63df8b tempest-AttachVolumeShelveTestJSON-1172915835 tempest-AttachVolumeShelveTestJSON-1172915835-project] 10.222.0.62 "GET /v2.0/ports?device_id=627eaac3-8c43-4aa3-a81c-7a6bfb58dbb5 HTTP/1.1" status: 200 len: 946 time: 0.0490205 Nov 23 19:39:34.975432 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-a823d92f-8635-4005-9c4b-5939196e0cf9 req-4c208e0d-59ba-44f2-8363-c7efa3e36862 tempest-AttachVolumeShelveTestJSON-1172915835 tempest-AttachVolumeShelveTestJSON-1172915835-project] 10.222.0.62 "GET /v2.0/security-groups?id=a246a431-7eb4-441f-b1e6-9c9c351ee888&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0409012 Nov 23 19:39:35.392319 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c877d188-0cdc-42d8-8d3d-8b8a25fb6780 req-a685fe0b-4a83-41e5-849e-fc77b445c38f tempest-TestMinimumBasicScenario-716536904 tempest-TestMinimumBasicScenario-716536904-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102992) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:39:35.398019 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-c877d188-0cdc-42d8-8d3d-8b8a25fb6780 req-a685fe0b-4a83-41e5-849e-fc77b445c38f tempest-TestMinimumBasicScenario-716536904 tempest-TestMinimumBasicScenario-716536904-project] 10.222.0.62 "GET /v2.0/ports?device_id=b5fed716-ff16-48c0-8e89-95731739f55c HTTP/1.1" status: 200 len: 984 time: 0.0528719 Nov 23 19:39:35.460365 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-c877d188-0cdc-42d8-8d3d-8b8a25fb6780 req-0e2677ec-6345-4dd1-baab-e22a887c7708 tempest-TestMinimumBasicScenario-716536904 tempest-TestMinimumBasicScenario-716536904-project] 10.222.0.62 "GET /v2.0/security-groups?id=d09b4044-91d5-4432-9faa-4b7a40b1627d&id=04706b6c-202a-4225-af46-0d450ab58a7b&fields=id&fields=name HTTP/1.1" status: 200 len: 380 time: 0.0605507 Nov 23 19:39:35.517186 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-8b8b6526-8711-4c0a-9c4a-79e6de0b1924 req-dd97a652-99e0-4549-9dd5-8437e77345a8 tempest-TestVolumeBootPattern-147141705 tempest-TestVolumeBootPattern-147141705-project] 10.222.0.62 "GET /v2.0/security-groups?name=tempest-secgroup-smoke-1973485717&fields=id&tenant_id=257b0b2e531441b4bb745e99cfd799f3 HTTP/1.1" status: 200 len: 267 time: 0.0493739 Nov 23 19:39:35.621684 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8b8b6526-8711-4c0a-9c4a-79e6de0b1924 req-76ffc5cf-5a4e-4563-ba40-a26414aa810b tempest-TestVolumeBootPattern-147141705 tempest-TestVolumeBootPattern-147141705-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=102993) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:39:35.623041 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-8b8b6526-8711-4c0a-9c4a-79e6de0b1924 req-76ffc5cf-5a4e-4563-ba40-a26414aa810b tempest-TestVolumeBootPattern-147141705 tempest-TestVolumeBootPattern-147141705-project] 10.222.0.62 "GET /v2.0/networks?id=226a519f-5f3e-4d80-bb8a-0e9fc4f64828 HTTP/1.1" status: 200 len: 810 time: 0.0990813 Nov 23 19:39:35.637937 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-8b8b6526-8711-4c0a-9c4a-79e6de0b1924 req-a86898b8-6850-4504-a9c8-62d7e78ff327 tempest-TestVolumeBootPattern-147141705 tempest-TestVolumeBootPattern-147141705-project] 10.222.0.62 "GET /v2.0/quotas/257b0b2e531441b4bb745e99cfd799f3 HTTP/1.1" status: 200 len: 375 time: 0.0087695 Nov 23 19:39:35.689924 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-8b8b6526-8711-4c0a-9c4a-79e6de0b1924 req-4edc412c-04f4-43d6-bd44-11a5486dd4c2 tempest-TestVolumeBootPattern-147141705 tempest-TestVolumeBootPattern-147141705-project] 10.222.0.62 "GET /v2.0/ports?tenant_id=257b0b2e531441b4bb745e99cfd799f3&fields=id HTTP/1.1" status: 200 len: 302 time: 0.0470166 Nov 23 19:39:35.827018 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-8b8b6526-8711-4c0a-9c4a-79e6de0b1924 req-1c84760d-71c8-4561-b4b4-ea7a7b140986 service neutron] 10.222.0.62 "GET /v2.0/networks/226a519f-5f3e-4d80-bb8a-0e9fc4f64828?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1239488 Nov 23 19:39:35.918325 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-8b8b6526-8711-4c0a-9c4a-79e6de0b1924 req-e5c42ddb-552a-4445-a4ac-d64fe5ccea23 service neutron] 10.222.0.62 "GET /v2.0/networks/226a519f-5f3e-4d80-bb8a-0e9fc4f64828?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0841503 Nov 23 19:39:36.095472 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7bec74ba-2a7a-4909-91e9-27802c9c2a69 req-f229d5f1-89e6-4886-97ff-c9ef39e3c1aa tempest-AttachVolumeShelveTestJSON-1172915835 tempest-AttachVolumeShelveTestJSON-1172915835-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102992) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:39:36.097554 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-7bec74ba-2a7a-4909-91e9-27802c9c2a69 req-f229d5f1-89e6-4886-97ff-c9ef39e3c1aa tempest-AttachVolumeShelveTestJSON-1172915835 tempest-AttachVolumeShelveTestJSON-1172915835-project] 10.222.0.62 "GET /v2.0/ports?device_id=627eaac3-8c43-4aa3-a81c-7a6bfb58dbb5 HTTP/1.1" status: 200 len: 946 time: 0.0495343 Nov 23 19:39:36.144203 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-7bec74ba-2a7a-4909-91e9-27802c9c2a69 req-92aa99ad-67bc-4b61-be0d-bff8db32b6bd tempest-AttachVolumeShelveTestJSON-1172915835 tempest-AttachVolumeShelveTestJSON-1172915835-project] 10.222.0.62 "GET /v2.0/security-groups?id=a246a431-7eb4-441f-b1e6-9c9c351ee888&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0406747 Nov 23 19:39:36.393152 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-05724ddd-a1c6-4f2a-8298-d2581a6c0939 req-597232fe-06ff-4231-aeff-b8f42d3d74e9 tempest-TestVolumeBootPattern-147141705 tempest-TestVolumeBootPattern-147141705-project] 10.222.0.62 "GET /v2.0/ports?device_id=9e64d320-821f-4313-8dd0-3b327ba75634 HTTP/1.1" status: 200 len: 210 time: 0.0340409 Nov 23 19:39:36.462290 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.plugins.ml2.rpc [None req-4bf48ff4-ecfb-4168-8b63-249b8c6e9f04 None None] Device 1a0a2345-c03d-4159-89a8-35402d8d2448 no longer exists at agent hyperv_hv-cinder-81901 {{(pid=102994) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 23 19:39:36.487666 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.plugins.ml2.plugin [None req-4bf48ff4-ecfb-4168-8b63-249b8c6e9f04 None None] No Port match for: 1a0a2345-c03d-4159-89a8-35402d8d2448 {{(pid=102994) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 23 19:39:36.487666 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.plugins.ml2.rpc [None req-4bf48ff4-ecfb-4168-8b63-249b8c6e9f04 None None] Device 1a0a2345-c03d-4159-89a8-35402d8d2448 not bound to the agent host hv-cinder-81901 {{(pid=102994) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 23 19:39:36.577397 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1825ef1e-4825-4a24-8df4-6b771bbb4cca req-a86bdea6-7407-4fa8-b7a5-0059eeec9a59 tempest-TestMinimumBasicScenario-716536904 tempest-TestMinimumBasicScenario-716536904-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102993) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:39:36.578912 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-1825ef1e-4825-4a24-8df4-6b771bbb4cca req-a86bdea6-7407-4fa8-b7a5-0059eeec9a59 tempest-TestMinimumBasicScenario-716536904 tempest-TestMinimumBasicScenario-716536904-project] 10.222.0.62 "GET /v2.0/ports?device_id=b5fed716-ff16-48c0-8e89-95731739f55c HTTP/1.1" status: 200 len: 984 time: 0.0494487 Nov 23 19:39:36.649227 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-1825ef1e-4825-4a24-8df4-6b771bbb4cca req-08ad0a7e-58a0-483a-8b74-e8d285e995e0 tempest-TestMinimumBasicScenario-716536904 tempest-TestMinimumBasicScenario-716536904-project] 10.222.0.62 "GET /v2.0/security-groups?id=d09b4044-91d5-4432-9faa-4b7a40b1627d&id=04706b6c-202a-4225-af46-0d450ab58a7b&fields=id&fields=name HTTP/1.1" status: 200 len: 380 time: 0.0585892 Nov 23 19:39:37.262425 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d465da3e-cda4-4480-b2bb-e269e1beea18 req-4aaa4f28-5ea4-4bec-bae1-411761c2449a tempest-AttachVolumeShelveTestJSON-1172915835 tempest-AttachVolumeShelveTestJSON-1172915835-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102992) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:39:37.263820 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-d465da3e-cda4-4480-b2bb-e269e1beea18 req-4aaa4f28-5ea4-4bec-bae1-411761c2449a tempest-AttachVolumeShelveTestJSON-1172915835 tempest-AttachVolumeShelveTestJSON-1172915835-project] 10.222.0.62 "GET /v2.0/ports?device_id=627eaac3-8c43-4aa3-a81c-7a6bfb58dbb5 HTTP/1.1" status: 200 len: 946 time: 0.0483236 Nov 23 19:39:37.316151 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-d465da3e-cda4-4480-b2bb-e269e1beea18 req-fd5abaa1-aebb-48b0-988c-54704475113d tempest-AttachVolumeShelveTestJSON-1172915835 tempest-AttachVolumeShelveTestJSON-1172915835-project] 10.222.0.62 "GET /v2.0/security-groups?id=a246a431-7eb4-441f-b1e6-9c9c351ee888&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0441835 Nov 23 19:39:37.489856 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-c26b6e11-bc83-4ab0-9346-0422e3e74e07 req-3d5e6e17-4fd9-48f7-887f-83002de5dc3e tempest-TestVolumeBootPattern-147141705 tempest-TestVolumeBootPattern-147141705-project] 10.222.0.62 "GET /v2.0/ports?device_id=9e64d320-821f-4313-8dd0-3b327ba75634 HTTP/1.1" status: 200 len: 210 time: 0.0278349 Nov 23 19:39:37.767001 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-41262698-169c-4e84-967c-73e22152b04b req-16cb9948-932f-4f32-98da-a871a6a18b65 tempest-TestMinimumBasicScenario-716536904 tempest-TestMinimumBasicScenario-716536904-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102992) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:39:37.768491 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-41262698-169c-4e84-967c-73e22152b04b req-16cb9948-932f-4f32-98da-a871a6a18b65 tempest-TestMinimumBasicScenario-716536904 tempest-TestMinimumBasicScenario-716536904-project] 10.222.0.62 "GET /v2.0/ports?device_id=b5fed716-ff16-48c0-8e89-95731739f55c HTTP/1.1" status: 200 len: 984 time: 0.0495715 Nov 23 19:39:37.829423 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-41262698-169c-4e84-967c-73e22152b04b req-b886a9df-d2b3-4761-9a7a-2554ccc6ebf0 tempest-TestMinimumBasicScenario-716536904 tempest-TestMinimumBasicScenario-716536904-project] 10.222.0.62 "GET /v2.0/security-groups?id=d09b4044-91d5-4432-9faa-4b7a40b1627d&id=04706b6c-202a-4225-af46-0d450ab58a7b&fields=id&fields=name HTTP/1.1" status: 200 len: 380 time: 0.0547514 Nov 23 19:39:38.328640 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8b8b6526-8711-4c0a-9c4a-79e6de0b1924 req-ae7dabae-9e0e-4995-910d-b3109dc6ad27 tempest-TestVolumeBootPattern-147141705 tempest-TestVolumeBootPattern-147141705-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=102992) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:39:38.330080 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-8b8b6526-8711-4c0a-9c4a-79e6de0b1924 req-ae7dabae-9e0e-4995-910d-b3109dc6ad27 tempest-TestVolumeBootPattern-147141705 tempest-TestVolumeBootPattern-147141705-project] 10.222.0.41 "GET /v2.0/networks?id=226a519f-5f3e-4d80-bb8a-0e9fc4f64828 HTTP/1.1" status: 200 len: 810 time: 0.1036780 Nov 23 19:39:38.410348 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-8b8b6526-8711-4c0a-9c4a-79e6de0b1924 req-078f0620-00b0-4856-9e16-478f4c5f0fb0 tempest-TestVolumeBootPattern-147141705 tempest-TestVolumeBootPattern-147141705-project] 10.222.0.41 "GET /v2.0/security-groups?fields=id&fields=name&tenant_id=257b0b2e531441b4bb745e99cfd799f3 HTTP/1.1" status: 200 len: 380 time: 0.0637016 Nov 23 19:39:38.428906 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.api.v2.base [req-8b8b6526-8711-4c0a-9c4a-79e6de0b1924 req-c1430ac7-ebdc-4647-9a92-7b15a630c7bb tempest-TestVolumeBootPattern-147141705 tempest-TestVolumeBootPattern-147141705-project] Request body: {'port': {'device_id': '9e64d320-821f-4313-8dd0-3b327ba75634', 'network_id': '226a519f-5f3e-4d80-bb8a-0e9fc4f64828', 'admin_state_up': True, 'tenant_id': '257b0b2e531441b4bb745e99cfd799f3', 'security_groups': ['a6e2b133-1a9b-4dde-a188-1ce8bcdb7b5c']}} {{(pid=102992) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 23 19:39:38.437071 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5d832496-affb-4451-895c-bf8619fcb671 req-af6dc4a4-d468-463e-adf6-f5752e0f124d tempest-AttachVolumeShelveTestJSON-1172915835 tempest-AttachVolumeShelveTestJSON-1172915835-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102993) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:39:38.438580 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-5d832496-affb-4451-895c-bf8619fcb671 req-af6dc4a4-d468-463e-adf6-f5752e0f124d tempest-AttachVolumeShelveTestJSON-1172915835 tempest-AttachVolumeShelveTestJSON-1172915835-project] 10.222.0.62 "GET /v2.0/ports?device_id=627eaac3-8c43-4aa3-a81c-7a6bfb58dbb5 HTTP/1.1" status: 200 len: 946 time: 0.0485923 Nov 23 19:39:38.494975 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-5d832496-affb-4451-895c-bf8619fcb671 req-bd03042c-c04b-49b4-b384-0568719b1abe tempest-AttachVolumeShelveTestJSON-1172915835 tempest-AttachVolumeShelveTestJSON-1172915835-project] 10.222.0.62 "GET /v2.0/security-groups?id=a246a431-7eb4-441f-b1e6-9c9c351ee888&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0479791 Nov 23 19:39:38.600113 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-1e16fc65-b035-436d-8d47-66414adefef0 req-48993d07-98b6-489f-9d78-8c253f1c4cd4 tempest-TestVolumeBootPattern-147141705 tempest-TestVolumeBootPattern-147141705-project] 10.222.0.62 "GET /v2.0/ports?device_id=9e64d320-821f-4313-8dd0-3b327ba75634 HTTP/1.1" status: 200 len: 210 time: 0.0297465 Nov 23 19:39:38.610563 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-8b8b6526-8711-4c0a-9c4a-79e6de0b1924 req-c1430ac7-ebdc-4647-9a92-7b15a630c7bb tempest-TestVolumeBootPattern-147141705 tempest-TestVolumeBootPattern-147141705-project] Made reservation on behalf of 257b0b2e531441b4bb745e99cfd799f3 for: {'port': 1} {{(pid=102992) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 23 19:39:38.614598 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [req-8b8b6526-8711-4c0a-9c4a-79e6de0b1924 req-c1430ac7-ebdc-4647-9a92-7b15a630c7bb tempest-TestVolumeBootPattern-147141705 tempest-TestVolumeBootPattern-147141705-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7921281'] for port, before_create {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:39:38.734613 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.db.db_base_plugin_common [req-8b8b6526-8711-4c0a-9c4a-79e6de0b1924 req-c1430ac7-ebdc-4647-9a92-7b15a630c7bb tempest-TestVolumeBootPattern-147141705 tempest-TestVolumeBootPattern-147141705-project] Allocated IP 172.20.0.13 (226a519f-5f3e-4d80-bb8a-0e9fc4f64828/88de785d-c540-4651-af1e-26f27ccaee3c/3f7db100-6209-44d3-88c7-906fb1cec5cb) {{(pid=102992) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 23 19:39:38.874990 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [req-8b8b6526-8711-4c0a-9c4a-79e6de0b1924 req-c1430ac7-ebdc-4647-9a92-7b15a630c7bb tempest-TestVolumeBootPattern-147141705 tempest-TestVolumeBootPattern-147141705-project] Publish callbacks [] for port, precommit_create {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:39:38.944732 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-543912d4-dde3-4e85-a396-49f480c298ad req-7ee2ab43-f159-4736-ad14-1441c9ef8de8 tempest-TestMinimumBasicScenario-716536904 tempest-TestMinimumBasicScenario-716536904-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102993) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:39:38.946243 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-543912d4-dde3-4e85-a396-49f480c298ad req-7ee2ab43-f159-4736-ad14-1441c9ef8de8 tempest-TestMinimumBasicScenario-716536904 tempest-TestMinimumBasicScenario-716536904-project] 10.222.0.62 "GET /v2.0/ports?device_id=b5fed716-ff16-48c0-8e89-95731739f55c HTTP/1.1" status: 200 len: 984 time: 0.0498593 Nov 23 19:39:38.977392 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [req-8b8b6526-8711-4c0a-9c4a-79e6de0b1924 req-c1430ac7-ebdc-4647-9a92-7b15a630c7bb tempest-TestVolumeBootPattern-147141705 tempest-TestVolumeBootPattern-147141705-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7918660', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-15067', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560168', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8783631008714', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-25199805'] for port, after_create {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:39:39.009130 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-543912d4-dde3-4e85-a396-49f480c298ad req-dfbdc59a-fc04-43fb-800a-b02899d05f51 tempest-TestMinimumBasicScenario-716536904 tempest-TestMinimumBasicScenario-716536904-project] 10.222.0.62 "GET /v2.0/security-groups?id=d09b4044-91d5-4432-9faa-4b7a40b1627d&id=04706b6c-202a-4225-af46-0d450ab58a7b&fields=id&fields=name HTTP/1.1" status: 200 len: 380 time: 0.0569365 Nov 23 19:39:39.023983 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-8b8b6526-8711-4c0a-9c4a-79e6de0b1924 req-c1430ac7-ebdc-4647-9a92-7b15a630c7bb tempest-TestVolumeBootPattern-147141705 tempest-TestVolumeBootPattern-147141705-project] Network 226a519f-5f3e-4d80-bb8a-0e9fc4f64828 is already hosted by enough agents. {{(pid=102992) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 23 19:39:39.024913 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.scheduler.base_scheduler [req-8b8b6526-8711-4c0a-9c4a-79e6de0b1924 req-c1430ac7-ebdc-4647-9a92-7b15a630c7bb tempest-TestVolumeBootPattern-147141705 tempest-TestVolumeBootPattern-147141705-project] Resources bound (agent type, host, resource id): {{(pid=102992) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 23 19:39:39.031659 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c1430ac7-ebdc-4647-9a92-7b15a630c7bb tempest-TestVolumeBootPattern-147141705 tempest-TestVolumeBootPattern-147141705-project] Pushing event updated for resources: {'Port': ['ID=3f7db100-6209-44d3-88c7-906fb1cec5cb,revision_number=1']} {{(pid=102992) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 23 19:39:39.033817 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.db.l3_dvrscheduler_db [req-8b8b6526-8711-4c0a-9c4a-79e6de0b1924 req-c1430ac7-ebdc-4647-9a92-7b15a630c7bb tempest-TestVolumeBootPattern-147141705 tempest-TestVolumeBootPattern-147141705-project] Received port after_create {{(pid=102992) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 23 19:39:39.088513 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8b8b6526-8711-4c0a-9c4a-79e6de0b1924 req-c1430ac7-ebdc-4647-9a92-7b15a630c7bb tempest-TestVolumeBootPattern-147141705 tempest-TestVolumeBootPattern-147141705-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=102992) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:39:39.089122 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [req-8b8b6526-8711-4c0a-9c4a-79e6de0b1924 req-c1430ac7-ebdc-4647-9a92-7b15a630c7bb tempest-TestVolumeBootPattern-147141705 tempest-TestVolumeBootPattern-147141705-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-514902'] for port, before_response {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:39:39.213640 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.db.provisioning_blocks [None req-c78a6b17-2382-4d4e-95ec-497548baf986 None None] Provisioning complete for port 3f7db100-6209-44d3-88c7-906fb1cec5cb triggered by entity DHCP. {{(pid=102994) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 23 19:39:39.214194 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron_lib.callbacks.manager [None req-c78a6b17-2382-4d4e-95ec-497548baf986 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-8355713'] for port, provisioning_complete {{(pid=102994) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:39:39.246856 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.plugins.ml2.plugin [None req-c78a6b17-2382-4d4e-95ec-497548baf986 None None] Port 3f7db100-6209-44d3-88c7-906fb1cec5cb cannot update to ACTIVE because it is not bound. {{(pid=102994) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 23 19:39:39.260303 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-8b8b6526-8711-4c0a-9c4a-79e6de0b1924 req-c1430ac7-ebdc-4647-9a92-7b15a630c7bb tempest-TestVolumeBootPattern-147141705 tempest-TestVolumeBootPattern-147141705-project] 10.222.0.41 "POST /v2.0/ports HTTP/1.1" status: 201 len: 934 time: 0.8354504 Nov 23 19:39:39.273012 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.api.v2.base [req-8b8b6526-8711-4c0a-9c4a-79e6de0b1924 req-51738488-cfcb-43fa-a011-dacaa185c581 service neutron] Request body: {'port': {'device_id': '9e64d320-821f-4313-8dd0-3b327ba75634', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-81901'}} {{(pid=102992) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 23 19:39:39.325398 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [req-8b8b6526-8711-4c0a-9c4a-79e6de0b1924 req-51738488-cfcb-43fa-a011-dacaa185c581 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7921281'] for port, before_update {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:39:39.718785 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ae068ac2-332d-472a-8f13-e4283d5ac198 req-e74d49c1-7c7c-4ff0-94ef-3bc9132f709f tempest-TestVolumeBootPattern-147141705 tempest-TestVolumeBootPattern-147141705-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102993) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:39:39.720276 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-ae068ac2-332d-472a-8f13-e4283d5ac198 req-e74d49c1-7c7c-4ff0-94ef-3bc9132f709f tempest-TestVolumeBootPattern-147141705 tempest-TestVolumeBootPattern-147141705-project] 10.222.0.62 "GET /v2.0/ports?device_id=9e64d320-821f-4313-8dd0-3b327ba75634 HTTP/1.1" status: 200 len: 932 time: 0.0507228 Nov 23 19:39:39.771099 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-ae068ac2-332d-472a-8f13-e4283d5ac198 req-73e5fdba-a2c9-4a68-b37c-bfcf5901e85a tempest-TestVolumeBootPattern-147141705 tempest-TestVolumeBootPattern-147141705-project] 10.222.0.62 "GET /v2.0/security-groups?id=a6e2b133-1a9b-4dde-a188-1ce8bcdb7b5c&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0438113 Nov 23 19:39:39.804599 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e43b06de-3787-4813-bf7a-9e7d789e0c5d req-f04acd41-b1c3-4dfd-8c7f-06c70c48f461 tempest-AttachVolumeShelveTestJSON-1172915835 tempest-AttachVolumeShelveTestJSON-1172915835-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102992) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:39:39.806113 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-e43b06de-3787-4813-bf7a-9e7d789e0c5d req-f04acd41-b1c3-4dfd-8c7f-06c70c48f461 tempest-AttachVolumeShelveTestJSON-1172915835 tempest-AttachVolumeShelveTestJSON-1172915835-project] 10.222.0.62 "GET /v2.0/ports?device_id=627eaac3-8c43-4aa3-a81c-7a6bfb58dbb5 HTTP/1.1" status: 200 len: 946 time: 0.1043239 Nov 23 19:39:39.892760 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-e43b06de-3787-4813-bf7a-9e7d789e0c5d req-b513d872-ff39-47a4-b87c-ad582d2761f5 tempest-AttachVolumeShelveTestJSON-1172915835 tempest-AttachVolumeShelveTestJSON-1172915835-project] 10.222.0.62 "GET /v2.0/security-groups?id=a246a431-7eb4-441f-b1e6-9c9c351ee888&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0803545 Nov 23 19:39:39.898643 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.notifiers.nova [req-8b8b6526-8711-4c0a-9c4a-79e6de0b1924 req-51738488-cfcb-43fa-a011-dacaa185c581 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 3f7db100-6209-44d3-88c7-906fb1cec5cb {{(pid=102992) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 23 19:39:39.905776 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [req-8b8b6526-8711-4c0a-9c4a-79e6de0b1924 req-51738488-cfcb-43fa-a011-dacaa185c581 service neutron] Publish callbacks [] for port, precommit_update {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:39:39.918153 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.db.provisioning_blocks [req-8b8b6526-8711-4c0a-9c4a-79e6de0b1924 req-51738488-cfcb-43fa-a011-dacaa185c581 service neutron] Transition to ACTIVE for port object 3f7db100-6209-44d3-88c7-906fb1cec5cb will not be triggered until provisioned by entity L2. {{(pid=102992) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 23 19:39:39.976441 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [req-8b8b6526-8711-4c0a-9c4a-79e6de0b1924 req-51738488-cfcb-43fa-a011-dacaa185c581 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7918660', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-15067', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560168', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8783631423946', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8783631008732', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8783631008750', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-25199748'] for port, after_update {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:39:40.029057 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-51738488-cfcb-43fa-a011-dacaa185c581 service neutron] Pushing event updated for resources: {'Port': ['ID=3f7db100-6209-44d3-88c7-906fb1cec5cb,revision_number=2']} {{(pid=102992) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 23 19:39:40.104212 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.plugins.ml2.managers [req-8b8b6526-8711-4c0a-9c4a-79e6de0b1924 req-51738488-cfcb-43fa-a011-dacaa185c581 service neutron] Attempting to bind port 3f7db100-6209-44d3-88c7-906fb1cec5cb on host hv-cinder-81901 for vnic_type normal with profile {{(pid=102992) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 23 19:39:40.104577 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.plugins.ml2.managers [req-8b8b6526-8711-4c0a-9c4a-79e6de0b1924 req-51738488-cfcb-43fa-a011-dacaa185c581 service neutron] Attempting to bind port 3f7db100-6209-44d3-88c7-906fb1cec5cb by drivers openvswitch,hyperv on host hv-cinder-81901 at level 0 using segments [{'id': '56316385-5b81-43f5-84db-b708b46f04eb', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 800, 'network_id': '226a519f-5f3e-4d80-bb8a-0e9fc4f64828'}] {{(pid=102992) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 23 19:39:40.104989 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-8b8b6526-8711-4c0a-9c4a-79e6de0b1924 req-51738488-cfcb-43fa-a011-dacaa185c581 service neutron] Attempting to bind port 3f7db100-6209-44d3-88c7-906fb1cec5cb on network 226a519f-5f3e-4d80-bb8a-0e9fc4f64828 {{(pid=102992) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 23 19:39:40.109695 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-8b8b6526-8711-4c0a-9c4a-79e6de0b1924 req-51738488-cfcb-43fa-a011-dacaa185c581 service neutron] Port 3f7db100-6209-44d3-88c7-906fb1cec5cb on network 226a519f-5f3e-4d80-bb8a-0e9fc4f64828 not bound, no agent of type Open vSwitch agent registered on host hv-cinder-81901 {{(pid=102992) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Nov 23 19:39:40.110015 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-8b8b6526-8711-4c0a-9c4a-79e6de0b1924 req-51738488-cfcb-43fa-a011-dacaa185c581 service neutron] Attempting to bind port 3f7db100-6209-44d3-88c7-906fb1cec5cb on network 226a519f-5f3e-4d80-bb8a-0e9fc4f64828 {{(pid=102992) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 23 19:39:40.115800 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-8b8b6526-8711-4c0a-9c4a-79e6de0b1924 req-51738488-cfcb-43fa-a011-dacaa185c581 service neutron] Checking agent: {'id': '14e5d049-431d-466a-8d1c-264e5129d376', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-81901', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 23, 19, 31, 29), 'started_at': datetime.datetime(2021, 11, 23, 19, 31, 29), 'heartbeat_timestamp': datetime.datetime(2021, 11, 23, 19, 39, 30), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=102992) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 23 19:39:40.116124 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-8b8b6526-8711-4c0a-9c4a-79e6de0b1924 req-51738488-cfcb-43fa-a011-dacaa185c581 service neutron] Checking segment: {'id': '56316385-5b81-43f5-84db-b708b46f04eb', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 800, 'network_id': '226a519f-5f3e-4d80-bb8a-0e9fc4f64828'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102992) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 23 19:39:40.116530 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-8b8b6526-8711-4c0a-9c4a-79e6de0b1924 req-51738488-cfcb-43fa-a011-dacaa185c581 service neutron] Bound using segment: {'id': '56316385-5b81-43f5-84db-b708b46f04eb', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 800, 'network_id': '226a519f-5f3e-4d80-bb8a-0e9fc4f64828'} {{(pid=102992) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 23 19:39:40.117006 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.plugins.ml2.managers [req-8b8b6526-8711-4c0a-9c4a-79e6de0b1924 req-51738488-cfcb-43fa-a011-dacaa185c581 service neutron] Bound port: 3f7db100-6209-44d3-88c7-906fb1cec5cb, host: hv-cinder-81901, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '56316385-5b81-43f5-84db-b708b46f04eb', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 800, 'network_id': '226a519f-5f3e-4d80-bb8a-0e9fc4f64828'}}] {{(pid=102992) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 23 19:39:40.117362 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [req-8b8b6526-8711-4c0a-9c4a-79e6de0b1924 req-51738488-cfcb-43fa-a011-dacaa185c581 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7921281'] for port, before_update {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:39:40.140080 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-27e23be1-c826-4a3c-9e86-e7450e442c2f req-30a94361-e83e-4e6f-b7de-78541a4574d1 tempest-TestMinimumBasicScenario-716536904 tempest-TestMinimumBasicScenario-716536904-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102993) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:39:40.141647 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-27e23be1-c826-4a3c-9e86-e7450e442c2f req-30a94361-e83e-4e6f-b7de-78541a4574d1 tempest-TestMinimumBasicScenario-716536904 tempest-TestMinimumBasicScenario-716536904-project] 10.222.0.62 "GET /v2.0/ports?device_id=b5fed716-ff16-48c0-8e89-95731739f55c HTTP/1.1" status: 200 len: 984 time: 0.0528169 Nov 23 19:39:40.185445 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.plugins.ml2.db [req-8b8b6526-8711-4c0a-9c4a-79e6de0b1924 req-51738488-cfcb-43fa-a011-dacaa185c581 service neutron] For port 3f7db100-6209-44d3-88c7-906fb1cec5cb, host hv-cinder-81901, cleared binding levels {{(pid=102992) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 23 19:39:40.188623 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.plugins.ml2.db [req-8b8b6526-8711-4c0a-9c4a-79e6de0b1924 req-51738488-cfcb-43fa-a011-dacaa185c581 service neutron] For port 3f7db100-6209-44d3-88c7-906fb1cec5cb, host hv-cinder-81901, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81901',level=0,port_id=3f7db100-6209-44d3-88c7-906fb1cec5cb,segment=NetworkSegment(56316385-5b81-43f5-84db-b708b46f04eb),segment_id=56316385-5b81-43f5-84db-b708b46f04eb)] {{(pid=102992) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 23 19:39:40.208339 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-27e23be1-c826-4a3c-9e86-e7450e442c2f req-c7db1aee-6b2e-47f1-8b6d-14f298dc0df5 tempest-TestMinimumBasicScenario-716536904 tempest-TestMinimumBasicScenario-716536904-project] 10.222.0.62 "GET /v2.0/security-groups?id=d09b4044-91d5-4432-9faa-4b7a40b1627d&id=04706b6c-202a-4225-af46-0d450ab58a7b&fields=id&fields=name HTTP/1.1" status: 200 len: 380 time: 0.0594354 Nov 23 19:39:40.257376 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [req-8b8b6526-8711-4c0a-9c4a-79e6de0b1924 req-51738488-cfcb-43fa-a011-dacaa185c581 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7918660', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-15067', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560168', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8783631423946', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8783631008732', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8783631008750', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-25199748'] for port, after_update {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:39:40.292050 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8b8b6526-8711-4c0a-9c4a-79e6de0b1924 req-51738488-cfcb-43fa-a011-dacaa185c581 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102992) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:39:40.292717 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [req-8b8b6526-8711-4c0a-9c4a-79e6de0b1924 req-51738488-cfcb-43fa-a011-dacaa185c581 service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-514902'] for port, before_response {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:39:40.294320 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-8b8b6526-8711-4c0a-9c4a-79e6de0b1924 req-51738488-cfcb-43fa-a011-dacaa185c581 service neutron] 10.222.0.41 "PUT /v2.0/ports/3f7db100-6209-44d3-88c7-906fb1cec5cb HTTP/1.1" status: 200 len: 1094 time: 1.0259426 Nov 23 19:39:40.296432 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '9e64d320-821f-4313-8dd0-3b327ba75634', 'tag': '3f7db100-6209-44d3-88c7-906fb1cec5cb'}] {{(pid=102992) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 23 19:39:40.298673 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.62/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}f86c332b591ae691ababa4b64e0601cbf242a448242f95367ce03daabfb7e1ce" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-1544aff5-d193-499b-8fa0-2d0b23819cd2" -d '{"events": [{"name": "network-changed", "server_uuid": "9e64d320-821f-4313-8dd0-3b327ba75634", "tag": "3f7db100-6209-44d3-88c7-906fb1cec5cb"}]}' {{(pid=102992) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 23 19:39:40.330812 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-51738488-cfcb-43fa-a011-dacaa185c581 service neutron] Pushing event updated for resources: {'Port': ['ID=3f7db100-6209-44d3-88c7-906fb1cec5cb,revision_number=3']} {{(pid=102992) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 23 19:39:40.340296 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Tue, 23 Nov 2021 19:39:40 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-2ac9c011-ae1c-4be5-8181-a6228955bc49 x-openstack-request-id: req-2ac9c011-ae1c-4be5-8181-a6228955bc49 {{(pid=102992) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 23 19:39:40.340747 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "9e64d320-821f-4313-8dd0-3b327ba75634", "tag": "3f7db100-6209-44d3-88c7-906fb1cec5cb", "status": "completed", "code": 200}]} {{(pid=102992) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 23 19:39:40.341112 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.62/compute/v2.1/os-server-external-events used request id req-2ac9c011-ae1c-4be5-8181-a6228955bc49 {{(pid=102992) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 23 19:39:40.342151 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '9e64d320-821f-4313-8dd0-3b327ba75634', 'tag': '3f7db100-6209-44d3-88c7-906fb1cec5cb', 'status': 'completed', 'code': 200} Nov 23 19:39:40.410533 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1544aff5-d193-499b-8fa0-2d0b23819cd2 req-4453a47a-2c0e-48f7-a2c0-deac8cfb09d0 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102992) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:39:40.412249 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-1544aff5-d193-499b-8fa0-2d0b23819cd2 req-4453a47a-2c0e-48f7-a2c0-deac8cfb09d0 service neutron] 10.222.0.41 "GET /v2.0/ports?tenant_id=257b0b2e531441b4bb745e99cfd799f3&device_id=9e64d320-821f-4313-8dd0-3b327ba75634 HTTP/1.1" status: 200 len: 1097 time: 0.0435236 Nov 23 19:39:40.518762 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1544aff5-d193-499b-8fa0-2d0b23819cd2 req-a8ca6a90-63c1-408c-a69e-a874aeb83897 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102992) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:39:40.520842 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-1544aff5-d193-499b-8fa0-2d0b23819cd2 req-a8ca6a90-63c1-408c-a69e-a874aeb83897 service neutron] 10.222.0.41 "GET /v2.0/networks?tenant_id=257b0b2e531441b4bb745e99cfd799f3&shared=False HTTP/1.1" status: 200 len: 911 time: 0.1001172 Nov 23 19:39:40.618409 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1544aff5-d193-499b-8fa0-2d0b23819cd2 req-a0644280-a77f-4c40-a180-3adb764e1840 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102992) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:39:40.619782 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-1544aff5-d193-499b-8fa0-2d0b23819cd2 req-a0644280-a77f-4c40-a180-3adb764e1840 service neutron] 10.222.0.41 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 870 time: 0.0909662 Nov 23 19:39:40.703048 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8b8b6526-8711-4c0a-9c4a-79e6de0b1924 req-d2a76889-b237-4c97-a164-319a0850e83e service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102992) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:39:40.704518 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-8b8b6526-8711-4c0a-9c4a-79e6de0b1924 req-d2a76889-b237-4c97-a164-319a0850e83e service neutron] 10.222.0.41 "GET /v2.0/ports?tenant_id=257b0b2e531441b4bb745e99cfd799f3&device_id=9e64d320-821f-4313-8dd0-3b327ba75634 HTTP/1.1" status: 200 len: 1097 time: 0.0404999 Nov 23 19:39:40.745862 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-8b8b6526-8711-4c0a-9c4a-79e6de0b1924 req-f279804b-dfeb-4d08-9ea1-a4d4b3ea259b service neutron] 10.222.0.41 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.13&port_id=3f7db100-6209-44d3-88c7-906fb1cec5cb HTTP/1.1" status: 200 len: 217 time: 0.0330734 Nov 23 19:39:40.802989 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8b8b6526-8711-4c0a-9c4a-79e6de0b1924 req-878eff19-d335-439d-bbd8-a7bf9b339574 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102992) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:39:40.804423 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-8b8b6526-8711-4c0a-9c4a-79e6de0b1924 req-878eff19-d335-439d-bbd8-a7bf9b339574 service neutron] 10.222.0.41 "GET /v2.0/subnets?id=88de785d-c540-4651-af1e-26f27ccaee3c HTTP/1.1" status: 200 len: 849 time: 0.0463707 Nov 23 19:39:40.851710 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8b8b6526-8711-4c0a-9c4a-79e6de0b1924 req-389b5993-962d-4fa9-868f-71dcd9d0a111 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102992) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:39:40.853178 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-8b8b6526-8711-4c0a-9c4a-79e6de0b1924 req-389b5993-962d-4fa9-868f-71dcd9d0a111 service neutron] 10.222.0.41 "GET /v2.0/ports?network_id=226a519f-5f3e-4d80-bb8a-0e9fc4f64828&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0407708 Nov 23 19:39:40.887504 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-49cbef96-2206-4026-9444-a2af0b1bbd58 req-5edc1239-e7b8-4d25-995b-b9572de6bbb1 tempest-TestVolumeBootPattern-147141705 tempest-TestVolumeBootPattern-147141705-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102993) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:39:40.888984 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-49cbef96-2206-4026-9444-a2af0b1bbd58 req-5edc1239-e7b8-4d25-995b-b9572de6bbb1 tempest-TestVolumeBootPattern-147141705 tempest-TestVolumeBootPattern-147141705-project] 10.222.0.62 "GET /v2.0/ports?device_id=9e64d320-821f-4313-8dd0-3b327ba75634 HTTP/1.1" status: 200 len: 944 time: 0.0489128 Nov 23 19:39:40.942123 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-49cbef96-2206-4026-9444-a2af0b1bbd58 req-9985e4fd-d657-4237-9780-04e3db277fe3 tempest-TestVolumeBootPattern-147141705 tempest-TestVolumeBootPattern-147141705-project] 10.222.0.62 "GET /v2.0/security-groups?id=a6e2b133-1a9b-4dde-a188-1ce8bcdb7b5c&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0460804 Nov 23 19:39:40.947686 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-8b8b6526-8711-4c0a-9c4a-79e6de0b1924 req-c5ee0f8f-5ae5-4fef-b5df-703b352ab9f5 service neutron] 10.222.0.41 "GET /v2.0/networks/226a519f-5f3e-4d80-bb8a-0e9fc4f64828?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0859914 Nov 23 19:39:41.070128 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6583067a-b467-42dc-a33d-340e0ecfa7e0 req-bc216256-d104-4e84-8547-2c37693270d9 tempest-AttachVolumeShelveTestJSON-1172915835 tempest-AttachVolumeShelveTestJSON-1172915835-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102992) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:39:41.071526 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-6583067a-b467-42dc-a33d-340e0ecfa7e0 req-bc216256-d104-4e84-8547-2c37693270d9 tempest-AttachVolumeShelveTestJSON-1172915835 tempest-AttachVolumeShelveTestJSON-1172915835-project] 10.222.0.62 "GET /v2.0/ports?device_id=627eaac3-8c43-4aa3-a81c-7a6bfb58dbb5 HTTP/1.1" status: 200 len: 946 time: 0.1031008 Nov 23 19:39:41.098579 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-8b8b6526-8711-4c0a-9c4a-79e6de0b1924 req-a2f84614-a9c7-4b29-b96b-de2d98e21051 service neutron] 10.222.0.41 "GET /v2.0/networks/226a519f-5f3e-4d80-bb8a-0e9fc4f64828?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1378851 Nov 23 19:39:41.127858 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-6583067a-b467-42dc-a33d-340e0ecfa7e0 req-172598a2-22b7-48e2-9cbf-30cf0c38cb39 tempest-AttachVolumeShelveTestJSON-1172915835 tempest-AttachVolumeShelveTestJSON-1172915835-project] 10.222.0.62 "GET /v2.0/security-groups?id=a246a431-7eb4-441f-b1e6-9c9c351ee888&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0503891 Nov 23 19:39:41.325582 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3527e0d3-9944-4fcb-8764-3237c7f47b6c req-9a4da844-f18b-4222-9bb6-e7f6332ce463 tempest-TestMinimumBasicScenario-716536904 tempest-TestMinimumBasicScenario-716536904-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102993) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:39:41.326981 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-3527e0d3-9944-4fcb-8764-3237c7f47b6c req-9a4da844-f18b-4222-9bb6-e7f6332ce463 tempest-TestMinimumBasicScenario-716536904 tempest-TestMinimumBasicScenario-716536904-project] 10.222.0.62 "GET /v2.0/ports?device_id=b5fed716-ff16-48c0-8e89-95731739f55c HTTP/1.1" status: 200 len: 984 time: 0.0526433 Nov 23 19:39:41.388514 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-3527e0d3-9944-4fcb-8764-3237c7f47b6c req-12e9123d-8dc2-4aa8-96bb-c8342a0e8f19 tempest-TestMinimumBasicScenario-716536904 tempest-TestMinimumBasicScenario-716536904-project] 10.222.0.62 "GET /v2.0/security-groups?id=d09b4044-91d5-4432-9faa-4b7a40b1627d&id=04706b6c-202a-4225-af46-0d450ab58a7b&fields=id&fields=name HTTP/1.1" status: 200 len: 380 time: 0.0551076 Nov 23 19:39:41.713668 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron_lib.callbacks.manager [None req-9fb517da-9566-47be-945f-ac55305b1dc7 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8783631323329', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7978582'] for agent, after_update {{(pid=102994) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:39:42.064160 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7d708c74-78ae-4b59-ba66-06767aa8f368 req-eb175f9c-f352-4074-8428-82c699337f1d tempest-TestVolumeBootPattern-147141705 tempest-TestVolumeBootPattern-147141705-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102992) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:39:42.065696 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-7d708c74-78ae-4b59-ba66-06767aa8f368 req-eb175f9c-f352-4074-8428-82c699337f1d tempest-TestVolumeBootPattern-147141705 tempest-TestVolumeBootPattern-147141705-project] 10.222.0.62 "GET /v2.0/ports?device_id=9e64d320-821f-4313-8dd0-3b327ba75634 HTTP/1.1" status: 200 len: 944 time: 0.0521567 Nov 23 19:39:42.115438 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-7d708c74-78ae-4b59-ba66-06767aa8f368 req-c724bb2b-51ef-4796-8c93-b24cfbaeac43 tempest-TestVolumeBootPattern-147141705 tempest-TestVolumeBootPattern-147141705-project] 10.222.0.62 "GET /v2.0/security-groups?id=a6e2b133-1a9b-4dde-a188-1ce8bcdb7b5c&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0432909 Nov 23 19:39:42.248039 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-79885044-14cb-499c-87d7-63f31eaf2eb2 req-eac4f76f-b9d5-4652-8c30-37dc6932588e tempest-AttachVolumeShelveTestJSON-1172915835 tempest-AttachVolumeShelveTestJSON-1172915835-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102993) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:39:42.249428 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-79885044-14cb-499c-87d7-63f31eaf2eb2 req-eac4f76f-b9d5-4652-8c30-37dc6932588e tempest-AttachVolumeShelveTestJSON-1172915835 tempest-AttachVolumeShelveTestJSON-1172915835-project] 10.222.0.62 "GET /v2.0/ports?device_id=627eaac3-8c43-4aa3-a81c-7a6bfb58dbb5 HTTP/1.1" status: 200 len: 946 time: 0.0489552 Nov 23 19:39:42.295728 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-79885044-14cb-499c-87d7-63f31eaf2eb2 req-a4801fdd-6cb9-48ac-8f53-6a6dcdc29775 tempest-AttachVolumeShelveTestJSON-1172915835 tempest-AttachVolumeShelveTestJSON-1172915835-project] 10.222.0.62 "GET /v2.0/security-groups?id=a246a431-7eb4-441f-b1e6-9c9c351ee888&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0404048 Nov 23 19:39:42.502264 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-34bee8ea-03b8-4ae0-b13d-9e0123127c7c req-48a4e3ac-b01c-4c17-97c3-b1b027e878a1 tempest-TestMinimumBasicScenario-716536904 tempest-TestMinimumBasicScenario-716536904-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102992) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:39:42.503683 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-34bee8ea-03b8-4ae0-b13d-9e0123127c7c req-48a4e3ac-b01c-4c17-97c3-b1b027e878a1 tempest-TestMinimumBasicScenario-716536904 tempest-TestMinimumBasicScenario-716536904-project] 10.222.0.62 "GET /v2.0/ports?device_id=b5fed716-ff16-48c0-8e89-95731739f55c HTTP/1.1" status: 200 len: 984 time: 0.0504835 Nov 23 19:39:42.562729 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-34bee8ea-03b8-4ae0-b13d-9e0123127c7c req-87f42d67-64cc-4f93-bfc3-1c4bf7683c50 tempest-TestMinimumBasicScenario-716536904 tempest-TestMinimumBasicScenario-716536904-project] 10.222.0.62 "GET /v2.0/security-groups?id=d09b4044-91d5-4432-9faa-4b7a40b1627d&id=04706b6c-202a-4225-af46-0d450ab58a7b&fields=id&fields=name HTTP/1.1" status: 200 len: 380 time: 0.0528228 Nov 23 19:39:43.226920 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bc3716a1-193f-45c7-a3c5-3b4f3806ed08 req-8589832b-cb91-4e3c-93d4-131a2009ce09 tempest-TestVolumeBootPattern-147141705 tempest-TestVolumeBootPattern-147141705-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102993) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:39:43.228354 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-bc3716a1-193f-45c7-a3c5-3b4f3806ed08 req-8589832b-cb91-4e3c-93d4-131a2009ce09 tempest-TestVolumeBootPattern-147141705 tempest-TestVolumeBootPattern-147141705-project] 10.222.0.62 "GET /v2.0/ports?device_id=9e64d320-821f-4313-8dd0-3b327ba75634 HTTP/1.1" status: 200 len: 944 time: 0.0476258 Nov 23 19:39:43.279461 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-bc3716a1-193f-45c7-a3c5-3b4f3806ed08 req-ce06a803-017b-4824-979e-b27da4a1f1ba tempest-TestVolumeBootPattern-147141705 tempest-TestVolumeBootPattern-147141705-project] 10.222.0.62 "GET /v2.0/security-groups?id=a6e2b133-1a9b-4dde-a188-1ce8bcdb7b5c&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0451641 Nov 23 19:39:43.420293 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a639606f-fe73-416c-b070-435c29f39ed1 req-d51e07cf-576c-495b-b049-1b34edb48a4d tempest-AttachVolumeShelveTestJSON-1172915835 tempest-AttachVolumeShelveTestJSON-1172915835-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102992) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:39:43.421714 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-a639606f-fe73-416c-b070-435c29f39ed1 req-d51e07cf-576c-495b-b049-1b34edb48a4d tempest-AttachVolumeShelveTestJSON-1172915835 tempest-AttachVolumeShelveTestJSON-1172915835-project] 10.222.0.62 "GET /v2.0/ports?device_id=627eaac3-8c43-4aa3-a81c-7a6bfb58dbb5 HTTP/1.1" status: 200 len: 946 time: 0.0553546 Nov 23 19:39:43.469857 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-a639606f-fe73-416c-b070-435c29f39ed1 req-3781063f-d182-4449-9a12-977fa10f605c tempest-AttachVolumeShelveTestJSON-1172915835 tempest-AttachVolumeShelveTestJSON-1172915835-project] 10.222.0.62 "GET /v2.0/security-groups?id=a246a431-7eb4-441f-b1e6-9c9c351ee888&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0421567 Nov 23 19:39:44.187844 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron_lib.callbacks.manager [None req-191873f0-1cda-427e-b5cb-cb0eba34d915 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8783631323329', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7978582'] for agent, after_update {{(pid=102994) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:39:44.392794 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2e2ace0a-2deb-49ca-92e9-fa5cbbddb03d req-9f46065d-b337-4097-99eb-42ea4d094952 tempest-TestVolumeBootPattern-147141705 tempest-TestVolumeBootPattern-147141705-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102993) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:39:44.394870 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-2e2ace0a-2deb-49ca-92e9-fa5cbbddb03d req-9f46065d-b337-4097-99eb-42ea4d094952 tempest-TestVolumeBootPattern-147141705 tempest-TestVolumeBootPattern-147141705-project] 10.222.0.62 "GET /v2.0/ports?device_id=9e64d320-821f-4313-8dd0-3b327ba75634 HTTP/1.1" status: 200 len: 944 time: 0.0479951 Nov 23 19:39:44.444559 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-2e2ace0a-2deb-49ca-92e9-fa5cbbddb03d req-7a70eaa7-94ca-48df-8de3-216b151a6a4a tempest-TestVolumeBootPattern-147141705 tempest-TestVolumeBootPattern-147141705-project] 10.222.0.62 "GET /v2.0/security-groups?id=a6e2b133-1a9b-4dde-a188-1ce8bcdb7b5c&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0436409 Nov 23 19:39:44.505991 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.plugins.ml2.rpc [None req-4bf48ff4-ecfb-4168-8b63-249b8c6e9f04 None None] Device 895334df-08a6-40fc-9056-3c5fba79b18c details requested by agent hyperv_hv-cinder-81901 with host hv-cinder-81901 {{(pid=102994) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Nov 23 19:39:44.588613 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a57ec9ac-d280-453f-b12b-386246980123 req-0ca81df7-0ea6-4adc-bef8-7c09c71dadbf tempest-AttachVolumeShelveTestJSON-1172915835 tempest-AttachVolumeShelveTestJSON-1172915835-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102992) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:39:44.590130 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-a57ec9ac-d280-453f-b12b-386246980123 req-0ca81df7-0ea6-4adc-bef8-7c09c71dadbf tempest-AttachVolumeShelveTestJSON-1172915835 tempest-AttachVolumeShelveTestJSON-1172915835-project] 10.222.0.62 "GET /v2.0/ports?device_id=627eaac3-8c43-4aa3-a81c-7a6bfb58dbb5 HTTP/1.1" status: 200 len: 946 time: 0.0494745 Nov 23 19:39:44.600249 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.plugins.ml2.db [None req-4bf48ff4-ecfb-4168-8b63-249b8c6e9f04 None None] For port 895334df-08a6-40fc-9056-3c5fba79b18c, host hv-cinder-81901, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81901',level=0,port_id=895334df-08a6-40fc-9056-3c5fba79b18c,segment=NetworkSegment(b4453f21-ac7f-498c-8316-73b738820700),segment_id=b4453f21-ac7f-498c-8316-73b738820700)] {{(pid=102994) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 23 19:39:44.615448 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.plugins.ml2.rpc [None req-4bf48ff4-ecfb-4168-8b63-249b8c6e9f04 None None] Returning: {'device': '895334df-08a6-40fc-9056-3c5fba79b18c', 'network_id': 'fc901312-2937-4784-8a6d-c046666e8bf8', 'port_id': '895334df-08a6-40fc-9056-3c5fba79b18c', 'mac_address': 'fa:16:3e:83:a6:a3', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 825, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '2caca985-6ed6-4ef7-ba49-7b7410bea160', 'ip_address': '172.20.0.11'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=102994) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Nov 23 19:39:44.638238 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-a57ec9ac-d280-453f-b12b-386246980123 req-636e6b17-43ba-4de5-bb8a-5be45e5b5c84 tempest-AttachVolumeShelveTestJSON-1172915835 tempest-AttachVolumeShelveTestJSON-1172915835-project] 10.222.0.62 "GET /v2.0/security-groups?id=a246a431-7eb4-441f-b1e6-9c9c351ee888&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0421622 Nov 23 19:39:44.652645 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron_lib.callbacks.manager [None req-4bf48ff4-ecfb-4168-8b63-249b8c6e9f04 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7921281'] for port, before_update {{(pid=102994) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:39:44.665121 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.notifiers.nova [None req-4bf48ff4-ecfb-4168-8b63-249b8c6e9f04 None None] Ignoring state change previous_port_status: ACTIVE current_port_status: BUILD port_id 895334df-08a6-40fc-9056-3c5fba79b18c {{(pid=102994) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 23 19:39:44.684028 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.plugins.ml2.db [None req-4bf48ff4-ecfb-4168-8b63-249b8c6e9f04 None None] For port 895334df-08a6-40fc-9056-3c5fba79b18c, host hv-cinder-81901, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81901',level=0,port_id=895334df-08a6-40fc-9056-3c5fba79b18c,segment=NetworkSegment(b4453f21-ac7f-498c-8316-73b738820700),segment_id=b4453f21-ac7f-498c-8316-73b738820700)] {{(pid=102994) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 23 19:39:44.719023 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron_lib.callbacks.manager [None req-4bf48ff4-ecfb-4168-8b63-249b8c6e9f04 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7918660', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-15067', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560168', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8783631423946', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8783631008732', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8783631008750'] for port, after_update {{(pid=102994) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:39:44.770348 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4bf48ff4-ecfb-4168-8b63-249b8c6e9f04 None None] Pushing event updated for resources: {'Port': ['ID=895334df-08a6-40fc-9056-3c5fba79b18c,revision_number=6']} {{(pid=102994) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 23 19:39:44.777635 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4bf48ff4-ecfb-4168-8b63-249b8c6e9f04 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-819011-1-iscsi {{(pid=102994) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 23 19:39:44.777997 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4bf48ff4-ecfb-4168-8b63-249b8c6e9f04 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-819011-1-iscsi {{(pid=102994) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 23 19:39:44.778351 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4bf48ff4-ecfb-4168-8b63-249b8c6e9f04 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-819011-1-iscsi {{(pid=102994) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 23 19:39:44.778697 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4bf48ff4-ecfb-4168-8b63-249b8c6e9f04 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-819011-1-iscsi {{(pid=102994) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 23 19:39:44.779038 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4bf48ff4-ecfb-4168-8b63-249b8c6e9f04 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-819011-1-iscsi {{(pid=102994) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 23 19:39:44.779376 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4bf48ff4-ecfb-4168-8b63-249b8c6e9f04 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-819011-1-iscsi {{(pid=102994) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 23 19:39:44.779752 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4bf48ff4-ecfb-4168-8b63-249b8c6e9f04 None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-819011-1-iscsi {{(pid=102994) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 23 19:39:44.780089 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4bf48ff4-ecfb-4168-8b63-249b8c6e9f04 None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-819011-1-iscsi {{(pid=102994) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 23 19:39:44.780448 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4bf48ff4-ecfb-4168-8b63-249b8c6e9f04 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-819011-1-iscsi {{(pid=102994) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 23 19:39:44.780786 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4bf48ff4-ecfb-4168-8b63-249b8c6e9f04 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-819011-1-iscsi {{(pid=102994) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 23 19:39:44.781117 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4bf48ff4-ecfb-4168-8b63-249b8c6e9f04 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-819011-1-iscsi {{(pid=102994) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 23 19:39:44.781503 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4bf48ff4-ecfb-4168-8b63-249b8c6e9f04 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-819011-1-iscsi {{(pid=102994) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 23 19:39:44.823603 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.plugins.ml2.db [None req-4bf48ff4-ecfb-4168-8b63-249b8c6e9f04 None None] get_ports_and_sgs() called for port_ids ['895334df-08a6-40fc-9056-3c5fba79b18c'] {{(pid=102994) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 23 19:39:45.096314 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron_lib.callbacks.manager [None req-8346ef05-f685-4c3d-af3d-a159b683bec2 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8783631323329', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7978582'] for agent, after_update {{(pid=102994) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:39:45.603523 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f2b0a29a-1b94-4c7e-b8b7-01aca1fd3ad9 req-7404186f-30ba-49a9-9754-cd56ecaf9139 tempest-TestVolumeBootPattern-147141705 tempest-TestVolumeBootPattern-147141705-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102993) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:39:45.604964 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-f2b0a29a-1b94-4c7e-b8b7-01aca1fd3ad9 req-7404186f-30ba-49a9-9754-cd56ecaf9139 tempest-TestVolumeBootPattern-147141705 tempest-TestVolumeBootPattern-147141705-project] 10.222.0.62 "GET /v2.0/ports?device_id=9e64d320-821f-4313-8dd0-3b327ba75634 HTTP/1.1" status: 200 len: 944 time: 0.0475593 Nov 23 19:39:45.655259 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-f2b0a29a-1b94-4c7e-b8b7-01aca1fd3ad9 req-5dda8c6c-68b4-49a3-b5b4-646fcb4a7b2b tempest-TestVolumeBootPattern-147141705 tempest-TestVolumeBootPattern-147141705-project] 10.222.0.62 "GET /v2.0/security-groups?id=a6e2b133-1a9b-4dde-a188-1ce8bcdb7b5c&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0444496 Nov 23 19:39:45.760979 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8f5d0142-7174-4062-b315-e043d9f2bf38 req-a6f63f7c-4168-4917-be9e-fd65a14cd9df tempest-AttachVolumeShelveTestJSON-1172915835 tempest-AttachVolumeShelveTestJSON-1172915835-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102992) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:39:45.762529 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-8f5d0142-7174-4062-b315-e043d9f2bf38 req-a6f63f7c-4168-4917-be9e-fd65a14cd9df tempest-AttachVolumeShelveTestJSON-1172915835 tempest-AttachVolumeShelveTestJSON-1172915835-project] 10.222.0.62 "GET /v2.0/ports?device_id=627eaac3-8c43-4aa3-a81c-7a6bfb58dbb5 HTTP/1.1" status: 200 len: 945 time: 0.0515211 Nov 23 19:39:45.814922 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-8f5d0142-7174-4062-b315-e043d9f2bf38 req-5ae5e3de-cbf3-485e-ac65-6d95ad84ff42 tempest-AttachVolumeShelveTestJSON-1172915835 tempest-AttachVolumeShelveTestJSON-1172915835-project] 10.222.0.62 "GET /v2.0/security-groups?id=a246a431-7eb4-441f-b1e6-9c9c351ee888&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0465150 Nov 23 19:39:46.527189 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.plugins.ml2.rpc [None req-4bf48ff4-ecfb-4168-8b63-249b8c6e9f04 None None] Device 895334df-08a6-40fc-9056-3c5fba79b18c up at agent hyperv_hv-cinder-81901 {{(pid=102994) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 23 19:39:46.576929 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron_lib.callbacks.manager [None req-785c1d26-11ba-42d8-b5a6-51a8b3daeef0 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8783631323329', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7978582'] for agent, after_update {{(pid=102994) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:39:46.587538 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.db.provisioning_blocks [None req-4bf48ff4-ecfb-4168-8b63-249b8c6e9f04 None None] Provisioning complete for port 895334df-08a6-40fc-9056-3c5fba79b18c triggered by entity L2. {{(pid=102994) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 23 19:39:46.596985 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron_lib.callbacks.manager [None req-4bf48ff4-ecfb-4168-8b63-249b8c6e9f04 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-8355713'] for port, provisioning_complete {{(pid=102994) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:39:46.683204 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron_lib.callbacks.manager [None req-4bf48ff4-ecfb-4168-8b63-249b8c6e9f04 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7921281'] for port, before_update {{(pid=102994) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:39:46.715715 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '627eaac3-8c43-4aa3-a81c-7a6bfb58dbb5', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '895334df-08a6-40fc-9056-3c5fba79b18c'}] {{(pid=102994) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 23 19:39:46.719144 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.62/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}09a7511da0d2ba1d728b27e36a8467ec5289399952f0059588048a7cb66d3a43" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-6d708ffa-0e7b-4e61-902f-09be6942ee59" -d '{"events": [{"server_uuid": "627eaac3-8c43-4aa3-a81c-7a6bfb58dbb5", "name": "network-vif-plugged", "status": "completed", "tag": "895334df-08a6-40fc-9056-3c5fba79b18c"}]}' {{(pid=102994) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 23 19:39:46.736500 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.plugins.ml2.db [None req-4bf48ff4-ecfb-4168-8b63-249b8c6e9f04 None None] For port 895334df-08a6-40fc-9056-3c5fba79b18c, host hv-cinder-81901, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81901',level=0,port_id=895334df-08a6-40fc-9056-3c5fba79b18c,segment=NetworkSegment(b4453f21-ac7f-498c-8316-73b738820700),segment_id=b4453f21-ac7f-498c-8316-73b738820700)] {{(pid=102994) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 23 19:39:46.805017 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron_lib.callbacks.manager [None req-4bf48ff4-ecfb-4168-8b63-249b8c6e9f04 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7918660', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-15067', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560168', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8783631423946', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8783631008732', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8783631008750'] for port, after_update {{(pid=102994) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:39:46.826062 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-da207f78-e9cf-45d2-bfe0-0c1bdaf35b83 req-60379d45-838e-4fe1-b87f-2e166e61ba8a tempest-TestVolumeBootPattern-147141705 tempest-TestVolumeBootPattern-147141705-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102993) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:39:46.835150 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-da207f78-e9cf-45d2-bfe0-0c1bdaf35b83 req-60379d45-838e-4fe1-b87f-2e166e61ba8a tempest-TestVolumeBootPattern-147141705 tempest-TestVolumeBootPattern-147141705-project] 10.222.0.62 "GET /v2.0/ports?device_id=9e64d320-821f-4313-8dd0-3b327ba75634 HTTP/1.1" status: 200 len: 944 time: 0.0865152 Nov 23 19:39:46.862545 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 23 Nov 2021 19:39:46 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-0ca41058-3dbd-448b-ba85-b14aead15c9d x-openstack-request-id: req-0ca41058-3dbd-448b-ba85-b14aead15c9d {{(pid=102994) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 23 19:39:46.863454 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "627eaac3-8c43-4aa3-a81c-7a6bfb58dbb5", "name": "network-vif-plugged", "status": "completed", "tag": "895334df-08a6-40fc-9056-3c5fba79b18c", "code": 200}]} {{(pid=102994) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 23 19:39:46.863767 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.62/compute/v2.1/os-server-external-events used request id req-0ca41058-3dbd-448b-ba85-b14aead15c9d {{(pid=102994) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 23 19:39:46.864783 dv-cinder-819011-1-iscsi neutron-server[102994]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '627eaac3-8c43-4aa3-a81c-7a6bfb58dbb5', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '895334df-08a6-40fc-9056-3c5fba79b18c', 'code': 200} Nov 23 19:39:46.892182 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4bf48ff4-ecfb-4168-8b63-249b8c6e9f04 None None] Pushing event updated for resources: {'Port': ['ID=895334df-08a6-40fc-9056-3c5fba79b18c,revision_number=7']} {{(pid=102994) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 23 19:39:46.899169 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-da207f78-e9cf-45d2-bfe0-0c1bdaf35b83 req-28e67ed4-b7b6-435a-9246-d3e798ca557d tempest-TestVolumeBootPattern-147141705 tempest-TestVolumeBootPattern-147141705-project] 10.222.0.62 "GET /v2.0/security-groups?id=a6e2b133-1a9b-4dde-a188-1ce8bcdb7b5c&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0575635 Nov 23 19:39:46.967286 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b59ccb3b-4f00-4fba-a5e5-09e80dec258a req-78dac549-300f-48ba-9a10-5c322897071b tempest-AttachVolumeShelveTestJSON-1172915835 tempest-AttachVolumeShelveTestJSON-1172915835-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102992) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:39:46.969006 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-b59ccb3b-4f00-4fba-a5e5-09e80dec258a req-78dac549-300f-48ba-9a10-5c322897071b tempest-AttachVolumeShelveTestJSON-1172915835 tempest-AttachVolumeShelveTestJSON-1172915835-project] 10.222.0.62 "GET /v2.0/ports?device_id=627eaac3-8c43-4aa3-a81c-7a6bfb58dbb5 HTTP/1.1" status: 200 len: 946 time: 0.0527840 Nov 23 19:39:47.022907 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-b59ccb3b-4f00-4fba-a5e5-09e80dec258a req-90a2702a-eff6-492c-bec7-457b54694c7f tempest-AttachVolumeShelveTestJSON-1172915835 tempest-AttachVolumeShelveTestJSON-1172915835-project] 10.222.0.62 "GET /v2.0/security-groups?id=a246a431-7eb4-441f-b1e6-9c9c351ee888&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0476789 Nov 23 19:39:47.330852 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron_lib.callbacks.manager [None req-eb87b2c3-3339-4249-8b85-e695b5b4e1f9 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8783631323329', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7978582'] for agent, after_update {{(pid=102994) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:39:48.020355 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c2cc58bb-9e53-422f-a68a-b342231ac1b2 req-e678e980-68e4-49e6-bd68-db69f882ceb4 tempest-TestVolumeBootPattern-147141705 tempest-TestVolumeBootPattern-147141705-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102993) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:39:48.022650 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-c2cc58bb-9e53-422f-a68a-b342231ac1b2 req-e678e980-68e4-49e6-bd68-db69f882ceb4 tempest-TestVolumeBootPattern-147141705 tempest-TestVolumeBootPattern-147141705-project] 10.222.0.62 "GET /v2.0/ports?device_id=9e64d320-821f-4313-8dd0-3b327ba75634 HTTP/1.1" status: 200 len: 944 time: 0.0597448 Nov 23 19:39:48.100877 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-c2cc58bb-9e53-422f-a68a-b342231ac1b2 req-ed054fed-c56d-4c4a-a7e5-521d6444eb5a tempest-TestVolumeBootPattern-147141705 tempest-TestVolumeBootPattern-147141705-project] 10.222.0.62 "GET /v2.0/security-groups?id=a6e2b133-1a9b-4dde-a188-1ce8bcdb7b5c&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0720589 Nov 23 19:39:48.176801 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0ef219ac-4f7b-4cf4-99d0-6b0f2392b7e6 req-0b31765c-f489-4cfc-ba24-fe10ff948bfd tempest-AttachVolumeShelveTestJSON-1172915835 tempest-AttachVolumeShelveTestJSON-1172915835-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102992) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:39:48.179017 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-0ef219ac-4f7b-4cf4-99d0-6b0f2392b7e6 req-0b31765c-f489-4cfc-ba24-fe10ff948bfd tempest-AttachVolumeShelveTestJSON-1172915835 tempest-AttachVolumeShelveTestJSON-1172915835-project] 10.222.0.62 "GET /v2.0/ports?device_id=627eaac3-8c43-4aa3-a81c-7a6bfb58dbb5 HTTP/1.1" status: 200 len: 946 time: 0.0535626 Nov 23 19:39:48.236614 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-0ef219ac-4f7b-4cf4-99d0-6b0f2392b7e6 req-944befde-1b3b-4270-ba91-38c888a8d832 tempest-AttachVolumeShelveTestJSON-1172915835 tempest-AttachVolumeShelveTestJSON-1172915835-project] 10.222.0.62 "GET /v2.0/security-groups?id=a246a431-7eb4-441f-b1e6-9c9c351ee888&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0505371 Nov 23 19:39:49.227177 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a946428f-eef1-4220-9b8e-7944a76bf68e req-69d08e17-1232-4d09-a3b3-31a9665ee91b tempest-TestVolumeBootPattern-147141705 tempest-TestVolumeBootPattern-147141705-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102993) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:39:49.228699 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-a946428f-eef1-4220-9b8e-7944a76bf68e req-69d08e17-1232-4d09-a3b3-31a9665ee91b tempest-TestVolumeBootPattern-147141705 tempest-TestVolumeBootPattern-147141705-project] 10.222.0.62 "GET /v2.0/ports?device_id=9e64d320-821f-4313-8dd0-3b327ba75634 HTTP/1.1" status: 200 len: 944 time: 0.0515976 Nov 23 19:39:49.284234 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-a946428f-eef1-4220-9b8e-7944a76bf68e req-d2ed1085-11ce-427c-9fba-e72b399eb132 tempest-TestVolumeBootPattern-147141705 tempest-TestVolumeBootPattern-147141705-project] 10.222.0.62 "GET /v2.0/security-groups?id=a6e2b133-1a9b-4dde-a188-1ce8bcdb7b5c&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0493882 Nov 23 19:39:49.376134 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9037f76c-44ac-47de-a975-02726447ee29 req-4dcd9f39-c31a-42b9-aa38-c1f34203a937 tempest-AttachVolumeShelveTestJSON-1172915835 tempest-AttachVolumeShelveTestJSON-1172915835-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102992) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:39:49.378585 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-9037f76c-44ac-47de-a975-02726447ee29 req-4dcd9f39-c31a-42b9-aa38-c1f34203a937 tempest-AttachVolumeShelveTestJSON-1172915835 tempest-AttachVolumeShelveTestJSON-1172915835-project] 10.222.0.62 "GET /v2.0/ports?device_id=627eaac3-8c43-4aa3-a81c-7a6bfb58dbb5 HTTP/1.1" status: 200 len: 946 time: 0.0564268 Nov 23 19:39:49.424765 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-9037f76c-44ac-47de-a975-02726447ee29 req-281c3f68-ab01-43b1-9df2-c9e024fc76c6 tempest-AttachVolumeShelveTestJSON-1172915835 tempest-AttachVolumeShelveTestJSON-1172915835-project] 10.222.0.62 "GET /v2.0/security-groups?id=a246a431-7eb4-441f-b1e6-9c9c351ee888&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0403259 Nov 23 19:39:50.415429 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f0c8b3bf-94f3-47e7-9544-1031657e9afa req-dc8e33ef-e335-4a52-a342-f9c2ce1a3420 tempest-TestVolumeBootPattern-147141705 tempest-TestVolumeBootPattern-147141705-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102993) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:39:50.418016 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-f0c8b3bf-94f3-47e7-9544-1031657e9afa req-dc8e33ef-e335-4a52-a342-f9c2ce1a3420 tempest-TestVolumeBootPattern-147141705 tempest-TestVolumeBootPattern-147141705-project] 10.222.0.62 "GET /v2.0/ports?device_id=9e64d320-821f-4313-8dd0-3b327ba75634 HTTP/1.1" status: 200 len: 944 time: 0.0588899 Nov 23 19:39:50.477284 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-f0c8b3bf-94f3-47e7-9544-1031657e9afa req-7170498f-ec5e-4591-873f-e8fd0913f6b4 tempest-TestVolumeBootPattern-147141705 tempest-TestVolumeBootPattern-147141705-project] 10.222.0.62 "GET /v2.0/security-groups?id=a6e2b133-1a9b-4dde-a188-1ce8bcdb7b5c&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0531721 Nov 23 19:39:50.551732 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.plugins.ml2.rpc [None req-4bf48ff4-ecfb-4168-8b63-249b8c6e9f04 None None] Device 3f7db100-6209-44d3-88c7-906fb1cec5cb details requested by agent hyperv_hv-cinder-81901 with host hv-cinder-81901 {{(pid=102994) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Nov 23 19:39:50.555340 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b96efa80-e666-4f1d-a5d8-8573a29fe09d req-797cfd5c-bbc4-4cbf-a688-713e1f7cb2e8 tempest-AttachVolumeShelveTestJSON-1172915835 tempest-AttachVolumeShelveTestJSON-1172915835-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102992) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:39:50.556809 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-b96efa80-e666-4f1d-a5d8-8573a29fe09d req-797cfd5c-bbc4-4cbf-a688-713e1f7cb2e8 tempest-AttachVolumeShelveTestJSON-1172915835 tempest-AttachVolumeShelveTestJSON-1172915835-project] 10.222.0.62 "GET /v2.0/ports?device_id=627eaac3-8c43-4aa3-a81c-7a6bfb58dbb5 HTTP/1.1" status: 200 len: 946 time: 0.0528896 Nov 23 19:39:50.610217 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-b96efa80-e666-4f1d-a5d8-8573a29fe09d req-59c10231-0725-41d1-9275-b422b435d59a tempest-AttachVolumeShelveTestJSON-1172915835 tempest-AttachVolumeShelveTestJSON-1172915835-project] 10.222.0.62 "GET /v2.0/security-groups?id=a246a431-7eb4-441f-b1e6-9c9c351ee888&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0460477 Nov 23 19:39:50.670599 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.plugins.ml2.db [None req-4bf48ff4-ecfb-4168-8b63-249b8c6e9f04 None None] For port 3f7db100-6209-44d3-88c7-906fb1cec5cb, host hv-cinder-81901, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81901',level=0,port_id=3f7db100-6209-44d3-88c7-906fb1cec5cb,segment=NetworkSegment(56316385-5b81-43f5-84db-b708b46f04eb),segment_id=56316385-5b81-43f5-84db-b708b46f04eb)] {{(pid=102994) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 23 19:39:50.683806 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.plugins.ml2.rpc [None req-4bf48ff4-ecfb-4168-8b63-249b8c6e9f04 None None] Returning: {'device': '3f7db100-6209-44d3-88c7-906fb1cec5cb', 'network_id': '226a519f-5f3e-4d80-bb8a-0e9fc4f64828', 'port_id': '3f7db100-6209-44d3-88c7-906fb1cec5cb', 'mac_address': 'fa:16:3e:27:ae:a3', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 800, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '88de785d-c540-4651-af1e-26f27ccaee3c', 'ip_address': '172.20.0.13'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=102994) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Nov 23 19:39:50.732442 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron_lib.callbacks.manager [None req-4bf48ff4-ecfb-4168-8b63-249b8c6e9f04 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7921281'] for port, before_update {{(pid=102994) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:39:50.750199 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.notifiers.nova [None req-4bf48ff4-ecfb-4168-8b63-249b8c6e9f04 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 3f7db100-6209-44d3-88c7-906fb1cec5cb {{(pid=102994) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 23 19:39:50.772419 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.plugins.ml2.db [None req-4bf48ff4-ecfb-4168-8b63-249b8c6e9f04 None None] For port 3f7db100-6209-44d3-88c7-906fb1cec5cb, host hv-cinder-81901, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81901',level=0,port_id=3f7db100-6209-44d3-88c7-906fb1cec5cb,segment=NetworkSegment(56316385-5b81-43f5-84db-b708b46f04eb),segment_id=56316385-5b81-43f5-84db-b708b46f04eb)] {{(pid=102994) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 23 19:39:50.833431 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron_lib.callbacks.manager [None req-4bf48ff4-ecfb-4168-8b63-249b8c6e9f04 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7918660', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-15067', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560168', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8783631423946', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8783631008732', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8783631008750'] for port, after_update {{(pid=102994) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:39:50.889786 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4bf48ff4-ecfb-4168-8b63-249b8c6e9f04 None None] Pushing event updated for resources: {'Port': ['ID=3f7db100-6209-44d3-88c7-906fb1cec5cb,revision_number=4']} {{(pid=102994) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 23 19:39:51.168032 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.plugins.ml2.db [None req-4bf48ff4-ecfb-4168-8b63-249b8c6e9f04 None None] get_ports_and_sgs() called for port_ids ['3f7db100-6209-44d3-88c7-906fb1cec5cb'] {{(pid=102994) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 23 19:39:51.608963 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a167aea5-2d51-49ae-964a-9f12a80ec03e req-4f47bf09-7663-4cdf-9123-6f5f4ef3f8cb tempest-TestVolumeBootPattern-147141705 tempest-TestVolumeBootPattern-147141705-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102993) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:39:51.611299 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-a167aea5-2d51-49ae-964a-9f12a80ec03e req-4f47bf09-7663-4cdf-9123-6f5f4ef3f8cb tempest-TestVolumeBootPattern-147141705 tempest-TestVolumeBootPattern-147141705-project] 10.222.0.62 "GET /v2.0/ports?device_id=9e64d320-821f-4313-8dd0-3b327ba75634 HTTP/1.1" status: 200 len: 945 time: 0.0543499 Nov 23 19:39:51.666340 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-a167aea5-2d51-49ae-964a-9f12a80ec03e req-56c71105-47db-42c8-8c4c-0d975dde5440 tempest-TestVolumeBootPattern-147141705 tempest-TestVolumeBootPattern-147141705-project] 10.222.0.62 "GET /v2.0/security-groups?id=a6e2b133-1a9b-4dde-a188-1ce8bcdb7b5c&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0489671 Nov 23 19:39:51.760060 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0ed31509-cd37-47ae-ab8e-4c38285ab925 req-3aaa2443-7988-46c2-bad3-0eb062c569e8 tempest-AttachVolumeShelveTestJSON-1172915835 tempest-AttachVolumeShelveTestJSON-1172915835-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102992) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:39:51.761650 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-0ed31509-cd37-47ae-ab8e-4c38285ab925 req-3aaa2443-7988-46c2-bad3-0eb062c569e8 tempest-AttachVolumeShelveTestJSON-1172915835 tempest-AttachVolumeShelveTestJSON-1172915835-project] 10.222.0.62 "GET /v2.0/ports?device_id=627eaac3-8c43-4aa3-a81c-7a6bfb58dbb5 HTTP/1.1" status: 200 len: 946 time: 0.0560446 Nov 23 19:39:51.819801 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-0ed31509-cd37-47ae-ab8e-4c38285ab925 req-a7b5085b-ecb2-4302-9e73-32fefcd1c5c0 tempest-AttachVolumeShelveTestJSON-1172915835 tempest-AttachVolumeShelveTestJSON-1172915835-project] 10.222.0.62 "GET /v2.0/security-groups?id=a246a431-7eb4-441f-b1e6-9c9c351ee888&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0522785 Nov 23 19:39:52.562269 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.plugins.ml2.rpc [None req-4bf48ff4-ecfb-4168-8b63-249b8c6e9f04 None None] Device 3f7db100-6209-44d3-88c7-906fb1cec5cb up at agent hyperv_hv-cinder-81901 {{(pid=102994) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 23 19:39:52.667626 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.db.provisioning_blocks [None req-4bf48ff4-ecfb-4168-8b63-249b8c6e9f04 None None] Provisioning for port 3f7db100-6209-44d3-88c7-906fb1cec5cb completed by entity L2. {{(pid=102994) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 23 19:39:52.671824 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.db.provisioning_blocks [None req-4bf48ff4-ecfb-4168-8b63-249b8c6e9f04 None None] Provisioning complete for port 3f7db100-6209-44d3-88c7-906fb1cec5cb triggered by entity L2. {{(pid=102994) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 23 19:39:52.672203 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron_lib.callbacks.manager [None req-4bf48ff4-ecfb-4168-8b63-249b8c6e9f04 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-8355713'] for port, provisioning_complete {{(pid=102994) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:39:52.773841 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron_lib.callbacks.manager [None req-4bf48ff4-ecfb-4168-8b63-249b8c6e9f04 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7921281'] for port, before_update {{(pid=102994) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:39:52.799264 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '9e64d320-821f-4313-8dd0-3b327ba75634', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '3f7db100-6209-44d3-88c7-906fb1cec5cb'}] {{(pid=102994) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 23 19:39:52.802835 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.62/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}09a7511da0d2ba1d728b27e36a8467ec5289399952f0059588048a7cb66d3a43" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-3fdff800-648c-4c5f-99f6-d2cbc5b8a505" -d '{"events": [{"server_uuid": "9e64d320-821f-4313-8dd0-3b327ba75634", "name": "network-vif-plugged", "status": "completed", "tag": "3f7db100-6209-44d3-88c7-906fb1cec5cb"}]}' {{(pid=102994) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 23 19:39:52.803583 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-02b9c98b-d9c2-46b1-af95-ea7c5f7ebbd4 req-59ee110d-faff-4c80-b0e0-cfe624d1b4f0 tempest-TestVolumeBootPattern-147141705 tempest-TestVolumeBootPattern-147141705-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102993) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:39:52.811026 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-02b9c98b-d9c2-46b1-af95-ea7c5f7ebbd4 req-59ee110d-faff-4c80-b0e0-cfe624d1b4f0 tempest-TestVolumeBootPattern-147141705 tempest-TestVolumeBootPattern-147141705-project] 10.222.0.62 "GET /v2.0/ports?device_id=9e64d320-821f-4313-8dd0-3b327ba75634 HTTP/1.1" status: 200 len: 945 time: 0.0711317 Nov 23 19:39:52.841205 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.plugins.ml2.db [None req-4bf48ff4-ecfb-4168-8b63-249b8c6e9f04 None None] For port 3f7db100-6209-44d3-88c7-906fb1cec5cb, host hv-cinder-81901, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81901',level=0,port_id=3f7db100-6209-44d3-88c7-906fb1cec5cb,segment=NetworkSegment(56316385-5b81-43f5-84db-b708b46f04eb),segment_id=56316385-5b81-43f5-84db-b708b46f04eb)] {{(pid=102994) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 23 19:39:52.868154 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 23 Nov 2021 19:39:52 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-20e723fa-3cc3-47c0-9f3f-ef7e01159d07 x-openstack-request-id: req-20e723fa-3cc3-47c0-9f3f-ef7e01159d07 {{(pid=102994) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 23 19:39:52.868154 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "9e64d320-821f-4313-8dd0-3b327ba75634", "name": "network-vif-plugged", "status": "completed", "tag": "3f7db100-6209-44d3-88c7-906fb1cec5cb", "code": 200}]} {{(pid=102994) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 23 19:39:52.868154 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.62/compute/v2.1/os-server-external-events used request id req-20e723fa-3cc3-47c0-9f3f-ef7e01159d07 {{(pid=102994) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 23 19:39:52.868154 dv-cinder-819011-1-iscsi neutron-server[102994]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '9e64d320-821f-4313-8dd0-3b327ba75634', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '3f7db100-6209-44d3-88c7-906fb1cec5cb', 'code': 200} Nov 23 19:39:52.878444 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-02b9c98b-d9c2-46b1-af95-ea7c5f7ebbd4 req-afd253a0-c5a8-43d2-87bf-499ef09a7d49 tempest-TestVolumeBootPattern-147141705 tempest-TestVolumeBootPattern-147141705-project] 10.222.0.62 "GET /v2.0/security-groups?id=a6e2b133-1a9b-4dde-a188-1ce8bcdb7b5c&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0621152 Nov 23 19:39:52.914208 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron_lib.callbacks.manager [None req-4bf48ff4-ecfb-4168-8b63-249b8c6e9f04 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7918660', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-15067', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560168', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8783631423946', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8783631008732', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8783631008750'] for port, after_update {{(pid=102994) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:39:52.980692 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f32c8d71-a9fe-45d3-9e78-de8ca2c7fa9e req-fb11cbca-aec7-4535-8043-d4c4d9676ce0 tempest-AttachVolumeShelveTestJSON-1172915835 tempest-AttachVolumeShelveTestJSON-1172915835-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102992) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:39:52.986132 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-f32c8d71-a9fe-45d3-9e78-de8ca2c7fa9e req-fb11cbca-aec7-4535-8043-d4c4d9676ce0 tempest-AttachVolumeShelveTestJSON-1172915835 tempest-AttachVolumeShelveTestJSON-1172915835-project] 10.222.0.62 "GET /v2.0/ports?device_id=627eaac3-8c43-4aa3-a81c-7a6bfb58dbb5 HTTP/1.1" status: 200 len: 946 time: 0.0606449 Nov 23 19:39:53.008044 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4bf48ff4-ecfb-4168-8b63-249b8c6e9f04 None None] Pushing event updated for resources: {'Port': ['ID=3f7db100-6209-44d3-88c7-906fb1cec5cb,revision_number=5']} {{(pid=102994) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 23 19:39:53.044288 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-f32c8d71-a9fe-45d3-9e78-de8ca2c7fa9e req-96a31ceb-015e-4551-9699-09c8b27a1636 tempest-AttachVolumeShelveTestJSON-1172915835 tempest-AttachVolumeShelveTestJSON-1172915835-project] 10.222.0.62 "GET /v2.0/security-groups?id=a246a431-7eb4-441f-b1e6-9c9c351ee888&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0547967 Nov 23 19:39:53.266465 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e550ce3e-314e-4722-bf4d-b1f72c79986b req-a75e2e20-f1a3-4728-b16f-462322f03daa service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102992) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:39:53.268457 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-e550ce3e-314e-4722-bf4d-b1f72c79986b req-a75e2e20-f1a3-4728-b16f-462322f03daa service neutron] 10.222.0.41 "GET /v2.0/ports?device_id=9e64d320-821f-4313-8dd0-3b327ba75634 HTTP/1.1" status: 200 len: 1099 time: 0.0529835 Nov 23 19:39:53.324854 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-e550ce3e-314e-4722-bf4d-b1f72c79986b req-7f21ff43-3754-4209-98e2-e84a2352c3f1 service neutron] 10.222.0.41 "GET /v2.0/security-groups?id=a6e2b133-1a9b-4dde-a188-1ce8bcdb7b5c&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0467877 Nov 23 19:39:53.992636 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c5c4ff01-16ee-41f3-a1c8-b4b1cc604ccc req-a318bd34-661e-4495-8468-1b59c12ca46e tempest-TestVolumeBootPattern-147141705 tempest-TestVolumeBootPattern-147141705-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102993) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:39:53.994815 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-c5c4ff01-16ee-41f3-a1c8-b4b1cc604ccc req-a318bd34-661e-4495-8468-1b59c12ca46e tempest-TestVolumeBootPattern-147141705 tempest-TestVolumeBootPattern-147141705-project] 10.222.0.62 "GET /v2.0/ports?device_id=9e64d320-821f-4313-8dd0-3b327ba75634 HTTP/1.1" status: 200 len: 946 time: 0.0524261 Nov 23 19:39:54.052679 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-c5c4ff01-16ee-41f3-a1c8-b4b1cc604ccc req-91d04e98-8582-4259-8741-08b07d81f744 tempest-TestVolumeBootPattern-147141705 tempest-TestVolumeBootPattern-147141705-project] 10.222.0.62 "GET /v2.0/security-groups?id=a6e2b133-1a9b-4dde-a188-1ce8bcdb7b5c&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0517969 Nov 23 19:39:54.193622 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0a7d7025-a8ba-48f1-90a6-5a8bfc957489 req-baaf96f0-5198-42c2-aac7-f22e9fe4eac3 tempest-AttachVolumeShelveTestJSON-1172915835 tempest-AttachVolumeShelveTestJSON-1172915835-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102992) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:39:54.197915 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-0a7d7025-a8ba-48f1-90a6-5a8bfc957489 req-baaf96f0-5198-42c2-aac7-f22e9fe4eac3 tempest-AttachVolumeShelveTestJSON-1172915835 tempest-AttachVolumeShelveTestJSON-1172915835-project] 10.222.0.62 "GET /v2.0/ports?device_id=627eaac3-8c43-4aa3-a81c-7a6bfb58dbb5 HTTP/1.1" status: 200 len: 946 time: 0.0656424 Nov 23 19:39:54.249284 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-0a7d7025-a8ba-48f1-90a6-5a8bfc957489 req-37ac32c7-43f0-4811-82d5-61b98186c28f tempest-AttachVolumeShelveTestJSON-1172915835 tempest-AttachVolumeShelveTestJSON-1172915835-project] 10.222.0.62 "GET /v2.0/security-groups?id=a246a431-7eb4-441f-b1e6-9c9c351ee888&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0466695 Nov 23 19:39:55.190609 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fd741a97-b9cf-43ee-837a-3aca4245494d req-b98648fa-3fbe-4ec2-ae18-2e5e16ef0e0e tempest-TestVolumeBootPattern-147141705 tempest-TestVolumeBootPattern-147141705-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102993) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:39:55.192446 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-fd741a97-b9cf-43ee-837a-3aca4245494d req-b98648fa-3fbe-4ec2-ae18-2e5e16ef0e0e tempest-TestVolumeBootPattern-147141705 tempest-TestVolumeBootPattern-147141705-project] 10.222.0.62 "GET /v2.0/ports?device_id=9e64d320-821f-4313-8dd0-3b327ba75634 HTTP/1.1" status: 200 len: 946 time: 0.0581541 Nov 23 19:39:55.258831 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-fd741a97-b9cf-43ee-837a-3aca4245494d req-8c01fc45-d4b2-41a7-8f3b-d564debe30a6 tempest-TestVolumeBootPattern-147141705 tempest-TestVolumeBootPattern-147141705-project] 10.222.0.62 "GET /v2.0/security-groups?id=a6e2b133-1a9b-4dde-a188-1ce8bcdb7b5c&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0601654 Nov 23 19:39:55.417389 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a0fb1a31-1254-42d4-a83f-2ef1a448dc69 req-1083acb5-5061-4446-a3cb-ed9098a8805a tempest-AttachVolumeShelveTestJSON-1172915835 tempest-AttachVolumeShelveTestJSON-1172915835-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102992) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:39:55.419798 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-a0fb1a31-1254-42d4-a83f-2ef1a448dc69 req-1083acb5-5061-4446-a3cb-ed9098a8805a tempest-AttachVolumeShelveTestJSON-1172915835 tempest-AttachVolumeShelveTestJSON-1172915835-project] 10.222.0.62 "GET /v2.0/ports?device_id=627eaac3-8c43-4aa3-a81c-7a6bfb58dbb5 HTTP/1.1" status: 200 len: 946 time: 0.0760953 Nov 23 19:39:55.431935 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a2405850-baa7-47d8-81f6-f040dbaf5c24 req-9fb47f73-43d7-498c-8bb6-95940ccb82d0 tempest-TestVolumeBootPattern-147141705 tempest-TestVolumeBootPattern-147141705-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102993) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:39:55.434878 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-a2405850-baa7-47d8-81f6-f040dbaf5c24 req-9fb47f73-43d7-498c-8bb6-95940ccb82d0 tempest-TestVolumeBootPattern-147141705 tempest-TestVolumeBootPattern-147141705-project] 10.222.0.62 "GET /v2.0/ports?device_id=9e64d320-821f-4313-8dd0-3b327ba75634 HTTP/1.1" status: 200 len: 946 time: 0.0654986 Nov 23 19:39:55.480938 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-a0fb1a31-1254-42d4-a83f-2ef1a448dc69 req-924607e6-08fa-4c6a-93d6-d5ca7f67b46b tempest-AttachVolumeShelveTestJSON-1172915835 tempest-AttachVolumeShelveTestJSON-1172915835-project] 10.222.0.62 "GET /v2.0/security-groups?id=a246a431-7eb4-441f-b1e6-9c9c351ee888&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0537221 Nov 23 19:39:55.488130 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-a2405850-baa7-47d8-81f6-f040dbaf5c24 req-b2e1dafd-6229-4108-ae76-59ba73543caa tempest-TestVolumeBootPattern-147141705 tempest-TestVolumeBootPattern-147141705-project] 10.222.0.62 "GET /v2.0/security-groups?id=a6e2b133-1a9b-4dde-a188-1ce8bcdb7b5c&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0520713 Nov 23 19:39:55.514922 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.wsgi [-] (102993) accepted ('10.222.0.62', 49754) {{(pid=102993) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 23 19:39:55.556761 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-99218b99-882d-458b-8524-98e40438bc84 tempest-TestVolumeBootPattern-762853593 tempest-TestVolumeBootPattern-762853593-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102993) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:39:55.558700 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [None req-99218b99-882d-458b-8524-98e40438bc84 tempest-TestVolumeBootPattern-762853593 tempest-TestVolumeBootPattern-762853593-project-admin] 10.222.0.62 "GET /v2.0/ports?device_id=9e64d320-821f-4313-8dd0-3b327ba75634 HTTP/1.1" status: 200 len: 1094 time: 0.0427673 Nov 23 19:39:55.561576 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.wsgi [-] (102993) accepted ('10.222.0.62', 49756) {{(pid=102993) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 23 19:39:55.566901 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.api.v2.base [None req-2c1eb8ce-7f35-4708-a854-71409f22a472 tempest-TestVolumeBootPattern-147141705 tempest-TestVolumeBootPattern-147141705-project] Request body: {'floatingip': {'floating_network_id': 'a93e254e-aac9-4233-9e4d-4290fd0458e4', 'port_id': '3f7db100-6209-44d3-88c7-906fb1cec5cb', 'tenant_id': '257b0b2e531441b4bb745e99cfd799f3', 'fixed_ip_address': '172.20.0.13'}} {{(pid=102993) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 23 19:39:55.804977 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-2c1eb8ce-7f35-4708-a854-71409f22a472 tempest-TestVolumeBootPattern-147141705 tempest-TestVolumeBootPattern-147141705-project] Publish callbacks [] for floatingip, before_create {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:39:55.905420 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-2c1eb8ce-7f35-4708-a854-71409f22a472 tempest-TestVolumeBootPattern-147141705 tempest-TestVolumeBootPattern-147141705-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7921281'] for port, before_create {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:39:56.030419 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.db.db_base_plugin_common [None req-2c1eb8ce-7f35-4708-a854-71409f22a472 tempest-TestVolumeBootPattern-147141705 tempest-TestVolumeBootPattern-147141705-project] Allocated IP 172.27.1.127 (a93e254e-aac9-4233-9e4d-4290fd0458e4/e0b32f3d-83d6-439a-bbed-01df7cf01051/ce917557-e28a-40ca-9c7a-f446a87153e5) {{(pid=102993) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 23 19:39:56.134158 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-2c1eb8ce-7f35-4708-a854-71409f22a472 tempest-TestVolumeBootPattern-147141705 tempest-TestVolumeBootPattern-147141705-project] Publish callbacks [] for port, precommit_create {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:39:56.239432 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-2c1eb8ce-7f35-4708-a854-71409f22a472 tempest-TestVolumeBootPattern-147141705 tempest-TestVolumeBootPattern-147141705-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7918660', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-15067', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560168', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8783631008714', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-17257496'] for port, after_create {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:39:56.288227 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-2c1eb8ce-7f35-4708-a854-71409f22a472 tempest-TestVolumeBootPattern-147141705 tempest-TestVolumeBootPattern-147141705-project] Network a93e254e-aac9-4233-9e4d-4290fd0458e4 is already hosted by enough agents. {{(pid=102993) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 23 19:39:56.294234 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.scheduler.base_scheduler [None req-2c1eb8ce-7f35-4708-a854-71409f22a472 tempest-TestVolumeBootPattern-147141705 tempest-TestVolumeBootPattern-147141705-project] Resources bound (agent type, host, resource id): {{(pid=102993) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 23 19:39:56.296846 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.db.l3_dvrscheduler_db [None req-2c1eb8ce-7f35-4708-a854-71409f22a472 tempest-TestVolumeBootPattern-147141705 tempest-TestVolumeBootPattern-147141705-project] Received port after_create {{(pid=102993) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 23 19:39:56.338486 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2c1eb8ce-7f35-4708-a854-71409f22a472 tempest-TestVolumeBootPattern-147141705 tempest-TestVolumeBootPattern-147141705-project] Pushing event updated for resources: {'Port': ['ID=ce917557-e28a-40ca-9c7a-f446a87153e5,revision_number=1']} {{(pid=102993) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 23 19:39:56.348714 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2c1eb8ce-7f35-4708-a854-71409f22a472 tempest-TestVolumeBootPattern-147141705 tempest-TestVolumeBootPattern-147141705-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-819011-1-iscsi {{(pid=102993) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 23 19:39:56.349068 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2c1eb8ce-7f35-4708-a854-71409f22a472 tempest-TestVolumeBootPattern-147141705 tempest-TestVolumeBootPattern-147141705-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-819011-1-iscsi {{(pid=102993) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 23 19:39:56.349436 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2c1eb8ce-7f35-4708-a854-71409f22a472 tempest-TestVolumeBootPattern-147141705 tempest-TestVolumeBootPattern-147141705-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-819011-1-iscsi {{(pid=102993) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 23 19:39:56.349781 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2c1eb8ce-7f35-4708-a854-71409f22a472 tempest-TestVolumeBootPattern-147141705 tempest-TestVolumeBootPattern-147141705-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-819011-1-iscsi {{(pid=102993) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 23 19:39:56.350122 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2c1eb8ce-7f35-4708-a854-71409f22a472 tempest-TestVolumeBootPattern-147141705 tempest-TestVolumeBootPattern-147141705-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-819011-1-iscsi {{(pid=102993) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 23 19:39:56.350459 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2c1eb8ce-7f35-4708-a854-71409f22a472 tempest-TestVolumeBootPattern-147141705 tempest-TestVolumeBootPattern-147141705-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-819011-1-iscsi {{(pid=102993) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 23 19:39:56.350795 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2c1eb8ce-7f35-4708-a854-71409f22a472 tempest-TestVolumeBootPattern-147141705 tempest-TestVolumeBootPattern-147141705-project] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-819011-1-iscsi {{(pid=102993) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 23 19:39:56.351125 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2c1eb8ce-7f35-4708-a854-71409f22a472 tempest-TestVolumeBootPattern-147141705 tempest-TestVolumeBootPattern-147141705-project] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-819011-1-iscsi {{(pid=102993) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 23 19:39:56.351487 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2c1eb8ce-7f35-4708-a854-71409f22a472 tempest-TestVolumeBootPattern-147141705 tempest-TestVolumeBootPattern-147141705-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-819011-1-iscsi {{(pid=102993) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 23 19:39:56.351934 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2c1eb8ce-7f35-4708-a854-71409f22a472 tempest-TestVolumeBootPattern-147141705 tempest-TestVolumeBootPattern-147141705-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-819011-1-iscsi {{(pid=102993) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 23 19:39:56.352110 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2c1eb8ce-7f35-4708-a854-71409f22a472 tempest-TestVolumeBootPattern-147141705 tempest-TestVolumeBootPattern-147141705-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-819011-1-iscsi {{(pid=102993) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 23 19:39:56.352490 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2c1eb8ce-7f35-4708-a854-71409f22a472 tempest-TestVolumeBootPattern-147141705 tempest-TestVolumeBootPattern-147141705-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-819011-1-iscsi {{(pid=102993) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 23 19:39:56.674060 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3d4d1fd5-b40c-489e-b062-c00c2f26834e req-fc1389ad-a82c-4bc8-b7e5-3f015ef77f20 tempest-AttachVolumeShelveTestJSON-1172915835 tempest-AttachVolumeShelveTestJSON-1172915835-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102992) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:39:56.676174 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-3d4d1fd5-b40c-489e-b062-c00c2f26834e req-fc1389ad-a82c-4bc8-b7e5-3f015ef77f20 tempest-AttachVolumeShelveTestJSON-1172915835 tempest-AttachVolumeShelveTestJSON-1172915835-project] 10.222.0.62 "GET /v2.0/ports?device_id=627eaac3-8c43-4aa3-a81c-7a6bfb58dbb5 HTTP/1.1" status: 200 len: 946 time: 0.0706229 Nov 23 19:39:56.744874 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-2c1eb8ce-7f35-4708-a854-71409f22a472 tempest-TestVolumeBootPattern-147141705 tempest-TestVolumeBootPattern-147141705-project] Publish callbacks [] for floatingip, precommit_create {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:39:56.746914 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-3d4d1fd5-b40c-489e-b062-c00c2f26834e req-68834e31-64ac-4306-934a-be46d6efaa06 tempest-AttachVolumeShelveTestJSON-1172915835 tempest-AttachVolumeShelveTestJSON-1172915835-project] 10.222.0.62 "GET /v2.0/security-groups?id=a246a431-7eb4-441f-b1e6-9c9c351ee888&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0593808 Nov 23 19:39:56.965092 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-2c1eb8ce-7f35-4708-a854-71409f22a472 tempest-TestVolumeBootPattern-147141705 tempest-TestVolumeBootPattern-147141705-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7921281'] for port, before_update {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:39:57.113191 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-2c1eb8ce-7f35-4708-a854-71409f22a472 tempest-TestVolumeBootPattern-147141705 tempest-TestVolumeBootPattern-147141705-project] Publish callbacks [] for port, precommit_update {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:39:57.164775 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-2c1eb8ce-7f35-4708-a854-71409f22a472 tempest-TestVolumeBootPattern-147141705 tempest-TestVolumeBootPattern-147141705-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7918660', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-15067', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560168', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8783631423946', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8783631008732', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8783631008750', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-17257505'] for port, after_update {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:39:57.236575 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2c1eb8ce-7f35-4708-a854-71409f22a472 tempest-TestVolumeBootPattern-147141705 tempest-TestVolumeBootPattern-147141705-project] Pushing event updated for resources: {'Port': ['ID=ce917557-e28a-40ca-9c7a-f446a87153e5,revision_number=2']} {{(pid=102993) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 23 19:39:57.249868 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-2c1eb8ce-7f35-4708-a854-71409f22a472 tempest-TestVolumeBootPattern-147141705 tempest-TestVolumeBootPattern-147141705-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-926531'] for floatingip, after_create {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:39:57.351985 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.db.l3_db [None req-2c1eb8ce-7f35-4708-a854-71409f22a472 tempest-TestVolumeBootPattern-147141705 tempest-TestVolumeBootPattern-147141705-project] Floating IP ea09a7d4-0775-4bc6-9310-f47e8ee059db associated. External IP: 172.27.1.127, port: 3f7db100-6209-44d3-88c7-906fb1cec5cb. Nov 23 19:39:57.818580 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-2c1eb8ce-7f35-4708-a854-71409f22a472 tempest-TestVolumeBootPattern-147141705 tempest-TestVolumeBootPattern-147141705-project] Router 0534bcc4-1e12-4026-90ce-1406543c7662 has already been hosted by L3 agent 1b20f2c4-70b6-43c3-b9bd-0062cc9e57ac {{(pid=102993) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 23 19:39:57.940032 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7c58734f-9a1a-4be5-bf4c-3751bec363d0 req-23a162ec-e91c-47a4-88ab-3aa83fb1bc80 tempest-AttachVolumeShelveTestJSON-1172915835 tempest-AttachVolumeShelveTestJSON-1172915835-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102993) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:39:57.942447 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-7c58734f-9a1a-4be5-bf4c-3751bec363d0 req-23a162ec-e91c-47a4-88ab-3aa83fb1bc80 tempest-AttachVolumeShelveTestJSON-1172915835 tempest-AttachVolumeShelveTestJSON-1172915835-project] 10.222.0.62 "GET /v2.0/ports?device_id=627eaac3-8c43-4aa3-a81c-7a6bfb58dbb5 HTTP/1.1" status: 200 len: 946 time: 0.1188807 Nov 23 19:39:57.945101 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3a4c093b-c6d6-4dfe-8014-8d0f57ee5052 req-c0869a49-d4f4-4c59-8578-4dd4dd01b074 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102992) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:39:57.946629 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-3a4c093b-c6d6-4dfe-8014-8d0f57ee5052 req-c0869a49-d4f4-4c59-8578-4dd4dd01b074 service neutron] 10.222.0.41 "GET /v2.0/ports?tenant_id=2d925fb59ba34355aa85758374d76928&device_id=627eaac3-8c43-4aa3-a81c-7a6bfb58dbb5 HTTP/1.1" status: 200 len: 1099 time: 0.0414965 Nov 23 19:39:57.981844 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-2c1eb8ce-7f35-4708-a854-71409f22a472 tempest-TestVolumeBootPattern-147141705 tempest-TestVolumeBootPattern-147141705-project] Notify agent at l3_agent.dv-cinder-819011-1-iscsi the message routers_updated {{(pid=102993) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 23 19:39:57.992571 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-1068e325-3f2d-4440-8b9b-95163f281a52 None None] Sync routers for ids ['0534bcc4-1e12-4026-90ce-1406543c7662'] in dv-cinder-819011-1-iscsi {{(pid=102994) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 23 19:39:58.002318 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.db.l3_dvrscheduler_db [None req-1068e325-3f2d-4440-8b9b-95163f281a52 None None] Routers {'0534bcc4-1e12-4026-90ce-1406543c7662'} bound to L3 agent in host dv-cinder-819011-1-iscsi {{(pid=102994) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 23 19:39:58.003234 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.db.l3_hamode_db [None req-1068e325-3f2d-4440-8b9b-95163f281a52 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-819011-1-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 9, "extensions": [], "floating_ips": 4, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 9, "log_agent_heartbeats": false, "routers": 9},created_at=2021-11-23T19:25:14Z,description=,heartbeat_timestamp=2021-11-23T19:39:44Z,host='dv-cinder-819011-1-iscsi',id=1b20f2c4-70b6-43c3-b9bd-0062cc9e57ac,load=0,resource_versions=,resources_synced=,started_at=2021-11-23T19:25:15Z,topic='l3_agent')) {'router_ids': ['0534bcc4-1e12-4026-90ce-1406543c7662'], 'active': True} {{(pid=102994) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 23 19:39:58.010580 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-7c58734f-9a1a-4be5-bf4c-3751bec363d0 req-85f5a35f-9c85-40a7-aabc-939be38d2e47 tempest-AttachVolumeShelveTestJSON-1172915835 tempest-AttachVolumeShelveTestJSON-1172915835-project] 10.222.0.62 "GET /v2.0/security-groups?id=a246a431-7eb4-441f-b1e6-9c9c351ee888&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0596075 Nov 23 19:39:58.047365 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3a4c093b-c6d6-4dfe-8014-8d0f57ee5052 req-64f275ef-75ff-4a1f-9f5b-c34267e12c22 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102992) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:39:58.048783 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-3a4c093b-c6d6-4dfe-8014-8d0f57ee5052 req-64f275ef-75ff-4a1f-9f5b-c34267e12c22 service neutron] 10.222.0.41 "GET /v2.0/networks?id=fc901312-2937-4784-8a6d-c046666e8bf8 HTTP/1.1" status: 200 len: 918 time: 0.0916779 Nov 23 19:39:58.075275 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-2c1eb8ce-7f35-4708-a854-71409f22a472 tempest-TestVolumeBootPattern-147141705 tempest-TestVolumeBootPattern-147141705-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-514902'] for floatingip, before_response {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:39:58.129996 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [None req-2c1eb8ce-7f35-4708-a854-71409f22a472 tempest-TestVolumeBootPattern-147141705 tempest-TestVolumeBootPattern-147141705-project] 10.222.0.62 "POST /v2.0/floatingips HTTP/1.1" status: 201 len: 997 time: 2.5529509 Nov 23 19:39:58.129996 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '9e64d320-821f-4313-8dd0-3b327ba75634', 'tag': '3f7db100-6209-44d3-88c7-906fb1cec5cb'}] {{(pid=102993) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 23 19:39:58.131175 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.db.l3_dvr_db [None req-1068e325-3f2d-4440-8b9b-95163f281a52 None None] Set router 0534bcc4-1e12-4026-90ce-1406543c7662 gateway port host: dv-cinder-819011-1-iscsi {{(pid=102994) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 23 19:39:58.131265 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.62/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}9b10b92acbee16fb695be1efeed0b68f7c36a5b215ec004a8d9d707fa3d35b2c" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-460245be-1356-4593-b921-dafb0abca5fa" -d '{"events": [{"name": "network-changed", "server_uuid": "9e64d320-821f-4313-8dd0-3b327ba75634", "tag": "3f7db100-6209-44d3-88c7-906fb1cec5cb"}]}' {{(pid=102993) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 23 19:39:58.134674 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-3a4c093b-c6d6-4dfe-8014-8d0f57ee5052 req-2a92bd9c-97e7-4af2-8d3e-7704e665031b service neutron] 10.222.0.41 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.11&port_id=895334df-08a6-40fc-9056-3c5fba79b18c HTTP/1.1" status: 200 len: 1002 time: 0.0759807 Nov 23 19:39:58.154546 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Tue, 23 Nov 2021 19:39:58 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-6850c25f-b12e-45a0-a7a8-1b4de492c860 x-openstack-request-id: req-6850c25f-b12e-45a0-a7a8-1b4de492c860 {{(pid=102993) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 23 19:39:58.154893 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "9e64d320-821f-4313-8dd0-3b327ba75634", "tag": "3f7db100-6209-44d3-88c7-906fb1cec5cb", "status": "completed", "code": 200}]} {{(pid=102993) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 23 19:39:58.155148 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.62/compute/v2.1/os-server-external-events used request id req-6850c25f-b12e-45a0-a7a8-1b4de492c860 {{(pid=102993) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 23 19:39:58.155549 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '9e64d320-821f-4313-8dd0-3b327ba75634', 'tag': '3f7db100-6209-44d3-88c7-906fb1cec5cb', 'status': 'completed', 'code': 200} Nov 23 19:39:58.190538 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3a4c093b-c6d6-4dfe-8014-8d0f57ee5052 req-5dfb11fa-faec-478b-88e0-5d50d590e4cd service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102992) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:39:58.192457 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-3a4c093b-c6d6-4dfe-8014-8d0f57ee5052 req-5dfb11fa-faec-478b-88e0-5d50d590e4cd service neutron] 10.222.0.41 "GET /v2.0/subnets?id=2caca985-6ed6-4ef7-ba49-7b7410bea160 HTTP/1.1" status: 200 len: 856 time: 0.0487645 Nov 23 19:39:58.224915 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-460245be-1356-4593-b921-dafb0abca5fa req-e94af908-23da-4a72-beb3-fdabc8602a8f service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102993) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:39:58.226453 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-460245be-1356-4593-b921-dafb0abca5fa req-e94af908-23da-4a72-beb3-fdabc8602a8f service neutron] 10.222.0.41 "GET /v2.0/ports?tenant_id=257b0b2e531441b4bb745e99cfd799f3&device_id=9e64d320-821f-4313-8dd0-3b327ba75634 HTTP/1.1" status: 200 len: 1099 time: 0.0430303 Nov 23 19:39:58.248236 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3a4c093b-c6d6-4dfe-8014-8d0f57ee5052 req-cd99d94a-007f-490f-8612-1fae5176a237 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102992) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:39:58.249990 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-3a4c093b-c6d6-4dfe-8014-8d0f57ee5052 req-cd99d94a-007f-490f-8612-1fae5176a237 service neutron] 10.222.0.41 "GET /v2.0/ports?network_id=fc901312-2937-4784-8a6d-c046666e8bf8&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0457141 Nov 23 19:39:58.326812 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-460245be-1356-4593-b921-dafb0abca5fa req-eaa2bf73-27b0-43a7-821e-1667cd9751dc service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102993) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:39:58.328334 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-460245be-1356-4593-b921-dafb0abca5fa req-eaa2bf73-27b0-43a7-821e-1667cd9751dc service neutron] 10.222.0.41 "GET /v2.0/networks?id=226a519f-5f3e-4d80-bb8a-0e9fc4f64828 HTTP/1.1" status: 200 len: 911 time: 0.0936580 Nov 23 19:39:58.348287 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-3a4c093b-c6d6-4dfe-8014-8d0f57ee5052 req-d641f107-bafa-4746-8582-09f5f10e0d83 service neutron] 10.222.0.41 "GET /v2.0/networks/fc901312-2937-4784-8a6d-c046666e8bf8?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0878048 Nov 23 19:39:58.349293 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.db.l3_hamode_db [None req-1068e325-3f2d-4440-8b9b-95163f281a52 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '0534bcc4-1e12-4026-90ce-1406543c7662', 'name': 'tempest-TestVolumeBootPattern-84632531-router', 'tenant_id': '257b0b2e531441b4bb745e99cfd799f3', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'a93e254e-aac9-4233-9e4d-4290fd0458e4', 'external_fixed_ips': [{'subnet_id': 'e0b32f3d-83d6-439a-bbed-01df7cf01051', 'ip_address': '172.27.1.154'}], 'enable_snat': True}, 'gw_port_id': 'c7996293-6188-4690-b614-395448e4dc25', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-23T19:35:29Z', 'updated_at': '2021-11-23T19:35:33Z', 'revision_number': 4, 'project_id': '257b0b2e531441b4bb745e99cfd799f3', 'gw_port': {'id': 'c7996293-6188-4690-b614-395448e4dc25', 'name': '', 'network_id': 'a93e254e-aac9-4233-9e4d-4290fd0458e4', 'tenant_id': '', 'mac_address': 'fa:16:3e:52:67:5e', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '0534bcc4-1e12-4026-90ce-1406543c7662', 'device_owner': 'network:router_gateway', 'standard_attr_id': 392, 'fixed_ips': [{'subnet_id': 'e0b32f3d-83d6-439a-bbed-01df7cf01051', 'ip_address': '172.27.1.154', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-819011-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-23T19:35:30Z', 'updated_at': '2021-11-23T19:35:34Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'e0b32f3d-83d6-439a-bbed-01df7cf01051', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-819011-1-iscsi', '_floatingips': [{'id': 'ea09a7d4-0775-4bc6-9310-f47e8ee059db', 'tenant_id': '257b0b2e531441b4bb745e99cfd799f3', 'floating_ip_address': '172.27.1.127', 'floating_network_id': 'a93e254e-aac9-4233-9e4d-4290fd0458e4', 'router_id': '0534bcc4-1e12-4026-90ce-1406543c7662', 'port_id': '3f7db100-6209-44d3-88c7-906fb1cec5cb', 'fixed_ip_address': '172.20.0.13', 'status': 'DOWN', 'standard_attr_id': 593, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '226a519f-5f3e-4d80-bb8a-0e9fc4f64828', 'mac_address': 'fa:16:3e:27:ae:a3', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '9e64d320-821f-4313-8dd0-3b327ba75634', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-23T19:39:56Z', 'updated_at': '2021-11-23T19:39:56Z', 'revision_number': 0, 'project_id': '257b0b2e531441b4bb745e99cfd799f3', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '854821af-61e0-47e7-a603-95f500a49030', 'name': '', 'network_id': '226a519f-5f3e-4d80-bb8a-0e9fc4f64828', 'tenant_id': '257b0b2e531441b4bb745e99cfd799f3', 'mac_address': 'fa:16:3e:90:11:65', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '0534bcc4-1e12-4026-90ce-1406543c7662', 'device_owner': 'network:router_interface', 'standard_attr_id': 393, 'fixed_ips': [{'subnet_id': '88de785d-c540-4651-af1e-26f27ccaee3c', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-819011-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-23T19:35:32Z', 'updated_at': '2021-11-23T19:35:37Z', 'revision_number': 5, 'project_id': '257b0b2e531441b4bb745e99cfd799f3', 'subnets': [{'id': '88de785d-c540-4651-af1e-26f27ccaee3c', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-819011-1-iscsi', False) {} {{(pid=102994) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 23 19:39:58.374738 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-1068e325-3f2d-4440-8b9b-95163f281a52 None None] Checking router: 0534bcc4-1e12-4026-90ce-1406543c7662 for host: dv-cinder-819011-1-iscsi {{(pid=102994) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 23 19:39:58.383799 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.db.l3_dvrscheduler_db [None req-1068e325-3f2d-4440-8b9b-95163f281a52 None None] Routers {'0534bcc4-1e12-4026-90ce-1406543c7662'} bound to L3 agent in host dv-cinder-819011-1-iscsi {{(pid=102994) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 23 19:39:58.384403 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.db.l3_hamode_db [None req-1068e325-3f2d-4440-8b9b-95163f281a52 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-819011-1-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 9, "extensions": [], "floating_ips": 4, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 9, "log_agent_heartbeats": false, "routers": 9},created_at=2021-11-23T19:25:14Z,description=,heartbeat_timestamp=2021-11-23T19:39:44Z,host='dv-cinder-819011-1-iscsi',id=1b20f2c4-70b6-43c3-b9bd-0062cc9e57ac,load=0,resource_versions=,resources_synced=,started_at=2021-11-23T19:25:15Z,topic='l3_agent')) {'router_ids': ['0534bcc4-1e12-4026-90ce-1406543c7662'], 'active': True} {{(pid=102994) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 23 19:39:58.399891 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-460245be-1356-4593-b921-dafb0abca5fa req-28649686-fa7c-4d82-82b1-8d21f6a06ba3 service neutron] 10.222.0.41 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.13&port_id=3f7db100-6209-44d3-88c7-906fb1cec5cb HTTP/1.1" status: 200 len: 1000 time: 0.0623343 Nov 23 19:39:58.450500 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-3a4c093b-c6d6-4dfe-8014-8d0f57ee5052 req-0526c754-9701-4186-8a47-09c1061db4b7 service neutron] 10.222.0.41 "GET /v2.0/networks/fc901312-2937-4784-8a6d-c046666e8bf8?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0905743 Nov 23 19:39:58.462083 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-460245be-1356-4593-b921-dafb0abca5fa req-b7f90cb6-98eb-4b08-b4a1-0fa4882f7024 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102993) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:39:58.463450 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-460245be-1356-4593-b921-dafb0abca5fa req-b7f90cb6-98eb-4b08-b4a1-0fa4882f7024 service neutron] 10.222.0.41 "GET /v2.0/subnets?id=88de785d-c540-4651-af1e-26f27ccaee3c HTTP/1.1" status: 200 len: 849 time: 0.0483739 Nov 23 19:39:58.494614 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.db.l3_dvr_db [None req-1068e325-3f2d-4440-8b9b-95163f281a52 None None] Set router 0534bcc4-1e12-4026-90ce-1406543c7662 gateway port host: dv-cinder-819011-1-iscsi {{(pid=102994) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 23 19:39:58.512368 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-460245be-1356-4593-b921-dafb0abca5fa req-3e70d82d-a2d5-4682-bd8a-4994de8c3040 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102993) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:39:58.513984 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-460245be-1356-4593-b921-dafb0abca5fa req-3e70d82d-a2d5-4682-bd8a-4994de8c3040 service neutron] 10.222.0.41 "GET /v2.0/ports?network_id=226a519f-5f3e-4d80-bb8a-0e9fc4f64828&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0414860 Nov 23 19:39:58.609630 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-460245be-1356-4593-b921-dafb0abca5fa req-5c1a716d-2730-4276-8ed4-c9dfba87a924 service neutron] 10.222.0.41 "GET /v2.0/networks/226a519f-5f3e-4d80-bb8a-0e9fc4f64828?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0854654 Nov 23 19:39:58.704478 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-460245be-1356-4593-b921-dafb0abca5fa req-c3638505-e023-4153-aea6-8092d2c1694b service neutron] 10.222.0.41 "GET /v2.0/networks/226a519f-5f3e-4d80-bb8a-0e9fc4f64828?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0833244 Nov 23 19:39:58.726550 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.db.l3_hamode_db [None req-1068e325-3f2d-4440-8b9b-95163f281a52 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '0534bcc4-1e12-4026-90ce-1406543c7662', 'name': 'tempest-TestVolumeBootPattern-84632531-router', 'tenant_id': '257b0b2e531441b4bb745e99cfd799f3', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'a93e254e-aac9-4233-9e4d-4290fd0458e4', 'external_fixed_ips': [{'subnet_id': 'e0b32f3d-83d6-439a-bbed-01df7cf01051', 'ip_address': '172.27.1.154'}], 'enable_snat': True}, 'gw_port_id': 'c7996293-6188-4690-b614-395448e4dc25', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-23T19:35:29Z', 'updated_at': '2021-11-23T19:35:33Z', 'revision_number': 4, 'project_id': '257b0b2e531441b4bb745e99cfd799f3', 'gw_port': {'id': 'c7996293-6188-4690-b614-395448e4dc25', 'name': '', 'network_id': 'a93e254e-aac9-4233-9e4d-4290fd0458e4', 'tenant_id': '', 'mac_address': 'fa:16:3e:52:67:5e', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '0534bcc4-1e12-4026-90ce-1406543c7662', 'device_owner': 'network:router_gateway', 'standard_attr_id': 392, 'fixed_ips': [{'subnet_id': 'e0b32f3d-83d6-439a-bbed-01df7cf01051', 'ip_address': '172.27.1.154', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-819011-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-23T19:35:30Z', 'updated_at': '2021-11-23T19:35:34Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'e0b32f3d-83d6-439a-bbed-01df7cf01051', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-819011-1-iscsi', '_floatingips': [{'id': 'ea09a7d4-0775-4bc6-9310-f47e8ee059db', 'tenant_id': '257b0b2e531441b4bb745e99cfd799f3', 'floating_ip_address': '172.27.1.127', 'floating_network_id': 'a93e254e-aac9-4233-9e4d-4290fd0458e4', 'router_id': '0534bcc4-1e12-4026-90ce-1406543c7662', 'port_id': '3f7db100-6209-44d3-88c7-906fb1cec5cb', 'fixed_ip_address': '172.20.0.13', 'status': 'DOWN', 'standard_attr_id': 593, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '226a519f-5f3e-4d80-bb8a-0e9fc4f64828', 'mac_address': 'fa:16:3e:27:ae:a3', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '9e64d320-821f-4313-8dd0-3b327ba75634', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-23T19:39:56Z', 'updated_at': '2021-11-23T19:39:56Z', 'revision_number': 0, 'project_id': '257b0b2e531441b4bb745e99cfd799f3', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '854821af-61e0-47e7-a603-95f500a49030', 'name': '', 'network_id': '226a519f-5f3e-4d80-bb8a-0e9fc4f64828', 'tenant_id': '257b0b2e531441b4bb745e99cfd799f3', 'mac_address': 'fa:16:3e:90:11:65', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '0534bcc4-1e12-4026-90ce-1406543c7662', 'device_owner': 'network:router_interface', 'standard_attr_id': 393, 'fixed_ips': [{'subnet_id': '88de785d-c540-4651-af1e-26f27ccaee3c', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-819011-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-23T19:35:32Z', 'updated_at': '2021-11-23T19:35:37Z', 'revision_number': 5, 'project_id': '257b0b2e531441b4bb745e99cfd799f3', 'subnets': [{'id': '88de785d-c540-4651-af1e-26f27ccaee3c', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-819011-1-iscsi', False) {} {{(pid=102994) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 23 19:39:58.752219 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-1068e325-3f2d-4440-8b9b-95163f281a52 None None] The sync data for ids ['0534bcc4-1e12-4026-90ce-1406543c7662'] in dv-cinder-819011-1-iscsi is: [{'id': '0534bcc4-1e12-4026-90ce-1406543c7662', 'name': 'tempest-TestVolumeBootPattern-84632531-router', 'tenant_id': '257b0b2e531441b4bb745e99cfd799f3', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'a93e254e-aac9-4233-9e4d-4290fd0458e4', 'external_fixed_ips': [{'subnet_id': 'e0b32f3d-83d6-439a-bbed-01df7cf01051', 'ip_address': '172.27.1.154'}], 'enable_snat': True}, 'gw_port_id': 'c7996293-6188-4690-b614-395448e4dc25', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-23T19:35:29Z', 'updated_at': '2021-11-23T19:35:33Z', 'revision_number': 4, 'project_id': '257b0b2e531441b4bb745e99cfd799f3', 'gw_port': {'id': 'c7996293-6188-4690-b614-395448e4dc25', 'name': '', 'network_id': 'a93e254e-aac9-4233-9e4d-4290fd0458e4', 'tenant_id': '', 'mac_address': 'fa:16:3e:52:67:5e', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '0534bcc4-1e12-4026-90ce-1406543c7662', 'device_owner': 'network:router_gateway', 'standard_attr_id': 392, 'fixed_ips': [{'subnet_id': 'e0b32f3d-83d6-439a-bbed-01df7cf01051', 'ip_address': '172.27.1.154', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-819011-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-23T19:35:30Z', 'updated_at': '2021-11-23T19:35:34Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'e0b32f3d-83d6-439a-bbed-01df7cf01051', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-819011-1-iscsi', '_floatingips': [{'id': 'ea09a7d4-0775-4bc6-9310-f47e8ee059db', 'tenant_id': '257b0b2e531441b4bb745e99cfd799f3', 'floating_ip_address': '172.27.1.127', 'floating_network_id': 'a93e254e-aac9-4233-9e4d-4290fd0458e4', 'router_id': '0534bcc4-1e12-4026-90ce-1406543c7662', 'port_id': '3f7db100-6209-44d3-88c7-906fb1cec5cb', 'fixed_ip_address': '172.20.0.13', 'status': 'DOWN', 'standard_attr_id': 593, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '226a519f-5f3e-4d80-bb8a-0e9fc4f64828', 'mac_address': 'fa:16:3e:27:ae:a3', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '9e64d320-821f-4313-8dd0-3b327ba75634', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-23T19:39:56Z', 'updated_at': '2021-11-23T19:39:56Z', 'revision_number': 0, 'project_id': '257b0b2e531441b4bb745e99cfd799f3', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '854821af-61e0-47e7-a603-95f500a49030', 'name': '', 'network_id': '226a519f-5f3e-4d80-bb8a-0e9fc4f64828', 'tenant_id': '257b0b2e531441b4bb745e99cfd799f3', 'mac_address': 'fa:16:3e:90:11:65', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '0534bcc4-1e12-4026-90ce-1406543c7662', 'device_owner': 'network:router_interface', 'standard_attr_id': 393, 'fixed_ips': [{'subnet_id': '88de785d-c540-4651-af1e-26f27ccaee3c', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-819011-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-23T19:35:32Z', 'updated_at': '2021-11-23T19:35:37Z', 'revision_number': 5, 'project_id': '257b0b2e531441b4bb745e99cfd799f3', 'subnets': [{'id': '88de785d-c540-4651-af1e-26f27ccaee3c', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=102994) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 23 19:39:58.952478 dv-cinder-819011-1-iscsi neutron-server[102995]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-c7fc6d49-c534-444a-b642-0f721b3d27f3 None None] New status for floating IP ea09a7d4-0775-4bc6-9310-f47e8ee059db: ACTIVE {{(pid=102995) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Nov 23 19:39:59.135880 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1ddb3c86-d718-4c28-9722-757c35b271a6 req-63eac073-8ce1-4804-90c8-4bdf3da31ca0 tempest-AttachVolumeShelveTestJSON-1172915835 tempest-AttachVolumeShelveTestJSON-1172915835-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102993) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:39:59.137267 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-1ddb3c86-d718-4c28-9722-757c35b271a6 req-63eac073-8ce1-4804-90c8-4bdf3da31ca0 tempest-AttachVolumeShelveTestJSON-1172915835 tempest-AttachVolumeShelveTestJSON-1172915835-project] 10.222.0.62 "GET /v2.0/ports?device_id=627eaac3-8c43-4aa3-a81c-7a6bfb58dbb5 HTTP/1.1" status: 200 len: 946 time: 0.0490763 Nov 23 19:39:59.188838 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-1ddb3c86-d718-4c28-9722-757c35b271a6 req-2a44246d-813f-412a-b002-3bf0bfdccdbe tempest-AttachVolumeShelveTestJSON-1172915835 tempest-AttachVolumeShelveTestJSON-1172915835-project] 10.222.0.62 "GET /v2.0/security-groups?id=a246a431-7eb4-441f-b1e6-9c9c351ee888&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0453873 Nov 23 19:39:59.764032 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron_lib.callbacks.manager [None req-4bf48ff4-ecfb-4168-8b63-249b8c6e9f04 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8783631323329', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7978582'] for agent, after_update {{(pid=102994) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:40:00.310014 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3d6ee379-ca60-4acb-9b9b-c5976cbb9510 req-d95c7bce-6e62-432c-9b03-92a99aaddd11 tempest-AttachVolumeShelveTestJSON-1172915835 tempest-AttachVolumeShelveTestJSON-1172915835-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102992) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:40:00.311592 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-3d6ee379-ca60-4acb-9b9b-c5976cbb9510 req-d95c7bce-6e62-432c-9b03-92a99aaddd11 tempest-AttachVolumeShelveTestJSON-1172915835 tempest-AttachVolumeShelveTestJSON-1172915835-project] 10.222.0.62 "GET /v2.0/ports?device_id=627eaac3-8c43-4aa3-a81c-7a6bfb58dbb5 HTTP/1.1" status: 200 len: 946 time: 0.0489354 Nov 23 19:40:00.358616 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-3d6ee379-ca60-4acb-9b9b-c5976cbb9510 req-586625f5-aeb9-4dbd-9cd1-06b22a395ece tempest-AttachVolumeShelveTestJSON-1172915835 tempest-AttachVolumeShelveTestJSON-1172915835-project] 10.222.0.62 "GET /v2.0/security-groups?id=a246a431-7eb4-441f-b1e6-9c9c351ee888&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0406716 Nov 23 19:40:01.007412 dv-cinder-819011-1-iscsi neutron-server[102995]: DEBUG neutron.db.agents_db [None req-84bdc9b2-57ea-4bdb-a245-07c78d37cea8 None None] Agent healthcheck: found 6 active agents {{(pid=102995) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 23 19:40:01.477246 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-719af52e-fa4c-41e9-b988-81bc810ffb80 req-2db88751-0829-49fc-9908-9eee2ff8ca09 tempest-AttachVolumeShelveTestJSON-1172915835 tempest-AttachVolumeShelveTestJSON-1172915835-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102993) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:40:01.480175 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-719af52e-fa4c-41e9-b988-81bc810ffb80 req-2db88751-0829-49fc-9908-9eee2ff8ca09 tempest-AttachVolumeShelveTestJSON-1172915835 tempest-AttachVolumeShelveTestJSON-1172915835-project] 10.222.0.62 "GET /v2.0/ports?device_id=627eaac3-8c43-4aa3-a81c-7a6bfb58dbb5 HTTP/1.1" status: 200 len: 946 time: 0.0484548 Nov 23 19:40:01.525833 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-719af52e-fa4c-41e9-b988-81bc810ffb80 req-11907baf-0f5e-45e7-9419-e1c237096e11 tempest-AttachVolumeShelveTestJSON-1172915835 tempest-AttachVolumeShelveTestJSON-1172915835-project] 10.222.0.62 "GET /v2.0/security-groups?id=a246a431-7eb4-441f-b1e6-9c9c351ee888&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0410864 Nov 23 19:40:02.603834 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.plugins.ml2.rpc [None req-4bf48ff4-ecfb-4168-8b63-249b8c6e9f04 None None] Device 895334df-08a6-40fc-9056-3c5fba79b18c no longer exists at agent hyperv_hv-cinder-81901 {{(pid=102994) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 23 19:40:02.682521 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron_lib.callbacks.manager [None req-4bf48ff4-ecfb-4168-8b63-249b8c6e9f04 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7921281'] for port, before_update {{(pid=102994) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:40:02.705873 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '627eaac3-8c43-4aa3-a81c-7a6bfb58dbb5', 'name': 'network-vif-unplugged', 'status': 'completed', 'tag': '895334df-08a6-40fc-9056-3c5fba79b18c'}] {{(pid=102994) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 23 19:40:02.708096 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.62/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}09a7511da0d2ba1d728b27e36a8467ec5289399952f0059588048a7cb66d3a43" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-3c0bc1d2-770a-4f5c-a72a-651f49f413c4" -d '{"events": [{"server_uuid": "627eaac3-8c43-4aa3-a81c-7a6bfb58dbb5", "name": "network-vif-unplugged", "status": "completed", "tag": "895334df-08a6-40fc-9056-3c5fba79b18c"}]}' {{(pid=102994) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 23 19:40:02.720655 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.plugins.ml2.db [None req-4bf48ff4-ecfb-4168-8b63-249b8c6e9f04 None None] For port 895334df-08a6-40fc-9056-3c5fba79b18c, host hv-cinder-81901, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81901',level=0,port_id=895334df-08a6-40fc-9056-3c5fba79b18c,segment=NetworkSegment(b4453f21-ac7f-498c-8316-73b738820700),segment_id=b4453f21-ac7f-498c-8316-73b738820700)] {{(pid=102994) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 23 19:40:02.743523 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG novaclient.v2.client [-] RESP: [207] Connection: close Content-Length: 182 Content-Type: application/json Date: Tue, 23 Nov 2021 19:40:02 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-9bedfbe1-9a9b-4781-af4a-b8f265170aa0 x-openstack-request-id: req-9bedfbe1-9a9b-4781-af4a-b8f265170aa0 {{(pid=102994) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 23 19:40:02.743816 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "627eaac3-8c43-4aa3-a81c-7a6bfb58dbb5", "name": "network-vif-unplugged", "status": "failed", "tag": "895334df-08a6-40fc-9056-3c5fba79b18c", "code": 422}]} {{(pid=102994) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 23 19:40:02.744072 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.62/compute/v2.1/os-server-external-events used request id req-9bedfbe1-9a9b-4781-af4a-b8f265170aa0 {{(pid=102994) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 23 19:40:02.744481 dv-cinder-819011-1-iscsi neutron-server[102994]: WARNING neutron.notifiers.nova [-] Nova event: {'server_uuid': '627eaac3-8c43-4aa3-a81c-7a6bfb58dbb5', 'name': 'network-vif-unplugged', 'status': 'failed', 'tag': '895334df-08a6-40fc-9056-3c5fba79b18c', 'code': 422} returned with failed status Nov 23 19:40:02.763991 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron_lib.callbacks.manager [None req-4bf48ff4-ecfb-4168-8b63-249b8c6e9f04 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7918660', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-15067', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560168', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8783631423946', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8783631008732', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8783631008750'] for port, after_update {{(pid=102994) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:40:02.811001 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4bf48ff4-ecfb-4168-8b63-249b8c6e9f04 None None] Pushing event updated for resources: {'Port': ['ID=895334df-08a6-40fc-9056-3c5fba79b18c,revision_number=8']} {{(pid=102994) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 23 19:40:03.055886 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.wsgi [req-59b9bea1-b70e-47cb-a7f9-604df70d2a96 req-c26be14f-ecad-4a14-af4e-f1c57fb08d83 service neutron] http://10.222.0.62:9696/v2.0/extensions returned with HTTP 200 {{(pid=102992) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Nov 23 19:40:03.056866 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-59b9bea1-b70e-47cb-a7f9-604df70d2a96 req-c26be14f-ecad-4a14-af4e-f1c57fb08d83 service neutron] 10.222.0.62 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 14082 time: 0.0051689 Nov 23 19:40:03.333467 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c214cdae-ac62-47a8-ba20-f7761d46f8bb req-028eadb6-c35a-4b9f-a3ba-13ae9fe6bf38 tempest-AttachVolumeShelveTestJSON-1172915835 tempest-AttachVolumeShelveTestJSON-1172915835-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102993) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:40:03.335045 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-c214cdae-ac62-47a8-ba20-f7761d46f8bb req-028eadb6-c35a-4b9f-a3ba-13ae9fe6bf38 tempest-AttachVolumeShelveTestJSON-1172915835 tempest-AttachVolumeShelveTestJSON-1172915835-project] 10.222.0.62 "GET /v2.0/ports?device_id=627eaac3-8c43-4aa3-a81c-7a6bfb58dbb5 HTTP/1.1" status: 200 len: 944 time: 0.0519354 Nov 23 19:40:03.382963 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-c214cdae-ac62-47a8-ba20-f7761d46f8bb req-8f766206-9bff-4352-9f5e-6e59474df21f tempest-AttachVolumeShelveTestJSON-1172915835 tempest-AttachVolumeShelveTestJSON-1172915835-project] 10.222.0.62 "GET /v2.0/security-groups?id=a246a431-7eb4-441f-b1e6-9c9c351ee888&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0418181 Nov 23 19:40:03.727224 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.wsgi [-] (102993) accepted ('10.222.0.62', 49838) {{(pid=102993) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 23 19:40:03.812971 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-8550e7af-275a-4bb3-92d3-f0314fc9aa55 req-fae11b1b-98c0-463c-b975-68eac4bc76b8 service neutron] 10.222.0.62 "GET /v2.0/ports?device_id=627eaac3-8c43-4aa3-a81c-7a6bfb58dbb5&fields=id&fields=resource_request HTTP/1.1" status: 200 len: 255 time: 0.0845983 Nov 23 19:40:03.822803 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.wsgi [req-8550e7af-275a-4bb3-92d3-f0314fc9aa55 req-5eb81998-e2bd-4cdd-a405-94b33f91387f service neutron] http://10.222.0.62:9696/v2.0/extensions returned with HTTP 200 {{(pid=102993) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Nov 23 19:40:03.823774 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-8550e7af-275a-4bb3-92d3-f0314fc9aa55 req-5eb81998-e2bd-4cdd-a405-94b33f91387f service neutron] 10.222.0.62 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 14082 time: 0.0049453 Nov 23 19:40:04.504686 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-95999cf6-df9b-4ad7-a33e-98e2cf0421f0 req-08cf938f-ab5f-404f-a5bb-751f045c412b tempest-AttachVolumeShelveTestJSON-1172915835 tempest-AttachVolumeShelveTestJSON-1172915835-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102992) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:40:04.506216 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-95999cf6-df9b-4ad7-a33e-98e2cf0421f0 req-08cf938f-ab5f-404f-a5bb-751f045c412b tempest-AttachVolumeShelveTestJSON-1172915835 tempest-AttachVolumeShelveTestJSON-1172915835-project] 10.222.0.62 "GET /v2.0/ports?device_id=627eaac3-8c43-4aa3-a81c-7a6bfb58dbb5 HTTP/1.1" status: 200 len: 944 time: 0.0481880 Nov 23 19:40:04.557451 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-95999cf6-df9b-4ad7-a33e-98e2cf0421f0 req-7a6112f9-e18a-485d-902a-5716cbddb9ba tempest-AttachVolumeShelveTestJSON-1172915835 tempest-AttachVolumeShelveTestJSON-1172915835-project] 10.222.0.62 "GET /v2.0/security-groups?id=a246a431-7eb4-441f-b1e6-9c9c351ee888&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0449967 Nov 23 19:40:05.223830 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8550e7af-275a-4bb3-92d3-f0314fc9aa55 req-0b5675f8-dede-43d7-8425-06ee10086ac3 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102993) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:40:05.225300 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-8550e7af-275a-4bb3-92d3-f0314fc9aa55 req-0b5675f8-dede-43d7-8425-06ee10086ac3 service neutron] 10.222.0.41 "GET /v2.0/ports?device_id=627eaac3-8c43-4aa3-a81c-7a6bfb58dbb5&tenant_id=2d925fb59ba34355aa85758374d76928 HTTP/1.1" status: 200 len: 1097 time: 0.0401671 Nov 23 19:40:05.297824 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8550e7af-275a-4bb3-92d3-f0314fc9aa55 req-0b13e3ed-d88a-4c60-bcd7-c7c6979df046 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102993) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:40:05.299929 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-8550e7af-275a-4bb3-92d3-f0314fc9aa55 req-0b13e3ed-d88a-4c60-bcd7-c7c6979df046 service neutron] 10.222.0.41 "GET /v2.0/ports?tenant_id=2d925fb59ba34355aa85758374d76928&device_id=627eaac3-8c43-4aa3-a81c-7a6bfb58dbb5 HTTP/1.1" status: 200 len: 1097 time: 0.0410724 Nov 23 19:40:05.392752 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8550e7af-275a-4bb3-92d3-f0314fc9aa55 req-c303cf3d-34bb-4bbf-af92-17cf09736d66 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102993) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:40:05.394134 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-8550e7af-275a-4bb3-92d3-f0314fc9aa55 req-c303cf3d-34bb-4bbf-af92-17cf09736d66 service neutron] 10.222.0.41 "GET /v2.0/networks?id=fc901312-2937-4784-8a6d-c046666e8bf8 HTTP/1.1" status: 200 len: 918 time: 0.0864911 Nov 23 19:40:05.463869 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-8550e7af-275a-4bb3-92d3-f0314fc9aa55 req-4abc620f-8211-458c-89fe-9ca14fd30b4c service neutron] 10.222.0.41 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.11&port_id=895334df-08a6-40fc-9056-3c5fba79b18c HTTP/1.1" status: 200 len: 1000 time: 0.0577965 Nov 23 19:40:05.517183 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8550e7af-275a-4bb3-92d3-f0314fc9aa55 req-e9f7df63-a8be-4f43-af79-5a8c64625a89 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102993) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:40:05.519172 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-8550e7af-275a-4bb3-92d3-f0314fc9aa55 req-e9f7df63-a8be-4f43-af79-5a8c64625a89 service neutron] 10.222.0.41 "GET /v2.0/subnets?id=2caca985-6ed6-4ef7-ba49-7b7410bea160 HTTP/1.1" status: 200 len: 856 time: 0.0433080 Nov 23 19:40:05.569046 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8550e7af-275a-4bb3-92d3-f0314fc9aa55 req-91d5307d-d466-4ad8-8556-8dc8ce437994 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102993) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:40:05.570535 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-8550e7af-275a-4bb3-92d3-f0314fc9aa55 req-91d5307d-d466-4ad8-8556-8dc8ce437994 service neutron] 10.222.0.41 "GET /v2.0/ports?network_id=fc901312-2937-4784-8a6d-c046666e8bf8&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0433486 Nov 23 19:40:05.696146 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-8550e7af-275a-4bb3-92d3-f0314fc9aa55 req-f6fd8a8c-d35f-4a4f-bbd0-b4884022e2ff service neutron] 10.222.0.41 "GET /v2.0/networks/fc901312-2937-4784-8a6d-c046666e8bf8?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1139450 Nov 23 19:40:05.707491 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-51c72986-5f90-499a-9804-9f9bc6264a8b req-ae1c4c2d-839d-4d74-b71e-76775eaee09f tempest-AttachVolumeShelveTestJSON-1172915835 tempest-AttachVolumeShelveTestJSON-1172915835-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102993) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:40:05.708903 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-51c72986-5f90-499a-9804-9f9bc6264a8b req-ae1c4c2d-839d-4d74-b71e-76775eaee09f tempest-AttachVolumeShelveTestJSON-1172915835 tempest-AttachVolumeShelveTestJSON-1172915835-project] 10.222.0.62 "GET /v2.0/ports?device_id=627eaac3-8c43-4aa3-a81c-7a6bfb58dbb5 HTTP/1.1" status: 200 len: 944 time: 0.0730684 Nov 23 19:40:05.809180 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-51c72986-5f90-499a-9804-9f9bc6264a8b req-6cae24a6-f349-41d4-ae60-9fceda75fc8b tempest-AttachVolumeShelveTestJSON-1172915835 tempest-AttachVolumeShelveTestJSON-1172915835-project] 10.222.0.62 "GET /v2.0/security-groups?id=a246a431-7eb4-441f-b1e6-9c9c351ee888&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0925486 Nov 23 19:40:05.824624 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-8550e7af-275a-4bb3-92d3-f0314fc9aa55 req-81fe3b4d-2077-46e4-a2d7-1d80f00f0850 service neutron] 10.222.0.41 "GET /v2.0/networks/fc901312-2937-4784-8a6d-c046666e8bf8?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1147726 Nov 23 19:40:06.929967 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8f4b7586-a43b-4716-a5e5-4c43acd35018 req-81f19161-22de-42fe-8f95-61bc64d8da8d tempest-AttachVolumeShelveTestJSON-1172915835 tempest-AttachVolumeShelveTestJSON-1172915835-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102992) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:40:06.931411 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-8f4b7586-a43b-4716-a5e5-4c43acd35018 req-81f19161-22de-42fe-8f95-61bc64d8da8d tempest-AttachVolumeShelveTestJSON-1172915835 tempest-AttachVolumeShelveTestJSON-1172915835-project] 10.222.0.62 "GET /v2.0/ports?device_id=627eaac3-8c43-4aa3-a81c-7a6bfb58dbb5 HTTP/1.1" status: 200 len: 944 time: 0.0484667 Nov 23 19:40:06.981993 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-8f4b7586-a43b-4716-a5e5-4c43acd35018 req-63d84ba1-e99c-4563-998b-7831ed158fd5 tempest-AttachVolumeShelveTestJSON-1172915835 tempest-AttachVolumeShelveTestJSON-1172915835-project] 10.222.0.62 "GET /v2.0/security-groups?id=a246a431-7eb4-441f-b1e6-9c9c351ee888&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0447781 Nov 23 19:40:08.106723 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-90e486f2-c6dd-4daf-b04c-f820b2e5695f req-6bea90f3-8737-4ee5-b396-92411903089c tempest-AttachVolumeShelveTestJSON-1172915835 tempest-AttachVolumeShelveTestJSON-1172915835-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102992) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:40:08.108253 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-90e486f2-c6dd-4daf-b04c-f820b2e5695f req-6bea90f3-8737-4ee5-b396-92411903089c tempest-AttachVolumeShelveTestJSON-1172915835 tempest-AttachVolumeShelveTestJSON-1172915835-project] 10.222.0.62 "GET /v2.0/ports?device_id=627eaac3-8c43-4aa3-a81c-7a6bfb58dbb5 HTTP/1.1" status: 200 len: 944 time: 0.0520718 Nov 23 19:40:08.164104 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-90e486f2-c6dd-4daf-b04c-f820b2e5695f req-3a304b2a-472c-4284-8447-3d45fc6fc3e2 tempest-AttachVolumeShelveTestJSON-1172915835 tempest-AttachVolumeShelveTestJSON-1172915835-project] 10.222.0.62 "GET /v2.0/security-groups?id=a246a431-7eb4-441f-b1e6-9c9c351ee888&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0493886 Nov 23 19:40:09.296252 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0c175598-fd4e-4142-bf35-b3f0789b7a13 req-68da719b-6c8a-41a5-956a-4d30e6f79c38 tempest-AttachVolumeShelveTestJSON-1172915835 tempest-AttachVolumeShelveTestJSON-1172915835-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102993) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:40:09.297934 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-0c175598-fd4e-4142-bf35-b3f0789b7a13 req-68da719b-6c8a-41a5-956a-4d30e6f79c38 tempest-AttachVolumeShelveTestJSON-1172915835 tempest-AttachVolumeShelveTestJSON-1172915835-project] 10.222.0.62 "GET /v2.0/ports?device_id=627eaac3-8c43-4aa3-a81c-7a6bfb58dbb5 HTTP/1.1" status: 200 len: 944 time: 0.0539825 Nov 23 19:40:09.348964 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-0c175598-fd4e-4142-bf35-b3f0789b7a13 req-f823143c-31bb-402a-a9e9-da7e84b40587 tempest-AttachVolumeShelveTestJSON-1172915835 tempest-AttachVolumeShelveTestJSON-1172915835-project] 10.222.0.62 "GET /v2.0/security-groups?id=a246a431-7eb4-441f-b1e6-9c9c351ee888&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0443325 Nov 23 19:40:10.477354 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9d9b7b90-45b7-425c-87a4-a50235671aec req-5f745a8e-ae81-4ad7-a6f5-f33b2bc9fc64 tempest-AttachVolumeShelveTestJSON-1172915835 tempest-AttachVolumeShelveTestJSON-1172915835-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102992) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:40:10.481054 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-9d9b7b90-45b7-425c-87a4-a50235671aec req-5f745a8e-ae81-4ad7-a6f5-f33b2bc9fc64 tempest-AttachVolumeShelveTestJSON-1172915835 tempest-AttachVolumeShelveTestJSON-1172915835-project] 10.222.0.62 "GET /v2.0/ports?device_id=627eaac3-8c43-4aa3-a81c-7a6bfb58dbb5 HTTP/1.1" status: 200 len: 944 time: 0.0558124 Nov 23 19:40:10.528495 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-9d9b7b90-45b7-425c-87a4-a50235671aec req-983ae674-d149-4c31-9ec3-b1808dbbe007 tempest-AttachVolumeShelveTestJSON-1172915835 tempest-AttachVolumeShelveTestJSON-1172915835-project] 10.222.0.62 "GET /v2.0/security-groups?id=a246a431-7eb4-441f-b1e6-9c9c351ee888&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0437977 Nov 23 19:40:11.675731 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9e62e30d-caba-4ea4-805a-98da1170e737 req-12ede202-3b65-48a6-9de0-d3013f9467e3 tempest-AttachVolumeShelveTestJSON-1172915835 tempest-AttachVolumeShelveTestJSON-1172915835-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102993) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:40:11.702305 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-9e62e30d-caba-4ea4-805a-98da1170e737 req-12ede202-3b65-48a6-9de0-d3013f9467e3 tempest-AttachVolumeShelveTestJSON-1172915835 tempest-AttachVolumeShelveTestJSON-1172915835-project] 10.222.0.62 "GET /v2.0/ports?device_id=627eaac3-8c43-4aa3-a81c-7a6bfb58dbb5 HTTP/1.1" status: 200 len: 944 time: 0.0706658 Nov 23 19:40:11.738372 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-9e62e30d-caba-4ea4-805a-98da1170e737 req-303c229a-900a-4058-9ded-6fe368214e2f tempest-AttachVolumeShelveTestJSON-1172915835 tempest-AttachVolumeShelveTestJSON-1172915835-project] 10.222.0.62 "GET /v2.0/security-groups?id=a246a431-7eb4-441f-b1e6-9c9c351ee888&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0551267 Nov 23 19:40:11.867302 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron_lib.callbacks.manager [None req-cb5ac758-0192-4cde-8d1a-b200837e8bb2 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8783631323329', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7978582'] for agent, after_update {{(pid=102994) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:40:12.867957 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-de760e34-7b86-409a-8d1a-57a5c6c85bad req-be0a1db2-629a-49a7-9b4c-f74869f0e002 tempest-AttachVolumeShelveTestJSON-1172915835 tempest-AttachVolumeShelveTestJSON-1172915835-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102992) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:40:12.869633 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-de760e34-7b86-409a-8d1a-57a5c6c85bad req-be0a1db2-629a-49a7-9b4c-f74869f0e002 tempest-AttachVolumeShelveTestJSON-1172915835 tempest-AttachVolumeShelveTestJSON-1172915835-project] 10.222.0.62 "GET /v2.0/ports?device_id=627eaac3-8c43-4aa3-a81c-7a6bfb58dbb5 HTTP/1.1" status: 200 len: 944 time: 0.0510614 Nov 23 19:40:12.917259 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-de760e34-7b86-409a-8d1a-57a5c6c85bad req-63860a2e-2fe5-45e1-a7d7-fe7128fdcca9 tempest-AttachVolumeShelveTestJSON-1172915835 tempest-AttachVolumeShelveTestJSON-1172915835-project] 10.222.0.62 "GET /v2.0/security-groups?id=a246a431-7eb4-441f-b1e6-9c9c351ee888&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0413921 Nov 23 19:40:14.049790 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-638b75ef-20bf-44d0-aecb-12837a605f12 req-8e0d3ec9-c613-4669-88b0-5694d0eab4ff tempest-AttachVolumeShelveTestJSON-1172915835 tempest-AttachVolumeShelveTestJSON-1172915835-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102993) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:40:14.051434 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-638b75ef-20bf-44d0-aecb-12837a605f12 req-8e0d3ec9-c613-4669-88b0-5694d0eab4ff tempest-AttachVolumeShelveTestJSON-1172915835 tempest-AttachVolumeShelveTestJSON-1172915835-project] 10.222.0.62 "GET /v2.0/ports?device_id=627eaac3-8c43-4aa3-a81c-7a6bfb58dbb5 HTTP/1.1" status: 200 len: 944 time: 0.0507512 Nov 23 19:40:14.108635 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-638b75ef-20bf-44d0-aecb-12837a605f12 req-61b308d8-7912-4ce7-951f-de73e78c9b7e tempest-AttachVolumeShelveTestJSON-1172915835 tempest-AttachVolumeShelveTestJSON-1172915835-project] 10.222.0.62 "GET /v2.0/security-groups?id=a246a431-7eb4-441f-b1e6-9c9c351ee888&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0505438 Nov 23 19:40:14.237885 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron_lib.callbacks.manager [None req-8698f0ce-700e-4464-bfaa-826f11a80f7a None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8783631323329', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7978582'] for agent, after_update {{(pid=102994) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:40:15.089596 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron_lib.callbacks.manager [None req-8346ef05-f685-4c3d-af3d-a159b683bec2 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8783631323329', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7978582'] for agent, after_update {{(pid=102994) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:40:15.236296 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-de413223-b1ac-4f04-b08e-538febff3596 req-3ee54507-c482-4284-98e9-8f87979f0e98 tempest-AttachVolumeShelveTestJSON-1172915835 tempest-AttachVolumeShelveTestJSON-1172915835-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102992) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:40:15.237847 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-de413223-b1ac-4f04-b08e-538febff3596 req-3ee54507-c482-4284-98e9-8f87979f0e98 tempest-AttachVolumeShelveTestJSON-1172915835 tempest-AttachVolumeShelveTestJSON-1172915835-project] 10.222.0.62 "GET /v2.0/ports?device_id=627eaac3-8c43-4aa3-a81c-7a6bfb58dbb5 HTTP/1.1" status: 200 len: 944 time: 0.0510583 Nov 23 19:40:15.289724 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-de413223-b1ac-4f04-b08e-538febff3596 req-fbbcbdb2-477e-4ab3-83d1-0a1e656f1bdc tempest-AttachVolumeShelveTestJSON-1172915835 tempest-AttachVolumeShelveTestJSON-1172915835-project] 10.222.0.62 "GET /v2.0/security-groups?id=a246a431-7eb4-441f-b1e6-9c9c351ee888&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0458581 Nov 23 19:40:16.424759 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7791c6d4-2f96-4f1e-b3b1-7ec668badf49 req-872c8403-eded-4ef0-bd2e-102de679c6d8 tempest-AttachVolumeShelveTestJSON-1172915835 tempest-AttachVolumeShelveTestJSON-1172915835-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102993) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:40:16.426340 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-7791c6d4-2f96-4f1e-b3b1-7ec668badf49 req-872c8403-eded-4ef0-bd2e-102de679c6d8 tempest-AttachVolumeShelveTestJSON-1172915835 tempest-AttachVolumeShelveTestJSON-1172915835-project] 10.222.0.62 "GET /v2.0/ports?device_id=627eaac3-8c43-4aa3-a81c-7a6bfb58dbb5 HTTP/1.1" status: 200 len: 944 time: 0.0504947 Nov 23 19:40:16.475976 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-7791c6d4-2f96-4f1e-b3b1-7ec668badf49 req-b2b55479-8229-4805-9c30-38e70bba0a8a tempest-AttachVolumeShelveTestJSON-1172915835 tempest-AttachVolumeShelveTestJSON-1172915835-project] 10.222.0.62 "GET /v2.0/security-groups?id=a246a431-7eb4-441f-b1e6-9c9c351ee888&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0432651 Nov 23 19:40:16.581504 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron_lib.callbacks.manager [None req-785c1d26-11ba-42d8-b5a6-51a8b3daeef0 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8783631323329', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7978582'] for agent, after_update {{(pid=102994) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:40:17.363752 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron_lib.callbacks.manager [None req-eb87b2c3-3339-4249-8b85-e695b5b4e1f9 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8783631323329', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7978582'] for agent, after_update {{(pid=102994) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:40:17.596914 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fb706968-462c-4f4b-bd5d-d30e08df58a5 req-ccfd78be-0de6-4e47-9fe0-3a2b87f4c8a3 tempest-AttachVolumeShelveTestJSON-1172915835 tempest-AttachVolumeShelveTestJSON-1172915835-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102992) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:40:17.598445 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-fb706968-462c-4f4b-bd5d-d30e08df58a5 req-ccfd78be-0de6-4e47-9fe0-3a2b87f4c8a3 tempest-AttachVolumeShelveTestJSON-1172915835 tempest-AttachVolumeShelveTestJSON-1172915835-project] 10.222.0.62 "GET /v2.0/ports?device_id=627eaac3-8c43-4aa3-a81c-7a6bfb58dbb5 HTTP/1.1" status: 200 len: 944 time: 0.0494323 Nov 23 19:40:17.646873 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-fb706968-462c-4f4b-bd5d-d30e08df58a5 req-7d0e7903-b60f-4054-83d7-59d5cc84f1b7 tempest-AttachVolumeShelveTestJSON-1172915835 tempest-AttachVolumeShelveTestJSON-1172915835-project] 10.222.0.62 "GET /v2.0/security-groups?id=a246a431-7eb4-441f-b1e6-9c9c351ee888&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0419703 Nov 23 19:40:18.767150 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e39d9677-db1c-4409-b729-1cab9018e01e req-35c161a3-1582-47ea-b1af-d176909da9c6 tempest-AttachVolumeShelveTestJSON-1172915835 tempest-AttachVolumeShelveTestJSON-1172915835-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102993) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:40:18.768621 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-e39d9677-db1c-4409-b729-1cab9018e01e req-35c161a3-1582-47ea-b1af-d176909da9c6 tempest-AttachVolumeShelveTestJSON-1172915835 tempest-AttachVolumeShelveTestJSON-1172915835-project] 10.222.0.62 "GET /v2.0/ports?device_id=627eaac3-8c43-4aa3-a81c-7a6bfb58dbb5 HTTP/1.1" status: 200 len: 944 time: 0.0484211 Nov 23 19:40:18.815989 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-e39d9677-db1c-4409-b729-1cab9018e01e req-0028c7a8-d03e-4ad9-a81d-1d39aab11857 tempest-AttachVolumeShelveTestJSON-1172915835 tempest-AttachVolumeShelveTestJSON-1172915835-project] 10.222.0.62 "GET /v2.0/security-groups?id=a246a431-7eb4-441f-b1e6-9c9c351ee888&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0414231 Nov 23 19:40:19.932697 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a3e953b3-0095-407e-9bac-50e7a4728cef req-d138c8d6-f716-464b-8ea2-0cae65733ea4 tempest-AttachVolumeShelveTestJSON-1172915835 tempest-AttachVolumeShelveTestJSON-1172915835-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102992) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:40:19.934631 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-a3e953b3-0095-407e-9bac-50e7a4728cef req-d138c8d6-f716-464b-8ea2-0cae65733ea4 tempest-AttachVolumeShelveTestJSON-1172915835 tempest-AttachVolumeShelveTestJSON-1172915835-project] 10.222.0.62 "GET /v2.0/ports?device_id=627eaac3-8c43-4aa3-a81c-7a6bfb58dbb5 HTTP/1.1" status: 200 len: 944 time: 0.0492473 Nov 23 19:40:19.980716 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-a3e953b3-0095-407e-9bac-50e7a4728cef req-bc58f740-6f64-4e8f-af2c-9b1e3d81b251 tempest-AttachVolumeShelveTestJSON-1172915835 tempest-AttachVolumeShelveTestJSON-1172915835-project] 10.222.0.62 "GET /v2.0/security-groups?id=a246a431-7eb4-441f-b1e6-9c9c351ee888&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0397801 Nov 23 19:40:20.409093 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-01a8f02c-9b16-4ff9-a64e-7abab246c298 req-92379349-5aa6-4819-aa92-bb11e28b0d38 tempest-AttachVolumeTestJSON-1120920040 tempest-AttachVolumeTestJSON-1120920040-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102992) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:40:20.410570 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-01a8f02c-9b16-4ff9-a64e-7abab246c298 req-92379349-5aa6-4819-aa92-bb11e28b0d38 tempest-AttachVolumeTestJSON-1120920040 tempest-AttachVolumeTestJSON-1120920040-project] 10.222.0.62 "GET /v2.0/ports?device_id=029fedce-3168-4d1d-992e-a9466fe3e886 HTTP/1.1" status: 200 len: 945 time: 0.0524526 Nov 23 19:40:20.457821 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-01a8f02c-9b16-4ff9-a64e-7abab246c298 req-c31d57a6-3b12-4a4c-87a5-04fae5464ede tempest-AttachVolumeTestJSON-1120920040 tempest-AttachVolumeTestJSON-1120920040-project] 10.222.0.62 "GET /v2.0/security-groups?id=f8cf4027-ad94-4b78-b429-c3f2d7f9d324&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0414076 Nov 23 19:40:20.660730 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.plugins.ml2.rpc [None req-4bf48ff4-ecfb-4168-8b63-249b8c6e9f04 None None] Device 895334df-08a6-40fc-9056-3c5fba79b18c details requested by agent hyperv_hv-cinder-81901 with host hv-cinder-81901 {{(pid=102994) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Nov 23 19:40:20.754118 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.plugins.ml2.db [None req-4bf48ff4-ecfb-4168-8b63-249b8c6e9f04 None None] For port 895334df-08a6-40fc-9056-3c5fba79b18c, host hv-cinder-81901, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81901',level=0,port_id=895334df-08a6-40fc-9056-3c5fba79b18c,segment=NetworkSegment(b4453f21-ac7f-498c-8316-73b738820700),segment_id=b4453f21-ac7f-498c-8316-73b738820700)] {{(pid=102994) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 23 19:40:20.764918 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.plugins.ml2.rpc [None req-4bf48ff4-ecfb-4168-8b63-249b8c6e9f04 None None] Returning: {'device': '895334df-08a6-40fc-9056-3c5fba79b18c', 'network_id': 'fc901312-2937-4784-8a6d-c046666e8bf8', 'port_id': '895334df-08a6-40fc-9056-3c5fba79b18c', 'mac_address': 'fa:16:3e:83:a6:a3', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 825, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '2caca985-6ed6-4ef7-ba49-7b7410bea160', 'ip_address': '172.20.0.11'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=102994) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Nov 23 19:40:20.805925 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron_lib.callbacks.manager [None req-4bf48ff4-ecfb-4168-8b63-249b8c6e9f04 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7921281'] for port, before_update {{(pid=102994) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:40:20.818832 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.notifiers.nova [None req-4bf48ff4-ecfb-4168-8b63-249b8c6e9f04 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 895334df-08a6-40fc-9056-3c5fba79b18c {{(pid=102994) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 23 19:40:20.836772 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.plugins.ml2.db [None req-4bf48ff4-ecfb-4168-8b63-249b8c6e9f04 None None] For port 895334df-08a6-40fc-9056-3c5fba79b18c, host hv-cinder-81901, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81901',level=0,port_id=895334df-08a6-40fc-9056-3c5fba79b18c,segment=NetworkSegment(b4453f21-ac7f-498c-8316-73b738820700),segment_id=b4453f21-ac7f-498c-8316-73b738820700)] {{(pid=102994) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 23 19:40:20.906289 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron_lib.callbacks.manager [None req-4bf48ff4-ecfb-4168-8b63-249b8c6e9f04 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7918660', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-15067', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560168', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8783631423946', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8783631008732', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8783631008750'] for port, after_update {{(pid=102994) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:40:20.954102 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4bf48ff4-ecfb-4168-8b63-249b8c6e9f04 None None] Pushing event updated for resources: {'Port': ['ID=895334df-08a6-40fc-9056-3c5fba79b18c,revision_number=9']} {{(pid=102994) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 23 19:40:21.104282 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c202b57e-ef4f-4593-9ae7-a5ee2822b847 req-795716cd-3ed5-457c-aa35-34fb17edee6a tempest-AttachVolumeShelveTestJSON-1172915835 tempest-AttachVolumeShelveTestJSON-1172915835-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102993) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:40:21.106102 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-c202b57e-ef4f-4593-9ae7-a5ee2822b847 req-795716cd-3ed5-457c-aa35-34fb17edee6a tempest-AttachVolumeShelveTestJSON-1172915835 tempest-AttachVolumeShelveTestJSON-1172915835-project] 10.222.0.62 "GET /v2.0/ports?device_id=627eaac3-8c43-4aa3-a81c-7a6bfb58dbb5 HTTP/1.1" status: 200 len: 945 time: 0.0527663 Nov 23 19:40:21.153620 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-c202b57e-ef4f-4593-9ae7-a5ee2822b847 req-930787bb-7138-46c3-8ae2-72dcc7928c32 tempest-AttachVolumeShelveTestJSON-1172915835 tempest-AttachVolumeShelveTestJSON-1172915835-project] 10.222.0.62 "GET /v2.0/security-groups?id=a246a431-7eb4-441f-b1e6-9c9c351ee888&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0417612 Nov 23 19:40:21.228343 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.plugins.ml2.db [None req-4bf48ff4-ecfb-4168-8b63-249b8c6e9f04 None None] get_ports_and_sgs() called for port_ids ['895334df-08a6-40fc-9056-3c5fba79b18c'] {{(pid=102994) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 23 19:40:21.570991 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1d71b364-f835-4643-89e2-0fbfc80dc192 req-9a81abc3-ba2c-4cdf-b7c5-eb8bef1d4da8 tempest-AttachVolumeTestJSON-1120920040 tempest-AttachVolumeTestJSON-1120920040-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102992) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:40:21.572445 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-1d71b364-f835-4643-89e2-0fbfc80dc192 req-9a81abc3-ba2c-4cdf-b7c5-eb8bef1d4da8 tempest-AttachVolumeTestJSON-1120920040 tempest-AttachVolumeTestJSON-1120920040-project] 10.222.0.62 "GET /v2.0/ports?device_id=029fedce-3168-4d1d-992e-a9466fe3e886 HTTP/1.1" status: 200 len: 945 time: 0.0475090 Nov 23 19:40:21.618541 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-1d71b364-f835-4643-89e2-0fbfc80dc192 req-7912288d-fbcc-4566-ba4f-8b27dd7fea86 tempest-AttachVolumeTestJSON-1120920040 tempest-AttachVolumeTestJSON-1120920040-project] 10.222.0.62 "GET /v2.0/security-groups?id=f8cf4027-ad94-4b78-b429-c3f2d7f9d324&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0395615 Nov 23 19:40:22.271682 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f96f7390-961d-45e9-80f7-24d3e57280de req-c07d102f-2f14-479e-8b42-ead95b355799 tempest-AttachVolumeShelveTestJSON-1172915835 tempest-AttachVolumeShelveTestJSON-1172915835-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102993) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:40:22.273990 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-f96f7390-961d-45e9-80f7-24d3e57280de req-c07d102f-2f14-479e-8b42-ead95b355799 tempest-AttachVolumeShelveTestJSON-1172915835 tempest-AttachVolumeShelveTestJSON-1172915835-project] 10.222.0.62 "GET /v2.0/ports?device_id=627eaac3-8c43-4aa3-a81c-7a6bfb58dbb5 HTTP/1.1" status: 200 len: 945 time: 0.0483656 Nov 23 19:40:22.321617 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-f96f7390-961d-45e9-80f7-24d3e57280de req-d4b7e522-be14-47d4-a1cc-bcae61379f53 tempest-AttachVolumeShelveTestJSON-1172915835 tempest-AttachVolumeShelveTestJSON-1172915835-project] 10.222.0.62 "GET /v2.0/security-groups?id=a246a431-7eb4-441f-b1e6-9c9c351ee888&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0410111 Nov 23 19:40:22.681643 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.plugins.ml2.rpc [None req-4bf48ff4-ecfb-4168-8b63-249b8c6e9f04 None None] Device 895334df-08a6-40fc-9056-3c5fba79b18c up at agent hyperv_hv-cinder-81901 {{(pid=102994) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 23 19:40:22.732288 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.db.provisioning_blocks [None req-4bf48ff4-ecfb-4168-8b63-249b8c6e9f04 None None] Provisioning complete for port 895334df-08a6-40fc-9056-3c5fba79b18c triggered by entity L2. {{(pid=102994) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 23 19:40:22.732662 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron_lib.callbacks.manager [None req-4bf48ff4-ecfb-4168-8b63-249b8c6e9f04 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-8355713'] for port, provisioning_complete {{(pid=102994) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:40:22.735070 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b6e4e6eb-ad7a-4637-b57a-a80e352084f4 req-dc10d65e-1989-40d2-9b37-2855038b58f5 tempest-AttachVolumeTestJSON-1120920040 tempest-AttachVolumeTestJSON-1120920040-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102992) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:40:22.736546 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-b6e4e6eb-ad7a-4637-b57a-a80e352084f4 req-dc10d65e-1989-40d2-9b37-2855038b58f5 tempest-AttachVolumeTestJSON-1120920040 tempest-AttachVolumeTestJSON-1120920040-project] 10.222.0.62 "GET /v2.0/ports?device_id=029fedce-3168-4d1d-992e-a9466fe3e886 HTTP/1.1" status: 200 len: 945 time: 0.0515311 Nov 23 19:40:22.785567 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-b6e4e6eb-ad7a-4637-b57a-a80e352084f4 req-5934ecc2-0bdc-404e-be00-be02effe0939 tempest-AttachVolumeTestJSON-1120920040 tempest-AttachVolumeTestJSON-1120920040-project] 10.222.0.62 "GET /v2.0/security-groups?id=f8cf4027-ad94-4b78-b429-c3f2d7f9d324&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0431080 Nov 23 19:40:22.811037 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron_lib.callbacks.manager [None req-4bf48ff4-ecfb-4168-8b63-249b8c6e9f04 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7921281'] for port, before_update {{(pid=102994) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:40:22.836862 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '627eaac3-8c43-4aa3-a81c-7a6bfb58dbb5', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '895334df-08a6-40fc-9056-3c5fba79b18c'}] {{(pid=102994) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 23 19:40:22.839175 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.62/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}09a7511da0d2ba1d728b27e36a8467ec5289399952f0059588048a7cb66d3a43" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-a0ec1a39-e7ce-4bf8-950c-fe813678d363" -d '{"events": [{"server_uuid": "627eaac3-8c43-4aa3-a81c-7a6bfb58dbb5", "name": "network-vif-plugged", "status": "completed", "tag": "895334df-08a6-40fc-9056-3c5fba79b18c"}]}' {{(pid=102994) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 23 19:40:22.852276 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.plugins.ml2.db [None req-4bf48ff4-ecfb-4168-8b63-249b8c6e9f04 None None] For port 895334df-08a6-40fc-9056-3c5fba79b18c, host hv-cinder-81901, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81901',level=0,port_id=895334df-08a6-40fc-9056-3c5fba79b18c,segment=NetworkSegment(b4453f21-ac7f-498c-8316-73b738820700),segment_id=b4453f21-ac7f-498c-8316-73b738820700)] {{(pid=102994) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 23 19:40:22.874694 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 23 Nov 2021 19:40:22 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-9e7acb8e-9a48-494f-9ed7-f9a330f49386 x-openstack-request-id: req-9e7acb8e-9a48-494f-9ed7-f9a330f49386 {{(pid=102994) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 23 19:40:22.875012 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "627eaac3-8c43-4aa3-a81c-7a6bfb58dbb5", "name": "network-vif-plugged", "status": "completed", "tag": "895334df-08a6-40fc-9056-3c5fba79b18c", "code": 200}]} {{(pid=102994) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 23 19:40:22.875274 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.62/compute/v2.1/os-server-external-events used request id req-9e7acb8e-9a48-494f-9ed7-f9a330f49386 {{(pid=102994) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 23 19:40:22.875793 dv-cinder-819011-1-iscsi neutron-server[102994]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '627eaac3-8c43-4aa3-a81c-7a6bfb58dbb5', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '895334df-08a6-40fc-9056-3c5fba79b18c', 'code': 200} Nov 23 19:40:22.912126 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron_lib.callbacks.manager [None req-4bf48ff4-ecfb-4168-8b63-249b8c6e9f04 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7918660', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-15067', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560168', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8783631423946', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8783631008732', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8783631008750'] for port, after_update {{(pid=102994) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:40:22.960015 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4bf48ff4-ecfb-4168-8b63-249b8c6e9f04 None None] Pushing event updated for resources: {'Port': ['ID=895334df-08a6-40fc-9056-3c5fba79b18c,revision_number=10']} {{(pid=102994) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 23 19:40:23.181035 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-edf5e249-3272-4f30-8f6a-7acc78e504d1 req-bb350168-3f07-494b-8026-6653fd9dd18c service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102993) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:40:23.182440 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-edf5e249-3272-4f30-8f6a-7acc78e504d1 req-bb350168-3f07-494b-8026-6653fd9dd18c service neutron] 10.222.0.41 "GET /v2.0/ports?device_id=627eaac3-8c43-4aa3-a81c-7a6bfb58dbb5 HTTP/1.1" status: 200 len: 1100 time: 0.0417464 Nov 23 19:40:23.227592 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-edf5e249-3272-4f30-8f6a-7acc78e504d1 req-156353b7-9258-416e-b159-52c8d1d1b265 service neutron] 10.222.0.41 "GET /v2.0/security-groups?id=a246a431-7eb4-441f-b1e6-9c9c351ee888&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0367386 Nov 23 19:40:23.440317 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9e2de947-0e21-43a6-8ea8-43bbe13167a3 req-a11339d2-edfc-47b0-a91f-588202d8df89 tempest-AttachVolumeShelveTestJSON-1172915835 tempest-AttachVolumeShelveTestJSON-1172915835-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102992) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:40:23.442068 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-9e2de947-0e21-43a6-8ea8-43bbe13167a3 req-a11339d2-edfc-47b0-a91f-588202d8df89 tempest-AttachVolumeShelveTestJSON-1172915835 tempest-AttachVolumeShelveTestJSON-1172915835-project] 10.222.0.62 "GET /v2.0/ports?device_id=627eaac3-8c43-4aa3-a81c-7a6bfb58dbb5 HTTP/1.1" status: 200 len: 947 time: 0.0498667 Nov 23 19:40:23.489954 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-9e2de947-0e21-43a6-8ea8-43bbe13167a3 req-220b46b0-4bae-45ed-a217-89a3e7aa06ce tempest-AttachVolumeShelveTestJSON-1172915835 tempest-AttachVolumeShelveTestJSON-1172915835-project] 10.222.0.62 "GET /v2.0/security-groups?id=a246a431-7eb4-441f-b1e6-9c9c351ee888&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0420313 Nov 23 19:40:23.900753 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-54c31e81-2f15-4ef7-9bca-dffce0f6bb88 req-ed74eeec-791f-4cb6-937c-63c71980c901 tempest-AttachVolumeTestJSON-1120920040 tempest-AttachVolumeTestJSON-1120920040-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102993) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:40:23.902846 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-54c31e81-2f15-4ef7-9bca-dffce0f6bb88 req-ed74eeec-791f-4cb6-937c-63c71980c901 tempest-AttachVolumeTestJSON-1120920040 tempest-AttachVolumeTestJSON-1120920040-project] 10.222.0.62 "GET /v2.0/ports?device_id=029fedce-3168-4d1d-992e-a9466fe3e886 HTTP/1.1" status: 200 len: 945 time: 0.0482485 Nov 23 19:40:23.949130 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-54c31e81-2f15-4ef7-9bca-dffce0f6bb88 req-d203deaa-b389-40a9-af36-da56cf5528b0 tempest-AttachVolumeTestJSON-1120920040 tempest-AttachVolumeTestJSON-1120920040-project] 10.222.0.62 "GET /v2.0/security-groups?id=f8cf4027-ad94-4b78-b429-c3f2d7f9d324&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0402889 Nov 23 19:40:24.617792 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-da0ec08d-e79a-448a-80b1-919dd33273c1 req-25b94db1-40f9-4b53-8a76-401434825948 tempest-AttachVolumeShelveTestJSON-1172915835 tempest-AttachVolumeShelveTestJSON-1172915835-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102992) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:40:24.619274 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-da0ec08d-e79a-448a-80b1-919dd33273c1 req-25b94db1-40f9-4b53-8a76-401434825948 tempest-AttachVolumeShelveTestJSON-1172915835 tempest-AttachVolumeShelveTestJSON-1172915835-project] 10.222.0.62 "GET /v2.0/ports?device_id=627eaac3-8c43-4aa3-a81c-7a6bfb58dbb5 HTTP/1.1" status: 200 len: 947 time: 0.0574474 Nov 23 19:40:24.672729 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-da0ec08d-e79a-448a-80b1-919dd33273c1 req-236f3a5a-be8c-42cf-8697-d63f479639eb tempest-AttachVolumeShelveTestJSON-1172915835 tempest-AttachVolumeShelveTestJSON-1172915835-project] 10.222.0.62 "GET /v2.0/security-groups?id=a246a431-7eb4-441f-b1e6-9c9c351ee888&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0468245 Nov 23 19:40:25.065609 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9b3f7b5a-f673-44c8-a853-5c07fc3a694c req-485ffb02-1a25-416f-9cb6-3aa867685e7e tempest-AttachVolumeTestJSON-1120920040 tempest-AttachVolumeTestJSON-1120920040-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102993) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:40:25.067000 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-9b3f7b5a-f673-44c8-a853-5c07fc3a694c req-485ffb02-1a25-416f-9cb6-3aa867685e7e tempest-AttachVolumeTestJSON-1120920040 tempest-AttachVolumeTestJSON-1120920040-project] 10.222.0.62 "GET /v2.0/ports?device_id=029fedce-3168-4d1d-992e-a9466fe3e886 HTTP/1.1" status: 200 len: 945 time: 0.0495584 Nov 23 19:40:25.120902 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-9b3f7b5a-f673-44c8-a853-5c07fc3a694c req-33418254-4822-47d1-a482-82c53f680e95 tempest-AttachVolumeTestJSON-1120920040 tempest-AttachVolumeTestJSON-1120920040-project] 10.222.0.62 "GET /v2.0/security-groups?id=f8cf4027-ad94-4b78-b429-c3f2d7f9d324&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0460799 Nov 23 19:40:25.222160 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-360bfcad-a849-44b7-bd4d-be0aa2a0f2e1 req-cf4f9bbf-a6b8-487a-8920-ad90165a0cf7 tempest-TestMinimumBasicScenario-716536904 tempest-TestMinimumBasicScenario-716536904-project] 10.222.0.62 "GET /v2.0/security-groups?name=tempest-secgroup-smoke-1929938272&fields=id&tenant_id=ed0d906c96b540a7b11d508615543890 HTTP/1.1" status: 200 len: 267 time: 0.0459986 Nov 23 19:40:25.279878 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-360bfcad-a849-44b7-bd4d-be0aa2a0f2e1 req-5cf4bbfc-cd1f-44c7-8a1d-43247f5c44af tempest-TestMinimumBasicScenario-716536904 tempest-TestMinimumBasicScenario-716536904-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102992) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:40:25.281400 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-360bfcad-a849-44b7-bd4d-be0aa2a0f2e1 req-5cf4bbfc-cd1f-44c7-8a1d-43247f5c44af tempest-TestMinimumBasicScenario-716536904 tempest-TestMinimumBasicScenario-716536904-project] 10.222.0.62 "GET /v2.0/ports?device_id=b5fed716-ff16-48c0-8e89-95731739f55c HTTP/1.1" status: 200 len: 984 time: 0.0535722 Nov 23 19:40:25.293177 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.api.v2.base [req-360bfcad-a849-44b7-bd4d-be0aa2a0f2e1 req-79717a60-52b4-45e1-8cfe-713b65ebc8e6 tempest-TestMinimumBasicScenario-716536904 tempest-TestMinimumBasicScenario-716536904-project] Request body: {'port': {'security_groups': ['d09b4044-91d5-4432-9faa-4b7a40b1627d']}} {{(pid=102992) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 23 19:40:25.373720 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [req-360bfcad-a849-44b7-bd4d-be0aa2a0f2e1 req-79717a60-52b4-45e1-8cfe-713b65ebc8e6 tempest-TestMinimumBasicScenario-716536904 tempest-TestMinimumBasicScenario-716536904-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7921281'] for port, before_update {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:40:25.553360 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.plugins.ml2.db [req-360bfcad-a849-44b7-bd4d-be0aa2a0f2e1 req-79717a60-52b4-45e1-8cfe-713b65ebc8e6 tempest-TestMinimumBasicScenario-716536904 tempest-TestMinimumBasicScenario-716536904-project] For port 733eac81-0446-4e4c-b1d5-b8c491dcbeb4, host hv-cinder-81901, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81901',level=0,port_id=733eac81-0446-4e4c-b1d5-b8c491dcbeb4,segment=NetworkSegment(81f92f0c-ea8d-4880-af1c-e4418f898de3),segment_id=81f92f0c-ea8d-4880-af1c-e4418f898de3)] {{(pid=102992) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 23 19:40:25.587255 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [req-360bfcad-a849-44b7-bd4d-be0aa2a0f2e1 req-79717a60-52b4-45e1-8cfe-713b65ebc8e6 tempest-TestMinimumBasicScenario-716536904 tempest-TestMinimumBasicScenario-716536904-project] Publish callbacks [] for port, precommit_update {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:40:25.672166 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [req-360bfcad-a849-44b7-bd4d-be0aa2a0f2e1 req-79717a60-52b4-45e1-8cfe-713b65ebc8e6 tempest-TestMinimumBasicScenario-716536904 tempest-TestMinimumBasicScenario-716536904-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7918660', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-15067', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560168', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8783631423946', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8783631008732', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8783631008750', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-25199748'] for port, after_update {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:40:25.686366 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.plugins.ml2.db [None req-4bf48ff4-ecfb-4168-8b63-249b8c6e9f04 None None] get_ports_and_sgs() called for port_ids ['733eac81-0446-4e4c-b1d5-b8c491dcbeb4'] {{(pid=102994) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 23 19:40:25.718996 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-360bfcad-a849-44b7-bd4d-be0aa2a0f2e1 req-79717a60-52b4-45e1-8cfe-713b65ebc8e6 tempest-TestMinimumBasicScenario-716536904 tempest-TestMinimumBasicScenario-716536904-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102992) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:40:25.719638 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [req-360bfcad-a849-44b7-bd4d-be0aa2a0f2e1 req-79717a60-52b4-45e1-8cfe-713b65ebc8e6 tempest-TestMinimumBasicScenario-716536904 tempest-TestMinimumBasicScenario-716536904-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-514902'] for port, before_response {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:40:25.721060 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-360bfcad-a849-44b7-bd4d-be0aa2a0f2e1 req-79717a60-52b4-45e1-8cfe-713b65ebc8e6 tempest-TestMinimumBasicScenario-716536904 tempest-TestMinimumBasicScenario-716536904-project] 10.222.0.62 "PUT /v2.0/ports/733eac81-0446-4e4c-b1d5-b8c491dcbeb4 HTTP/1.1" status: 200 len: 942 time: 0.4329948 Nov 23 19:40:25.721557 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'b5fed716-ff16-48c0-8e89-95731739f55c', 'tag': '733eac81-0446-4e4c-b1d5-b8c491dcbeb4'}] {{(pid=102992) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 23 19:40:25.723924 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.62/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}f86c332b591ae691ababa4b64e0601cbf242a448242f95367ce03daabfb7e1ce" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-331e45b1-3d22-4929-a0be-ae324bf1419d" -d '{"events": [{"name": "network-changed", "server_uuid": "b5fed716-ff16-48c0-8e89-95731739f55c", "tag": "733eac81-0446-4e4c-b1d5-b8c491dcbeb4"}]}' {{(pid=102992) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 23 19:40:25.732662 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.wsgi [-] (102993) accepted ('10.222.0.62', 50012) {{(pid=102993) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 23 19:40:25.769329 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-79717a60-52b4-45e1-8cfe-713b65ebc8e6 tempest-TestMinimumBasicScenario-716536904 tempest-TestMinimumBasicScenario-716536904-project] Pushing event updated for resources: {'Port': ['ID=733eac81-0446-4e4c-b1d5-b8c491dcbeb4,revision_number=7']} {{(pid=102992) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 23 19:40:25.778242 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-79717a60-52b4-45e1-8cfe-713b65ebc8e6 tempest-TestMinimumBasicScenario-716536904 tempest-TestMinimumBasicScenario-716536904-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-819011-1-iscsi {{(pid=102992) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 23 19:40:25.778745 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-79717a60-52b4-45e1-8cfe-713b65ebc8e6 tempest-TestMinimumBasicScenario-716536904 tempest-TestMinimumBasicScenario-716536904-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-819011-1-iscsi {{(pid=102992) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 23 19:40:25.779224 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-79717a60-52b4-45e1-8cfe-713b65ebc8e6 tempest-TestMinimumBasicScenario-716536904 tempest-TestMinimumBasicScenario-716536904-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-819011-1-iscsi {{(pid=102992) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 23 19:40:25.779676 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-79717a60-52b4-45e1-8cfe-713b65ebc8e6 tempest-TestMinimumBasicScenario-716536904 tempest-TestMinimumBasicScenario-716536904-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-819011-1-iscsi {{(pid=102992) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 23 19:40:25.780124 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-79717a60-52b4-45e1-8cfe-713b65ebc8e6 tempest-TestMinimumBasicScenario-716536904 tempest-TestMinimumBasicScenario-716536904-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-819011-1-iscsi {{(pid=102992) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 23 19:40:25.780573 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-79717a60-52b4-45e1-8cfe-713b65ebc8e6 tempest-TestMinimumBasicScenario-716536904 tempest-TestMinimumBasicScenario-716536904-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-819011-1-iscsi {{(pid=102992) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 23 19:40:25.781066 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-79717a60-52b4-45e1-8cfe-713b65ebc8e6 tempest-TestMinimumBasicScenario-716536904 tempest-TestMinimumBasicScenario-716536904-project] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-819011-1-iscsi {{(pid=102992) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 23 19:40:25.781471 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-79717a60-52b4-45e1-8cfe-713b65ebc8e6 tempest-TestMinimumBasicScenario-716536904 tempest-TestMinimumBasicScenario-716536904-project] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-819011-1-iscsi {{(pid=102992) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 23 19:40:25.781914 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-79717a60-52b4-45e1-8cfe-713b65ebc8e6 tempest-TestMinimumBasicScenario-716536904 tempest-TestMinimumBasicScenario-716536904-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-819011-1-iscsi {{(pid=102992) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 23 19:40:25.782364 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-79717a60-52b4-45e1-8cfe-713b65ebc8e6 tempest-TestMinimumBasicScenario-716536904 tempest-TestMinimumBasicScenario-716536904-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-819011-1-iscsi {{(pid=102992) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 23 19:40:25.783274 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-79717a60-52b4-45e1-8cfe-713b65ebc8e6 tempest-TestMinimumBasicScenario-716536904 tempest-TestMinimumBasicScenario-716536904-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-819011-1-iscsi {{(pid=102992) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 23 19:40:25.783413 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-79717a60-52b4-45e1-8cfe-713b65ebc8e6 tempest-TestMinimumBasicScenario-716536904 tempest-TestMinimumBasicScenario-716536904-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-819011-1-iscsi {{(pid=102992) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 23 19:40:25.811470 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Tue, 23 Nov 2021 19:40:25 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-9655f623-09e0-4692-b528-523ebdc48ce4 x-openstack-request-id: req-9655f623-09e0-4692-b528-523ebdc48ce4 {{(pid=102992) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 23 19:40:25.811871 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "b5fed716-ff16-48c0-8e89-95731739f55c", "tag": "733eac81-0446-4e4c-b1d5-b8c491dcbeb4", "status": "completed", "code": 200}]} {{(pid=102992) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 23 19:40:25.812234 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.62/compute/v2.1/os-server-external-events used request id req-9655f623-09e0-4692-b528-523ebdc48ce4 {{(pid=102992) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 23 19:40:25.812748 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'b5fed716-ff16-48c0-8e89-95731739f55c', 'tag': '733eac81-0446-4e4c-b1d5-b8c491dcbeb4', 'status': 'completed', 'code': 200} Nov 23 19:40:25.831532 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-79e3280f-7edf-46b0-8b95-2e5b83a9d949 tempest-TestMinimumBasicScenario-716536904 tempest-TestMinimumBasicScenario-716536904-project] Publish callbacks [] for security_group, before_delete {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:40:25.866603 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.plugins.ml2.db [None req-4bf48ff4-ecfb-4168-8b63-249b8c6e9f04 None None] get_ports_and_sgs() called for port_ids ['733eac81-0446-4e4c-b1d5-b8c491dcbeb4'] {{(pid=102994) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 23 19:40:25.911300 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-79e3280f-7edf-46b0-8b95-2e5b83a9d949 tempest-TestMinimumBasicScenario-716536904 tempest-TestMinimumBasicScenario-716536904-project] Publish callbacks [] for security_group, precommit_delete {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:40:25.979494 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-74db5b7a-e4f5-4c98-834a-9543329261b8 req-237d6e71-3ab0-4233-8a4f-463998b7d5dc tempest-AttachVolumeShelveTestJSON-1172915835 tempest-AttachVolumeShelveTestJSON-1172915835-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102993) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:40:25.983404 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-74db5b7a-e4f5-4c98-834a-9543329261b8 req-237d6e71-3ab0-4233-8a4f-463998b7d5dc tempest-AttachVolumeShelveTestJSON-1172915835 tempest-AttachVolumeShelveTestJSON-1172915835-project] 10.222.0.62 "GET /v2.0/ports?device_id=627eaac3-8c43-4aa3-a81c-7a6bfb58dbb5 HTTP/1.1" status: 200 len: 947 time: 0.1638594 Nov 23 19:40:25.983683 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-331e45b1-3d22-4929-a0be-ae324bf1419d req-3dc5efe3-c8fb-41ab-991c-6ae8848308f9 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102993) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:40:25.985498 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-331e45b1-3d22-4929-a0be-ae324bf1419d req-3dc5efe3-c8fb-41ab-991c-6ae8848308f9 service neutron] 10.222.0.41 "GET /v2.0/ports?tenant_id=ed0d906c96b540a7b11d508615543890&device_id=b5fed716-ff16-48c0-8e89-95731739f55c HTTP/1.1" status: 200 len: 1098 time: 0.1425014 Nov 23 19:40:26.061071 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.db.provisioning_blocks [None req-87773fff-bd1f-43ab-b785-2ae6eed2a3e3 None None] Provisioning complete for port 733eac81-0446-4e4c-b1d5-b8c491dcbeb4 triggered by entity DHCP. {{(pid=102994) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 23 19:40:26.061375 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron_lib.callbacks.manager [None req-87773fff-bd1f-43ab-b785-2ae6eed2a3e3 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-8355713'] for port, provisioning_complete {{(pid=102994) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:40:26.096754 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-74db5b7a-e4f5-4c98-834a-9543329261b8 req-4c8d8957-53c9-499d-9f87-569a74fb7e4e tempest-AttachVolumeShelveTestJSON-1172915835 tempest-AttachVolumeShelveTestJSON-1172915835-project] 10.222.0.62 "GET /v2.0/security-groups?id=a246a431-7eb4-441f-b1e6-9c9c351ee888&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1037419 Nov 23 19:40:26.117002 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-331e45b1-3d22-4929-a0be-ae324bf1419d req-2bc2ad98-44ef-4dc7-a34d-3def921858de service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102993) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:40:26.118523 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-331e45b1-3d22-4929-a0be-ae324bf1419d req-2bc2ad98-44ef-4dc7-a34d-3def921858de service neutron] 10.222.0.41 "GET /v2.0/networks?id=96f89427-8150-464f-a280-f07cf823b4fd HTTP/1.1" status: 200 len: 915 time: 0.1183186 Nov 23 19:40:26.165912 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-79e3280f-7edf-46b0-8b95-2e5b83a9d949 tempest-TestMinimumBasicScenario-716536904 tempest-TestMinimumBasicScenario-716536904-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-623933'] for security_group, after_delete {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:40:26.169464 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-79e3280f-7edf-46b0-8b95-2e5b83a9d949 tempest-TestMinimumBasicScenario-716536904 tempest-TestMinimumBasicScenario-716536904-project] Publish callbacks [] for security_group, before_response {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:40:26.170866 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [None req-79e3280f-7edf-46b0-8b95-2e5b83a9d949 tempest-TestMinimumBasicScenario-716536904 tempest-TestMinimumBasicScenario-716536904-project] 10.222.0.62 "DELETE /v2.0/security-groups/04706b6c-202a-4225-af46-0d450ab58a7b HTTP/1.1" status: 204 len: 168 time: 0.4360635 Nov 23 19:40:26.173742 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.wsgi [-] (102992) accepted ('10.222.0.62', 50016) {{(pid=102992) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 23 19:40:26.188451 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-79e3280f-7edf-46b0-8b95-2e5b83a9d949 tempest-TestMinimumBasicScenario-716536904 tempest-TestMinimumBasicScenario-716536904-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=04706b6c-202a-4225-af46-0d450ab58a7b,revision_number=None']} {{(pid=102993) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 23 19:40:26.204888 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-331e45b1-3d22-4929-a0be-ae324bf1419d req-814122e6-cac9-425a-b415-13bad258cc23 service neutron] 10.222.0.41 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.7&port_id=733eac81-0446-4e4c-b1d5-b8c491dcbeb4 HTTP/1.1" status: 200 len: 1001 time: 0.0766315 Nov 23 19:40:26.260038 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-331e45b1-3d22-4929-a0be-ae324bf1419d req-7730d38b-b0a3-4f5f-bdf3-d82471cf3e56 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102993) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:40:26.262230 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-331e45b1-3d22-4929-a0be-ae324bf1419d req-7730d38b-b0a3-4f5f-bdf3-d82471cf3e56 service neutron] 10.222.0.41 "GET /v2.0/subnets?id=bfa70c12-21c8-4b7f-8a30-da7ff37b80b8 HTTP/1.1" status: 200 len: 853 time: 0.0482523 Nov 23 19:40:26.309766 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-331e45b1-3d22-4929-a0be-ae324bf1419d req-2629d9ad-8003-4216-9e23-b7c7b22bbea2 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102993) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:40:26.311258 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-331e45b1-3d22-4929-a0be-ae324bf1419d req-2629d9ad-8003-4216-9e23-b7c7b22bbea2 service neutron] 10.222.0.41 "GET /v2.0/ports?network_id=96f89427-8150-464f-a280-f07cf823b4fd&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0407894 Nov 23 19:40:26.328503 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d56cf9ca-460b-44fb-b535-6ef2b6ba0e14 req-c0cc658e-31cb-4277-a257-80ec7ab53400 tempest-AttachVolumeTestJSON-1120920040 tempest-AttachVolumeTestJSON-1120920040-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102992) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:40:26.329993 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-d56cf9ca-460b-44fb-b535-6ef2b6ba0e14 req-c0cc658e-31cb-4277-a257-80ec7ab53400 tempest-AttachVolumeTestJSON-1120920040 tempest-AttachVolumeTestJSON-1120920040-project] 10.222.0.62 "GET /v2.0/ports?device_id=029fedce-3168-4d1d-992e-a9466fe3e886 HTTP/1.1" status: 200 len: 945 time: 0.1072168 Nov 23 19:40:26.407348 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-331e45b1-3d22-4929-a0be-ae324bf1419d req-53a12f29-306a-4f19-bd31-deab1ffca0e1 service neutron] 10.222.0.41 "GET /v2.0/networks/96f89427-8150-464f-a280-f07cf823b4fd?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0865414 Nov 23 19:40:26.407623 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-d56cf9ca-460b-44fb-b535-6ef2b6ba0e14 req-e929315b-26a6-4504-a675-35b8d4cfb9a6 tempest-AttachVolumeTestJSON-1120920040 tempest-AttachVolumeTestJSON-1120920040-project] 10.222.0.62 "GET /v2.0/security-groups?id=f8cf4027-ad94-4b78-b429-c3f2d7f9d324&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0709357 Nov 23 19:40:26.422153 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.plugins.ml2.plugin [None req-32f1c7e7-4e2d-41c7-8f41-4b0fce0fb1d2 tempest-TestMinimumBasicScenario-716536904 tempest-TestMinimumBasicScenario-716536904-project] Deleting port 11671f81-d3a8-4a70-aab9-e1bd9607a27a {{(pid=102992) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 23 19:40:26.422494 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [None req-32f1c7e7-4e2d-41c7-8f41-4b0fce0fb1d2 tempest-TestMinimumBasicScenario-716536904 tempest-TestMinimumBasicScenario-716536904-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8783631423070'] for port, before_delete {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:40:26.503982 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [None req-32f1c7e7-4e2d-41c7-8f41-4b0fce0fb1d2 tempest-TestMinimumBasicScenario-716536904 tempest-TestMinimumBasicScenario-716536904-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-927332'] for port, precommit_delete {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:40:26.504311 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [None req-32f1c7e7-4e2d-41c7-8f41-4b0fce0fb1d2 tempest-TestMinimumBasicScenario-716536904 tempest-TestMinimumBasicScenario-716536904-project] Publish callbacks [] for floatingip, precommit_delete {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:40:26.504805 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-331e45b1-3d22-4929-a0be-ae324bf1419d req-49f6e3f4-7d44-4bf0-a885-bd8dcd7bded7 service neutron] 10.222.0.41 "GET /v2.0/networks/96f89427-8150-464f-a280-f07cf823b4fd?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0876973 Nov 23 19:40:26.517124 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.plugins.ml2.plugin [None req-32f1c7e7-4e2d-41c7-8f41-4b0fce0fb1d2 tempest-TestMinimumBasicScenario-716536904 tempest-TestMinimumBasicScenario-716536904-project] Calling delete_port for 11671f81-d3a8-4a70-aab9-e1bd9607a27a owned by network:floatingip {{(pid=102992) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 23 19:40:26.740141 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [None req-32f1c7e7-4e2d-41c7-8f41-4b0fce0fb1d2 tempest-TestMinimumBasicScenario-716536904 tempest-TestMinimumBasicScenario-716536904-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7918660', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-15067', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560168', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8783631424624', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8783631008723', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-25199805'] for port, after_delete {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:40:26.770975 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-32f1c7e7-4e2d-41c7-8f41-4b0fce0fb1d2 tempest-TestMinimumBasicScenario-716536904 tempest-TestMinimumBasicScenario-716536904-project] Pushing event deleted for resources: {'Port': ['ID=11671f81-d3a8-4a70-aab9-e1bd9607a27a,revision_number=None']} {{(pid=102992) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 23 19:40:26.827451 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [None req-32f1c7e7-4e2d-41c7-8f41-4b0fce0fb1d2 tempest-TestMinimumBasicScenario-716536904 tempest-TestMinimumBasicScenario-716536904-project] Publish callbacks [] for floatingip, after_delete {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:40:26.827792 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.db.l3_db [None req-32f1c7e7-4e2d-41c7-8f41-4b0fce0fb1d2 tempest-TestMinimumBasicScenario-716536904 tempest-TestMinimumBasicScenario-716536904-project] Floating IP e1c3ef82-f958-4d03-8d87-5247ae26ec2a disassociated (deleted). External IP: 172.27.1.233, port: 733eac81-0446-4e4c-b1d5-b8c491dcbeb4. Nov 23 19:40:27.031535 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-32f1c7e7-4e2d-41c7-8f41-4b0fce0fb1d2 tempest-TestMinimumBasicScenario-716536904 tempest-TestMinimumBasicScenario-716536904-project] Router dea93f43-8b8f-439e-820e-4269a0926491 has already been hosted by L3 agent 1b20f2c4-70b6-43c3-b9bd-0062cc9e57ac {{(pid=102992) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 23 19:40:27.139753 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-32f1c7e7-4e2d-41c7-8f41-4b0fce0fb1d2 tempest-TestMinimumBasicScenario-716536904 tempest-TestMinimumBasicScenario-716536904-project] Notify agent at l3_agent.dv-cinder-819011-1-iscsi the message routers_updated {{(pid=102992) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 23 19:40:27.144389 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [None req-32f1c7e7-4e2d-41c7-8f41-4b0fce0fb1d2 tempest-TestMinimumBasicScenario-716536904 tempest-TestMinimumBasicScenario-716536904-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-514902'] for floatingip, before_response {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:40:27.150280 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-19492be7-e46f-476d-922a-adc114431245 None None] Sync routers for ids ['dea93f43-8b8f-439e-820e-4269a0926491'] in dv-cinder-819011-1-iscsi {{(pid=102994) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 23 19:40:27.161490 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.db.l3_dvrscheduler_db [None req-19492be7-e46f-476d-922a-adc114431245 None None] Routers {'dea93f43-8b8f-439e-820e-4269a0926491'} bound to L3 agent in host dv-cinder-819011-1-iscsi {{(pid=102994) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 23 19:40:27.162431 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.db.l3_hamode_db [None req-19492be7-e46f-476d-922a-adc114431245 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-819011-1-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 9, "extensions": [], "floating_ips": 5, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 9, "log_agent_heartbeats": false, "routers": 9},created_at=2021-11-23T19:25:14Z,description=,heartbeat_timestamp=2021-11-23T19:40:14Z,host='dv-cinder-819011-1-iscsi',id=1b20f2c4-70b6-43c3-b9bd-0062cc9e57ac,load=0,resource_versions=,resources_synced=,started_at=2021-11-23T19:25:15Z,topic='l3_agent')) {'router_ids': ['dea93f43-8b8f-439e-820e-4269a0926491'], 'active': True} {{(pid=102994) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 23 19:40:27.173317 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [None req-32f1c7e7-4e2d-41c7-8f41-4b0fce0fb1d2 tempest-TestMinimumBasicScenario-716536904 tempest-TestMinimumBasicScenario-716536904-project] 10.222.0.62 "DELETE /v2.0/floatingips/e1c3ef82-f958-4d03-8d87-5247ae26ec2a HTTP/1.1" status: 204 len: 168 time: 0.9984441 Nov 23 19:40:27.242998 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6ef831f4-c2e0-49dd-acd1-2c627820cd67 req-2df41437-2201-4613-bb79-9aa2ff725510 tempest-AttachVolumeShelveTestJSON-1172915835 tempest-AttachVolumeShelveTestJSON-1172915835-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102993) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:40:27.244615 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-6ef831f4-c2e0-49dd-acd1-2c627820cd67 req-2df41437-2201-4613-bb79-9aa2ff725510 tempest-AttachVolumeShelveTestJSON-1172915835 tempest-AttachVolumeShelveTestJSON-1172915835-project] 10.222.0.62 "GET /v2.0/ports?device_id=627eaac3-8c43-4aa3-a81c-7a6bfb58dbb5 HTTP/1.1" status: 200 len: 947 time: 0.0717993 Nov 23 19:40:27.300202 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-6ef831f4-c2e0-49dd-acd1-2c627820cd67 req-61aa95eb-d395-4db1-8950-cac8efbec736 tempest-AttachVolumeShelveTestJSON-1172915835 tempest-AttachVolumeShelveTestJSON-1172915835-project] 10.222.0.62 "GET /v2.0/security-groups?id=a246a431-7eb4-441f-b1e6-9c9c351ee888&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0457468 Nov 23 19:40:27.410644 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.db.l3_dvr_db [None req-19492be7-e46f-476d-922a-adc114431245 None None] Set router dea93f43-8b8f-439e-820e-4269a0926491 gateway port host: dv-cinder-819011-1-iscsi {{(pid=102994) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 23 19:40:27.532372 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6e889f5c-d815-4153-8120-b89ea7631328 req-747e2853-579c-48b9-b545-6fe0f532397f tempest-AttachVolumeTestJSON-1120920040 tempest-AttachVolumeTestJSON-1120920040-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102993) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:40:27.534491 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-6e889f5c-d815-4153-8120-b89ea7631328 req-747e2853-579c-48b9-b545-6fe0f532397f tempest-AttachVolumeTestJSON-1120920040 tempest-AttachVolumeTestJSON-1120920040-project] 10.222.0.62 "GET /v2.0/ports?device_id=029fedce-3168-4d1d-992e-a9466fe3e886 HTTP/1.1" status: 200 len: 945 time: 0.0518873 Nov 23 19:40:27.584972 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-6e889f5c-d815-4153-8120-b89ea7631328 req-3038b452-d712-4c1d-94ef-c6d2c7b528cd tempest-AttachVolumeTestJSON-1120920040 tempest-AttachVolumeTestJSON-1120920040-project] 10.222.0.62 "GET /v2.0/security-groups?id=f8cf4027-ad94-4b78-b429-c3f2d7f9d324&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0442488 Nov 23 19:40:27.623290 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.db.l3_hamode_db [None req-19492be7-e46f-476d-922a-adc114431245 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'dea93f43-8b8f-439e-820e-4269a0926491', 'name': 'tempest-TestMinimumBasicScenario-387750355-router', 'tenant_id': 'ed0d906c96b540a7b11d508615543890', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'a93e254e-aac9-4233-9e4d-4290fd0458e4', 'external_fixed_ips': [{'subnet_id': 'e0b32f3d-83d6-439a-bbed-01df7cf01051', 'ip_address': '172.27.1.102'}], 'enable_snat': True}, 'gw_port_id': '80f6861a-4aab-4ba4-a058-5c03b253434a', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-23T19:37:47Z', 'updated_at': '2021-11-23T19:37:50Z', 'revision_number': 4, 'project_id': 'ed0d906c96b540a7b11d508615543890', 'gw_port': {'id': '80f6861a-4aab-4ba4-a058-5c03b253434a', 'name': '', 'network_id': 'a93e254e-aac9-4233-9e4d-4290fd0458e4', 'tenant_id': '', 'mac_address': 'fa:16:3e:d4:39:b5', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'dea93f43-8b8f-439e-820e-4269a0926491', 'device_owner': 'network:router_gateway', 'standard_attr_id': 554, 'fixed_ips': [{'subnet_id': 'e0b32f3d-83d6-439a-bbed-01df7cf01051', 'ip_address': '172.27.1.102', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-819011-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-23T19:37:48Z', 'updated_at': '2021-11-23T19:37:52Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'e0b32f3d-83d6-439a-bbed-01df7cf01051', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-819011-1-iscsi', '_interfaces': [{'id': '35d7927f-9541-4e91-b520-51ae3ab623f1', 'name': '', 'network_id': '96f89427-8150-464f-a280-f07cf823b4fd', 'tenant_id': 'ed0d906c96b540a7b11d508615543890', 'mac_address': 'fa:16:3e:00:20:e6', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'dea93f43-8b8f-439e-820e-4269a0926491', 'device_owner': 'network:router_interface', 'standard_attr_id': 555, 'fixed_ips': [{'subnet_id': 'bfa70c12-21c8-4b7f-8a30-da7ff37b80b8', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-819011-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-23T19:37:50Z', 'updated_at': '2021-11-23T19:37:54Z', 'revision_number': 5, 'project_id': 'ed0d906c96b540a7b11d508615543890', 'subnets': [{'id': 'bfa70c12-21c8-4b7f-8a30-da7ff37b80b8', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-819011-1-iscsi', False) {} {{(pid=102994) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 23 19:40:27.653499 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-19492be7-e46f-476d-922a-adc114431245 None None] Checking router: dea93f43-8b8f-439e-820e-4269a0926491 for host: dv-cinder-819011-1-iscsi {{(pid=102994) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 23 19:40:27.661883 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.db.l3_dvrscheduler_db [None req-19492be7-e46f-476d-922a-adc114431245 None None] Routers {'dea93f43-8b8f-439e-820e-4269a0926491'} bound to L3 agent in host dv-cinder-819011-1-iscsi {{(pid=102994) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 23 19:40:27.662489 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.db.l3_hamode_db [None req-19492be7-e46f-476d-922a-adc114431245 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-819011-1-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 9, "extensions": [], "floating_ips": 5, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 9, "log_agent_heartbeats": false, "routers": 9},created_at=2021-11-23T19:25:14Z,description=,heartbeat_timestamp=2021-11-23T19:40:14Z,host='dv-cinder-819011-1-iscsi',id=1b20f2c4-70b6-43c3-b9bd-0062cc9e57ac,load=0,resource_versions=,resources_synced=,started_at=2021-11-23T19:25:15Z,topic='l3_agent')) {'router_ids': ['dea93f43-8b8f-439e-820e-4269a0926491'], 'active': True} {{(pid=102994) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 23 19:40:27.767032 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.db.l3_dvr_db [None req-19492be7-e46f-476d-922a-adc114431245 None None] Set router dea93f43-8b8f-439e-820e-4269a0926491 gateway port host: dv-cinder-819011-1-iscsi {{(pid=102994) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 23 19:40:27.813614 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'b5fed716-ff16-48c0-8e89-95731739f55c', 'tag': '733eac81-0446-4e4c-b1d5-b8c491dcbeb4'}] {{(pid=102992) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 23 19:40:27.816227 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.62/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}f86c332b591ae691ababa4b64e0601cbf242a448242f95367ce03daabfb7e1ce" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-cfd45f43-ccb0-4619-93d1-743a5ab84901" -d '{"events": [{"name": "network-changed", "server_uuid": "b5fed716-ff16-48c0-8e89-95731739f55c", "tag": "733eac81-0446-4e4c-b1d5-b8c491dcbeb4"}]}' {{(pid=102992) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 23 19:40:27.851411 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Tue, 23 Nov 2021 19:40:27 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-d19a7044-4363-4ae2-a8b6-8a93a1c4e894 x-openstack-request-id: req-d19a7044-4363-4ae2-a8b6-8a93a1c4e894 {{(pid=102992) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 23 19:40:27.851705 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "b5fed716-ff16-48c0-8e89-95731739f55c", "tag": "733eac81-0446-4e4c-b1d5-b8c491dcbeb4", "status": "completed", "code": 200}]} {{(pid=102992) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 23 19:40:27.851962 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.62/compute/v2.1/os-server-external-events used request id req-d19a7044-4363-4ae2-a8b6-8a93a1c4e894 {{(pid=102992) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 23 19:40:27.852364 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'b5fed716-ff16-48c0-8e89-95731739f55c', 'tag': '733eac81-0446-4e4c-b1d5-b8c491dcbeb4', 'status': 'completed', 'code': 200} Nov 23 19:40:27.954836 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cfd45f43-ccb0-4619-93d1-743a5ab84901 req-a5ef292c-8ffe-4986-8456-38e4d663bda1 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102993) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:40:27.956497 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-cfd45f43-ccb0-4619-93d1-743a5ab84901 req-a5ef292c-8ffe-4986-8456-38e4d663bda1 service neutron] 10.222.0.41 "GET /v2.0/ports?tenant_id=ed0d906c96b540a7b11d508615543890&device_id=b5fed716-ff16-48c0-8e89-95731739f55c HTTP/1.1" status: 200 len: 1098 time: 0.0432382 Nov 23 19:40:27.970130 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.db.l3_hamode_db [None req-19492be7-e46f-476d-922a-adc114431245 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'dea93f43-8b8f-439e-820e-4269a0926491', 'name': 'tempest-TestMinimumBasicScenario-387750355-router', 'tenant_id': 'ed0d906c96b540a7b11d508615543890', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'a93e254e-aac9-4233-9e4d-4290fd0458e4', 'external_fixed_ips': [{'subnet_id': 'e0b32f3d-83d6-439a-bbed-01df7cf01051', 'ip_address': '172.27.1.102'}], 'enable_snat': True}, 'gw_port_id': '80f6861a-4aab-4ba4-a058-5c03b253434a', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-23T19:37:47Z', 'updated_at': '2021-11-23T19:37:50Z', 'revision_number': 4, 'project_id': 'ed0d906c96b540a7b11d508615543890', 'gw_port': {'id': '80f6861a-4aab-4ba4-a058-5c03b253434a', 'name': '', 'network_id': 'a93e254e-aac9-4233-9e4d-4290fd0458e4', 'tenant_id': '', 'mac_address': 'fa:16:3e:d4:39:b5', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'dea93f43-8b8f-439e-820e-4269a0926491', 'device_owner': 'network:router_gateway', 'standard_attr_id': 554, 'fixed_ips': [{'subnet_id': 'e0b32f3d-83d6-439a-bbed-01df7cf01051', 'ip_address': '172.27.1.102', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-819011-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-23T19:37:48Z', 'updated_at': '2021-11-23T19:37:52Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'e0b32f3d-83d6-439a-bbed-01df7cf01051', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-819011-1-iscsi', '_interfaces': [{'id': '35d7927f-9541-4e91-b520-51ae3ab623f1', 'name': '', 'network_id': '96f89427-8150-464f-a280-f07cf823b4fd', 'tenant_id': 'ed0d906c96b540a7b11d508615543890', 'mac_address': 'fa:16:3e:00:20:e6', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'dea93f43-8b8f-439e-820e-4269a0926491', 'device_owner': 'network:router_interface', 'standard_attr_id': 555, 'fixed_ips': [{'subnet_id': 'bfa70c12-21c8-4b7f-8a30-da7ff37b80b8', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-819011-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-23T19:37:50Z', 'updated_at': '2021-11-23T19:37:54Z', 'revision_number': 5, 'project_id': 'ed0d906c96b540a7b11d508615543890', 'subnets': [{'id': 'bfa70c12-21c8-4b7f-8a30-da7ff37b80b8', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-819011-1-iscsi', False) {} {{(pid=102994) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 23 19:40:27.996387 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-19492be7-e46f-476d-922a-adc114431245 None None] The sync data for ids ['dea93f43-8b8f-439e-820e-4269a0926491'] in dv-cinder-819011-1-iscsi is: [{'id': 'dea93f43-8b8f-439e-820e-4269a0926491', 'name': 'tempest-TestMinimumBasicScenario-387750355-router', 'tenant_id': 'ed0d906c96b540a7b11d508615543890', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'a93e254e-aac9-4233-9e4d-4290fd0458e4', 'external_fixed_ips': [{'subnet_id': 'e0b32f3d-83d6-439a-bbed-01df7cf01051', 'ip_address': '172.27.1.102'}], 'enable_snat': True}, 'gw_port_id': '80f6861a-4aab-4ba4-a058-5c03b253434a', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-23T19:37:47Z', 'updated_at': '2021-11-23T19:37:50Z', 'revision_number': 4, 'project_id': 'ed0d906c96b540a7b11d508615543890', 'gw_port': {'id': '80f6861a-4aab-4ba4-a058-5c03b253434a', 'name': '', 'network_id': 'a93e254e-aac9-4233-9e4d-4290fd0458e4', 'tenant_id': '', 'mac_address': 'fa:16:3e:d4:39:b5', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'dea93f43-8b8f-439e-820e-4269a0926491', 'device_owner': 'network:router_gateway', 'standard_attr_id': 554, 'fixed_ips': [{'subnet_id': 'e0b32f3d-83d6-439a-bbed-01df7cf01051', 'ip_address': '172.27.1.102', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-819011-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-23T19:37:48Z', 'updated_at': '2021-11-23T19:37:52Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'e0b32f3d-83d6-439a-bbed-01df7cf01051', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-819011-1-iscsi', '_interfaces': [{'id': '35d7927f-9541-4e91-b520-51ae3ab623f1', 'name': '', 'network_id': '96f89427-8150-464f-a280-f07cf823b4fd', 'tenant_id': 'ed0d906c96b540a7b11d508615543890', 'mac_address': 'fa:16:3e:00:20:e6', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'dea93f43-8b8f-439e-820e-4269a0926491', 'device_owner': 'network:router_interface', 'standard_attr_id': 555, 'fixed_ips': [{'subnet_id': 'bfa70c12-21c8-4b7f-8a30-da7ff37b80b8', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-819011-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-23T19:37:50Z', 'updated_at': '2021-11-23T19:37:54Z', 'revision_number': 5, 'project_id': 'ed0d906c96b540a7b11d508615543890', 'subnets': [{'id': 'bfa70c12-21c8-4b7f-8a30-da7ff37b80b8', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=102994) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 23 19:40:28.061193 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cfd45f43-ccb0-4619-93d1-743a5ab84901 req-7dfdabca-313b-4285-bdf7-779ee66259f6 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102993) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:40:28.062616 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-cfd45f43-ccb0-4619-93d1-743a5ab84901 req-7dfdabca-313b-4285-bdf7-779ee66259f6 service neutron] 10.222.0.41 "GET /v2.0/networks?id=96f89427-8150-464f-a280-f07cf823b4fd HTTP/1.1" status: 200 len: 915 time: 0.0918069 Nov 23 19:40:28.116084 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-cfd45f43-ccb0-4619-93d1-743a5ab84901 req-00c3e7dc-ec01-4959-9982-a20b15ea3f81 service neutron] 10.222.0.41 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.7&port_id=733eac81-0446-4e4c-b1d5-b8c491dcbeb4 HTTP/1.1" status: 200 len: 217 time: 0.0393550 Nov 23 19:40:28.181715 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cfd45f43-ccb0-4619-93d1-743a5ab84901 req-e6cecb53-3063-45f3-a264-9c3920f8634e service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102993) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:40:28.184502 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-cfd45f43-ccb0-4619-93d1-743a5ab84901 req-e6cecb53-3063-45f3-a264-9c3920f8634e service neutron] 10.222.0.41 "GET /v2.0/subnets?id=bfa70c12-21c8-4b7f-8a30-da7ff37b80b8 HTTP/1.1" status: 200 len: 853 time: 0.0500054 Nov 23 19:40:28.220570 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-03ddb32f-0999-4c0a-9877-212c6716d3c3 req-7b5d29da-28d6-4675-8c76-118de540de9a service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102992) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:40:28.223464 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-03ddb32f-0999-4c0a-9877-212c6716d3c3 req-7b5d29da-28d6-4675-8c76-118de540de9a service neutron] 10.222.0.41 "GET /v2.0/ports?tenant_id=c9d53f0599374b679185cc73383b417c&device_id=029fedce-3168-4d1d-992e-a9466fe3e886 HTTP/1.1" status: 200 len: 1098 time: 0.0514593 Nov 23 19:40:28.240767 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cfd45f43-ccb0-4619-93d1-743a5ab84901 req-115b3bbb-28fc-4631-a5b4-336ca9f54d92 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102993) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:40:28.242495 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-cfd45f43-ccb0-4619-93d1-743a5ab84901 req-115b3bbb-28fc-4631-a5b4-336ca9f54d92 service neutron] 10.222.0.41 "GET /v2.0/ports?network_id=96f89427-8150-464f-a280-f07cf823b4fd&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0483956 Nov 23 19:40:28.246977 dv-cinder-819011-1-iscsi neutron-server[102995]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-5f8ac068-051c-40cf-a3dd-368a1953a088 None None] New status for floating IP e1c3ef82-f958-4d03-8d87-5247ae26ec2a: DOWN {{(pid=102995) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Nov 23 19:40:28.352281 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-03ddb32f-0999-4c0a-9877-212c6716d3c3 req-3ca79e48-64d8-4de3-a3a3-599deb084223 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102992) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:40:28.353864 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-03ddb32f-0999-4c0a-9877-212c6716d3c3 req-3ca79e48-64d8-4de3-a3a3-599deb084223 service neutron] 10.222.0.41 "GET /v2.0/networks?id=41fa5020-8aad-49ce-b2a6-39d87c9e6042 HTTP/1.1" status: 200 len: 912 time: 0.0911393 Nov 23 19:40:28.356182 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-cfd45f43-ccb0-4619-93d1-743a5ab84901 req-97fe4921-aeab-4344-a267-16c473684cdf service neutron] 10.222.0.41 "GET /v2.0/networks/96f89427-8150-464f-a280-f07cf823b4fd?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0938265 Nov 23 19:40:28.430099 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-03ddb32f-0999-4c0a-9877-212c6716d3c3 req-fb2bcef1-014a-4710-a2ca-39a6365461bb service neutron] 10.222.0.41 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.6&port_id=2872cb22-0134-49c4-b6d7-034ca4132327 HTTP/1.1" status: 200 len: 1001 time: 0.0629601 Nov 23 19:40:28.450823 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-cfd45f43-ccb0-4619-93d1-743a5ab84901 req-766c2291-8df1-4615-a4c3-7481b9d2301e service neutron] 10.222.0.41 "GET /v2.0/networks/96f89427-8150-464f-a280-f07cf823b4fd?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0826428 Nov 23 19:40:28.483309 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-03ddb32f-0999-4c0a-9877-212c6716d3c3 req-00efe135-36f0-46a6-8b39-60647e69bbbf service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102992) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:40:28.488032 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-03ddb32f-0999-4c0a-9877-212c6716d3c3 req-00efe135-36f0-46a6-8b39-60647e69bbbf service neutron] 10.222.0.41 "GET /v2.0/subnets?id=8f74a1ae-f892-4057-89a5-ca78a259b1bd HTTP/1.1" status: 200 len: 850 time: 0.0470662 Nov 23 19:40:28.536369 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-03ddb32f-0999-4c0a-9877-212c6716d3c3 req-e54051ad-7e89-49f1-8120-f38e6e312118 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102992) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:40:28.539913 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-03ddb32f-0999-4c0a-9877-212c6716d3c3 req-e54051ad-7e89-49f1-8120-f38e6e312118 service neutron] 10.222.0.41 "GET /v2.0/ports?network_id=41fa5020-8aad-49ce-b2a6-39d87c9e6042&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0404272 Nov 23 19:40:28.903892 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-03ddb32f-0999-4c0a-9877-212c6716d3c3 req-820ba458-e08f-40a5-a16b-b26dbc7e0852 service neutron] 10.222.0.41 "GET /v2.0/networks/41fa5020-8aad-49ce-b2a6-39d87c9e6042?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.3576927 Nov 23 19:40:28.911131 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-34676df7-6685-456a-83bb-3319928a568f req-51552538-60fc-4053-bacc-81019fd46ac8 tempest-AttachVolumeTestJSON-1120920040 tempest-AttachVolumeTestJSON-1120920040-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102992) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:40:28.912467 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-34676df7-6685-456a-83bb-3319928a568f req-51552538-60fc-4053-bacc-81019fd46ac8 tempest-AttachVolumeTestJSON-1120920040 tempest-AttachVolumeTestJSON-1120920040-project] 10.222.0.62 "GET /v2.0/ports?device_id=029fedce-3168-4d1d-992e-a9466fe3e886 HTTP/1.1" status: 200 len: 945 time: 0.0672941 Nov 23 19:40:29.012924 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-34676df7-6685-456a-83bb-3319928a568f req-ab3242d7-1ed5-48c4-84a4-04fbd7c4d323 tempest-AttachVolumeTestJSON-1120920040 tempest-AttachVolumeTestJSON-1120920040-project] 10.222.0.62 "GET /v2.0/security-groups?id=f8cf4027-ad94-4b78-b429-c3f2d7f9d324&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0911837 Nov 23 19:40:29.031969 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-03ddb32f-0999-4c0a-9877-212c6716d3c3 req-968a1f34-82d2-4aa8-81c5-91ac22e2fd3c service neutron] 10.222.0.41 "GET /v2.0/networks/41fa5020-8aad-49ce-b2a6-39d87c9e6042?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1177063 Nov 23 19:40:29.779113 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron_lib.callbacks.manager [None req-4bf48ff4-ecfb-4168-8b63-249b8c6e9f04 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8783631323329', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7978582'] for agent, after_update {{(pid=102994) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:40:30.127188 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3b86220f-8488-4495-973f-421048bf8254 req-05ec2978-bcf7-4051-8ef6-635246bc912a tempest-AttachVolumeTestJSON-1120920040 tempest-AttachVolumeTestJSON-1120920040-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102993) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:40:30.128603 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-3b86220f-8488-4495-973f-421048bf8254 req-05ec2978-bcf7-4051-8ef6-635246bc912a tempest-AttachVolumeTestJSON-1120920040 tempest-AttachVolumeTestJSON-1120920040-project] 10.222.0.62 "GET /v2.0/ports?device_id=029fedce-3168-4d1d-992e-a9466fe3e886 HTTP/1.1" status: 200 len: 945 time: 0.0492628 Nov 23 19:40:30.178894 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-3b86220f-8488-4495-973f-421048bf8254 req-2fa5a94d-d3b3-4055-b856-d48d436500ee tempest-AttachVolumeTestJSON-1120920040 tempest-AttachVolumeTestJSON-1120920040-project] 10.222.0.62 "GET /v2.0/security-groups?id=f8cf4027-ad94-4b78-b429-c3f2d7f9d324&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0442195 Nov 23 19:40:31.295394 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a31cffeb-afdc-4ea6-ac62-60dd9f00502c req-e4ddd616-a7cb-41c4-a31f-8c1c37891017 tempest-AttachVolumeTestJSON-1120920040 tempest-AttachVolumeTestJSON-1120920040-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102993) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:40:31.297017 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-a31cffeb-afdc-4ea6-ac62-60dd9f00502c req-e4ddd616-a7cb-41c4-a31f-8c1c37891017 tempest-AttachVolumeTestJSON-1120920040 tempest-AttachVolumeTestJSON-1120920040-project] 10.222.0.62 "GET /v2.0/ports?device_id=029fedce-3168-4d1d-992e-a9466fe3e886 HTTP/1.1" status: 200 len: 945 time: 0.0504122 Nov 23 19:40:31.341140 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7ffab3c9-a4dd-4cb2-9183-38ba522a227e req-411730f3-9269-48ff-a963-88b2c6124a21 tempest-TestMinimumBasicScenario-716536904 tempest-TestMinimumBasicScenario-716536904-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102992) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:40:31.343193 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-7ffab3c9-a4dd-4cb2-9183-38ba522a227e req-411730f3-9269-48ff-a963-88b2c6124a21 tempest-TestMinimumBasicScenario-716536904 tempest-TestMinimumBasicScenario-716536904-project] 10.222.0.62 "GET /v2.0/ports?device_id=b5fed716-ff16-48c0-8e89-95731739f55c HTTP/1.1" status: 200 len: 945 time: 0.0506575 Nov 23 19:40:31.344001 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-a31cffeb-afdc-4ea6-ac62-60dd9f00502c req-9d1d9247-d4e9-44b6-aa5f-c688fb69c413 tempest-AttachVolumeTestJSON-1120920040 tempest-AttachVolumeTestJSON-1120920040-project] 10.222.0.62 "GET /v2.0/security-groups?id=f8cf4027-ad94-4b78-b429-c3f2d7f9d324&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0412116 Nov 23 19:40:31.390248 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-7ffab3c9-a4dd-4cb2-9183-38ba522a227e req-af1e6b97-1f46-4ba2-907a-eab83c0e7076 tempest-TestMinimumBasicScenario-716536904 tempest-TestMinimumBasicScenario-716536904-project] 10.222.0.62 "GET /v2.0/security-groups?id=d09b4044-91d5-4432-9faa-4b7a40b1627d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0410564 Nov 23 19:40:32.457018 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e1b252d3-b93a-46be-abc2-879b33f7811e req-41bf9ae5-5876-41e5-8eb8-ff07bb82f172 tempest-AttachVolumeTestJSON-1120920040 tempest-AttachVolumeTestJSON-1120920040-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102993) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:40:32.458514 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-e1b252d3-b93a-46be-abc2-879b33f7811e req-41bf9ae5-5876-41e5-8eb8-ff07bb82f172 tempest-AttachVolumeTestJSON-1120920040 tempest-AttachVolumeTestJSON-1120920040-project] 10.222.0.62 "GET /v2.0/ports?device_id=029fedce-3168-4d1d-992e-a9466fe3e886 HTTP/1.1" status: 200 len: 945 time: 0.0485587 Nov 23 19:40:32.507497 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-e1b252d3-b93a-46be-abc2-879b33f7811e req-beb19c32-3303-4868-82e0-93ba2b8ffe6e tempest-AttachVolumeTestJSON-1120920040 tempest-AttachVolumeTestJSON-1120920040-project] 10.222.0.62 "GET /v2.0/security-groups?id=f8cf4027-ad94-4b78-b429-c3f2d7f9d324&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0431056 Nov 23 19:40:32.510957 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5a637795-083e-49d6-a80c-10f28d16a7bf req-363fe846-8f29-405b-904d-7f4d28b3ed37 tempest-TestMinimumBasicScenario-716536904 tempest-TestMinimumBasicScenario-716536904-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102992) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:40:32.512474 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-5a637795-083e-49d6-a80c-10f28d16a7bf req-363fe846-8f29-405b-904d-7f4d28b3ed37 tempest-TestMinimumBasicScenario-716536904 tempest-TestMinimumBasicScenario-716536904-project] 10.222.0.62 "GET /v2.0/ports?device_id=b5fed716-ff16-48c0-8e89-95731739f55c HTTP/1.1" status: 200 len: 945 time: 0.0526848 Nov 23 19:40:32.559248 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-5a637795-083e-49d6-a80c-10f28d16a7bf req-a1b6a9d5-a9aa-4f9d-b1b0-71d12c8f0655 tempest-TestMinimumBasicScenario-716536904 tempest-TestMinimumBasicScenario-716536904-project] 10.222.0.62 "GET /v2.0/security-groups?id=d09b4044-91d5-4432-9faa-4b7a40b1627d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0404212 Nov 23 19:40:33.366420 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a531f836-95e8-4daf-abf5-aff408bc9ddd req-90708237-63fd-4a8e-b3e2-9d379fe435a4 tempest-TestMinimumBasicScenario-716536904 tempest-TestMinimumBasicScenario-716536904-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102992) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:40:33.367854 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-a531f836-95e8-4daf-abf5-aff408bc9ddd req-90708237-63fd-4a8e-b3e2-9d379fe435a4 tempest-TestMinimumBasicScenario-716536904 tempest-TestMinimumBasicScenario-716536904-project] 10.222.0.41 "GET /v2.0/ports?device_id=b5fed716-ff16-48c0-8e89-95731739f55c HTTP/1.1" status: 200 len: 945 time: 0.0490162 Nov 23 19:40:33.460600 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.plugins.ml2.plugin [req-a531f836-95e8-4daf-abf5-aff408bc9ddd req-ee8bf77f-6acb-45d2-a6fc-aae47c66ddf2 tempest-TestMinimumBasicScenario-716536904 tempest-TestMinimumBasicScenario-716536904-project] Deleting port 733eac81-0446-4e4c-b1d5-b8c491dcbeb4 {{(pid=102992) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 23 19:40:33.460941 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [req-a531f836-95e8-4daf-abf5-aff408bc9ddd req-ee8bf77f-6acb-45d2-a6fc-aae47c66ddf2 tempest-TestMinimumBasicScenario-716536904 tempest-TestMinimumBasicScenario-716536904-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8783631423070'] for port, before_delete {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:40:33.551547 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.plugins.ml2.db [req-a531f836-95e8-4daf-abf5-aff408bc9ddd req-ee8bf77f-6acb-45d2-a6fc-aae47c66ddf2 tempest-TestMinimumBasicScenario-716536904 tempest-TestMinimumBasicScenario-716536904-project] For port 733eac81-0446-4e4c-b1d5-b8c491dcbeb4, host hv-cinder-81901, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81901',level=0,port_id=733eac81-0446-4e4c-b1d5-b8c491dcbeb4,segment=NetworkSegment(81f92f0c-ea8d-4880-af1c-e4418f898de3),segment_id=81f92f0c-ea8d-4880-af1c-e4418f898de3)] {{(pid=102992) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 23 19:40:33.552171 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [req-a531f836-95e8-4daf-abf5-aff408bc9ddd req-ee8bf77f-6acb-45d2-a6fc-aae47c66ddf2 tempest-TestMinimumBasicScenario-716536904 tempest-TestMinimumBasicScenario-716536904-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-927332'] for port, precommit_delete {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:40:33.565728 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.plugins.ml2.plugin [req-a531f836-95e8-4daf-abf5-aff408bc9ddd req-ee8bf77f-6acb-45d2-a6fc-aae47c66ddf2 tempest-TestMinimumBasicScenario-716536904 tempest-TestMinimumBasicScenario-716536904-project] Calling delete_port for 733eac81-0446-4e4c-b1d5-b8c491dcbeb4 owned by compute:nova {{(pid=102992) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 23 19:40:33.626979 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-db26ad6b-f38a-4f6c-b83f-814f32d6a5d9 req-5aec410c-719c-400f-b40f-7843abce1cfd tempest-AttachVolumeTestJSON-1120920040 tempest-AttachVolumeTestJSON-1120920040-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102993) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:40:33.628494 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-db26ad6b-f38a-4f6c-b83f-814f32d6a5d9 req-5aec410c-719c-400f-b40f-7843abce1cfd tempest-AttachVolumeTestJSON-1120920040 tempest-AttachVolumeTestJSON-1120920040-project] 10.222.0.62 "GET /v2.0/ports?device_id=029fedce-3168-4d1d-992e-a9466fe3e886 HTTP/1.1" status: 200 len: 945 time: 0.0537455 Nov 23 19:40:33.674533 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-db26ad6b-f38a-4f6c-b83f-814f32d6a5d9 req-070c76dd-4790-4c40-8562-823366cbf779 tempest-AttachVolumeTestJSON-1120920040 tempest-AttachVolumeTestJSON-1120920040-project] 10.222.0.62 "GET /v2.0/security-groups?id=f8cf4027-ad94-4b78-b429-c3f2d7f9d324&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0403628 Nov 23 19:40:33.689067 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a4f3ad1a-3b04-42c3-a7c0-ff4bd0470e19 req-555a9370-e9cd-4412-a514-366002a77a9f tempest-TestMinimumBasicScenario-716536904 tempest-TestMinimumBasicScenario-716536904-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102992) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:40:33.690862 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-a4f3ad1a-3b04-42c3-a7c0-ff4bd0470e19 req-555a9370-e9cd-4412-a514-366002a77a9f tempest-TestMinimumBasicScenario-716536904 tempest-TestMinimumBasicScenario-716536904-project] 10.222.0.62 "GET /v2.0/ports?device_id=b5fed716-ff16-48c0-8e89-95731739f55c HTTP/1.1" status: 200 len: 945 time: 0.0644917 Nov 23 19:40:33.765355 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-a4f3ad1a-3b04-42c3-a7c0-ff4bd0470e19 req-4b381682-5b39-4452-932c-e68c9dd73fe3 tempest-TestMinimumBasicScenario-716536904 tempest-TestMinimumBasicScenario-716536904-project] 10.222.0.62 "GET /v2.0/security-groups?id=d09b4044-91d5-4432-9faa-4b7a40b1627d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0563560 Nov 23 19:40:33.797066 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [req-a531f836-95e8-4daf-abf5-aff408bc9ddd req-ee8bf77f-6acb-45d2-a6fc-aae47c66ddf2 tempest-TestMinimumBasicScenario-716536904 tempest-TestMinimumBasicScenario-716536904-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7918660', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-15067', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560168', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8783631424624', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8783631008723', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-25199805'] for port, after_delete {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:40:33.812145 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.plugins.ml2.db [None req-4bf48ff4-ecfb-4168-8b63-249b8c6e9f04 None None] get_ports_and_sgs() called for port_ids ['733eac81-0446-4e4c-b1d5-b8c491dcbeb4'] {{(pid=102994) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 23 19:40:33.827818 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ee8bf77f-6acb-45d2-a6fc-aae47c66ddf2 tempest-TestMinimumBasicScenario-716536904 tempest-TestMinimumBasicScenario-716536904-project] Pushing event deleted for resources: {'Port': ['ID=733eac81-0446-4e4c-b1d5-b8c491dcbeb4,revision_number=None']} {{(pid=102992) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 23 19:40:33.871823 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.db.l3_dvrscheduler_db [req-a531f836-95e8-4daf-abf5-aff408bc9ddd req-ee8bf77f-6acb-45d2-a6fc-aae47c66ddf2 tempest-TestMinimumBasicScenario-716536904 tempest-TestMinimumBasicScenario-716536904-project] No DVR routers for this DVR port 733eac81-0446-4e4c-b1d5-b8c491dcbeb4 on host hv-cinder-81901 {{(pid=102992) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 23 19:40:33.875035 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [req-a531f836-95e8-4daf-abf5-aff408bc9ddd req-ee8bf77f-6acb-45d2-a6fc-aae47c66ddf2 tempest-TestMinimumBasicScenario-716536904 tempest-TestMinimumBasicScenario-716536904-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-514902'] for port, before_response {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:40:33.878446 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-a531f836-95e8-4daf-abf5-aff408bc9ddd req-ee8bf77f-6acb-45d2-a6fc-aae47c66ddf2 tempest-TestMinimumBasicScenario-716536904 tempest-TestMinimumBasicScenario-716536904-project] 10.222.0.41 "DELETE /v2.0/ports/733eac81-0446-4e4c-b1d5-b8c491dcbeb4 HTTP/1.1" status: 204 len: 173 time: 0.5035024 Nov 23 19:40:33.878932 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'b5fed716-ff16-48c0-8e89-95731739f55c', 'name': 'network-vif-deleted', 'tag': '733eac81-0446-4e4c-b1d5-b8c491dcbeb4'}] {{(pid=102992) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 23 19:40:33.881143 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.62/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}f86c332b591ae691ababa4b64e0601cbf242a448242f95367ce03daabfb7e1ce" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-e216b142-2b59-4260-a4ea-bdc8e8ce0815" -d '{"events": [{"server_uuid": "b5fed716-ff16-48c0-8e89-95731739f55c", "name": "network-vif-deleted", "tag": "733eac81-0446-4e4c-b1d5-b8c491dcbeb4"}]}' {{(pid=102992) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 23 19:40:33.916302 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 23 Nov 2021 19:40:33 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-7dc54910-712e-459c-b309-1b4e62385c62 x-openstack-request-id: req-7dc54910-712e-459c-b309-1b4e62385c62 {{(pid=102992) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 23 19:40:33.916598 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "b5fed716-ff16-48c0-8e89-95731739f55c", "name": "network-vif-deleted", "tag": "733eac81-0446-4e4c-b1d5-b8c491dcbeb4", "status": "completed", "code": 200}]} {{(pid=102992) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 23 19:40:33.916857 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.62/compute/v2.1/os-server-external-events used request id req-7dc54910-712e-459c-b309-1b4e62385c62 {{(pid=102992) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 23 19:40:33.917287 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'b5fed716-ff16-48c0-8e89-95731739f55c', 'name': 'network-vif-deleted', 'tag': '733eac81-0446-4e4c-b1d5-b8c491dcbeb4', 'status': 'completed', 'code': 200} Nov 23 19:40:34.790801 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bcd8962f-7be1-4e3d-80d6-0590882fa508 req-229cab05-e5fe-4003-87a9-829a142a9735 tempest-AttachVolumeTestJSON-1120920040 tempest-AttachVolumeTestJSON-1120920040-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102992) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:40:34.792216 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-bcd8962f-7be1-4e3d-80d6-0590882fa508 req-229cab05-e5fe-4003-87a9-829a142a9735 tempest-AttachVolumeTestJSON-1120920040 tempest-AttachVolumeTestJSON-1120920040-project] 10.222.0.62 "GET /v2.0/ports?device_id=029fedce-3168-4d1d-992e-a9466fe3e886 HTTP/1.1" status: 200 len: 945 time: 0.0488153 Nov 23 19:40:34.840781 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-bcd8962f-7be1-4e3d-80d6-0590882fa508 req-313c825b-373d-4f97-bde1-ba12b6da5c38 tempest-AttachVolumeTestJSON-1120920040 tempest-AttachVolumeTestJSON-1120920040-project] 10.222.0.62 "GET /v2.0/security-groups?id=f8cf4027-ad94-4b78-b429-c3f2d7f9d324&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0421088 Nov 23 19:40:35.961256 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d4a64d95-5469-490b-8569-c30340c2117d req-e6445992-07ed-4c27-9157-c446e4b13795 tempest-AttachVolumeTestJSON-1120920040 tempest-AttachVolumeTestJSON-1120920040-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102992) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:40:35.961256 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-d4a64d95-5469-490b-8569-c30340c2117d req-e6445992-07ed-4c27-9157-c446e4b13795 tempest-AttachVolumeTestJSON-1120920040 tempest-AttachVolumeTestJSON-1120920040-project] 10.222.0.62 "GET /v2.0/ports?device_id=029fedce-3168-4d1d-992e-a9466fe3e886 HTTP/1.1" status: 200 len: 945 time: 0.0524347 Nov 23 19:40:36.016206 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-d4a64d95-5469-490b-8569-c30340c2117d req-c3643fe7-7ad8-41ba-b1bd-745b4abdd337 tempest-AttachVolumeTestJSON-1120920040 tempest-AttachVolumeTestJSON-1120920040-project] 10.222.0.62 "GET /v2.0/security-groups?id=f8cf4027-ad94-4b78-b429-c3f2d7f9d324&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0494382 Nov 23 19:40:36.092079 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.wsgi [-] (102992) accepted ('10.222.0.62', 50114) {{(pid=102992) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 23 19:40:36.497862 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [None req-3f2c28ef-b524-4a2e-9ef7-8a058492b97b admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-932931'] for router_interface, before_delete {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:40:36.790433 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.plugins.ml2.rpc [None req-4bf48ff4-ecfb-4168-8b63-249b8c6e9f04 None None] Device 733eac81-0446-4e4c-b1d5-b8c491dcbeb4 no longer exists at agent hyperv_hv-cinder-81901 {{(pid=102994) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 23 19:40:36.801075 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.plugins.ml2.plugin [None req-3f2c28ef-b524-4a2e-9ef7-8a058492b97b admin admin] Deleting port 35d7927f-9541-4e91-b520-51ae3ab623f1 {{(pid=102992) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 23 19:40:36.801428 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [None req-3f2c28ef-b524-4a2e-9ef7-8a058492b97b admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8783631423070'] for port, before_delete {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:40:36.811771 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.plugins.ml2.plugin [None req-4bf48ff4-ecfb-4168-8b63-249b8c6e9f04 None None] No Port match for: 733eac81-0446-4e4c-b1d5-b8c491dcbeb4 {{(pid=102994) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 23 19:40:36.812558 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.plugins.ml2.rpc [None req-4bf48ff4-ecfb-4168-8b63-249b8c6e9f04 None None] Device 733eac81-0446-4e4c-b1d5-b8c491dcbeb4 not bound to the agent host hv-cinder-81901 {{(pid=102994) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 23 19:40:36.881475 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.plugins.ml2.db [None req-3f2c28ef-b524-4a2e-9ef7-8a058492b97b admin admin] For port 35d7927f-9541-4e91-b520-51ae3ab623f1, host dv-cinder-819011-1-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-819011-1-iscsi',level=0,port_id=35d7927f-9541-4e91-b520-51ae3ab623f1,segment=NetworkSegment(81f92f0c-ea8d-4880-af1c-e4418f898de3),segment_id=81f92f0c-ea8d-4880-af1c-e4418f898de3)] {{(pid=102992) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 23 19:40:36.881865 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [None req-3f2c28ef-b524-4a2e-9ef7-8a058492b97b admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-927332'] for port, precommit_delete {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:40:36.893834 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.plugins.ml2.plugin [None req-3f2c28ef-b524-4a2e-9ef7-8a058492b97b admin admin] Calling delete_port for 35d7927f-9541-4e91-b520-51ae3ab623f1 owned by network:router_interface {{(pid=102992) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 23 19:40:37.100232 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [None req-3f2c28ef-b524-4a2e-9ef7-8a058492b97b admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7918660', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-15067', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560168', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8783631424624', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8783631008723', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-25199805'] for port, after_delete {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:40:37.126371 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3f2c28ef-b524-4a2e-9ef7-8a058492b97b admin admin] Pushing event deleted for resources: {'Port': ['ID=35d7927f-9541-4e91-b520-51ae3ab623f1,revision_number=None']} {{(pid=102992) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 23 19:40:37.145549 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ad897597-8d2a-457c-aeb3-3de9d44fd12b req-ec25337f-bcfa-4a1d-a198-f6ed5f87df20 tempest-AttachVolumeTestJSON-1120920040 tempest-AttachVolumeTestJSON-1120920040-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102993) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:40:37.147893 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-ad897597-8d2a-457c-aeb3-3de9d44fd12b req-ec25337f-bcfa-4a1d-a198-f6ed5f87df20 tempest-AttachVolumeTestJSON-1120920040 tempest-AttachVolumeTestJSON-1120920040-project] 10.222.0.62 "GET /v2.0/ports?device_id=029fedce-3168-4d1d-992e-a9466fe3e886 HTTP/1.1" status: 200 len: 945 time: 0.0532417 Nov 23 19:40:37.215364 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-ad897597-8d2a-457c-aeb3-3de9d44fd12b req-02cca905-2f42-4348-a3e4-28e9fd4a3560 tempest-AttachVolumeTestJSON-1120920040 tempest-AttachVolumeTestJSON-1120920040-project] 10.222.0.62 "GET /v2.0/security-groups?id=f8cf4027-ad94-4b78-b429-c3f2d7f9d324&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0523551 Nov 23 19:40:37.307970 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [None req-3f2c28ef-b524-4a2e-9ef7-8a058492b97b admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-560161', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-933087'] for router_interface, after_delete {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:40:37.530469 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-3f2c28ef-b524-4a2e-9ef7-8a058492b97b admin admin] Router dea93f43-8b8f-439e-820e-4269a0926491 has already been hosted by L3 agent 1b20f2c4-70b6-43c3-b9bd-0062cc9e57ac {{(pid=102992) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 23 19:40:37.575495 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-197e70b0-c70c-493f-a2b6-d19a7aa56c09 req-a6aaf67f-bfeb-428c-af6d-a259f9ee0ca5 tempest-AttachVolumeTestJSON-1120920040 tempest-AttachVolumeTestJSON-1120920040-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102993) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:40:37.578216 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-197e70b0-c70c-493f-a2b6-d19a7aa56c09 req-a6aaf67f-bfeb-428c-af6d-a259f9ee0ca5 tempest-AttachVolumeTestJSON-1120920040 tempest-AttachVolumeTestJSON-1120920040-project] 10.222.0.62 "GET /v2.0/ports?device_id=029fedce-3168-4d1d-992e-a9466fe3e886 HTTP/1.1" status: 200 len: 945 time: 0.0534344 Nov 23 19:40:37.628473 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-197e70b0-c70c-493f-a2b6-d19a7aa56c09 req-f13d3fd3-2e0d-48fa-88c4-1c6e2e1bb2e4 tempest-AttachVolumeTestJSON-1120920040 tempest-AttachVolumeTestJSON-1120920040-project] 10.222.0.62 "GET /v2.0/security-groups?id=f8cf4027-ad94-4b78-b429-c3f2d7f9d324&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0439925 Nov 23 19:40:37.646141 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-3f2c28ef-b524-4a2e-9ef7-8a058492b97b admin admin] Notify agent at l3_agent.dv-cinder-819011-1-iscsi the message routers_updated {{(pid=102992) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 23 19:40:37.652581 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [None req-3f2c28ef-b524-4a2e-9ef7-8a058492b97b admin admin] 10.222.0.62 "PUT /v2.0/routers/dea93f43-8b8f-439e-820e-4269a0926491/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 1.5584307 Nov 23 19:40:37.654755 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.wsgi [-] (102992) accepted ('10.222.0.62', 50124) {{(pid=102992) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 23 19:40:37.656682 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-adbd4967-630f-41a3-85aa-eb7f1b340f28 None None] Sync routers for ids ['dea93f43-8b8f-439e-820e-4269a0926491'] in dv-cinder-819011-1-iscsi {{(pid=102994) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 23 19:40:37.666255 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.db.l3_dvrscheduler_db [None req-adbd4967-630f-41a3-85aa-eb7f1b340f28 None None] Routers {'dea93f43-8b8f-439e-820e-4269a0926491'} bound to L3 agent in host dv-cinder-819011-1-iscsi {{(pid=102994) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 23 19:40:37.667108 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.db.l3_hamode_db [None req-adbd4967-630f-41a3-85aa-eb7f1b340f28 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-819011-1-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 9, "extensions": [], "floating_ips": 5, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 9, "log_agent_heartbeats": false, "routers": 9},created_at=2021-11-23T19:25:14Z,description=,heartbeat_timestamp=2021-11-23T19:40:14Z,host='dv-cinder-819011-1-iscsi',id=1b20f2c4-70b6-43c3-b9bd-0062cc9e57ac,load=0,resource_versions=,resources_synced=,started_at=2021-11-23T19:25:15Z,topic='l3_agent')) {'router_ids': ['dea93f43-8b8f-439e-820e-4269a0926491'], 'active': True} {{(pid=102994) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 23 19:40:37.776392 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.db.l3_dvr_db [None req-adbd4967-630f-41a3-85aa-eb7f1b340f28 None None] Set router dea93f43-8b8f-439e-820e-4269a0926491 gateway port host: dv-cinder-819011-1-iscsi {{(pid=102994) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 23 19:40:37.968140 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.db.l3_hamode_db [None req-adbd4967-630f-41a3-85aa-eb7f1b340f28 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'dea93f43-8b8f-439e-820e-4269a0926491', 'name': 'tempest-TestMinimumBasicScenario-387750355-router', 'tenant_id': 'ed0d906c96b540a7b11d508615543890', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'a93e254e-aac9-4233-9e4d-4290fd0458e4', 'external_fixed_ips': [{'subnet_id': 'e0b32f3d-83d6-439a-bbed-01df7cf01051', 'ip_address': '172.27.1.102'}], 'enable_snat': True}, 'gw_port_id': '80f6861a-4aab-4ba4-a058-5c03b253434a', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-23T19:37:47Z', 'updated_at': '2021-11-23T19:40:37Z', 'revision_number': 5, 'project_id': 'ed0d906c96b540a7b11d508615543890', 'gw_port': {'id': '80f6861a-4aab-4ba4-a058-5c03b253434a', 'name': '', 'network_id': 'a93e254e-aac9-4233-9e4d-4290fd0458e4', 'tenant_id': '', 'mac_address': 'fa:16:3e:d4:39:b5', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'dea93f43-8b8f-439e-820e-4269a0926491', 'device_owner': 'network:router_gateway', 'standard_attr_id': 554, 'fixed_ips': [{'subnet_id': 'e0b32f3d-83d6-439a-bbed-01df7cf01051', 'ip_address': '172.27.1.102', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-819011-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-23T19:37:48Z', 'updated_at': '2021-11-23T19:37:52Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'e0b32f3d-83d6-439a-bbed-01df7cf01051', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-819011-1-iscsi'}], 'dv-cinder-819011-1-iscsi', False) {} {{(pid=102994) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 23 19:40:37.995383 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-adbd4967-630f-41a3-85aa-eb7f1b340f28 None None] Checking router: dea93f43-8b8f-439e-820e-4269a0926491 for host: dv-cinder-819011-1-iscsi {{(pid=102994) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 23 19:40:38.004515 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.db.l3_dvrscheduler_db [None req-adbd4967-630f-41a3-85aa-eb7f1b340f28 None None] Routers {'dea93f43-8b8f-439e-820e-4269a0926491'} bound to L3 agent in host dv-cinder-819011-1-iscsi {{(pid=102994) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 23 19:40:38.005144 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.db.l3_hamode_db [None req-adbd4967-630f-41a3-85aa-eb7f1b340f28 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-819011-1-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 9, "extensions": [], "floating_ips": 5, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 9, "log_agent_heartbeats": false, "routers": 9},created_at=2021-11-23T19:25:14Z,description=,heartbeat_timestamp=2021-11-23T19:40:14Z,host='dv-cinder-819011-1-iscsi',id=1b20f2c4-70b6-43c3-b9bd-0062cc9e57ac,load=0,resource_versions=,resources_synced=,started_at=2021-11-23T19:25:15Z,topic='l3_agent')) {'router_ids': ['dea93f43-8b8f-439e-820e-4269a0926491'], 'active': True} {{(pid=102994) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 23 19:40:38.006130 dv-cinder-819011-1-iscsi neutron-server[102995]: DEBUG neutron.db.agents_db [None req-84bdc9b2-57ea-4bdb-a245-07c78d37cea8 None None] Agent healthcheck: found 6 active agents {{(pid=102995) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 23 19:40:38.028729 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bc098204-509c-43cd-9fdf-b7b60ef34094 req-8cecf99c-bd3d-489a-9cdf-d2ae38488870 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102992) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:40:38.030729 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-bc098204-509c-43cd-9fdf-b7b60ef34094 req-8cecf99c-bd3d-489a-9cdf-d2ae38488870 service neutron] 10.222.0.41 "GET /v2.0/ports?tenant_id=c9d53f0599374b679185cc73383b417c&device_id=029fedce-3168-4d1d-992e-a9466fe3e886 HTTP/1.1" status: 200 len: 1098 time: 0.3368752 Nov 23 19:40:38.051651 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [None req-0d3f45c5-9c68-4214-8762-556c15b18bbd admin admin] Publish callbacks [] for router, before_delete {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:40:38.110612 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.db.l3_dvr_db [None req-adbd4967-630f-41a3-85aa-eb7f1b340f28 None None] Set router dea93f43-8b8f-439e-820e-4269a0926491 gateway port host: dv-cinder-819011-1-iscsi {{(pid=102994) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 23 19:40:38.206212 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bc098204-509c-43cd-9fdf-b7b60ef34094 req-2827721f-4c52-4ea7-99a2-9169a43928fa service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102992) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:40:38.207677 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-bc098204-509c-43cd-9fdf-b7b60ef34094 req-2827721f-4c52-4ea7-99a2-9169a43928fa service neutron] 10.222.0.41 "GET /v2.0/networks?id=41fa5020-8aad-49ce-b2a6-39d87c9e6042 HTTP/1.1" status: 200 len: 912 time: 0.1668599 Nov 23 19:40:38.224098 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [None req-0d3f45c5-9c68-4214-8762-556c15b18bbd admin admin] Publish callbacks [] for router_gateway, before_delete {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:40:38.283829 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-bc098204-509c-43cd-9fdf-b7b60ef34094 req-46e9aa9b-42e4-457a-939e-20b98db59056 service neutron] 10.222.0.41 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.6&port_id=2872cb22-0134-49c4-b6d7-034ca4132327 HTTP/1.1" status: 200 len: 1001 time: 0.0677788 Nov 23 19:40:38.299234 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.db.l3_hamode_db [None req-adbd4967-630f-41a3-85aa-eb7f1b340f28 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'dea93f43-8b8f-439e-820e-4269a0926491', 'name': 'tempest-TestMinimumBasicScenario-387750355-router', 'tenant_id': 'ed0d906c96b540a7b11d508615543890', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'a93e254e-aac9-4233-9e4d-4290fd0458e4', 'external_fixed_ips': [{'subnet_id': 'e0b32f3d-83d6-439a-bbed-01df7cf01051', 'ip_address': '172.27.1.102'}], 'enable_snat': True}, 'gw_port_id': '80f6861a-4aab-4ba4-a058-5c03b253434a', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-23T19:37:47Z', 'updated_at': '2021-11-23T19:40:37Z', 'revision_number': 5, 'project_id': 'ed0d906c96b540a7b11d508615543890', 'gw_port': {'id': '80f6861a-4aab-4ba4-a058-5c03b253434a', 'name': '', 'network_id': 'a93e254e-aac9-4233-9e4d-4290fd0458e4', 'tenant_id': '', 'mac_address': 'fa:16:3e:d4:39:b5', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'dea93f43-8b8f-439e-820e-4269a0926491', 'device_owner': 'network:router_gateway', 'standard_attr_id': 554, 'fixed_ips': [{'subnet_id': 'e0b32f3d-83d6-439a-bbed-01df7cf01051', 'ip_address': '172.27.1.102', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-819011-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-23T19:37:48Z', 'updated_at': '2021-11-23T19:37:52Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'e0b32f3d-83d6-439a-bbed-01df7cf01051', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-819011-1-iscsi'}], 'dv-cinder-819011-1-iscsi', False) {} {{(pid=102994) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 23 19:40:38.327835 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-adbd4967-630f-41a3-85aa-eb7f1b340f28 None None] The sync data for ids ['dea93f43-8b8f-439e-820e-4269a0926491'] in dv-cinder-819011-1-iscsi is: [{'id': 'dea93f43-8b8f-439e-820e-4269a0926491', 'name': 'tempest-TestMinimumBasicScenario-387750355-router', 'tenant_id': 'ed0d906c96b540a7b11d508615543890', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'a93e254e-aac9-4233-9e4d-4290fd0458e4', 'external_fixed_ips': [{'subnet_id': 'e0b32f3d-83d6-439a-bbed-01df7cf01051', 'ip_address': '172.27.1.102'}], 'enable_snat': True}, 'gw_port_id': '80f6861a-4aab-4ba4-a058-5c03b253434a', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-23T19:37:47Z', 'updated_at': '2021-11-23T19:40:37Z', 'revision_number': 5, 'project_id': 'ed0d906c96b540a7b11d508615543890', 'gw_port': {'id': '80f6861a-4aab-4ba4-a058-5c03b253434a', 'name': '', 'network_id': 'a93e254e-aac9-4233-9e4d-4290fd0458e4', 'tenant_id': '', 'mac_address': 'fa:16:3e:d4:39:b5', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'dea93f43-8b8f-439e-820e-4269a0926491', 'device_owner': 'network:router_gateway', 'standard_attr_id': 554, 'fixed_ips': [{'subnet_id': 'e0b32f3d-83d6-439a-bbed-01df7cf01051', 'ip_address': '172.27.1.102', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-819011-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-23T19:37:48Z', 'updated_at': '2021-11-23T19:37:52Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'e0b32f3d-83d6-439a-bbed-01df7cf01051', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-819011-1-iscsi'}] {{(pid=102994) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 23 19:40:38.355301 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bc098204-509c-43cd-9fdf-b7b60ef34094 req-19ff5c38-dc8c-4934-b5a5-8cbf74b2bf81 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102992) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:40:38.356742 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-bc098204-509c-43cd-9fdf-b7b60ef34094 req-19ff5c38-dc8c-4934-b5a5-8cbf74b2bf81 service neutron] 10.222.0.41 "GET /v2.0/subnets?id=8f74a1ae-f892-4057-89a5-ca78a259b1bd HTTP/1.1" status: 200 len: 850 time: 0.0652714 Nov 23 19:40:38.403741 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.plugins.ml2.plugin [None req-0d3f45c5-9c68-4214-8762-556c15b18bbd admin admin] Deleting port 80f6861a-4aab-4ba4-a058-5c03b253434a {{(pid=102992) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 23 19:40:38.404093 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [None req-0d3f45c5-9c68-4214-8762-556c15b18bbd admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8783631423070'] for port, before_delete {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:40:38.435032 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bc098204-509c-43cd-9fdf-b7b60ef34094 req-a09584bd-88ed-4ea2-a2f4-7d91b30ce9be service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102992) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:40:38.436659 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-bc098204-509c-43cd-9fdf-b7b60ef34094 req-a09584bd-88ed-4ea2-a2f4-7d91b30ce9be service neutron] 10.222.0.41 "GET /v2.0/ports?network_id=41fa5020-8aad-49ce-b2a6-39d87c9e6042&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0685024 Nov 23 19:40:38.549048 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.plugins.ml2.db [None req-0d3f45c5-9c68-4214-8762-556c15b18bbd admin admin] For port 80f6861a-4aab-4ba4-a058-5c03b253434a, host dv-cinder-819011-1-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-819011-1-iscsi',level=0,port_id=80f6861a-4aab-4ba4-a058-5c03b253434a,segment=NetworkSegment(3cb5e60b-103a-47d0-a28b-d68e3159d032),segment_id=3cb5e60b-103a-47d0-a28b-d68e3159d032)] {{(pid=102992) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 23 19:40:38.549446 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [None req-0d3f45c5-9c68-4214-8762-556c15b18bbd admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-927332'] for port, precommit_delete {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:40:38.561099 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fdd38171-ab9a-4b23-873b-7c205806d62e req-3a160fbb-71a5-4bc6-94be-fd50d253075a tempest-TestShelveInstance-292550524 tempest-TestShelveInstance-292550524-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102993) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:40:38.562740 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-fdd38171-ab9a-4b23-873b-7c205806d62e req-3a160fbb-71a5-4bc6-94be-fd50d253075a tempest-TestShelveInstance-292550524 tempest-TestShelveInstance-292550524-project] 10.222.0.62 "GET /v2.0/ports?device_id=b504cdb2-6182-4c24-9b46-6dc0f85da342 HTTP/1.1" status: 200 len: 946 time: 0.0498271 Nov 23 19:40:38.565375 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.plugins.ml2.plugin [None req-0d3f45c5-9c68-4214-8762-556c15b18bbd admin admin] Calling delete_port for 80f6861a-4aab-4ba4-a058-5c03b253434a owned by network:router_gateway {{(pid=102992) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 23 19:40:38.590631 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-bc098204-509c-43cd-9fdf-b7b60ef34094 req-0552c8c9-022d-4463-8dca-9fe9160cfe30 service neutron] 10.222.0.41 "GET /v2.0/networks/41fa5020-8aad-49ce-b2a6-39d87c9e6042?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1296761 Nov 23 19:40:38.621207 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-fdd38171-ab9a-4b23-873b-7c205806d62e req-e809e122-ab7f-4929-9376-761aa281f855 tempest-TestShelveInstance-292550524 tempest-TestShelveInstance-292550524-project] 10.222.0.62 "GET /v2.0/security-groups?id=7fe194e6-71c3-47a9-8f36-0dbb24d1f72d&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0447030 Nov 23 19:40:38.791978 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-bc098204-509c-43cd-9fdf-b7b60ef34094 req-ff8160a5-b38a-4e3d-8b30-34e9473511a5 service neutron] 10.222.0.41 "GET /v2.0/networks/41fa5020-8aad-49ce-b2a6-39d87c9e6042?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1744263 Nov 23 19:40:38.963103 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-98d9b543-14a5-4e76-a780-bd756efa404c req-95de660e-d8b1-4586-a581-835d061c3e23 tempest-AttachVolumeTestJSON-1120920040 tempest-AttachVolumeTestJSON-1120920040-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102992) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:40:38.963103 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-98d9b543-14a5-4e76-a780-bd756efa404c req-95de660e-d8b1-4586-a581-835d061c3e23 tempest-AttachVolumeTestJSON-1120920040 tempest-AttachVolumeTestJSON-1120920040-project] 10.222.0.62 "GET /v2.0/ports?device_id=029fedce-3168-4d1d-992e-a9466fe3e886 HTTP/1.1" status: 200 len: 945 time: 0.1159530 Nov 23 19:40:38.963103 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-98d9b543-14a5-4e76-a780-bd756efa404c req-b9ec29c8-b8a8-4881-a8e7-c5466ad0a342 tempest-AttachVolumeTestJSON-1120920040 tempest-AttachVolumeTestJSON-1120920040-project] 10.222.0.62 "GET /v2.0/security-groups?id=f8cf4027-ad94-4b78-b429-c3f2d7f9d324&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0574853 Nov 23 19:40:38.991295 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [None req-0d3f45c5-9c68-4214-8762-556c15b18bbd admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7918660', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-15067', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560168', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8783631424624', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8783631008723', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-25199805'] for port, after_delete {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:40:39.018351 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0d3f45c5-9c68-4214-8762-556c15b18bbd admin admin] Pushing event deleted for resources: {'Port': ['ID=80f6861a-4aab-4ba4-a058-5c03b253434a,revision_number=None']} {{(pid=102992) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 23 19:40:39.081714 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [None req-0d3f45c5-9c68-4214-8762-556c15b18bbd admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-926585'] for router_gateway, after_delete {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:40:39.168679 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [None req-0d3f45c5-9c68-4214-8762-556c15b18bbd admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-932919', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-13457'] for router, precommit_delete {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:40:39.171402 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [None req-0d3f45c5-9c68-4214-8762-556c15b18bbd admin admin] Publish callbacks [] for router_controller, precommit_delete_associations {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:40:39.288426 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [None req-0d3f45c5-9c68-4214-8762-556c15b18bbd admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-926715'] for router, after_delete {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:40:39.289091 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-0d3f45c5-9c68-4214-8762-556c15b18bbd admin admin] Fanout notify agent at l3_agent the message router_deleted on router dea93f43-8b8f-439e-820e-4269a0926491 {{(pid=102992) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Nov 23 19:40:39.293880 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [None req-0d3f45c5-9c68-4214-8762-556c15b18bbd admin admin] Publish callbacks [] for router, before_response {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:40:39.295018 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [None req-0d3f45c5-9c68-4214-8762-556c15b18bbd admin admin] 10.222.0.62 "DELETE /v2.0/routers/dea93f43-8b8f-439e-820e-4269a0926491 HTTP/1.1" status: 204 len: 168 time: 1.6392825 Nov 23 19:40:39.298543 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.wsgi [-] (102992) accepted ('10.222.0.62', 50132) {{(pid=102992) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 23 19:40:39.345627 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.db.db_base_plugin_v2 [None req-1e1c05cf-b0ba-4afa-b128-48915da45489 admin admin] Deleting subnet bfa70c12-21c8-4b7f-8a30-da7ff37b80b8 {{(pid=102992) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Nov 23 19:40:39.349010 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [None req-1e1c05cf-b0ba-4afa-b128-48915da45489 admin admin] Publish callbacks [] for subnet, before_delete {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:40:39.388422 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [None req-1e1c05cf-b0ba-4afa-b128-48915da45489 admin admin] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-25272549'] for subnet, precommit_delete_associations {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:40:39.502993 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [None req-1e1c05cf-b0ba-4afa-b128-48915da45489 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-7975863'] for subnet, precommit_delete {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:40:39.615008 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [None req-1e1c05cf-b0ba-4afa-b128-48915da45489 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-7982148', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-554858', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560168', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-25199822', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-25999729'] for subnet, after_delete {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:40:39.644193 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1e1c05cf-b0ba-4afa-b128-48915da45489 admin admin] Pushing event deleted for resources: {'Subnet': ['ID=bfa70c12-21c8-4b7f-8a30-da7ff37b80b8,revision_number=None']} {{(pid=102992) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 23 19:40:39.647858 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [None req-1e1c05cf-b0ba-4afa-b128-48915da45489 admin admin] Publish callbacks [] for subnet, before_response {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:40:39.653678 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [None req-1e1c05cf-b0ba-4afa-b128-48915da45489 admin admin] 10.222.0.62 "DELETE /v2.0/subnets/bfa70c12-21c8-4b7f-8a30-da7ff37b80b8 HTTP/1.1" status: 204 len: 168 time: 0.3517282 Nov 23 19:40:39.655250 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.wsgi [-] (102992) accepted ('10.222.0.62', 50136) {{(pid=102992) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 23 19:40:39.657632 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-1ab67994-f829-434a-be83-65eef855270c None None] Network 96f89427-8150-464f-a280-f07cf823b4fd requested from dv-cinder-819011-1-iscsi {{(pid=102994) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 23 19:40:39.727551 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [None req-040dfdf4-b9a1-43d9-8b92-a478f0c3bac0 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-8133038'] for network, before_delete {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:40:39.763155 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0232dfa2-a5ea-4396-94bb-171dc4eab09a req-d51ff4f4-67e5-4d40-aeb1-31289b8f677f tempest-TestShelveInstance-292550524 tempest-TestShelveInstance-292550524-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102993) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:40:39.765816 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-0232dfa2-a5ea-4396-94bb-171dc4eab09a req-d51ff4f4-67e5-4d40-aeb1-31289b8f677f tempest-TestShelveInstance-292550524 tempest-TestShelveInstance-292550524-project] 10.222.0.62 "GET /v2.0/ports?device_id=b504cdb2-6182-4c24-9b46-6dc0f85da342 HTTP/1.1" status: 200 len: 946 time: 0.0648685 Nov 23 19:40:39.785203 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.plugins.ml2.plugin [None req-040dfdf4-b9a1-43d9-8b92-a478f0c3bac0 admin admin] Deleting port 42144ab1-222d-419d-bc9e-bfd56a9e1e94 {{(pid=102992) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 23 19:40:39.785917 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [None req-040dfdf4-b9a1-43d9-8b92-a478f0c3bac0 admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8783631423070'] for port, before_delete {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:40:39.839406 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-0232dfa2-a5ea-4396-94bb-171dc4eab09a req-6639df9e-b202-4612-998f-798417b21fab tempest-TestShelveInstance-292550524 tempest-TestShelveInstance-292550524-project] 10.222.0.62 "GET /v2.0/security-groups?id=7fe194e6-71c3-47a9-8f36-0dbb24d1f72d&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0667703 Nov 23 19:40:39.858870 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.plugins.ml2.db [None req-040dfdf4-b9a1-43d9-8b92-a478f0c3bac0 admin admin] For port 42144ab1-222d-419d-bc9e-bfd56a9e1e94, host dv-cinder-819011-1-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-819011-1-iscsi',level=0,port_id=42144ab1-222d-419d-bc9e-bfd56a9e1e94,segment=NetworkSegment(81f92f0c-ea8d-4880-af1c-e4418f898de3),segment_id=81f92f0c-ea8d-4880-af1c-e4418f898de3)] {{(pid=102992) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 23 19:40:39.859356 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [None req-040dfdf4-b9a1-43d9-8b92-a478f0c3bac0 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-927332'] for port, precommit_delete {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:40:39.872523 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.plugins.ml2.plugin [None req-040dfdf4-b9a1-43d9-8b92-a478f0c3bac0 admin admin] Calling delete_port for 42144ab1-222d-419d-bc9e-bfd56a9e1e94 owned by network:dhcp {{(pid=102992) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 23 19:40:39.964807 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-05e46895-b106-4906-9b68-8d10ad6f4d46 None None] DHCP port deletion for 96f89427-8150-464f-a280-f07cf823b4fd request from dv-cinder-819011-1-iscsi {{(pid=102994) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:266}} Nov 23 19:40:40.014886 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.plugins.ml2.plugin [None req-05e46895-b106-4906-9b68-8d10ad6f4d46 None None] Deleting port 42144ab1-222d-419d-bc9e-bfd56a9e1e94 {{(pid=102994) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 23 19:40:40.015274 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron_lib.callbacks.manager [None req-05e46895-b106-4906-9b68-8d10ad6f4d46 None None] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8783631423070'] for port, before_delete {{(pid=102994) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:40:40.027153 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bbc801e9-5d5a-4b6b-b713-657be22732da req-ce3bc735-8e53-4294-89e8-b36b0b3c2cfd tempest-AttachVolumeTestJSON-1120920040 tempest-AttachVolumeTestJSON-1120920040-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102992) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:40:40.028627 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-bbc801e9-5d5a-4b6b-b713-657be22732da req-ce3bc735-8e53-4294-89e8-b36b0b3c2cfd tempest-AttachVolumeTestJSON-1120920040 tempest-AttachVolumeTestJSON-1120920040-project] 10.222.0.62 "GET /v2.0/ports?device_id=029fedce-3168-4d1d-992e-a9466fe3e886 HTTP/1.1" status: 200 len: 945 time: 0.0523751 Nov 23 19:40:40.031938 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [None req-040dfdf4-b9a1-43d9-8b92-a478f0c3bac0 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7918660', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-15067', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560168', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8783631424624', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8783631008723', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-25199805'] for port, after_delete {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:40:40.072219 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-040dfdf4-b9a1-43d9-8b92-a478f0c3bac0 admin admin] Pushing event deleted for resources: {'Port': ['ID=42144ab1-222d-419d-bc9e-bfd56a9e1e94,revision_number=None']} {{(pid=102992) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 23 19:40:40.076152 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.db.l3_dvrscheduler_db [None req-040dfdf4-b9a1-43d9-8b92-a478f0c3bac0 admin admin] No DVR routers for this DVR port 42144ab1-222d-419d-bc9e-bfd56a9e1e94 on host dv-cinder-819011-1-iscsi {{(pid=102992) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 23 19:40:40.082406 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.plugins.ml2.db [None req-05e46895-b106-4906-9b68-8d10ad6f4d46 None None] For port 42144ab1-222d-419d-bc9e-bfd56a9e1e94, host dv-cinder-819011-1-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-819011-1-iscsi',level=0,port_id=42144ab1-222d-419d-bc9e-bfd56a9e1e94,segment=NetworkSegment(81f92f0c-ea8d-4880-af1c-e4418f898de3),segment_id=81f92f0c-ea8d-4880-af1c-e4418f898de3)] {{(pid=102994) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 23 19:40:40.082806 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron_lib.callbacks.manager [None req-05e46895-b106-4906-9b68-8d10ad6f4d46 None None] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-927332'] for port, precommit_delete {{(pid=102994) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:40:40.096423 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.plugins.ml2.plugin [None req-05e46895-b106-4906-9b68-8d10ad6f4d46 None None] Calling delete_port for 42144ab1-222d-419d-bc9e-bfd56a9e1e94 owned by network:dhcp {{(pid=102994) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 23 19:40:40.139948 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-bbc801e9-5d5a-4b6b-b713-657be22732da req-06a578e5-b06c-4fc0-88dc-f0d5f49920d8 tempest-AttachVolumeTestJSON-1120920040 tempest-AttachVolumeTestJSON-1120920040-project] 10.222.0.62 "GET /v2.0/security-groups?id=f8cf4027-ad94-4b78-b429-c3f2d7f9d324&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0992393 Nov 23 19:40:40.175190 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [None req-040dfdf4-b9a1-43d9-8b92-a478f0c3bac0 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-7977576', 'neutron.services.segments.db._delete_segments_for_network-8783631323320'] for network, precommit_delete {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:40:40.185028 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.plugins.ml2.rpc [None req-eb87b2c3-3339-4249-8b85-e695b5b4e1f9 None None] Device 80f6861a-4aab-4ba4-a058-5c03b253434a no longer exists at agent ovs-agent-dv-cinder-819011-1-iscsi {{(pid=102994) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 23 19:40:40.196293 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.services.segments.db [None req-040dfdf4-b9a1-43d9-8b92-a478f0c3bac0 admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['96f89427-8150-464f-a280-f07cf823b4fd']}} {{(pid=102992) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 23 19:40:40.206267 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.services.segments.db [None req-040dfdf4-b9a1-43d9-8b92-a478f0c3bac0 admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '81f92f0c-ea8d-4880-af1c-e4418f898de3') {'for_net_delete': True} {{(pid=102992) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 23 19:40:40.206566 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.services.segments.db [None req-040dfdf4-b9a1-43d9-8b92-a478f0c3bac0 admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '81f92f0c-ea8d-4880-af1c-e4418f898de3') {} {{(pid=102992) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 23 19:40:40.215753 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [None req-040dfdf4-b9a1-43d9-8b92-a478f0c3bac0 admin admin] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8783631432524', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-25272530'] for segment, before_delete {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:40:40.220926 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.plugins.ml2.plugin [None req-eb87b2c3-3339-4249-8b85-e695b5b4e1f9 None None] No Port match for: 80f6861a-4aab-4ba4-a058-5c03b253434a {{(pid=102994) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 23 19:40:40.221277 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.plugins.ml2.rpc [None req-eb87b2c3-3339-4249-8b85-e695b5b4e1f9 None None] Device 80f6861a-4aab-4ba4-a058-5c03b253434a not bound to the agent host dv-cinder-819011-1-iscsi {{(pid=102994) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 23 19:40:40.221752 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.plugins.ml2.rpc [None req-eb87b2c3-3339-4249-8b85-e695b5b4e1f9 None None] Device 42144ab1-222d-419d-bc9e-bfd56a9e1e94 no longer exists at agent ovs-agent-dv-cinder-819011-1-iscsi {{(pid=102994) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 23 19:40:40.229240 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [None req-040dfdf4-b9a1-43d9-8b92-a478f0c3bac0 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7982218'] for segment, precommit_delete {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:40:40.235246 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-040dfdf4-b9a1-43d9-8b92-a478f0c3bac0 admin admin] Releasing vlan 816 on physical network physnet1 to pool {{(pid=102992) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Nov 23 19:40:40.235621 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [None req-040dfdf4-b9a1-43d9-8b92-a478f0c3bac0 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7982218', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-25200492'] for segment, after_delete {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:40:40.237214 dv-cinder-819011-1-iscsi neutron-server[102992]: Traceback (most recent call last): Nov 23 19:40:40.237214 dv-cinder-819011-1-iscsi neutron-server[102992]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Nov 23 19:40:40.237214 dv-cinder-819011-1-iscsi neutron-server[102992]: timer() Nov 23 19:40:40.237214 dv-cinder-819011-1-iscsi neutron-server[102992]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 23 19:40:40.237214 dv-cinder-819011-1-iscsi neutron-server[102992]: cb(*args, **kw) Nov 23 19:40:40.237214 dv-cinder-819011-1-iscsi neutron-server[102992]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Nov 23 19:40:40.237214 dv-cinder-819011-1-iscsi neutron-server[102992]: return func(*args, **kwargs) Nov 23 19:40:40.237214 dv-cinder-819011-1-iscsi neutron-server[102992]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 23 19:40:40.237214 dv-cinder-819011-1-iscsi neutron-server[102992]: self._notify() Nov 23 19:40:40.237214 dv-cinder-819011-1-iscsi neutron-server[102992]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 23 19:40:40.237214 dv-cinder-819011-1-iscsi neutron-server[102992]: self.callback(batched_events) Nov 23 19:40:40.237214 dv-cinder-819011-1-iscsi neutron-server[102992]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 23 19:40:40.237214 dv-cinder-819011-1-iscsi neutron-server[102992]: event.method(event) Nov 23 19:40:40.237214 dv-cinder-819011-1-iscsi neutron-server[102992]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Nov 23 19:40:40.237214 dv-cinder-819011-1-iscsi neutron-server[102992]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 23 19:40:40.237214 dv-cinder-819011-1-iscsi neutron-server[102992]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Nov 23 19:40:40.237214 dv-cinder-819011-1-iscsi neutron-server[102992]: aggregate_uuid = self.p_client.list_aggregates( Nov 23 19:40:40.237214 dv-cinder-819011-1-iscsi neutron-server[102992]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Nov 23 19:40:40.237214 dv-cinder-819011-1-iscsi neutron-server[102992]: return f(self, *a, **k) Nov 23 19:40:40.237214 dv-cinder-819011-1-iscsi neutron-server[102992]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 23 19:40:40.237214 dv-cinder-819011-1-iscsi neutron-server[102992]: return self._get(url).json() Nov 23 19:40:40.237214 dv-cinder-819011-1-iscsi neutron-server[102992]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 23 19:40:40.237214 dv-cinder-819011-1-iscsi neutron-server[102992]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 23 19:40:40.237214 dv-cinder-819011-1-iscsi neutron-server[102992]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Nov 23 19:40:40.237214 dv-cinder-819011-1-iscsi neutron-server[102992]: return self.request(url, 'GET', **kwargs) Nov 23 19:40:40.237214 dv-cinder-819011-1-iscsi neutron-server[102992]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Nov 23 19:40:40.237214 dv-cinder-819011-1-iscsi neutron-server[102992]: base_url = self.get_endpoint(auth, allow=allow, Nov 23 19:40:40.237214 dv-cinder-819011-1-iscsi neutron-server[102992]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Nov 23 19:40:40.237214 dv-cinder-819011-1-iscsi neutron-server[102992]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 23 19:40:40.237214 dv-cinder-819011-1-iscsi neutron-server[102992]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Nov 23 19:40:40.237214 dv-cinder-819011-1-iscsi neutron-server[102992]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 23 19:40:40.237214 dv-cinder-819011-1-iscsi neutron-server[102992]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 23 19:40:40.253110 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.plugins.ml2.plugin [None req-eb87b2c3-3339-4249-8b85-e695b5b4e1f9 None None] No Port match for: 42144ab1-222d-419d-bc9e-bfd56a9e1e94 {{(pid=102994) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 23 19:40:40.253561 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.plugins.ml2.rpc [None req-eb87b2c3-3339-4249-8b85-e695b5b4e1f9 None None] Device 42144ab1-222d-419d-bc9e-bfd56a9e1e94 not bound to the agent host dv-cinder-819011-1-iscsi {{(pid=102994) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 23 19:40:40.253997 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.plugins.ml2.rpc [None req-eb87b2c3-3339-4249-8b85-e695b5b4e1f9 None None] Device 35d7927f-9541-4e91-b520-51ae3ab623f1 no longer exists at agent ovs-agent-dv-cinder-819011-1-iscsi {{(pid=102994) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 23 19:40:40.276565 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.plugins.ml2.plugin [None req-eb87b2c3-3339-4249-8b85-e695b5b4e1f9 None None] No Port match for: 35d7927f-9541-4e91-b520-51ae3ab623f1 {{(pid=102994) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 23 19:40:40.276565 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.plugins.ml2.rpc [None req-eb87b2c3-3339-4249-8b85-e695b5b4e1f9 None None] Device 35d7927f-9541-4e91-b520-51ae3ab623f1 not bound to the agent host dv-cinder-819011-1-iscsi {{(pid=102994) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 23 19:40:40.279334 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron_lib.callbacks.manager [None req-05e46895-b106-4906-9b68-8d10ad6f4d46 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7918660', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-15067', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560168', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8783631424624', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8783631008723'] for port, after_delete {{(pid=102994) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:40:40.307267 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-05e46895-b106-4906-9b68-8d10ad6f4d46 None None] Pushing event deleted for resources: {'Port': ['ID=42144ab1-222d-419d-bc9e-bfd56a9e1e94,revision_number=None']} {{(pid=102994) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 23 19:40:40.311583 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.db.l3_dvrscheduler_db [None req-05e46895-b106-4906-9b68-8d10ad6f4d46 None None] No DVR routers for this DVR port 42144ab1-222d-419d-bc9e-bfd56a9e1e94 on host dv-cinder-819011-1-iscsi {{(pid=102994) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 23 19:40:40.339691 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [None req-040dfdf4-b9a1-43d9-8b92-a478f0c3bac0 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-7977567', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-554949', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560168', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-926557'] for network, after_delete {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:40:40.345441 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [None req-040dfdf4-b9a1-43d9-8b92-a478f0c3bac0 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-560186'] for network, before_response {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:40:40.348817 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [None req-040dfdf4-b9a1-43d9-8b92-a478f0c3bac0 admin admin] 10.222.0.62 "DELETE /v2.0/networks/96f89427-8150-464f-a280-f07cf823b4fd HTTP/1.1" status: 204 len: 168 time: 0.6925955 Nov 23 19:40:40.351806 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.wsgi [-] (102993) accepted ('10.222.0.62', 50142) {{(pid=102993) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 23 19:40:40.359884 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-040dfdf4-b9a1-43d9-8b92-a478f0c3bac0 admin admin] Pushing event deleted for resources: {'Network': ['ID=96f89427-8150-464f-a280-f07cf823b4fd,revision_number=None']} {{(pid=102992) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 23 19:40:40.693369 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-10d2da44-1431-46e0-864a-e064d44b073e admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-932931'] for router_interface, before_delete {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:40:41.135638 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7077a406-a035-446b-8d11-75ffdbe81d6c req-8d768b3b-4724-4b53-879a-2aa631ff7b9a tempest-TestShelveInstance-292550524 tempest-TestShelveInstance-292550524-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102993) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:40:41.137013 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-7077a406-a035-446b-8d11-75ffdbe81d6c req-8d768b3b-4724-4b53-879a-2aa631ff7b9a tempest-TestShelveInstance-292550524 tempest-TestShelveInstance-292550524-project] 10.222.0.62 "GET /v2.0/ports?device_id=b504cdb2-6182-4c24-9b46-6dc0f85da342 HTTP/1.1" status: 200 len: 946 time: 0.0936635 Nov 23 19:40:41.212240 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-7077a406-a035-446b-8d11-75ffdbe81d6c req-35fb0712-b4aa-4dbb-b9e0-3e1017eb3929 tempest-TestShelveInstance-292550524 tempest-TestShelveInstance-292550524-project] 10.222.0.62 "GET /v2.0/security-groups?id=7fe194e6-71c3-47a9-8f36-0dbb24d1f72d&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0560453 Nov 23 19:40:41.288875 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.plugins.ml2.plugin [None req-10d2da44-1431-46e0-864a-e064d44b073e admin admin] Deleting port bc49825c-fa1c-4a34-9835-46a0c3e77dd2 {{(pid=102993) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 23 19:40:41.289205 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-10d2da44-1431-46e0-864a-e064d44b073e admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8783631423070'] for port, before_delete {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:40:41.365798 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.plugins.ml2.db [None req-10d2da44-1431-46e0-864a-e064d44b073e admin admin] For port bc49825c-fa1c-4a34-9835-46a0c3e77dd2, host dv-cinder-819011-1-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-819011-1-iscsi',level=0,port_id=bc49825c-fa1c-4a34-9835-46a0c3e77dd2,segment=NetworkSegment(af2ab065-e074-4168-9b03-e42fa5dfb6ab),segment_id=af2ab065-e074-4168-9b03-e42fa5dfb6ab)] {{(pid=102993) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 23 19:40:41.366185 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-10d2da44-1431-46e0-864a-e064d44b073e admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-927332'] for port, precommit_delete {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:40:41.378380 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.plugins.ml2.plugin [None req-10d2da44-1431-46e0-864a-e064d44b073e admin admin] Calling delete_port for bc49825c-fa1c-4a34-9835-46a0c3e77dd2 owned by network:router_interface {{(pid=102993) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 23 19:40:41.619709 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-10d2da44-1431-46e0-864a-e064d44b073e admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7918660', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-15067', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560168', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8783631424624', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8783631008723', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-17257496'] for port, after_delete {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:40:41.645751 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-10d2da44-1431-46e0-864a-e064d44b073e admin admin] Pushing event deleted for resources: {'Port': ['ID=bc49825c-fa1c-4a34-9835-46a0c3e77dd2,revision_number=None']} {{(pid=102993) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 23 19:40:41.735084 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron_lib.callbacks.manager [None req-299893b1-30ed-41c6-98d5-a343b7a5b51a None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8783631323329', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7978582'] for agent, after_update {{(pid=102994) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:40:41.813096 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-10d2da44-1431-46e0-864a-e064d44b073e admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-560161', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-933087'] for router_interface, after_delete {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:40:42.031441 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-10d2da44-1431-46e0-864a-e064d44b073e admin admin] Router cd026b6a-8872-4a92-92e4-4bd664068764 has already been hosted by L3 agent 1b20f2c4-70b6-43c3-b9bd-0062cc9e57ac {{(pid=102993) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 23 19:40:42.137500 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-10d2da44-1431-46e0-864a-e064d44b073e admin admin] Notify agent at l3_agent.dv-cinder-819011-1-iscsi the message routers_updated {{(pid=102993) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 23 19:40:42.143637 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [None req-10d2da44-1431-46e0-864a-e064d44b073e admin admin] 10.222.0.62 "PUT /v2.0/routers/cd026b6a-8872-4a92-92e4-4bd664068764/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 1.7905326 Nov 23 19:40:42.146209 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.wsgi [-] (102993) accepted ('10.222.0.62', 50146) {{(pid=102993) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 23 19:40:42.150810 dv-cinder-819011-1-iscsi neutron-server[102995]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-0b63fe55-63d1-4f32-a11a-fff684987b3e None None] Sync routers for ids ['cd026b6a-8872-4a92-92e4-4bd664068764'] in dv-cinder-819011-1-iscsi {{(pid=102995) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 23 19:40:42.161452 dv-cinder-819011-1-iscsi neutron-server[102995]: DEBUG neutron.db.l3_dvrscheduler_db [None req-0b63fe55-63d1-4f32-a11a-fff684987b3e None None] Routers {'cd026b6a-8872-4a92-92e4-4bd664068764'} bound to L3 agent in host dv-cinder-819011-1-iscsi {{(pid=102995) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 23 19:40:42.162322 dv-cinder-819011-1-iscsi neutron-server[102995]: DEBUG neutron.db.l3_hamode_db [None req-0b63fe55-63d1-4f32-a11a-fff684987b3e None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-819011-1-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 9, "extensions": [], "floating_ips": 5, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 9, "log_agent_heartbeats": false, "routers": 9},created_at=2021-11-23T19:25:14Z,description=,heartbeat_timestamp=2021-11-23T19:40:14Z,host='dv-cinder-819011-1-iscsi',id=1b20f2c4-70b6-43c3-b9bd-0062cc9e57ac,load=0,resource_versions=,resources_synced=,started_at=2021-11-23T19:25:15Z,topic='l3_agent')) {'router_ids': ['cd026b6a-8872-4a92-92e4-4bd664068764'], 'active': True} {{(pid=102995) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 23 19:40:42.251050 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-49c6bf16-8f1c-42fc-9a65-b55142f890cd admin admin] Publish callbacks [] for router, before_delete {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:40:42.278290 dv-cinder-819011-1-iscsi neutron-server[102995]: DEBUG neutron.db.l3_dvr_db [None req-0b63fe55-63d1-4f32-a11a-fff684987b3e None None] Set router cd026b6a-8872-4a92-92e4-4bd664068764 gateway port host: dv-cinder-819011-1-iscsi {{(pid=102995) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 23 19:40:42.338921 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0ad66895-2864-4661-84f4-762079a67f8c req-d47190d0-ecbf-4407-8f7a-6763ececab67 tempest-TestShelveInstance-292550524 tempest-TestShelveInstance-292550524-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102992) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:40:42.340315 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-0ad66895-2864-4661-84f4-762079a67f8c req-d47190d0-ecbf-4407-8f7a-6763ececab67 tempest-TestShelveInstance-292550524 tempest-TestShelveInstance-292550524-project] 10.222.0.62 "GET /v2.0/ports?device_id=b504cdb2-6182-4c24-9b46-6dc0f85da342 HTTP/1.1" status: 200 len: 946 time: 0.0559254 Nov 23 19:40:42.360479 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-49c6bf16-8f1c-42fc-9a65-b55142f890cd admin admin] Publish callbacks [] for router_gateway, before_delete {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:40:42.391394 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-0ad66895-2864-4661-84f4-762079a67f8c req-a814e0d6-9ec9-4a1a-b4a8-6d2f32750bc1 tempest-TestShelveInstance-292550524 tempest-TestShelveInstance-292550524-project] 10.222.0.62 "GET /v2.0/security-groups?id=7fe194e6-71c3-47a9-8f36-0dbb24d1f72d&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0437624 Nov 23 19:40:42.458742 dv-cinder-819011-1-iscsi neutron-server[102995]: DEBUG neutron.db.l3_hamode_db [None req-0b63fe55-63d1-4f32-a11a-fff684987b3e None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'cd026b6a-8872-4a92-92e4-4bd664068764', 'name': 'tempest-TestMinimumBasicScenario-1019384590-router', 'tenant_id': 'ce37dcbb36ad436fbb4c75aff35bbebf', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'a93e254e-aac9-4233-9e4d-4290fd0458e4', 'external_fixed_ips': [{'subnet_id': 'e0b32f3d-83d6-439a-bbed-01df7cf01051', 'ip_address': '172.27.1.250'}], 'enable_snat': True}, 'gw_port_id': '7d43a82d-0eb8-4132-bc25-a50299a7264c', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-23T19:37:53Z', 'updated_at': '2021-11-23T19:40:41Z', 'revision_number': 5, 'project_id': 'ce37dcbb36ad436fbb4c75aff35bbebf', 'gw_port': {'id': '7d43a82d-0eb8-4132-bc25-a50299a7264c', 'name': '', 'network_id': 'a93e254e-aac9-4233-9e4d-4290fd0458e4', 'tenant_id': '', 'mac_address': 'fa:16:3e:ad:76:0e', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'cd026b6a-8872-4a92-92e4-4bd664068764', 'device_owner': 'network:router_gateway', 'standard_attr_id': 566, 'fixed_ips': [{'subnet_id': 'e0b32f3d-83d6-439a-bbed-01df7cf01051', 'ip_address': '172.27.1.250', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-819011-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-23T19:37:54Z', 'updated_at': '2021-11-23T19:38:00Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'e0b32f3d-83d6-439a-bbed-01df7cf01051', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-819011-1-iscsi'}], 'dv-cinder-819011-1-iscsi', False) {} {{(pid=102995) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 23 19:40:42.486128 dv-cinder-819011-1-iscsi neutron-server[102995]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-0b63fe55-63d1-4f32-a11a-fff684987b3e None None] Checking router: cd026b6a-8872-4a92-92e4-4bd664068764 for host: dv-cinder-819011-1-iscsi {{(pid=102995) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 23 19:40:42.493218 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.plugins.ml2.plugin [None req-49c6bf16-8f1c-42fc-9a65-b55142f890cd admin admin] Deleting port 7d43a82d-0eb8-4132-bc25-a50299a7264c {{(pid=102993) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 23 19:40:42.493606 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-49c6bf16-8f1c-42fc-9a65-b55142f890cd admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8783631423070'] for port, before_delete {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:40:42.494168 dv-cinder-819011-1-iscsi neutron-server[102995]: DEBUG neutron.db.l3_dvrscheduler_db [None req-0b63fe55-63d1-4f32-a11a-fff684987b3e None None] Routers {'cd026b6a-8872-4a92-92e4-4bd664068764'} bound to L3 agent in host dv-cinder-819011-1-iscsi {{(pid=102995) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 23 19:40:42.494768 dv-cinder-819011-1-iscsi neutron-server[102995]: DEBUG neutron.db.l3_hamode_db [None req-0b63fe55-63d1-4f32-a11a-fff684987b3e None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-819011-1-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 9, "extensions": [], "floating_ips": 5, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 9, "log_agent_heartbeats": false, "routers": 9},created_at=2021-11-23T19:25:14Z,description=,heartbeat_timestamp=2021-11-23T19:40:14Z,host='dv-cinder-819011-1-iscsi',id=1b20f2c4-70b6-43c3-b9bd-0062cc9e57ac,load=0,resource_versions=,resources_synced=,started_at=2021-11-23T19:25:15Z,topic='l3_agent')) {'router_ids': ['cd026b6a-8872-4a92-92e4-4bd664068764'], 'active': True} {{(pid=102995) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 23 19:40:42.577215 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.plugins.ml2.db [None req-49c6bf16-8f1c-42fc-9a65-b55142f890cd admin admin] For port 7d43a82d-0eb8-4132-bc25-a50299a7264c, host dv-cinder-819011-1-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-819011-1-iscsi',level=0,port_id=7d43a82d-0eb8-4132-bc25-a50299a7264c,segment=NetworkSegment(3cb5e60b-103a-47d0-a28b-d68e3159d032),segment_id=3cb5e60b-103a-47d0-a28b-d68e3159d032)] {{(pid=102993) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 23 19:40:42.577648 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-49c6bf16-8f1c-42fc-9a65-b55142f890cd admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-927332'] for port, precommit_delete {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:40:42.579210 dv-cinder-819011-1-iscsi neutron-server[102995]: DEBUG neutron.db.l3_dvr_db [None req-0b63fe55-63d1-4f32-a11a-fff684987b3e None None] Set router cd026b6a-8872-4a92-92e4-4bd664068764 gateway port host: None {{(pid=102995) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 23 19:40:42.589943 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.plugins.ml2.plugin [None req-49c6bf16-8f1c-42fc-9a65-b55142f890cd admin admin] Calling delete_port for 7d43a82d-0eb8-4132-bc25-a50299a7264c owned by network:router_gateway {{(pid=102993) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 23 19:40:42.629699 dv-cinder-819011-1-iscsi neutron-server[102995]: DEBUG neutron.db.l3_hamode_db [None req-0b63fe55-63d1-4f32-a11a-fff684987b3e None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'cd026b6a-8872-4a92-92e4-4bd664068764', 'name': 'tempest-TestMinimumBasicScenario-1019384590-router', 'tenant_id': 'ce37dcbb36ad436fbb4c75aff35bbebf', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-23T19:37:53Z', 'updated_at': '2021-11-23T19:40:42Z', 'revision_number': 6, 'project_id': 'ce37dcbb36ad436fbb4c75aff35bbebf', 'gw_port_host': None}], 'dv-cinder-819011-1-iscsi', False) {} {{(pid=102995) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 23 19:40:42.658231 dv-cinder-819011-1-iscsi neutron-server[102995]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-0b63fe55-63d1-4f32-a11a-fff684987b3e None None] The sync data for ids ['cd026b6a-8872-4a92-92e4-4bd664068764'] in dv-cinder-819011-1-iscsi is: [{'id': 'cd026b6a-8872-4a92-92e4-4bd664068764', 'name': 'tempest-TestMinimumBasicScenario-1019384590-router', 'tenant_id': 'ce37dcbb36ad436fbb4c75aff35bbebf', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-23T19:37:53Z', 'updated_at': '2021-11-23T19:40:42Z', 'revision_number': 6, 'project_id': 'ce37dcbb36ad436fbb4c75aff35bbebf', 'gw_port_host': None}] {{(pid=102995) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 23 19:40:42.785366 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-49c6bf16-8f1c-42fc-9a65-b55142f890cd admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7918660', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-15067', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560168', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8783631424624', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8783631008723', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-17257496'] for port, after_delete {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:40:42.809259 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-49c6bf16-8f1c-42fc-9a65-b55142f890cd admin admin] Pushing event deleted for resources: {'Port': ['ID=7d43a82d-0eb8-4132-bc25-a50299a7264c,revision_number=None']} {{(pid=102993) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 23 19:40:42.874879 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-49c6bf16-8f1c-42fc-9a65-b55142f890cd admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-926585'] for router_gateway, after_delete {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:40:42.979269 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-49c6bf16-8f1c-42fc-9a65-b55142f890cd admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-932919', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-13457'] for router, precommit_delete {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:40:42.981549 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-49c6bf16-8f1c-42fc-9a65-b55142f890cd admin admin] Publish callbacks [] for router_controller, precommit_delete_associations {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:40:43.088085 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-49c6bf16-8f1c-42fc-9a65-b55142f890cd admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-926715'] for router, after_delete {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:40:43.088660 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-49c6bf16-8f1c-42fc-9a65-b55142f890cd admin admin] Fanout notify agent at l3_agent the message router_deleted on router cd026b6a-8872-4a92-92e4-4bd664068764 {{(pid=102993) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Nov 23 19:40:43.096293 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-49c6bf16-8f1c-42fc-9a65-b55142f890cd admin admin] Publish callbacks [] for router, before_response {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:40:43.096293 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [None req-49c6bf16-8f1c-42fc-9a65-b55142f890cd admin admin] 10.222.0.62 "DELETE /v2.0/routers/cd026b6a-8872-4a92-92e4-4bd664068764 HTTP/1.1" status: 204 len: 168 time: 0.9482884 Nov 23 19:40:43.097967 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.wsgi [-] (102993) accepted ('10.222.0.62', 50150) {{(pid=102993) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 23 19:40:43.146169 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.db.db_base_plugin_v2 [None req-33e373a4-0ec7-4b6c-b19e-f50ace0e659b admin admin] Deleting subnet ae751b05-57d4-48cb-8d43-9f8a983127e9 {{(pid=102993) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Nov 23 19:40:43.149078 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-33e373a4-0ec7-4b6c-b19e-f50ace0e659b admin admin] Publish callbacks [] for subnet, before_delete {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:40:43.182454 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-33e373a4-0ec7-4b6c-b19e-f50ace0e659b admin admin] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-16914634'] for subnet, precommit_delete_associations {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:40:43.289958 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-33e373a4-0ec7-4b6c-b19e-f50ace0e659b admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-7975863'] for subnet, precommit_delete {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:40:43.402865 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-33e373a4-0ec7-4b6c-b19e-f50ace0e659b admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-7982148', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-554858', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560168', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-17257579', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-17772973'] for subnet, after_delete {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:40:43.426677 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-33e373a4-0ec7-4b6c-b19e-f50ace0e659b admin admin] Pushing event deleted for resources: {'Subnet': ['ID=ae751b05-57d4-48cb-8d43-9f8a983127e9,revision_number=None']} {{(pid=102993) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 23 19:40:43.432375 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-33e373a4-0ec7-4b6c-b19e-f50ace0e659b admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-560186'] for subnet, before_response {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:40:43.435713 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [None req-33e373a4-0ec7-4b6c-b19e-f50ace0e659b admin admin] 10.222.0.62 "DELETE /v2.0/subnets/ae751b05-57d4-48cb-8d43-9f8a983127e9 HTTP/1.1" status: 204 len: 168 time: 0.3367381 Nov 23 19:40:43.439581 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.wsgi [-] (102993) accepted ('10.222.0.62', 50154) {{(pid=102993) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 23 19:40:43.441582 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-42506294-6ba5-440d-a845-5a66a6dc2a8d None None] Network e174bef4-375a-481e-8191-fce5c2cbb97d requested from dv-cinder-819011-1-iscsi {{(pid=102994) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 23 19:40:43.544342 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-3e387461-534f-48cd-829e-4004bc84df8e admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-8133038'] for network, before_delete {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:40:43.568052 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9f911b82-6116-4b22-8c7c-510ae70b9fdb req-7db0acf3-108e-411e-8840-2d0598e29547 tempest-TestShelveInstance-292550524 tempest-TestShelveInstance-292550524-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102993) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:40:43.569610 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-9f911b82-6116-4b22-8c7c-510ae70b9fdb req-7db0acf3-108e-411e-8840-2d0598e29547 tempest-TestShelveInstance-292550524 tempest-TestShelveInstance-292550524-project] 10.222.0.62 "GET /v2.0/ports?device_id=b504cdb2-6182-4c24-9b46-6dc0f85da342 HTTP/1.1" status: 200 len: 946 time: 0.1001956 Nov 23 19:40:43.650358 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-9f911b82-6116-4b22-8c7c-510ae70b9fdb req-6b37f430-37f0-408d-b8fd-8c3e7e62ac7f tempest-TestShelveInstance-292550524 tempest-TestShelveInstance-292550524-project] 10.222.0.62 "GET /v2.0/security-groups?id=7fe194e6-71c3-47a9-8f36-0dbb24d1f72d&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0592070 Nov 23 19:40:43.657705 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.plugins.ml2.plugin [None req-3e387461-534f-48cd-829e-4004bc84df8e admin admin] Deleting port d12303ae-95fd-4188-99d6-02b273fd2188 {{(pid=102993) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 23 19:40:43.658048 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-3e387461-534f-48cd-829e-4004bc84df8e admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8783631423070'] for port, before_delete {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:40:43.660368 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-60903d9f-4e5c-4b7a-847f-8455ebb07129 None None] DHCP port deletion for e174bef4-375a-481e-8191-fce5c2cbb97d request from dv-cinder-819011-1-iscsi {{(pid=102994) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:266}} Nov 23 19:40:43.708904 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.plugins.ml2.plugin [None req-60903d9f-4e5c-4b7a-847f-8455ebb07129 None None] Deleting port d12303ae-95fd-4188-99d6-02b273fd2188 {{(pid=102994) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 23 19:40:43.709274 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron_lib.callbacks.manager [None req-60903d9f-4e5c-4b7a-847f-8455ebb07129 None None] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8783631423070'] for port, before_delete {{(pid=102994) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:40:43.730154 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.plugins.ml2.db [None req-3e387461-534f-48cd-829e-4004bc84df8e admin admin] For port d12303ae-95fd-4188-99d6-02b273fd2188, host dv-cinder-819011-1-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-819011-1-iscsi',level=0,port_id=d12303ae-95fd-4188-99d6-02b273fd2188,segment=NetworkSegment(af2ab065-e074-4168-9b03-e42fa5dfb6ab),segment_id=af2ab065-e074-4168-9b03-e42fa5dfb6ab)] {{(pid=102993) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 23 19:40:43.730547 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-3e387461-534f-48cd-829e-4004bc84df8e admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-927332'] for port, precommit_delete {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:40:43.743492 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.plugins.ml2.plugin [None req-3e387461-534f-48cd-829e-4004bc84df8e admin admin] Calling delete_port for d12303ae-95fd-4188-99d6-02b273fd2188 owned by network:dhcp {{(pid=102993) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 23 19:40:43.769529 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.plugins.ml2.db [None req-60903d9f-4e5c-4b7a-847f-8455ebb07129 None None] For port d12303ae-95fd-4188-99d6-02b273fd2188, host dv-cinder-819011-1-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-819011-1-iscsi',level=0,port_id=d12303ae-95fd-4188-99d6-02b273fd2188,segment=NetworkSegment(af2ab065-e074-4168-9b03-e42fa5dfb6ab),segment_id=af2ab065-e074-4168-9b03-e42fa5dfb6ab)] {{(pid=102994) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 23 19:40:43.769920 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron_lib.callbacks.manager [None req-60903d9f-4e5c-4b7a-847f-8455ebb07129 None None] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-927332'] for port, precommit_delete {{(pid=102994) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:40:43.785731 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.plugins.ml2.plugin [None req-60903d9f-4e5c-4b7a-847f-8455ebb07129 None None] Calling delete_port for d12303ae-95fd-4188-99d6-02b273fd2188 owned by network:dhcp {{(pid=102994) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 23 19:40:43.877028 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-3e387461-534f-48cd-829e-4004bc84df8e admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7918660', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-15067', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560168', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8783631424624', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8783631008723', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-17257496'] for port, after_delete {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:40:43.882805 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron_lib.callbacks.manager [None req-60903d9f-4e5c-4b7a-847f-8455ebb07129 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7918660', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-15067', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560168', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8783631424624', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8783631008723'] for port, after_delete {{(pid=102994) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:40:43.902393 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3e387461-534f-48cd-829e-4004bc84df8e admin admin] Pushing event deleted for resources: {'Port': ['ID=d12303ae-95fd-4188-99d6-02b273fd2188,revision_number=None']} {{(pid=102993) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 23 19:40:43.905960 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.db.l3_dvrscheduler_db [None req-3e387461-534f-48cd-829e-4004bc84df8e admin admin] No DVR routers for this DVR port d12303ae-95fd-4188-99d6-02b273fd2188 on host dv-cinder-819011-1-iscsi {{(pid=102993) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 23 19:40:43.909640 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-60903d9f-4e5c-4b7a-847f-8455ebb07129 None None] Pushing event deleted for resources: {'Port': ['ID=d12303ae-95fd-4188-99d6-02b273fd2188,revision_number=None']} {{(pid=102994) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 23 19:40:43.921379 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.db.l3_dvrscheduler_db [None req-60903d9f-4e5c-4b7a-847f-8455ebb07129 None None] No DVR routers for this DVR port d12303ae-95fd-4188-99d6-02b273fd2188 on host dv-cinder-819011-1-iscsi {{(pid=102994) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 23 19:40:43.977191 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-3e387461-534f-48cd-829e-4004bc84df8e admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-7977576', 'neutron.services.segments.db._delete_segments_for_network-8783631323320'] for network, precommit_delete {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:40:43.996933 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.services.segments.db [None req-3e387461-534f-48cd-829e-4004bc84df8e admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['e174bef4-375a-481e-8191-fce5c2cbb97d']}} {{(pid=102993) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 23 19:40:44.007648 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.services.segments.db [None req-3e387461-534f-48cd-829e-4004bc84df8e admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, 'af2ab065-e074-4168-9b03-e42fa5dfb6ab') {'for_net_delete': True} {{(pid=102993) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 23 19:40:44.007949 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.services.segments.db [None req-3e387461-534f-48cd-829e-4004bc84df8e admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, 'af2ab065-e074-4168-9b03-e42fa5dfb6ab') {} {{(pid=102993) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 23 19:40:44.017906 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-3e387461-534f-48cd-829e-4004bc84df8e admin admin] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8783631432524', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-16914685'] for segment, before_delete {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:40:44.031020 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-3e387461-534f-48cd-829e-4004bc84df8e admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7982218'] for segment, precommit_delete {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:40:44.036766 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-3e387461-534f-48cd-829e-4004bc84df8e admin admin] Releasing vlan 814 on physical network physnet1 to pool {{(pid=102993) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Nov 23 19:40:44.037143 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-3e387461-534f-48cd-829e-4004bc84df8e admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7982218', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-17258441'] for segment, after_delete {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:40:44.038793 dv-cinder-819011-1-iscsi neutron-server[102993]: Traceback (most recent call last): Nov 23 19:40:44.038793 dv-cinder-819011-1-iscsi neutron-server[102993]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Nov 23 19:40:44.038793 dv-cinder-819011-1-iscsi neutron-server[102993]: timer() Nov 23 19:40:44.038793 dv-cinder-819011-1-iscsi neutron-server[102993]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 23 19:40:44.038793 dv-cinder-819011-1-iscsi neutron-server[102993]: cb(*args, **kw) Nov 23 19:40:44.038793 dv-cinder-819011-1-iscsi neutron-server[102993]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Nov 23 19:40:44.038793 dv-cinder-819011-1-iscsi neutron-server[102993]: return func(*args, **kwargs) Nov 23 19:40:44.038793 dv-cinder-819011-1-iscsi neutron-server[102993]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 23 19:40:44.038793 dv-cinder-819011-1-iscsi neutron-server[102993]: self._notify() Nov 23 19:40:44.038793 dv-cinder-819011-1-iscsi neutron-server[102993]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 23 19:40:44.038793 dv-cinder-819011-1-iscsi neutron-server[102993]: self.callback(batched_events) Nov 23 19:40:44.038793 dv-cinder-819011-1-iscsi neutron-server[102993]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 23 19:40:44.038793 dv-cinder-819011-1-iscsi neutron-server[102993]: event.method(event) Nov 23 19:40:44.038793 dv-cinder-819011-1-iscsi neutron-server[102993]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Nov 23 19:40:44.038793 dv-cinder-819011-1-iscsi neutron-server[102993]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 23 19:40:44.038793 dv-cinder-819011-1-iscsi neutron-server[102993]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Nov 23 19:40:44.038793 dv-cinder-819011-1-iscsi neutron-server[102993]: aggregate_uuid = self.p_client.list_aggregates( Nov 23 19:40:44.038793 dv-cinder-819011-1-iscsi neutron-server[102993]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Nov 23 19:40:44.038793 dv-cinder-819011-1-iscsi neutron-server[102993]: return f(self, *a, **k) Nov 23 19:40:44.038793 dv-cinder-819011-1-iscsi neutron-server[102993]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 23 19:40:44.038793 dv-cinder-819011-1-iscsi neutron-server[102993]: return self._get(url).json() Nov 23 19:40:44.038793 dv-cinder-819011-1-iscsi neutron-server[102993]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 23 19:40:44.038793 dv-cinder-819011-1-iscsi neutron-server[102993]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 23 19:40:44.038793 dv-cinder-819011-1-iscsi neutron-server[102993]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Nov 23 19:40:44.038793 dv-cinder-819011-1-iscsi neutron-server[102993]: return self.request(url, 'GET', **kwargs) Nov 23 19:40:44.038793 dv-cinder-819011-1-iscsi neutron-server[102993]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Nov 23 19:40:44.038793 dv-cinder-819011-1-iscsi neutron-server[102993]: base_url = self.get_endpoint(auth, allow=allow, Nov 23 19:40:44.038793 dv-cinder-819011-1-iscsi neutron-server[102993]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Nov 23 19:40:44.038793 dv-cinder-819011-1-iscsi neutron-server[102993]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 23 19:40:44.038793 dv-cinder-819011-1-iscsi neutron-server[102993]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Nov 23 19:40:44.038793 dv-cinder-819011-1-iscsi neutron-server[102993]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 23 19:40:44.038793 dv-cinder-819011-1-iscsi neutron-server[102993]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 23 19:40:44.145462 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-3e387461-534f-48cd-829e-4004bc84df8e admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-7977567', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-554949', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560168', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-926557'] for network, after_delete {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:40:44.151035 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-3e387461-534f-48cd-829e-4004bc84df8e admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-560186'] for network, before_response {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:40:44.154647 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [None req-3e387461-534f-48cd-829e-4004bc84df8e admin admin] 10.222.0.62 "DELETE /v2.0/networks/e174bef4-375a-481e-8191-fce5c2cbb97d HTTP/1.1" status: 204 len: 168 time: 0.7141266 Nov 23 19:40:44.165855 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3e387461-534f-48cd-829e-4004bc84df8e admin admin] Pushing event deleted for resources: {'Network': ['ID=e174bef4-375a-481e-8191-fce5c2cbb97d,revision_number=None']} {{(pid=102993) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 23 19:40:44.180680 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.plugins.ml2.rpc [None req-eb87b2c3-3339-4249-8b85-e695b5b4e1f9 None None] Device bc49825c-fa1c-4a34-9835-46a0c3e77dd2 no longer exists at agent ovs-agent-dv-cinder-819011-1-iscsi {{(pid=102994) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 23 19:40:44.203360 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.plugins.ml2.plugin [None req-eb87b2c3-3339-4249-8b85-e695b5b4e1f9 None None] No Port match for: bc49825c-fa1c-4a34-9835-46a0c3e77dd2 {{(pid=102994) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 23 19:40:44.203797 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.plugins.ml2.rpc [None req-eb87b2c3-3339-4249-8b85-e695b5b4e1f9 None None] Device bc49825c-fa1c-4a34-9835-46a0c3e77dd2 not bound to the agent host dv-cinder-819011-1-iscsi {{(pid=102994) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 23 19:40:44.204301 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.plugins.ml2.rpc [None req-eb87b2c3-3339-4249-8b85-e695b5b4e1f9 None None] Device 7d43a82d-0eb8-4132-bc25-a50299a7264c no longer exists at agent ovs-agent-dv-cinder-819011-1-iscsi {{(pid=102994) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 23 19:40:44.227303 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.plugins.ml2.plugin [None req-eb87b2c3-3339-4249-8b85-e695b5b4e1f9 None None] No Port match for: 7d43a82d-0eb8-4132-bc25-a50299a7264c {{(pid=102994) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 23 19:40:44.227652 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.plugins.ml2.rpc [None req-eb87b2c3-3339-4249-8b85-e695b5b4e1f9 None None] Device 7d43a82d-0eb8-4132-bc25-a50299a7264c not bound to the agent host dv-cinder-819011-1-iscsi {{(pid=102994) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 23 19:40:44.228070 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.plugins.ml2.rpc [None req-eb87b2c3-3339-4249-8b85-e695b5b4e1f9 None None] Device d12303ae-95fd-4188-99d6-02b273fd2188 no longer exists at agent ovs-agent-dv-cinder-819011-1-iscsi {{(pid=102994) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 23 19:40:44.229736 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron_lib.callbacks.manager [None req-4db924c8-1270-4b62-883f-f371131c0e23 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8783631323329', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7978582'] for agent, after_update {{(pid=102994) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:40:44.251109 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.plugins.ml2.plugin [None req-eb87b2c3-3339-4249-8b85-e695b5b4e1f9 None None] No Port match for: d12303ae-95fd-4188-99d6-02b273fd2188 {{(pid=102994) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 23 19:40:44.251464 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.plugins.ml2.rpc [None req-eb87b2c3-3339-4249-8b85-e695b5b4e1f9 None None] Device d12303ae-95fd-4188-99d6-02b273fd2188 not bound to the agent host dv-cinder-819011-1-iscsi {{(pid=102994) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 23 19:40:44.497565 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.wsgi [-] (102993) accepted ('10.222.0.62', 50158) {{(pid=102993) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 23 19:40:44.536531 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [None req-701e0c97-a231-4318-a589-347501aaa96e admin admin] 10.222.0.62 "GET /v2.0/security-groups?tenant_id=ed0d906c96b540a7b11d508615543890&name=default HTTP/1.1" status: 200 len: 2996 time: 0.0377569 Nov 23 19:40:44.538947 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.wsgi [-] (102993) accepted ('10.222.0.62', 50160) {{(pid=102993) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 23 19:40:44.585128 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-5ee05a7e-5d3a-4f59-822a-54961c80cb58 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:40:44.606185 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-5ee05a7e-5d3a-4f59-822a-54961c80cb58 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:40:44.688441 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-5ee05a7e-5d3a-4f59-822a-54961c80cb58 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-623933'] for security_group, after_delete {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:40:44.691495 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-5ee05a7e-5d3a-4f59-822a-54961c80cb58 admin admin] Publish callbacks [] for security_group, before_response {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:40:44.692659 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [None req-5ee05a7e-5d3a-4f59-822a-54961c80cb58 admin admin] 10.222.0.62 "DELETE /v2.0/security-groups/d09b4044-91d5-4432-9faa-4b7a40b1627d HTTP/1.1" status: 204 len: 168 time: 0.1527979 Nov 23 19:40:44.701804 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5ee05a7e-5d3a-4f59-822a-54961c80cb58 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=d09b4044-91d5-4432-9faa-4b7a40b1627d,revision_number=None']} {{(pid=102993) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 23 19:40:44.778268 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7097e72b-fd9c-4330-b27f-89a933333b95 req-45af1b7f-5c21-4e17-9e87-4dc0f91da7e9 tempest-TestShelveInstance-292550524 tempest-TestShelveInstance-292550524-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102992) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:40:44.780292 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-7097e72b-fd9c-4330-b27f-89a933333b95 req-45af1b7f-5c21-4e17-9e87-4dc0f91da7e9 tempest-TestShelveInstance-292550524 tempest-TestShelveInstance-292550524-project] 10.222.0.62 "GET /v2.0/ports?device_id=b504cdb2-6182-4c24-9b46-6dc0f85da342 HTTP/1.1" status: 200 len: 946 time: 0.0552189 Nov 23 19:40:44.831554 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-7097e72b-fd9c-4330-b27f-89a933333b95 req-86ae9540-cafc-4f7d-935f-1cbc7743d980 tempest-TestShelveInstance-292550524 tempest-TestShelveInstance-292550524-project] 10.222.0.62 "GET /v2.0/security-groups?id=7fe194e6-71c3-47a9-8f36-0dbb24d1f72d&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0444028 Nov 23 19:40:45.110998 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron_lib.callbacks.manager [None req-8346ef05-f685-4c3d-af3d-a159b683bec2 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8783631323329', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7978582'] for agent, after_update {{(pid=102994) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:40:45.274420 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.wsgi [-] (102993) accepted ('10.222.0.62', 50168) {{(pid=102993) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 23 19:40:45.317095 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [None req-ee0e6296-e0cc-49b9-ad18-65e91b23e2b8 admin admin] 10.222.0.62 "GET /v2.0/security-groups?tenant_id=ce37dcbb36ad436fbb4c75aff35bbebf&name=default HTTP/1.1" status: 200 len: 2996 time: 0.0415456 Nov 23 19:40:45.319649 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.wsgi [-] (102993) accepted ('10.222.0.62', 50170) {{(pid=102993) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 23 19:40:45.365676 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-2e05eb69-5507-4c1d-8772-3244eea28e15 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:40:45.386410 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-2e05eb69-5507-4c1d-8772-3244eea28e15 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:40:45.476413 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-2e05eb69-5507-4c1d-8772-3244eea28e15 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-623933'] for security_group, after_delete {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:40:45.479025 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-2e05eb69-5507-4c1d-8772-3244eea28e15 admin admin] Publish callbacks [] for security_group, before_response {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:40:45.480160 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [None req-2e05eb69-5507-4c1d-8772-3244eea28e15 admin admin] 10.222.0.62 "DELETE /v2.0/security-groups/de59d408-34e1-4392-9424-9e47c20da5fb HTTP/1.1" status: 204 len: 168 time: 0.1595995 Nov 23 19:40:45.488629 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2e05eb69-5507-4c1d-8772-3244eea28e15 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=de59d408-34e1-4392-9424-9e47c20da5fb,revision_number=None']} {{(pid=102993) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 23 19:40:45.953780 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9b5a7d0c-c157-46a1-ad6f-5029fc32c5f0 req-31a9cd00-9551-4b37-9c41-eee41afafefb tempest-TestShelveInstance-292550524 tempest-TestShelveInstance-292550524-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102993) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:40:45.955391 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-9b5a7d0c-c157-46a1-ad6f-5029fc32c5f0 req-31a9cd00-9551-4b37-9c41-eee41afafefb tempest-TestShelveInstance-292550524 tempest-TestShelveInstance-292550524-project] 10.222.0.62 "GET /v2.0/ports?device_id=b504cdb2-6182-4c24-9b46-6dc0f85da342 HTTP/1.1" status: 200 len: 946 time: 0.0527372 Nov 23 19:40:46.008697 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-9b5a7d0c-c157-46a1-ad6f-5029fc32c5f0 req-7e1aaf1b-ace8-4d6c-9c62-aa2fe45988ee tempest-TestShelveInstance-292550524 tempest-TestShelveInstance-292550524-project] 10.222.0.62 "GET /v2.0/security-groups?id=7fe194e6-71c3-47a9-8f36-0dbb24d1f72d&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0470128 Nov 23 19:40:46.579351 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron_lib.callbacks.manager [None req-785c1d26-11ba-42d8-b5a6-51a8b3daeef0 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8783631323329', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7978582'] for agent, after_update {{(pid=102994) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:40:47.124899 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cd9908e8-800f-4475-ac67-6f6fca381545 req-8a248a94-5b12-48a4-a6ac-b845db2bc88d tempest-TestShelveInstance-292550524 tempest-TestShelveInstance-292550524-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102992) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:40:47.126278 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-cd9908e8-800f-4475-ac67-6f6fca381545 req-8a248a94-5b12-48a4-a6ac-b845db2bc88d tempest-TestShelveInstance-292550524 tempest-TestShelveInstance-292550524-project] 10.222.0.62 "GET /v2.0/ports?device_id=b504cdb2-6182-4c24-9b46-6dc0f85da342 HTTP/1.1" status: 200 len: 946 time: 0.0509672 Nov 23 19:40:47.173294 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-cd9908e8-800f-4475-ac67-6f6fca381545 req-20fc7520-9235-46b4-a83d-faa619c570e4 tempest-TestShelveInstance-292550524 tempest-TestShelveInstance-292550524-project] 10.222.0.62 "GET /v2.0/security-groups?id=7fe194e6-71c3-47a9-8f36-0dbb24d1f72d&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0411689 Nov 23 19:40:47.299437 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron_lib.callbacks.manager [None req-eb87b2c3-3339-4249-8b85-e695b5b4e1f9 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8783631323329', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7978582'] for agent, after_update {{(pid=102994) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:40:48.290699 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e78a527b-15aa-48c5-8357-78fc82410235 req-71d1ebfa-d32d-46aa-a8c3-15ff0f5a0e0a tempest-TestShelveInstance-292550524 tempest-TestShelveInstance-292550524-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102993) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:40:48.292147 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-e78a527b-15aa-48c5-8357-78fc82410235 req-71d1ebfa-d32d-46aa-a8c3-15ff0f5a0e0a tempest-TestShelveInstance-292550524 tempest-TestShelveInstance-292550524-project] 10.222.0.62 "GET /v2.0/ports?device_id=b504cdb2-6182-4c24-9b46-6dc0f85da342 HTTP/1.1" status: 200 len: 946 time: 0.0506856 Nov 23 19:40:48.340073 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-e78a527b-15aa-48c5-8357-78fc82410235 req-e8a9916e-08af-49dc-bd14-f98c24cdb570 tempest-TestShelveInstance-292550524 tempest-TestShelveInstance-292550524-project] 10.222.0.62 "GET /v2.0/security-groups?id=7fe194e6-71c3-47a9-8f36-0dbb24d1f72d&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0418735 Nov 23 19:40:48.785692 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ccae8da0-492d-49b2-ba0e-5ce46a703466 req-11828554-7381-4748-af11-66d4dee693f1 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102992) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:40:48.787292 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-ccae8da0-492d-49b2-ba0e-5ce46a703466 req-11828554-7381-4748-af11-66d4dee693f1 service neutron] 10.222.0.41 "GET /v2.0/ports?tenant_id=35f8a5017a27449084aabd12f27f5a8a&device_id=b504cdb2-6182-4c24-9b46-6dc0f85da342 HTTP/1.1" status: 200 len: 1099 time: 0.0474169 Nov 23 19:40:48.887080 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ccae8da0-492d-49b2-ba0e-5ce46a703466 req-2e01db43-66b1-4eb2-8ab2-92a6bd425e4a service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102992) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:40:48.888535 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-ccae8da0-492d-49b2-ba0e-5ce46a703466 req-2e01db43-66b1-4eb2-8ab2-92a6bd425e4a service neutron] 10.222.0.41 "GET /v2.0/networks?id=87e46ab6-0f90-430f-930f-9ea1580c04c3 HTTP/1.1" status: 200 len: 909 time: 0.0868900 Nov 23 19:40:48.955600 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-ccae8da0-492d-49b2-ba0e-5ce46a703466 req-10b8e1a4-b14a-4ed5-8cba-8dbd2443167f service neutron] 10.222.0.41 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.13&port_id=bbafb0bb-163c-43f4-8d2c-2f5304e0bd04 HTTP/1.1" status: 200 len: 1002 time: 0.0565362 Nov 23 19:40:49.015023 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ccae8da0-492d-49b2-ba0e-5ce46a703466 req-46af8d0c-c2ba-4a9a-beac-5cfa9740f235 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102992) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:40:49.016368 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-ccae8da0-492d-49b2-ba0e-5ce46a703466 req-46af8d0c-c2ba-4a9a-beac-5cfa9740f235 service neutron] 10.222.0.41 "GET /v2.0/subnets?id=afa5bc59-f70c-409d-8c15-be2dcdce66a3 HTTP/1.1" status: 200 len: 847 time: 0.0429590 Nov 23 19:40:49.066690 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ccae8da0-492d-49b2-ba0e-5ce46a703466 req-c777aa68-ae0e-4cda-b015-b06013987893 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102992) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:40:49.068141 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-ccae8da0-492d-49b2-ba0e-5ce46a703466 req-c777aa68-ae0e-4cda-b015-b06013987893 service neutron] 10.222.0.41 "GET /v2.0/ports?network_id=87e46ab6-0f90-430f-930f-9ea1580c04c3&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0424302 Nov 23 19:40:49.156993 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-ccae8da0-492d-49b2-ba0e-5ce46a703466 req-46f4a3b5-5cc7-4bb3-9fa1-2f36eea3329f service neutron] 10.222.0.41 "GET /v2.0/networks/87e46ab6-0f90-430f-930f-9ea1580c04c3?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0800154 Nov 23 19:40:49.260647 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-ccae8da0-492d-49b2-ba0e-5ce46a703466 req-b11792aa-f380-41b0-8253-55e9c03018ba service neutron] 10.222.0.41 "GET /v2.0/networks/87e46ab6-0f90-430f-930f-9ea1580c04c3?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0846758 Nov 23 19:40:49.454314 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3d008d64-afe3-4f64-814d-ab3aaedf39b2 req-2b08ef83-f6dc-4bcc-9885-a515eb039478 tempest-TestShelveInstance-292550524 tempest-TestShelveInstance-292550524-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102992) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:40:49.455772 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-3d008d64-afe3-4f64-814d-ab3aaedf39b2 req-2b08ef83-f6dc-4bcc-9885-a515eb039478 tempest-TestShelveInstance-292550524 tempest-TestShelveInstance-292550524-project] 10.222.0.62 "GET /v2.0/ports?device_id=b504cdb2-6182-4c24-9b46-6dc0f85da342 HTTP/1.1" status: 200 len: 946 time: 0.0495670 Nov 23 19:40:49.504681 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-3d008d64-afe3-4f64-814d-ab3aaedf39b2 req-1ab3d09a-8779-44c9-b611-a49a72d4d27e tempest-TestShelveInstance-292550524 tempest-TestShelveInstance-292550524-project] 10.222.0.62 "GET /v2.0/security-groups?id=7fe194e6-71c3-47a9-8f36-0dbb24d1f72d&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0430059 Nov 23 19:40:50.616621 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-642616b1-5a4f-4a5c-b57f-26d0b7e692d7 req-5871c524-1be1-4d5f-8486-797080c788d0 tempest-TestShelveInstance-292550524 tempest-TestShelveInstance-292550524-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102993) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:40:50.618092 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-642616b1-5a4f-4a5c-b57f-26d0b7e692d7 req-5871c524-1be1-4d5f-8486-797080c788d0 tempest-TestShelveInstance-292550524 tempest-TestShelveInstance-292550524-project] 10.222.0.62 "GET /v2.0/ports?device_id=b504cdb2-6182-4c24-9b46-6dc0f85da342 HTTP/1.1" status: 200 len: 946 time: 0.0478964 Nov 23 19:40:50.665716 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-642616b1-5a4f-4a5c-b57f-26d0b7e692d7 req-d263ee16-61b8-4245-86c2-71d14fa8ded3 tempest-TestShelveInstance-292550524 tempest-TestShelveInstance-292550524-project] 10.222.0.62 "GET /v2.0/security-groups?id=7fe194e6-71c3-47a9-8f36-0dbb24d1f72d&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0412500 Nov 23 19:40:51.780455 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-44b4fe14-c1a6-4428-b43d-0e93c89c5f65 req-69df974e-b906-43e8-aa04-a2d603e9b3fc tempest-TestShelveInstance-292550524 tempest-TestShelveInstance-292550524-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102992) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:40:51.781977 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-44b4fe14-c1a6-4428-b43d-0e93c89c5f65 req-69df974e-b906-43e8-aa04-a2d603e9b3fc tempest-TestShelveInstance-292550524 tempest-TestShelveInstance-292550524-project] 10.222.0.62 "GET /v2.0/ports?device_id=b504cdb2-6182-4c24-9b46-6dc0f85da342 HTTP/1.1" status: 200 len: 946 time: 0.0495110 Nov 23 19:40:51.836032 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-44b4fe14-c1a6-4428-b43d-0e93c89c5f65 req-e3581b96-9d14-4b83-801f-6d5ddd9e12f1 tempest-TestShelveInstance-292550524 tempest-TestShelveInstance-292550524-project] 10.222.0.62 "GET /v2.0/security-groups?id=7fe194e6-71c3-47a9-8f36-0dbb24d1f72d&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0480030 Nov 23 19:40:52.952262 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8ef0e591-8c9e-4bb7-ac24-59d415eec163 req-c789e3a7-353a-458c-9b00-69a406955bed tempest-TestShelveInstance-292550524 tempest-TestShelveInstance-292550524-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102993) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:40:52.953746 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-8ef0e591-8c9e-4bb7-ac24-59d415eec163 req-c789e3a7-353a-458c-9b00-69a406955bed tempest-TestShelveInstance-292550524 tempest-TestShelveInstance-292550524-project] 10.222.0.62 "GET /v2.0/ports?device_id=b504cdb2-6182-4c24-9b46-6dc0f85da342 HTTP/1.1" status: 200 len: 946 time: 0.0516675 Nov 23 19:40:53.001262 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-8ef0e591-8c9e-4bb7-ac24-59d415eec163 req-4931088a-d7e4-4e63-ae9c-f9a2b5a18b79 tempest-TestShelveInstance-292550524 tempest-TestShelveInstance-292550524-project] 10.222.0.62 "GET /v2.0/security-groups?id=7fe194e6-71c3-47a9-8f36-0dbb24d1f72d&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0415392 Nov 23 19:40:53.333842 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ef2cd898-e16d-406f-b44c-de06ba1e4b77 req-b8ef84de-bbdf-4bf3-bdc7-14cd28d324c3 tempest-TestShelveInstance-292550524 tempest-TestShelveInstance-292550524-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102993) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:40:53.335295 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-ef2cd898-e16d-406f-b44c-de06ba1e4b77 req-b8ef84de-bbdf-4bf3-bdc7-14cd28d324c3 tempest-TestShelveInstance-292550524 tempest-TestShelveInstance-292550524-project] 10.222.0.62 "GET /v2.0/ports?device_id=b504cdb2-6182-4c24-9b46-6dc0f85da342 HTTP/1.1" status: 200 len: 946 time: 0.0727184 Nov 23 19:40:53.361821 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-2f2cbfab-5b7a-42c5-9e33-f2db023fc403 req-1eb0cc65-ddd4-430e-a6b1-229d6081ebac service neutron] 10.222.0.62 "GET /v2.0/ports?device_id=b504cdb2-6182-4c24-9b46-6dc0f85da342&fields=id&fields=resource_request HTTP/1.1" status: 200 len: 255 time: 0.0673029 Nov 23 19:40:53.392254 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-ef2cd898-e16d-406f-b44c-de06ba1e4b77 req-f132c70a-670e-4d9f-a250-fbf83b8c6fcd tempest-TestShelveInstance-292550524 tempest-TestShelveInstance-292550524-project] 10.222.0.62 "GET /v2.0/security-groups?id=7fe194e6-71c3-47a9-8f36-0dbb24d1f72d&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0504513 Nov 23 19:40:54.507622 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bb1e6f4e-5e6c-4914-9f71-a214de3bc706 req-7b77efbd-3ee0-4cbe-8003-999ef01c0ced tempest-TestShelveInstance-292550524 tempest-TestShelveInstance-292550524-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102992) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:40:54.509164 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-bb1e6f4e-5e6c-4914-9f71-a214de3bc706 req-7b77efbd-3ee0-4cbe-8003-999ef01c0ced tempest-TestShelveInstance-292550524 tempest-TestShelveInstance-292550524-project] 10.222.0.62 "GET /v2.0/ports?device_id=b504cdb2-6182-4c24-9b46-6dc0f85da342 HTTP/1.1" status: 200 len: 946 time: 0.0490489 Nov 23 19:40:54.559369 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-bb1e6f4e-5e6c-4914-9f71-a214de3bc706 req-5d785e5d-a293-4414-b109-bb5646c6b0f3 tempest-TestShelveInstance-292550524 tempest-TestShelveInstance-292550524-project] 10.222.0.62 "GET /v2.0/security-groups?id=7fe194e6-71c3-47a9-8f36-0dbb24d1f72d&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0441811 Nov 23 19:40:54.864122 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.plugins.ml2.rpc [None req-4bf48ff4-ecfb-4168-8b63-249b8c6e9f04 None None] Device bbafb0bb-163c-43f4-8d2c-2f5304e0bd04 no longer exists at agent hyperv_hv-cinder-81901 {{(pid=102994) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 23 19:40:54.940102 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron_lib.callbacks.manager [None req-4bf48ff4-ecfb-4168-8b63-249b8c6e9f04 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7921281'] for port, before_update {{(pid=102994) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:40:54.962221 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'b504cdb2-6182-4c24-9b46-6dc0f85da342', 'name': 'network-vif-unplugged', 'status': 'completed', 'tag': 'bbafb0bb-163c-43f4-8d2c-2f5304e0bd04'}] {{(pid=102994) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 23 19:40:54.964541 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.62/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}09a7511da0d2ba1d728b27e36a8467ec5289399952f0059588048a7cb66d3a43" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-8b169200-cd4f-4c5b-ae32-a0bf43829b6f" -d '{"events": [{"server_uuid": "b504cdb2-6182-4c24-9b46-6dc0f85da342", "name": "network-vif-unplugged", "status": "completed", "tag": "bbafb0bb-163c-43f4-8d2c-2f5304e0bd04"}]}' {{(pid=102994) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 23 19:40:54.977807 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.plugins.ml2.db [None req-4bf48ff4-ecfb-4168-8b63-249b8c6e9f04 None None] For port bbafb0bb-163c-43f4-8d2c-2f5304e0bd04, host hv-cinder-81901, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81901',level=0,port_id=bbafb0bb-163c-43f4-8d2c-2f5304e0bd04,segment=NetworkSegment(5c30b9a1-7b41-4664-aa24-084baf66a2d5),segment_id=5c30b9a1-7b41-4664-aa24-084baf66a2d5)] {{(pid=102994) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 23 19:40:55.001348 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG novaclient.v2.client [-] RESP: [207] Connection: close Content-Length: 182 Content-Type: application/json Date: Tue, 23 Nov 2021 19:40:54 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-64cebdcf-fd70-43d9-8a46-968ada2ed702 x-openstack-request-id: req-64cebdcf-fd70-43d9-8a46-968ada2ed702 {{(pid=102994) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 23 19:40:55.001674 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "b504cdb2-6182-4c24-9b46-6dc0f85da342", "name": "network-vif-unplugged", "status": "failed", "tag": "bbafb0bb-163c-43f4-8d2c-2f5304e0bd04", "code": 422}]} {{(pid=102994) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 23 19:40:55.001935 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.62/compute/v2.1/os-server-external-events used request id req-64cebdcf-fd70-43d9-8a46-968ada2ed702 {{(pid=102994) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 23 19:40:55.002364 dv-cinder-819011-1-iscsi neutron-server[102994]: WARNING neutron.notifiers.nova [-] Nova event: {'server_uuid': 'b504cdb2-6182-4c24-9b46-6dc0f85da342', 'name': 'network-vif-unplugged', 'status': 'failed', 'tag': 'bbafb0bb-163c-43f4-8d2c-2f5304e0bd04', 'code': 422} returned with failed status Nov 23 19:40:55.042326 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron_lib.callbacks.manager [None req-4bf48ff4-ecfb-4168-8b63-249b8c6e9f04 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7918660', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-15067', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560168', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8783631423946', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8783631008732', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8783631008750'] for port, after_update {{(pid=102994) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:40:55.096204 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4bf48ff4-ecfb-4168-8b63-249b8c6e9f04 None None] Pushing event updated for resources: {'Port': ['ID=bbafb0bb-163c-43f4-8d2c-2f5304e0bd04,revision_number=6']} {{(pid=102994) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 23 19:40:55.103485 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4bf48ff4-ecfb-4168-8b63-249b8c6e9f04 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-819011-1-iscsi {{(pid=102994) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 23 19:40:55.103861 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4bf48ff4-ecfb-4168-8b63-249b8c6e9f04 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-819011-1-iscsi {{(pid=102994) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 23 19:40:55.104217 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4bf48ff4-ecfb-4168-8b63-249b8c6e9f04 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-819011-1-iscsi {{(pid=102994) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 23 19:40:55.104598 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4bf48ff4-ecfb-4168-8b63-249b8c6e9f04 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-819011-1-iscsi {{(pid=102994) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 23 19:40:55.104903 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4bf48ff4-ecfb-4168-8b63-249b8c6e9f04 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-819011-1-iscsi {{(pid=102994) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 23 19:40:55.105284 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4bf48ff4-ecfb-4168-8b63-249b8c6e9f04 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-819011-1-iscsi {{(pid=102994) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 23 19:40:55.105607 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4bf48ff4-ecfb-4168-8b63-249b8c6e9f04 None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-819011-1-iscsi {{(pid=102994) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 23 19:40:55.105942 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4bf48ff4-ecfb-4168-8b63-249b8c6e9f04 None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-819011-1-iscsi {{(pid=102994) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 23 19:40:55.106275 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4bf48ff4-ecfb-4168-8b63-249b8c6e9f04 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-819011-1-iscsi {{(pid=102994) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 23 19:40:55.106606 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4bf48ff4-ecfb-4168-8b63-249b8c6e9f04 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-819011-1-iscsi {{(pid=102994) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 23 19:40:55.106940 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4bf48ff4-ecfb-4168-8b63-249b8c6e9f04 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-819011-1-iscsi {{(pid=102994) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 23 19:40:55.107295 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4bf48ff4-ecfb-4168-8b63-249b8c6e9f04 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-819011-1-iscsi {{(pid=102994) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 23 19:40:55.713342 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6792ae04-ce53-40c7-99c2-688e68d3929f req-6e10a255-ba4e-418c-8af4-01c1e875eec0 tempest-TestShelveInstance-292550524 tempest-TestShelveInstance-292550524-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102992) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:40:55.714807 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-6792ae04-ce53-40c7-99c2-688e68d3929f req-6e10a255-ba4e-418c-8af4-01c1e875eec0 tempest-TestShelveInstance-292550524 tempest-TestShelveInstance-292550524-project] 10.222.0.62 "GET /v2.0/ports?device_id=b504cdb2-6182-4c24-9b46-6dc0f85da342 HTTP/1.1" status: 200 len: 944 time: 0.0793247 Nov 23 19:40:55.718045 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2f2cbfab-5b7a-42c5-9e33-f2db023fc403 req-2c832d52-0fda-42d0-aa72-0e73ab7a9a6f service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102992) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:40:55.719391 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-2f2cbfab-5b7a-42c5-9e33-f2db023fc403 req-2c832d52-0fda-42d0-aa72-0e73ab7a9a6f service neutron] 10.222.0.41 "GET /v2.0/ports?device_id=b504cdb2-6182-4c24-9b46-6dc0f85da342&tenant_id=35f8a5017a27449084aabd12f27f5a8a HTTP/1.1" status: 200 len: 1097 time: 0.1105194 Nov 23 19:40:55.762209 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-6792ae04-ce53-40c7-99c2-688e68d3929f req-aca330f8-d95a-4f92-ab71-b76390db0aa3 tempest-TestShelveInstance-292550524 tempest-TestShelveInstance-292550524-project] 10.222.0.62 "GET /v2.0/security-groups?id=7fe194e6-71c3-47a9-8f36-0dbb24d1f72d&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0407884 Nov 23 19:40:55.800614 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2f2cbfab-5b7a-42c5-9e33-f2db023fc403 req-2c32d784-bdf2-4363-be28-458a82b7adf0 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102992) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:40:55.802144 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-2f2cbfab-5b7a-42c5-9e33-f2db023fc403 req-2c32d784-bdf2-4363-be28-458a82b7adf0 service neutron] 10.222.0.41 "GET /v2.0/ports?tenant_id=35f8a5017a27449084aabd12f27f5a8a&device_id=b504cdb2-6182-4c24-9b46-6dc0f85da342 HTTP/1.1" status: 200 len: 1097 time: 0.0391016 Nov 23 19:40:55.901996 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2f2cbfab-5b7a-42c5-9e33-f2db023fc403 req-dff66116-a9ed-4255-84e7-11173c54aecf service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102992) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:40:55.903343 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-2f2cbfab-5b7a-42c5-9e33-f2db023fc403 req-dff66116-a9ed-4255-84e7-11173c54aecf service neutron] 10.222.0.41 "GET /v2.0/networks?id=87e46ab6-0f90-430f-930f-9ea1580c04c3 HTTP/1.1" status: 200 len: 909 time: 0.0851505 Nov 23 19:40:55.971630 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-2f2cbfab-5b7a-42c5-9e33-f2db023fc403 req-b04af693-4e0b-421b-b91d-9dc2c8a09329 service neutron] 10.222.0.41 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.13&port_id=bbafb0bb-163c-43f4-8d2c-2f5304e0bd04 HTTP/1.1" status: 200 len: 1000 time: 0.0572991 Nov 23 19:40:56.023663 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2f2cbfab-5b7a-42c5-9e33-f2db023fc403 req-bd010409-e28c-420c-869c-6eb9579d3de0 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102992) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:40:56.025100 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-2f2cbfab-5b7a-42c5-9e33-f2db023fc403 req-bd010409-e28c-420c-869c-6eb9579d3de0 service neutron] 10.222.0.41 "GET /v2.0/subnets?id=afa5bc59-f70c-409d-8c15-be2dcdce66a3 HTTP/1.1" status: 200 len: 847 time: 0.0459082 Nov 23 19:40:56.071361 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2f2cbfab-5b7a-42c5-9e33-f2db023fc403 req-9c0cdb56-b442-47af-9fc2-03ddd41357c2 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102992) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:40:56.072775 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-2f2cbfab-5b7a-42c5-9e33-f2db023fc403 req-9c0cdb56-b442-47af-9fc2-03ddd41357c2 service neutron] 10.222.0.41 "GET /v2.0/ports?network_id=87e46ab6-0f90-430f-930f-9ea1580c04c3&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0381696 Nov 23 19:40:56.168048 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-2f2cbfab-5b7a-42c5-9e33-f2db023fc403 req-1f0ed53e-6af0-45c7-8880-95a173060584 service neutron] 10.222.0.41 "GET /v2.0/networks/87e46ab6-0f90-430f-930f-9ea1580c04c3?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0788245 Nov 23 19:40:56.262802 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-2f2cbfab-5b7a-42c5-9e33-f2db023fc403 req-1c328136-39b1-47a4-bf27-da3c6e07660d service neutron] 10.222.0.41 "GET /v2.0/networks/87e46ab6-0f90-430f-930f-9ea1580c04c3?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0828559 Nov 23 19:40:56.880495 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-47bd6665-77b5-4013-be24-ac48863086b0 req-f72ad200-d46b-4337-b90c-8fae219563db tempest-TestShelveInstance-292550524 tempest-TestShelveInstance-292550524-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102993) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:40:56.882017 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-47bd6665-77b5-4013-be24-ac48863086b0 req-f72ad200-d46b-4337-b90c-8fae219563db tempest-TestShelveInstance-292550524 tempest-TestShelveInstance-292550524-project] 10.222.0.62 "GET /v2.0/ports?device_id=b504cdb2-6182-4c24-9b46-6dc0f85da342 HTTP/1.1" status: 200 len: 944 time: 0.0518141 Nov 23 19:40:56.931562 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-47bd6665-77b5-4013-be24-ac48863086b0 req-d0df7459-45de-43ce-834b-81f031efcfa5 tempest-TestShelveInstance-292550524 tempest-TestShelveInstance-292550524-project] 10.222.0.62 "GET /v2.0/security-groups?id=7fe194e6-71c3-47a9-8f36-0dbb24d1f72d&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0436075 Nov 23 19:40:58.046379 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f3f21671-e0e2-4101-a794-1fe898214e47 req-49888eb7-e6e4-46a2-b44e-52e46068ce34 tempest-TestShelveInstance-292550524 tempest-TestShelveInstance-292550524-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102992) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:40:58.047861 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-f3f21671-e0e2-4101-a794-1fe898214e47 req-49888eb7-e6e4-46a2-b44e-52e46068ce34 tempest-TestShelveInstance-292550524 tempest-TestShelveInstance-292550524-project] 10.222.0.62 "GET /v2.0/ports?device_id=b504cdb2-6182-4c24-9b46-6dc0f85da342 HTTP/1.1" status: 200 len: 944 time: 0.0481057 Nov 23 19:40:58.097079 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-f3f21671-e0e2-4101-a794-1fe898214e47 req-19c36c0b-fc54-4727-bd53-417b38556e2f tempest-TestShelveInstance-292550524 tempest-TestShelveInstance-292550524-project] 10.222.0.62 "GET /v2.0/security-groups?id=7fe194e6-71c3-47a9-8f36-0dbb24d1f72d&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0432887 Nov 23 19:40:59.212102 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-42d99918-494f-45ff-8fd6-05e7265c3f27 req-a445a845-cfc8-4071-8c29-57f9baffb7c6 tempest-TestShelveInstance-292550524 tempest-TestShelveInstance-292550524-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102993) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:40:59.213583 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-42d99918-494f-45ff-8fd6-05e7265c3f27 req-a445a845-cfc8-4071-8c29-57f9baffb7c6 tempest-TestShelveInstance-292550524 tempest-TestShelveInstance-292550524-project] 10.222.0.62 "GET /v2.0/ports?device_id=b504cdb2-6182-4c24-9b46-6dc0f85da342 HTTP/1.1" status: 200 len: 944 time: 0.0485539 Nov 23 19:40:59.261275 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-42d99918-494f-45ff-8fd6-05e7265c3f27 req-6ee6bb08-8cc2-40b5-87ba-42571239bbf5 tempest-TestShelveInstance-292550524 tempest-TestShelveInstance-292550524-project] 10.222.0.62 "GET /v2.0/security-groups?id=7fe194e6-71c3-47a9-8f36-0dbb24d1f72d&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0417068 Nov 23 19:40:59.761520 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron_lib.callbacks.manager [None req-4bf48ff4-ecfb-4168-8b63-249b8c6e9f04 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8783631323329', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7978582'] for agent, after_update {{(pid=102994) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:41:00.378398 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7708db00-1f43-4f92-9f11-17cbe6548a2a req-e5b1ef64-a0fc-443c-aeb9-dcfceeb85476 tempest-TestShelveInstance-292550524 tempest-TestShelveInstance-292550524-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102992) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:41:00.379798 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-7708db00-1f43-4f92-9f11-17cbe6548a2a req-e5b1ef64-a0fc-443c-aeb9-dcfceeb85476 tempest-TestShelveInstance-292550524 tempest-TestShelveInstance-292550524-project] 10.222.0.62 "GET /v2.0/ports?device_id=b504cdb2-6182-4c24-9b46-6dc0f85da342 HTTP/1.1" status: 200 len: 944 time: 0.0525692 Nov 23 19:41:00.691008 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-7708db00-1f43-4f92-9f11-17cbe6548a2a req-bdeada8e-fb33-4db0-b834-74c17bd96649 tempest-TestShelveInstance-292550524 tempest-TestShelveInstance-292550524-project] 10.222.0.62 "GET /v2.0/security-groups?id=7fe194e6-71c3-47a9-8f36-0dbb24d1f72d&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.3052742 Nov 23 19:41:01.807206 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9ac20b52-1046-41e5-b596-09d5ccae2996 req-6ddec6e2-c0c1-4cc2-8444-24488217fd89 tempest-TestShelveInstance-292550524 tempest-TestShelveInstance-292550524-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102993) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:41:01.808676 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-9ac20b52-1046-41e5-b596-09d5ccae2996 req-6ddec6e2-c0c1-4cc2-8444-24488217fd89 tempest-TestShelveInstance-292550524 tempest-TestShelveInstance-292550524-project] 10.222.0.62 "GET /v2.0/ports?device_id=b504cdb2-6182-4c24-9b46-6dc0f85da342 HTTP/1.1" status: 200 len: 944 time: 0.0515440 Nov 23 19:41:01.859272 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-9ac20b52-1046-41e5-b596-09d5ccae2996 req-eb4f635f-7d62-422a-98b1-62a584d279dc tempest-TestShelveInstance-292550524 tempest-TestShelveInstance-292550524-project] 10.222.0.62 "GET /v2.0/security-groups?id=7fe194e6-71c3-47a9-8f36-0dbb24d1f72d&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0439920 Nov 23 19:41:02.971812 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a2cb4ec1-4257-48a7-ace0-d30a4f3187d7 req-d75eb6f8-9212-4324-8f4e-af108046bba5 tempest-TestShelveInstance-292550524 tempest-TestShelveInstance-292550524-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102992) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:41:02.973260 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-a2cb4ec1-4257-48a7-ace0-d30a4f3187d7 req-d75eb6f8-9212-4324-8f4e-af108046bba5 tempest-TestShelveInstance-292550524 tempest-TestShelveInstance-292550524-project] 10.222.0.62 "GET /v2.0/ports?device_id=b504cdb2-6182-4c24-9b46-6dc0f85da342 HTTP/1.1" status: 200 len: 944 time: 0.0486984 Nov 23 19:41:03.021893 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-a2cb4ec1-4257-48a7-ace0-d30a4f3187d7 req-9c0272b6-c3c1-487c-bc81-9fd08947179c tempest-TestShelveInstance-292550524 tempest-TestShelveInstance-292550524-project] 10.222.0.62 "GET /v2.0/security-groups?id=7fe194e6-71c3-47a9-8f36-0dbb24d1f72d&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0427985 Nov 23 19:41:04.135742 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fede867d-6f7a-4593-a7d7-c7bcf23c4257 req-82282c28-4185-4204-889a-cef94352ace1 tempest-TestShelveInstance-292550524 tempest-TestShelveInstance-292550524-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102993) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:41:04.137289 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-fede867d-6f7a-4593-a7d7-c7bcf23c4257 req-82282c28-4185-4204-889a-cef94352ace1 tempest-TestShelveInstance-292550524 tempest-TestShelveInstance-292550524-project] 10.222.0.62 "GET /v2.0/ports?device_id=b504cdb2-6182-4c24-9b46-6dc0f85da342 HTTP/1.1" status: 200 len: 944 time: 0.0485404 Nov 23 19:41:04.188678 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-fede867d-6f7a-4593-a7d7-c7bcf23c4257 req-8c297e38-cf3e-411d-b1d3-111c23fe66cb tempest-TestShelveInstance-292550524 tempest-TestShelveInstance-292550524-project] 10.222.0.62 "GET /v2.0/security-groups?id=7fe194e6-71c3-47a9-8f36-0dbb24d1f72d&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0444479 Nov 23 19:41:04.925299 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.plugins.ml2.rpc [None req-4bf48ff4-ecfb-4168-8b63-249b8c6e9f04 None None] Device bbafb0bb-163c-43f4-8d2c-2f5304e0bd04 details requested by agent hyperv_hv-cinder-81901 with host hv-cinder-81901 {{(pid=102994) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Nov 23 19:41:05.020499 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.plugins.ml2.db [None req-4bf48ff4-ecfb-4168-8b63-249b8c6e9f04 None None] For port bbafb0bb-163c-43f4-8d2c-2f5304e0bd04, host hv-cinder-81901, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81901',level=0,port_id=bbafb0bb-163c-43f4-8d2c-2f5304e0bd04,segment=NetworkSegment(5c30b9a1-7b41-4664-aa24-084baf66a2d5),segment_id=5c30b9a1-7b41-4664-aa24-084baf66a2d5)] {{(pid=102994) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 23 19:41:05.031418 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.plugins.ml2.rpc [None req-4bf48ff4-ecfb-4168-8b63-249b8c6e9f04 None None] Returning: {'device': 'bbafb0bb-163c-43f4-8d2c-2f5304e0bd04', 'network_id': '87e46ab6-0f90-430f-930f-9ea1580c04c3', 'port_id': 'bbafb0bb-163c-43f4-8d2c-2f5304e0bd04', 'mac_address': 'fa:16:3e:3d:cc:c0', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 817, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'afa5bc59-f70c-409d-8c15-be2dcdce66a3', 'ip_address': '172.20.0.13'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=102994) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Nov 23 19:41:05.067944 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron_lib.callbacks.manager [None req-4bf48ff4-ecfb-4168-8b63-249b8c6e9f04 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7921281'] for port, before_update {{(pid=102994) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:41:05.080744 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.notifiers.nova [None req-4bf48ff4-ecfb-4168-8b63-249b8c6e9f04 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id bbafb0bb-163c-43f4-8d2c-2f5304e0bd04 {{(pid=102994) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 23 19:41:05.099522 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.plugins.ml2.db [None req-4bf48ff4-ecfb-4168-8b63-249b8c6e9f04 None None] For port bbafb0bb-163c-43f4-8d2c-2f5304e0bd04, host hv-cinder-81901, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81901',level=0,port_id=bbafb0bb-163c-43f4-8d2c-2f5304e0bd04,segment=NetworkSegment(5c30b9a1-7b41-4664-aa24-084baf66a2d5),segment_id=5c30b9a1-7b41-4664-aa24-084baf66a2d5)] {{(pid=102994) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 23 19:41:05.167510 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron_lib.callbacks.manager [None req-4bf48ff4-ecfb-4168-8b63-249b8c6e9f04 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7918660', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-15067', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560168', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8783631423946', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8783631008732', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8783631008750'] for port, after_update {{(pid=102994) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:41:05.218085 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4bf48ff4-ecfb-4168-8b63-249b8c6e9f04 None None] Pushing event updated for resources: {'Port': ['ID=bbafb0bb-163c-43f4-8d2c-2f5304e0bd04,revision_number=7']} {{(pid=102994) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 23 19:41:05.302530 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-aa0324fe-62b9-453b-8390-e2f7f9bf3e45 req-e9cd5c1e-69f0-4fbe-939a-3eed3c1708b3 tempest-TestShelveInstance-292550524 tempest-TestShelveInstance-292550524-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102992) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:41:05.304002 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-aa0324fe-62b9-453b-8390-e2f7f9bf3e45 req-e9cd5c1e-69f0-4fbe-939a-3eed3c1708b3 tempest-TestShelveInstance-292550524 tempest-TestShelveInstance-292550524-project] 10.222.0.62 "GET /v2.0/ports?device_id=b504cdb2-6182-4c24-9b46-6dc0f85da342 HTTP/1.1" status: 200 len: 945 time: 0.0481467 Nov 23 19:41:05.355593 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-aa0324fe-62b9-453b-8390-e2f7f9bf3e45 req-0e541f91-ae10-4d35-8f16-e133b0d5766e tempest-TestShelveInstance-292550524 tempest-TestShelveInstance-292550524-project] 10.222.0.62 "GET /v2.0/security-groups?id=7fe194e6-71c3-47a9-8f36-0dbb24d1f72d&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0455010 Nov 23 19:41:05.488670 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.plugins.ml2.db [None req-4bf48ff4-ecfb-4168-8b63-249b8c6e9f04 None None] get_ports_and_sgs() called for port_ids ['bbafb0bb-163c-43f4-8d2c-2f5304e0bd04'] {{(pid=102994) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 23 19:41:06.470784 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-68e0df80-11b0-4551-962e-6e4b9bba2acb req-900a909d-6d68-4e39-bfee-b26add02614b tempest-TestShelveInstance-292550524 tempest-TestShelveInstance-292550524-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102993) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:41:06.472272 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-68e0df80-11b0-4551-962e-6e4b9bba2acb req-900a909d-6d68-4e39-bfee-b26add02614b tempest-TestShelveInstance-292550524 tempest-TestShelveInstance-292550524-project] 10.222.0.62 "GET /v2.0/ports?device_id=b504cdb2-6182-4c24-9b46-6dc0f85da342 HTTP/1.1" status: 200 len: 945 time: 0.0486290 Nov 23 19:41:06.526230 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-68e0df80-11b0-4551-962e-6e4b9bba2acb req-b5aa4b9c-1d8f-490a-9d4a-bd72ae3561b3 tempest-TestShelveInstance-292550524 tempest-TestShelveInstance-292550524-project] 10.222.0.62 "GET /v2.0/security-groups?id=7fe194e6-71c3-47a9-8f36-0dbb24d1f72d&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0481236 Nov 23 19:41:06.941268 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.plugins.ml2.rpc [None req-4bf48ff4-ecfb-4168-8b63-249b8c6e9f04 None None] Device bbafb0bb-163c-43f4-8d2c-2f5304e0bd04 up at agent hyperv_hv-cinder-81901 {{(pid=102994) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 23 19:41:06.992557 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.db.provisioning_blocks [None req-4bf48ff4-ecfb-4168-8b63-249b8c6e9f04 None None] Provisioning complete for port bbafb0bb-163c-43f4-8d2c-2f5304e0bd04 triggered by entity L2. {{(pid=102994) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 23 19:41:06.992963 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron_lib.callbacks.manager [None req-4bf48ff4-ecfb-4168-8b63-249b8c6e9f04 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-8355713'] for port, provisioning_complete {{(pid=102994) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:41:07.043834 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-22eb479a-5235-4d6c-ab90-1f30914caf39 req-f6e947d0-15dc-4dfb-b029-e6e33346e8d1 tempest-AttachVolumeShelveTestJSON-1172915835 tempest-AttachVolumeShelveTestJSON-1172915835-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102992) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:41:07.045313 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-22eb479a-5235-4d6c-ab90-1f30914caf39 req-f6e947d0-15dc-4dfb-b029-e6e33346e8d1 tempest-AttachVolumeShelveTestJSON-1172915835 tempest-AttachVolumeShelveTestJSON-1172915835-project] 10.222.0.62 "GET /v2.0/ports?device_id=627eaac3-8c43-4aa3-a81c-7a6bfb58dbb5 HTTP/1.1" status: 200 len: 947 time: 0.0513494 Nov 23 19:41:07.070799 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron_lib.callbacks.manager [None req-4bf48ff4-ecfb-4168-8b63-249b8c6e9f04 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7921281'] for port, before_update {{(pid=102994) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:41:07.092788 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'b504cdb2-6182-4c24-9b46-6dc0f85da342', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'bbafb0bb-163c-43f4-8d2c-2f5304e0bd04'}] {{(pid=102994) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 23 19:41:07.094572 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-22eb479a-5235-4d6c-ab90-1f30914caf39 req-3a3e8649-10ef-4721-8c7a-a2805548c759 tempest-AttachVolumeShelveTestJSON-1172915835 tempest-AttachVolumeShelveTestJSON-1172915835-project] 10.222.0.62 "GET /v2.0/security-groups?id=a246a431-7eb4-441f-b1e6-9c9c351ee888&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0422966 Nov 23 19:41:07.095037 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.62/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}09a7511da0d2ba1d728b27e36a8467ec5289399952f0059588048a7cb66d3a43" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-136e306f-cb2c-4226-bde4-229607cee976" -d '{"events": [{"server_uuid": "b504cdb2-6182-4c24-9b46-6dc0f85da342", "name": "network-vif-plugged", "status": "completed", "tag": "bbafb0bb-163c-43f4-8d2c-2f5304e0bd04"}]}' {{(pid=102994) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 23 19:41:07.111438 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.plugins.ml2.db [None req-4bf48ff4-ecfb-4168-8b63-249b8c6e9f04 None None] For port bbafb0bb-163c-43f4-8d2c-2f5304e0bd04, host hv-cinder-81901, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81901',level=0,port_id=bbafb0bb-163c-43f4-8d2c-2f5304e0bd04,segment=NetworkSegment(5c30b9a1-7b41-4664-aa24-084baf66a2d5),segment_id=5c30b9a1-7b41-4664-aa24-084baf66a2d5)] {{(pid=102994) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 23 19:41:07.142185 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 23 Nov 2021 19:41:07 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-5930b5bb-18e2-4e6f-9703-940866581a3f x-openstack-request-id: req-5930b5bb-18e2-4e6f-9703-940866581a3f {{(pid=102994) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 23 19:41:07.142185 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "b504cdb2-6182-4c24-9b46-6dc0f85da342", "name": "network-vif-plugged", "status": "completed", "tag": "bbafb0bb-163c-43f4-8d2c-2f5304e0bd04", "code": 200}]} {{(pid=102994) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 23 19:41:07.142185 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.62/compute/v2.1/os-server-external-events used request id req-5930b5bb-18e2-4e6f-9703-940866581a3f {{(pid=102994) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 23 19:41:07.142185 dv-cinder-819011-1-iscsi neutron-server[102994]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'b504cdb2-6182-4c24-9b46-6dc0f85da342', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'bbafb0bb-163c-43f4-8d2c-2f5304e0bd04', 'code': 200} Nov 23 19:41:07.190491 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron_lib.callbacks.manager [None req-4bf48ff4-ecfb-4168-8b63-249b8c6e9f04 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7918660', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-15067', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560168', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8783631423946', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8783631008732', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8783631008750'] for port, after_update {{(pid=102994) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:41:07.240230 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4bf48ff4-ecfb-4168-8b63-249b8c6e9f04 None None] Pushing event updated for resources: {'Port': ['ID=bbafb0bb-163c-43f4-8d2c-2f5304e0bd04,revision_number=8']} {{(pid=102994) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 23 19:41:07.478296 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7bfb8de2-4f93-498a-8708-bbd086ed2b32 req-87c73a25-6de1-4102-8e36-9f30eb9305e1 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102992) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:41:07.479786 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-7bfb8de2-4f93-498a-8708-bbd086ed2b32 req-87c73a25-6de1-4102-8e36-9f30eb9305e1 service neutron] 10.222.0.41 "GET /v2.0/ports?device_id=b504cdb2-6182-4c24-9b46-6dc0f85da342 HTTP/1.1" status: 200 len: 1099 time: 0.0400584 Nov 23 19:41:07.529243 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-7bfb8de2-4f93-498a-8708-bbd086ed2b32 req-664f4c6f-d618-428c-8829-3980f0160e1a service neutron] 10.222.0.41 "GET /v2.0/security-groups?id=7fe194e6-71c3-47a9-8f36-0dbb24d1f72d&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0379009 Nov 23 19:41:07.642550 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-73d88572-2ab8-491b-8b74-c989415c7af1 req-5f1dadfc-b7d3-4d9e-a5ac-c32a7bc61531 tempest-TestShelveInstance-292550524 tempest-TestShelveInstance-292550524-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102992) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:41:07.644010 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-73d88572-2ab8-491b-8b74-c989415c7af1 req-5f1dadfc-b7d3-4d9e-a5ac-c32a7bc61531 tempest-TestShelveInstance-292550524 tempest-TestShelveInstance-292550524-project] 10.222.0.62 "GET /v2.0/ports?device_id=b504cdb2-6182-4c24-9b46-6dc0f85da342 HTTP/1.1" status: 200 len: 946 time: 0.0517480 Nov 23 19:41:07.694513 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-73d88572-2ab8-491b-8b74-c989415c7af1 req-e7f02ecb-1403-4877-9023-e41acb79aa87 tempest-TestShelveInstance-292550524 tempest-TestShelveInstance-292550524-project] 10.222.0.62 "GET /v2.0/security-groups?id=7fe194e6-71c3-47a9-8f36-0dbb24d1f72d&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0443645 Nov 23 19:41:08.218536 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-479ed5c7-bc3e-499b-bb07-17887474dcc2 req-550e953d-555e-41eb-9ce7-e87308f6083c tempest-AttachVolumeShelveTestJSON-1172915835 tempest-AttachVolumeShelveTestJSON-1172915835-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102993) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:41:08.219992 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-479ed5c7-bc3e-499b-bb07-17887474dcc2 req-550e953d-555e-41eb-9ce7-e87308f6083c tempest-AttachVolumeShelveTestJSON-1172915835 tempest-AttachVolumeShelveTestJSON-1172915835-project] 10.222.0.62 "GET /v2.0/ports?device_id=627eaac3-8c43-4aa3-a81c-7a6bfb58dbb5 HTTP/1.1" status: 200 len: 947 time: 0.0499456 Nov 23 19:41:08.266009 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-479ed5c7-bc3e-499b-bb07-17887474dcc2 req-9810ac93-80da-474f-bace-6c0c124d5bdf tempest-AttachVolumeShelveTestJSON-1172915835 tempest-AttachVolumeShelveTestJSON-1172915835-project] 10.222.0.62 "GET /v2.0/security-groups?id=a246a431-7eb4-441f-b1e6-9c9c351ee888&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0401311 Nov 23 19:41:08.809384 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a297a11b-497d-43bb-ad6f-f1caf44d8682 req-524dd683-9616-444d-8053-c64b0687eadc tempest-TestShelveInstance-292550524 tempest-TestShelveInstance-292550524-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102992) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:41:08.810870 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-a297a11b-497d-43bb-ad6f-f1caf44d8682 req-524dd683-9616-444d-8053-c64b0687eadc tempest-TestShelveInstance-292550524 tempest-TestShelveInstance-292550524-project] 10.222.0.62 "GET /v2.0/ports?device_id=b504cdb2-6182-4c24-9b46-6dc0f85da342 HTTP/1.1" status: 200 len: 946 time: 0.0498042 Nov 23 19:41:08.861642 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-a297a11b-497d-43bb-ad6f-f1caf44d8682 req-e38545ed-b9ea-4f97-92dc-32507c2496c4 tempest-TestShelveInstance-292550524 tempest-TestShelveInstance-292550524-project] 10.222.0.62 "GET /v2.0/security-groups?id=7fe194e6-71c3-47a9-8f36-0dbb24d1f72d&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0439746 Nov 23 19:41:09.020350 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e62e152b-0763-4029-80df-9a3742f0a41f req-9b422247-ba69-4c63-ac08-a94248d4dc72 tempest-AttachVolumeShelveTestJSON-1172915835 tempest-AttachVolumeShelveTestJSON-1172915835-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102992) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:41:09.021793 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-e62e152b-0763-4029-80df-9a3742f0a41f req-9b422247-ba69-4c63-ac08-a94248d4dc72 tempest-AttachVolumeShelveTestJSON-1172915835 tempest-AttachVolumeShelveTestJSON-1172915835-project] 10.222.0.41 "GET /v2.0/ports?device_id=627eaac3-8c43-4aa3-a81c-7a6bfb58dbb5 HTTP/1.1" status: 200 len: 947 time: 0.0475638 Nov 23 19:41:09.125060 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.plugins.ml2.plugin [req-e62e152b-0763-4029-80df-9a3742f0a41f req-21f6d345-9b88-42d4-86c9-974a158f8193 tempest-AttachVolumeShelveTestJSON-1172915835 tempest-AttachVolumeShelveTestJSON-1172915835-project] Deleting port 895334df-08a6-40fc-9056-3c5fba79b18c {{(pid=102992) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 23 19:41:09.125529 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [req-e62e152b-0763-4029-80df-9a3742f0a41f req-21f6d345-9b88-42d4-86c9-974a158f8193 tempest-AttachVolumeShelveTestJSON-1172915835 tempest-AttachVolumeShelveTestJSON-1172915835-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8783631423070'] for port, before_delete {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:41:09.214148 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.plugins.ml2.db [req-e62e152b-0763-4029-80df-9a3742f0a41f req-21f6d345-9b88-42d4-86c9-974a158f8193 tempest-AttachVolumeShelveTestJSON-1172915835 tempest-AttachVolumeShelveTestJSON-1172915835-project] For port 895334df-08a6-40fc-9056-3c5fba79b18c, host hv-cinder-81901, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81901',level=0,port_id=895334df-08a6-40fc-9056-3c5fba79b18c,segment=NetworkSegment(b4453f21-ac7f-498c-8316-73b738820700),segment_id=b4453f21-ac7f-498c-8316-73b738820700)] {{(pid=102992) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 23 19:41:09.214501 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [req-e62e152b-0763-4029-80df-9a3742f0a41f req-21f6d345-9b88-42d4-86c9-974a158f8193 tempest-AttachVolumeShelveTestJSON-1172915835 tempest-AttachVolumeShelveTestJSON-1172915835-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-927332'] for port, precommit_delete {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:41:09.384629 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [req-e62e152b-0763-4029-80df-9a3742f0a41f req-21f6d345-9b88-42d4-86c9-974a158f8193 tempest-AttachVolumeShelveTestJSON-1172915835 tempest-AttachVolumeShelveTestJSON-1172915835-project] Publish callbacks [] for floatingip, precommit_update {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:41:09.391881 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [req-e62e152b-0763-4029-80df-9a3742f0a41f req-21f6d345-9b88-42d4-86c9-974a158f8193 tempest-AttachVolumeShelveTestJSON-1172915835 tempest-AttachVolumeShelveTestJSON-1172915835-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-926531'] for floatingip, after_update {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:41:09.391881 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.db.l3_db [req-e62e152b-0763-4029-80df-9a3742f0a41f req-21f6d345-9b88-42d4-86c9-974a158f8193 tempest-AttachVolumeShelveTestJSON-1172915835 tempest-AttachVolumeShelveTestJSON-1172915835-project] Floating IP 25e15911-590c-423c-af10-5497434dba8d disassociated. External IP: 172.27.1.207, port: 895334df-08a6-40fc-9056-3c5fba79b18c. Nov 23 19:41:09.392121 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2edf0700-a1ff-4b1a-b392-e4d833f27588 req-d06aca8e-e92b-486b-96de-59a89f5c2e92 tempest-AttachVolumeShelveTestJSON-1172915835 tempest-AttachVolumeShelveTestJSON-1172915835-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102993) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:41:09.392584 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.plugins.ml2.plugin [req-e62e152b-0763-4029-80df-9a3742f0a41f req-21f6d345-9b88-42d4-86c9-974a158f8193 tempest-AttachVolumeShelveTestJSON-1172915835 tempest-AttachVolumeShelveTestJSON-1172915835-project] Calling delete_port for 895334df-08a6-40fc-9056-3c5fba79b18c owned by compute:nova {{(pid=102992) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 23 19:41:09.392697 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-2edf0700-a1ff-4b1a-b392-e4d833f27588 req-d06aca8e-e92b-486b-96de-59a89f5c2e92 tempest-AttachVolumeShelveTestJSON-1172915835 tempest-AttachVolumeShelveTestJSON-1172915835-project] 10.222.0.62 "GET /v2.0/ports?device_id=627eaac3-8c43-4aa3-a81c-7a6bfb58dbb5 HTTP/1.1" status: 200 len: 947 time: 0.0481710 Nov 23 19:41:09.434601 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-2edf0700-a1ff-4b1a-b392-e4d833f27588 req-e4ae8d3c-ab1c-4021-a3ac-2f9260424d0d tempest-AttachVolumeShelveTestJSON-1172915835 tempest-AttachVolumeShelveTestJSON-1172915835-project] 10.222.0.62 "GET /v2.0/security-groups?id=a246a431-7eb4-441f-b1e6-9c9c351ee888&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0408330 Nov 23 19:41:09.567118 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [req-e62e152b-0763-4029-80df-9a3742f0a41f req-21f6d345-9b88-42d4-86c9-974a158f8193 tempest-AttachVolumeShelveTestJSON-1172915835 tempest-AttachVolumeShelveTestJSON-1172915835-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7918660', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-15067', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560168', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8783631424624', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8783631008723', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-25199805'] for port, after_delete {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:41:09.595831 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-21f6d345-9b88-42d4-86c9-974a158f8193 tempest-AttachVolumeShelveTestJSON-1172915835 tempest-AttachVolumeShelveTestJSON-1172915835-project] Pushing event deleted for resources: {'Port': ['ID=895334df-08a6-40fc-9056-3c5fba79b18c,revision_number=None']} {{(pid=102992) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 23 19:41:09.708726 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.scheduler.l3_agent_scheduler [req-e62e152b-0763-4029-80df-9a3742f0a41f req-21f6d345-9b88-42d4-86c9-974a158f8193 tempest-AttachVolumeShelveTestJSON-1172915835 tempest-AttachVolumeShelveTestJSON-1172915835-project] Router 01438284-e62a-4056-8ee2-4899a051e144 has already been hosted by L3 agent 1b20f2c4-70b6-43c3-b9bd-0062cc9e57ac {{(pid=102992) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 23 19:41:09.815318 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [req-e62e152b-0763-4029-80df-9a3742f0a41f req-21f6d345-9b88-42d4-86c9-974a158f8193 tempest-AttachVolumeShelveTestJSON-1172915835 tempest-AttachVolumeShelveTestJSON-1172915835-project] Notify agent at l3_agent.dv-cinder-819011-1-iscsi the message routers_updated {{(pid=102992) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 23 19:41:09.825650 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-70fe4f83-caa8-43ce-bc9b-e49deb2252d6 None None] Sync routers for ids ['01438284-e62a-4056-8ee2-4899a051e144'] in dv-cinder-819011-1-iscsi {{(pid=102994) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 23 19:41:09.835964 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.db.l3_dvrscheduler_db [None req-70fe4f83-caa8-43ce-bc9b-e49deb2252d6 None None] Routers {'01438284-e62a-4056-8ee2-4899a051e144'} bound to L3 agent in host dv-cinder-819011-1-iscsi {{(pid=102994) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 23 19:41:09.836571 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.db.l3_hamode_db [None req-70fe4f83-caa8-43ce-bc9b-e49deb2252d6 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-819011-1-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 7, "extensions": [], "floating_ips": 4, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 7, "log_agent_heartbeats": false, "routers": 7},created_at=2021-11-23T19:25:14Z,description=,heartbeat_timestamp=2021-11-23T19:40:44Z,host='dv-cinder-819011-1-iscsi',id=1b20f2c4-70b6-43c3-b9bd-0062cc9e57ac,load=0,resource_versions=,resources_synced=,started_at=2021-11-23T19:25:15Z,topic='l3_agent')) {'router_ids': ['01438284-e62a-4056-8ee2-4899a051e144'], 'active': True} {{(pid=102994) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 23 19:41:09.854680 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.db.l3_dvrscheduler_db [req-e62e152b-0763-4029-80df-9a3742f0a41f req-21f6d345-9b88-42d4-86c9-974a158f8193 tempest-AttachVolumeShelveTestJSON-1172915835 tempest-AttachVolumeShelveTestJSON-1172915835-project] No DVR routers for this DVR port 895334df-08a6-40fc-9056-3c5fba79b18c on host hv-cinder-81901 {{(pid=102992) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 23 19:41:09.857186 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [req-e62e152b-0763-4029-80df-9a3742f0a41f req-21f6d345-9b88-42d4-86c9-974a158f8193 tempest-AttachVolumeShelveTestJSON-1172915835 tempest-AttachVolumeShelveTestJSON-1172915835-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-514902'] for port, before_response {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:41:09.860606 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-e62e152b-0763-4029-80df-9a3742f0a41f req-21f6d345-9b88-42d4-86c9-974a158f8193 tempest-AttachVolumeShelveTestJSON-1172915835 tempest-AttachVolumeShelveTestJSON-1172915835-project] 10.222.0.41 "DELETE /v2.0/ports/895334df-08a6-40fc-9056-3c5fba79b18c HTTP/1.1" status: 204 len: 173 time: 0.8235853 Nov 23 19:41:09.861043 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '627eaac3-8c43-4aa3-a81c-7a6bfb58dbb5', 'name': 'network-vif-deleted', 'tag': '895334df-08a6-40fc-9056-3c5fba79b18c'}] {{(pid=102992) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 23 19:41:09.863340 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.62/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}f86c332b591ae691ababa4b64e0601cbf242a448242f95367ce03daabfb7e1ce" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-5d6a24e4-7ee2-4f45-940d-097eab9d10b1" -d '{"events": [{"server_uuid": "627eaac3-8c43-4aa3-a81c-7a6bfb58dbb5", "name": "network-vif-deleted", "tag": "895334df-08a6-40fc-9056-3c5fba79b18c"}]}' {{(pid=102992) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 23 19:41:09.902311 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 23 Nov 2021 19:41:09 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-58317705-dce8-4ace-a3c8-b8ee8c2b6b8e x-openstack-request-id: req-58317705-dce8-4ace-a3c8-b8ee8c2b6b8e {{(pid=102992) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 23 19:41:09.902617 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "627eaac3-8c43-4aa3-a81c-7a6bfb58dbb5", "name": "network-vif-deleted", "tag": "895334df-08a6-40fc-9056-3c5fba79b18c", "status": "completed", "code": 200}]} {{(pid=102992) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 23 19:41:09.902874 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.62/compute/v2.1/os-server-external-events used request id req-58317705-dce8-4ace-a3c8-b8ee8c2b6b8e {{(pid=102992) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 23 19:41:09.904590 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '627eaac3-8c43-4aa3-a81c-7a6bfb58dbb5', 'name': 'network-vif-deleted', 'tag': '895334df-08a6-40fc-9056-3c5fba79b18c', 'status': 'completed', 'code': 200} Nov 23 19:41:09.946802 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.db.l3_dvr_db [None req-70fe4f83-caa8-43ce-bc9b-e49deb2252d6 None None] Set router 01438284-e62a-4056-8ee2-4899a051e144 gateway port host: dv-cinder-819011-1-iscsi {{(pid=102994) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 23 19:41:10.000475 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2ce57070-f26e-4a02-95e4-eb21f8f88d83 req-11b51d48-ebd9-44c1-bbf1-4098d522056b tempest-TestShelveInstance-292550524 tempest-TestShelveInstance-292550524-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102993) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:41:10.005924 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-2ce57070-f26e-4a02-95e4-eb21f8f88d83 req-11b51d48-ebd9-44c1-bbf1-4098d522056b tempest-TestShelveInstance-292550524 tempest-TestShelveInstance-292550524-project] 10.222.0.62 "GET /v2.0/ports?device_id=b504cdb2-6182-4c24-9b46-6dc0f85da342 HTTP/1.1" status: 200 len: 946 time: 0.0731585 Nov 23 19:41:10.079252 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-2ce57070-f26e-4a02-95e4-eb21f8f88d83 req-2468c180-47ea-47b3-946d-90bf83c2fe39 tempest-TestShelveInstance-292550524 tempest-TestShelveInstance-292550524-project] 10.222.0.62 "GET /v2.0/security-groups?id=7fe194e6-71c3-47a9-8f36-0dbb24d1f72d&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0672412 Nov 23 19:41:10.163220 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.db.l3_hamode_db [None req-70fe4f83-caa8-43ce-bc9b-e49deb2252d6 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '01438284-e62a-4056-8ee2-4899a051e144', 'name': 'tempest-AttachVolumeShelveTestJSON-1609224522-router', 'tenant_id': '2d925fb59ba34355aa85758374d76928', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'a93e254e-aac9-4233-9e4d-4290fd0458e4', 'external_fixed_ips': [{'subnet_id': 'e0b32f3d-83d6-439a-bbed-01df7cf01051', 'ip_address': '172.27.1.99'}], 'enable_snat': True}, 'gw_port_id': 'a6140c41-82e2-4d62-8e5f-f3fc119a374e', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-23T19:33:21Z', 'updated_at': '2021-11-23T19:33:28Z', 'revision_number': 4, 'project_id': '2d925fb59ba34355aa85758374d76928', 'gw_port': {'id': 'a6140c41-82e2-4d62-8e5f-f3fc119a374e', 'name': '', 'network_id': 'a93e254e-aac9-4233-9e4d-4290fd0458e4', 'tenant_id': '', 'mac_address': 'fa:16:3e:32:52:e2', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '01438284-e62a-4056-8ee2-4899a051e144', 'device_owner': 'network:router_gateway', 'standard_attr_id': 59, 'fixed_ips': [{'subnet_id': 'e0b32f3d-83d6-439a-bbed-01df7cf01051', 'ip_address': '172.27.1.99', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-819011-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-23T19:33:22Z', 'updated_at': '2021-11-23T19:33:30Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'e0b32f3d-83d6-439a-bbed-01df7cf01051', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-819011-1-iscsi', '_interfaces': [{'id': 'c96e4c46-b1fa-4e6c-9fe8-9c516c4ee278', 'name': '', 'network_id': 'fc901312-2937-4784-8a6d-c046666e8bf8', 'tenant_id': '2d925fb59ba34355aa85758374d76928', 'mac_address': 'fa:16:3e:b7:43:ca', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '01438284-e62a-4056-8ee2-4899a051e144', 'device_owner': 'network:router_interface', 'standard_attr_id': 71, 'fixed_ips': [{'subnet_id': '2caca985-6ed6-4ef7-ba49-7b7410bea160', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-819011-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-23T19:33:26Z', 'updated_at': '2021-11-23T19:33:35Z', 'revision_number': 5, 'project_id': '2d925fb59ba34355aa85758374d76928', 'subnets': [{'id': '2caca985-6ed6-4ef7-ba49-7b7410bea160', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-819011-1-iscsi', False) {} {{(pid=102994) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 23 19:41:10.193936 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-70fe4f83-caa8-43ce-bc9b-e49deb2252d6 None None] Checking router: 01438284-e62a-4056-8ee2-4899a051e144 for host: dv-cinder-819011-1-iscsi {{(pid=102994) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 23 19:41:10.203034 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.db.l3_dvrscheduler_db [None req-70fe4f83-caa8-43ce-bc9b-e49deb2252d6 None None] Routers {'01438284-e62a-4056-8ee2-4899a051e144'} bound to L3 agent in host dv-cinder-819011-1-iscsi {{(pid=102994) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 23 19:41:10.203653 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.db.l3_hamode_db [None req-70fe4f83-caa8-43ce-bc9b-e49deb2252d6 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-819011-1-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 7, "extensions": [], "floating_ips": 4, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 7, "log_agent_heartbeats": false, "routers": 7},created_at=2021-11-23T19:25:14Z,description=,heartbeat_timestamp=2021-11-23T19:40:44Z,host='dv-cinder-819011-1-iscsi',id=1b20f2c4-70b6-43c3-b9bd-0062cc9e57ac,load=0,resource_versions=,resources_synced=,started_at=2021-11-23T19:25:15Z,topic='l3_agent')) {'router_ids': ['01438284-e62a-4056-8ee2-4899a051e144'], 'active': True} {{(pid=102994) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 23 19:41:10.426934 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.db.l3_dvr_db [None req-70fe4f83-caa8-43ce-bc9b-e49deb2252d6 None None] Set router 01438284-e62a-4056-8ee2-4899a051e144 gateway port host: dv-cinder-819011-1-iscsi {{(pid=102994) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 23 19:41:10.552823 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-7236204c-ae41-44d7-ae48-f3f0df8dc86e req-4b9d9d12-aeca-4942-82ef-f818ada7bb37 tempest-AttachVolumeShelveTestJSON-1172915835 tempest-AttachVolumeShelveTestJSON-1172915835-project] 10.222.0.62 "GET /v2.0/ports?device_id=627eaac3-8c43-4aa3-a81c-7a6bfb58dbb5 HTTP/1.1" status: 200 len: 210 time: 0.0268822 Nov 23 19:41:10.624455 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.db.l3_hamode_db [None req-70fe4f83-caa8-43ce-bc9b-e49deb2252d6 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '01438284-e62a-4056-8ee2-4899a051e144', 'name': 'tempest-AttachVolumeShelveTestJSON-1609224522-router', 'tenant_id': '2d925fb59ba34355aa85758374d76928', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'a93e254e-aac9-4233-9e4d-4290fd0458e4', 'external_fixed_ips': [{'subnet_id': 'e0b32f3d-83d6-439a-bbed-01df7cf01051', 'ip_address': '172.27.1.99'}], 'enable_snat': True}, 'gw_port_id': 'a6140c41-82e2-4d62-8e5f-f3fc119a374e', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-23T19:33:21Z', 'updated_at': '2021-11-23T19:33:28Z', 'revision_number': 4, 'project_id': '2d925fb59ba34355aa85758374d76928', 'gw_port': {'id': 'a6140c41-82e2-4d62-8e5f-f3fc119a374e', 'name': '', 'network_id': 'a93e254e-aac9-4233-9e4d-4290fd0458e4', 'tenant_id': '', 'mac_address': 'fa:16:3e:32:52:e2', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '01438284-e62a-4056-8ee2-4899a051e144', 'device_owner': 'network:router_gateway', 'standard_attr_id': 59, 'fixed_ips': [{'subnet_id': 'e0b32f3d-83d6-439a-bbed-01df7cf01051', 'ip_address': '172.27.1.99', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-819011-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-23T19:33:22Z', 'updated_at': '2021-11-23T19:33:30Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'e0b32f3d-83d6-439a-bbed-01df7cf01051', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-819011-1-iscsi', '_interfaces': [{'id': 'c96e4c46-b1fa-4e6c-9fe8-9c516c4ee278', 'name': '', 'network_id': 'fc901312-2937-4784-8a6d-c046666e8bf8', 'tenant_id': '2d925fb59ba34355aa85758374d76928', 'mac_address': 'fa:16:3e:b7:43:ca', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '01438284-e62a-4056-8ee2-4899a051e144', 'device_owner': 'network:router_interface', 'standard_attr_id': 71, 'fixed_ips': [{'subnet_id': '2caca985-6ed6-4ef7-ba49-7b7410bea160', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-819011-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-23T19:33:26Z', 'updated_at': '2021-11-23T19:33:35Z', 'revision_number': 5, 'project_id': '2d925fb59ba34355aa85758374d76928', 'subnets': [{'id': '2caca985-6ed6-4ef7-ba49-7b7410bea160', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-819011-1-iscsi', False) {} {{(pid=102994) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 23 19:41:10.650738 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-70fe4f83-caa8-43ce-bc9b-e49deb2252d6 None None] The sync data for ids ['01438284-e62a-4056-8ee2-4899a051e144'] in dv-cinder-819011-1-iscsi is: [{'id': '01438284-e62a-4056-8ee2-4899a051e144', 'name': 'tempest-AttachVolumeShelveTestJSON-1609224522-router', 'tenant_id': '2d925fb59ba34355aa85758374d76928', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'a93e254e-aac9-4233-9e4d-4290fd0458e4', 'external_fixed_ips': [{'subnet_id': 'e0b32f3d-83d6-439a-bbed-01df7cf01051', 'ip_address': '172.27.1.99'}], 'enable_snat': True}, 'gw_port_id': 'a6140c41-82e2-4d62-8e5f-f3fc119a374e', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-23T19:33:21Z', 'updated_at': '2021-11-23T19:33:28Z', 'revision_number': 4, 'project_id': '2d925fb59ba34355aa85758374d76928', 'gw_port': {'id': 'a6140c41-82e2-4d62-8e5f-f3fc119a374e', 'name': '', 'network_id': 'a93e254e-aac9-4233-9e4d-4290fd0458e4', 'tenant_id': '', 'mac_address': 'fa:16:3e:32:52:e2', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '01438284-e62a-4056-8ee2-4899a051e144', 'device_owner': 'network:router_gateway', 'standard_attr_id': 59, 'fixed_ips': [{'subnet_id': 'e0b32f3d-83d6-439a-bbed-01df7cf01051', 'ip_address': '172.27.1.99', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-819011-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-23T19:33:22Z', 'updated_at': '2021-11-23T19:33:30Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'e0b32f3d-83d6-439a-bbed-01df7cf01051', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-819011-1-iscsi', '_interfaces': [{'id': 'c96e4c46-b1fa-4e6c-9fe8-9c516c4ee278', 'name': '', 'network_id': 'fc901312-2937-4784-8a6d-c046666e8bf8', 'tenant_id': '2d925fb59ba34355aa85758374d76928', 'mac_address': 'fa:16:3e:b7:43:ca', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '01438284-e62a-4056-8ee2-4899a051e144', 'device_owner': 'network:router_interface', 'standard_attr_id': 71, 'fixed_ips': [{'subnet_id': '2caca985-6ed6-4ef7-ba49-7b7410bea160', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-819011-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-23T19:33:26Z', 'updated_at': '2021-11-23T19:33:35Z', 'revision_number': 5, 'project_id': '2d925fb59ba34355aa85758374d76928', 'subnets': [{'id': '2caca985-6ed6-4ef7-ba49-7b7410bea160', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=102994) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 23 19:41:10.885082 dv-cinder-819011-1-iscsi neutron-server[102995]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-37e5d6c3-1920-4e6a-900f-823793bb2d11 None None] New status for floating IP 25e15911-590c-423c-af10-5497434dba8d: DOWN {{(pid=102995) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Nov 23 19:41:11.705663 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.wsgi [-] (102993) accepted ('10.222.0.62', 50270) {{(pid=102993) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 23 19:41:11.709932 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron_lib.callbacks.manager [None req-3bebfc5b-a1d3-485f-a1f6-ecb89e2cee69 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8783631323329', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7978582'] for agent, after_update {{(pid=102994) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:41:11.775778 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-bd539b3d-165d-4f2d-863c-5048807b561b tempest-AttachVolumeShelveTestJSON-1172915835 tempest-AttachVolumeShelveTestJSON-1172915835-project] Publish callbacks [] for security_group, before_delete {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:41:11.800255 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-bd539b3d-165d-4f2d-863c-5048807b561b tempest-AttachVolumeShelveTestJSON-1172915835 tempest-AttachVolumeShelveTestJSON-1172915835-project] Publish callbacks [] for security_group, precommit_delete {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:41:11.904377 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-bd539b3d-165d-4f2d-863c-5048807b561b tempest-AttachVolumeShelveTestJSON-1172915835 tempest-AttachVolumeShelveTestJSON-1172915835-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-623933'] for security_group, after_delete {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:41:11.907447 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-bd539b3d-165d-4f2d-863c-5048807b561b tempest-AttachVolumeShelveTestJSON-1172915835 tempest-AttachVolumeShelveTestJSON-1172915835-project] Publish callbacks [] for security_group, before_response {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:41:11.908602 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [None req-bd539b3d-165d-4f2d-863c-5048807b561b tempest-AttachVolumeShelveTestJSON-1172915835 tempest-AttachVolumeShelveTestJSON-1172915835-project] 10.222.0.62 "DELETE /v2.0/security-groups/a246a431-7eb4-441f-b1e6-9c9c351ee888 HTTP/1.1" status: 204 len: 168 time: 0.2018113 Nov 23 19:41:11.911541 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.wsgi [-] (102992) accepted ('10.222.0.62', 50272) {{(pid=102992) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 23 19:41:11.917734 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bd539b3d-165d-4f2d-863c-5048807b561b tempest-AttachVolumeShelveTestJSON-1172915835 tempest-AttachVolumeShelveTestJSON-1172915835-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=a246a431-7eb4-441f-b1e6-9c9c351ee888,revision_number=None']} {{(pid=102993) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 23 19:41:11.924930 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bd539b3d-165d-4f2d-863c-5048807b561b tempest-AttachVolumeShelveTestJSON-1172915835 tempest-AttachVolumeShelveTestJSON-1172915835-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-819011-1-iscsi {{(pid=102993) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 23 19:41:11.925286 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bd539b3d-165d-4f2d-863c-5048807b561b tempest-AttachVolumeShelveTestJSON-1172915835 tempest-AttachVolumeShelveTestJSON-1172915835-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-819011-1-iscsi {{(pid=102993) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 23 19:41:11.925391 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.api.v2.resource [None req-3867c726-b5ce-4363-b49e-f327690e6b86 tempest-AttachVolumeShelveTestJSON-1172915835 tempest-AttachVolumeShelveTestJSON-1172915835-project] show failed (client error): The resource could not be found. Nov 23 19:41:11.925673 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bd539b3d-165d-4f2d-863c-5048807b561b tempest-AttachVolumeShelveTestJSON-1172915835 tempest-AttachVolumeShelveTestJSON-1172915835-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-819011-1-iscsi {{(pid=102993) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 23 19:41:11.926026 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bd539b3d-165d-4f2d-863c-5048807b561b tempest-AttachVolumeShelveTestJSON-1172915835 tempest-AttachVolumeShelveTestJSON-1172915835-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-819011-1-iscsi {{(pid=102993) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 23 19:41:11.926358 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [None req-3867c726-b5ce-4363-b49e-f327690e6b86 tempest-AttachVolumeShelveTestJSON-1172915835 tempest-AttachVolumeShelveTestJSON-1172915835-project] 10.222.0.62 "GET /v2.0/security-groups/a246a431-7eb4-441f-b1e6-9c9c351ee888 HTTP/1.1" status: 404 len: 347 time: 0.0137184 Nov 23 19:41:11.926468 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bd539b3d-165d-4f2d-863c-5048807b561b tempest-AttachVolumeShelveTestJSON-1172915835 tempest-AttachVolumeShelveTestJSON-1172915835-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-819011-1-iscsi {{(pid=102993) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 23 19:41:11.926696 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bd539b3d-165d-4f2d-863c-5048807b561b tempest-AttachVolumeShelveTestJSON-1172915835 tempest-AttachVolumeShelveTestJSON-1172915835-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-819011-1-iscsi {{(pid=102993) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 23 19:41:11.927035 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bd539b3d-165d-4f2d-863c-5048807b561b tempest-AttachVolumeShelveTestJSON-1172915835 tempest-AttachVolumeShelveTestJSON-1172915835-project] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-819011-1-iscsi {{(pid=102993) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 23 19:41:11.927370 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bd539b3d-165d-4f2d-863c-5048807b561b tempest-AttachVolumeShelveTestJSON-1172915835 tempest-AttachVolumeShelveTestJSON-1172915835-project] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-819011-1-iscsi {{(pid=102993) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 23 19:41:11.927762 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bd539b3d-165d-4f2d-863c-5048807b561b tempest-AttachVolumeShelveTestJSON-1172915835 tempest-AttachVolumeShelveTestJSON-1172915835-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-819011-1-iscsi {{(pid=102993) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 23 19:41:11.928037 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bd539b3d-165d-4f2d-863c-5048807b561b tempest-AttachVolumeShelveTestJSON-1172915835 tempest-AttachVolumeShelveTestJSON-1172915835-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-819011-1-iscsi {{(pid=102993) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 23 19:41:11.928365 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bd539b3d-165d-4f2d-863c-5048807b561b tempest-AttachVolumeShelveTestJSON-1172915835 tempest-AttachVolumeShelveTestJSON-1172915835-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-819011-1-iscsi {{(pid=102993) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 23 19:41:11.928699 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bd539b3d-165d-4f2d-863c-5048807b561b tempest-AttachVolumeShelveTestJSON-1172915835 tempest-AttachVolumeShelveTestJSON-1172915835-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-819011-1-iscsi {{(pid=102993) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 23 19:41:11.929470 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.wsgi [-] (102992) accepted ('10.222.0.62', 50274) {{(pid=102992) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 23 19:41:12.053896 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.plugins.ml2.plugin [None req-84273cbc-6fd1-4987-901b-65ffd447109c tempest-AttachVolumeShelveTestJSON-1172915835 tempest-AttachVolumeShelveTestJSON-1172915835-project] Deleting port 79115858-b9f6-4f07-a55f-3b61fc43a874 {{(pid=102992) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 23 19:41:12.054247 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [None req-84273cbc-6fd1-4987-901b-65ffd447109c tempest-AttachVolumeShelveTestJSON-1172915835 tempest-AttachVolumeShelveTestJSON-1172915835-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8783631423070'] for port, before_delete {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:41:12.132513 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [None req-84273cbc-6fd1-4987-901b-65ffd447109c tempest-AttachVolumeShelveTestJSON-1172915835 tempest-AttachVolumeShelveTestJSON-1172915835-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-927332'] for port, precommit_delete {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:41:12.132844 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [None req-84273cbc-6fd1-4987-901b-65ffd447109c tempest-AttachVolumeShelveTestJSON-1172915835 tempest-AttachVolumeShelveTestJSON-1172915835-project] Publish callbacks [] for floatingip, precommit_delete {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:41:12.144266 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.plugins.ml2.plugin [None req-84273cbc-6fd1-4987-901b-65ffd447109c tempest-AttachVolumeShelveTestJSON-1172915835 tempest-AttachVolumeShelveTestJSON-1172915835-project] Calling delete_port for 79115858-b9f6-4f07-a55f-3b61fc43a874 owned by network:floatingip {{(pid=102992) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 23 19:41:12.309944 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [None req-84273cbc-6fd1-4987-901b-65ffd447109c tempest-AttachVolumeShelveTestJSON-1172915835 tempest-AttachVolumeShelveTestJSON-1172915835-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7918660', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-15067', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560168', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8783631424624', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8783631008723', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-25199805'] for port, after_delete {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:41:12.336248 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-84273cbc-6fd1-4987-901b-65ffd447109c tempest-AttachVolumeShelveTestJSON-1172915835 tempest-AttachVolumeShelveTestJSON-1172915835-project] Pushing event deleted for resources: {'Port': ['ID=79115858-b9f6-4f07-a55f-3b61fc43a874,revision_number=None']} {{(pid=102992) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 23 19:41:12.395990 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [None req-84273cbc-6fd1-4987-901b-65ffd447109c tempest-AttachVolumeShelveTestJSON-1172915835 tempest-AttachVolumeShelveTestJSON-1172915835-project] Publish callbacks [] for floatingip, after_delete {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:41:12.398742 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [None req-84273cbc-6fd1-4987-901b-65ffd447109c tempest-AttachVolumeShelveTestJSON-1172915835 tempest-AttachVolumeShelveTestJSON-1172915835-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-514902'] for floatingip, before_response {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:41:12.399900 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [None req-84273cbc-6fd1-4987-901b-65ffd447109c tempest-AttachVolumeShelveTestJSON-1172915835 tempest-AttachVolumeShelveTestJSON-1172915835-project] 10.222.0.62 "DELETE /v2.0/floatingips/25e15911-590c-423c-af10-5497434dba8d HTTP/1.1" status: 204 len: 168 time: 0.4694989 Nov 23 19:41:12.986572 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.plugins.ml2.rpc [None req-4bf48ff4-ecfb-4168-8b63-249b8c6e9f04 None None] Device 895334df-08a6-40fc-9056-3c5fba79b18c no longer exists at agent hyperv_hv-cinder-81901 {{(pid=102994) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 23 19:41:13.006770 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.plugins.ml2.plugin [None req-4bf48ff4-ecfb-4168-8b63-249b8c6e9f04 None None] No Port match for: 895334df-08a6-40fc-9056-3c5fba79b18c {{(pid=102994) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 23 19:41:13.007117 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.plugins.ml2.rpc [None req-4bf48ff4-ecfb-4168-8b63-249b8c6e9f04 None None] Device 895334df-08a6-40fc-9056-3c5fba79b18c not bound to the agent host hv-cinder-81901 {{(pid=102994) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 23 19:41:14.183857 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron_lib.callbacks.manager [None req-2d979eb5-705c-4ba8-8681-1cd00ccc0ae0 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8783631323329', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7978582'] for agent, after_update {{(pid=102994) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:41:15.006156 dv-cinder-819011-1-iscsi neutron-server[102995]: DEBUG neutron.db.agents_db [None req-84bdc9b2-57ea-4bdb-a245-07c78d37cea8 None None] Agent healthcheck: found 6 active agents {{(pid=102995) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 23 19:41:15.015338 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.wsgi [-] (102993) accepted ('10.222.0.62', 50298) {{(pid=102993) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 23 19:41:15.098334 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron_lib.callbacks.manager [None req-8346ef05-f685-4c3d-af3d-a159b683bec2 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8783631323329', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7978582'] for agent, after_update {{(pid=102994) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:41:15.797610 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-fe6533af-b36c-4c14-ac6c-c27b5821b237 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-932931'] for router_interface, before_delete {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:41:16.036111 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.plugins.ml2.plugin [None req-fe6533af-b36c-4c14-ac6c-c27b5821b237 admin admin] Deleting port c96e4c46-b1fa-4e6c-9fe8-9c516c4ee278 {{(pid=102993) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 23 19:41:16.036805 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-fe6533af-b36c-4c14-ac6c-c27b5821b237 admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8783631423070'] for port, before_delete {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:41:16.111354 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.plugins.ml2.db [None req-fe6533af-b36c-4c14-ac6c-c27b5821b237 admin admin] For port c96e4c46-b1fa-4e6c-9fe8-9c516c4ee278, host dv-cinder-819011-1-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-819011-1-iscsi',level=0,port_id=c96e4c46-b1fa-4e6c-9fe8-9c516c4ee278,segment=NetworkSegment(b4453f21-ac7f-498c-8316-73b738820700),segment_id=b4453f21-ac7f-498c-8316-73b738820700)] {{(pid=102993) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 23 19:41:16.111599 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-fe6533af-b36c-4c14-ac6c-c27b5821b237 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-927332'] for port, precommit_delete {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:41:16.123922 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.plugins.ml2.plugin [None req-fe6533af-b36c-4c14-ac6c-c27b5821b237 admin admin] Calling delete_port for c96e4c46-b1fa-4e6c-9fe8-9c516c4ee278 owned by network:router_interface {{(pid=102993) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 23 19:41:16.332442 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-fe6533af-b36c-4c14-ac6c-c27b5821b237 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7918660', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-15067', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560168', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8783631424624', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8783631008723', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-17257496'] for port, after_delete {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:41:16.362027 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fe6533af-b36c-4c14-ac6c-c27b5821b237 admin admin] Pushing event deleted for resources: {'Port': ['ID=c96e4c46-b1fa-4e6c-9fe8-9c516c4ee278,revision_number=None']} {{(pid=102993) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 23 19:41:16.527872 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-fe6533af-b36c-4c14-ac6c-c27b5821b237 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-560161', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-933087'] for router_interface, after_delete {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:41:16.601297 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron_lib.callbacks.manager [None req-785c1d26-11ba-42d8-b5a6-51a8b3daeef0 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8783631323329', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7978582'] for agent, after_update {{(pid=102994) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:41:16.740775 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-fe6533af-b36c-4c14-ac6c-c27b5821b237 admin admin] Router 01438284-e62a-4056-8ee2-4899a051e144 has already been hosted by L3 agent 1b20f2c4-70b6-43c3-b9bd-0062cc9e57ac {{(pid=102993) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 23 19:41:16.843899 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-fe6533af-b36c-4c14-ac6c-c27b5821b237 admin admin] Notify agent at l3_agent.dv-cinder-819011-1-iscsi the message routers_updated {{(pid=102993) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 23 19:41:16.849390 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [None req-fe6533af-b36c-4c14-ac6c-c27b5821b237 admin admin] 10.222.0.62 "PUT /v2.0/routers/01438284-e62a-4056-8ee2-4899a051e144/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 1.8325257 Nov 23 19:41:16.851594 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.wsgi [-] (102993) accepted ('10.222.0.62', 50302) {{(pid=102993) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 23 19:41:16.854168 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-3ff41e49-e206-4db5-bde3-5e6801705565 None None] Sync routers for ids ['01438284-e62a-4056-8ee2-4899a051e144'] in dv-cinder-819011-1-iscsi {{(pid=102994) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 23 19:41:16.864682 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.db.l3_dvrscheduler_db [None req-3ff41e49-e206-4db5-bde3-5e6801705565 None None] Routers {'01438284-e62a-4056-8ee2-4899a051e144'} bound to L3 agent in host dv-cinder-819011-1-iscsi {{(pid=102994) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 23 19:41:16.865300 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.db.l3_hamode_db [None req-3ff41e49-e206-4db5-bde3-5e6801705565 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-819011-1-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 7, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 7, "log_agent_heartbeats": false, "routers": 7},created_at=2021-11-23T19:25:14Z,description=,heartbeat_timestamp=2021-11-23T19:41:14Z,host='dv-cinder-819011-1-iscsi',id=1b20f2c4-70b6-43c3-b9bd-0062cc9e57ac,load=0,resource_versions=,resources_synced=,started_at=2021-11-23T19:25:15Z,topic='l3_agent')) {'router_ids': ['01438284-e62a-4056-8ee2-4899a051e144'], 'active': True} {{(pid=102994) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 23 19:41:16.953915 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-1b89c8ed-f374-4317-acb3-9d0fbdbba0f5 admin admin] Publish callbacks [] for router, before_delete {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:41:16.970589 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.db.l3_dvr_db [None req-3ff41e49-e206-4db5-bde3-5e6801705565 None None] Set router 01438284-e62a-4056-8ee2-4899a051e144 gateway port host: dv-cinder-819011-1-iscsi {{(pid=102994) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 23 19:41:17.052361 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-1b89c8ed-f374-4317-acb3-9d0fbdbba0f5 admin admin] Publish callbacks [] for router_gateway, before_delete {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:41:17.147094 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.db.l3_hamode_db [None req-3ff41e49-e206-4db5-bde3-5e6801705565 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '01438284-e62a-4056-8ee2-4899a051e144', 'name': 'tempest-AttachVolumeShelveTestJSON-1609224522-router', 'tenant_id': '2d925fb59ba34355aa85758374d76928', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'a93e254e-aac9-4233-9e4d-4290fd0458e4', 'external_fixed_ips': [{'subnet_id': 'e0b32f3d-83d6-439a-bbed-01df7cf01051', 'ip_address': '172.27.1.99'}], 'enable_snat': True}, 'gw_port_id': 'a6140c41-82e2-4d62-8e5f-f3fc119a374e', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-23T19:33:21Z', 'updated_at': '2021-11-23T19:41:16Z', 'revision_number': 5, 'project_id': '2d925fb59ba34355aa85758374d76928', 'gw_port': {'id': 'a6140c41-82e2-4d62-8e5f-f3fc119a374e', 'name': '', 'network_id': 'a93e254e-aac9-4233-9e4d-4290fd0458e4', 'tenant_id': '', 'mac_address': 'fa:16:3e:32:52:e2', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '01438284-e62a-4056-8ee2-4899a051e144', 'device_owner': 'network:router_gateway', 'standard_attr_id': 59, 'fixed_ips': [{'subnet_id': 'e0b32f3d-83d6-439a-bbed-01df7cf01051', 'ip_address': '172.27.1.99', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-819011-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-23T19:33:22Z', 'updated_at': '2021-11-23T19:33:30Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'e0b32f3d-83d6-439a-bbed-01df7cf01051', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-819011-1-iscsi'}], 'dv-cinder-819011-1-iscsi', False) {} {{(pid=102994) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 23 19:41:17.161832 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.plugins.ml2.plugin [None req-1b89c8ed-f374-4317-acb3-9d0fbdbba0f5 admin admin] Deleting port a6140c41-82e2-4d62-8e5f-f3fc119a374e {{(pid=102993) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 23 19:41:17.162175 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-1b89c8ed-f374-4317-acb3-9d0fbdbba0f5 admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8783631423070'] for port, before_delete {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:41:17.172917 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-3ff41e49-e206-4db5-bde3-5e6801705565 None None] Checking router: 01438284-e62a-4056-8ee2-4899a051e144 for host: dv-cinder-819011-1-iscsi {{(pid=102994) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 23 19:41:17.181142 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.db.l3_dvrscheduler_db [None req-3ff41e49-e206-4db5-bde3-5e6801705565 None None] Routers {'01438284-e62a-4056-8ee2-4899a051e144'} bound to L3 agent in host dv-cinder-819011-1-iscsi {{(pid=102994) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 23 19:41:17.181774 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.db.l3_hamode_db [None req-3ff41e49-e206-4db5-bde3-5e6801705565 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-819011-1-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 7, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 7, "log_agent_heartbeats": false, "routers": 7},created_at=2021-11-23T19:25:14Z,description=,heartbeat_timestamp=2021-11-23T19:41:14Z,host='dv-cinder-819011-1-iscsi',id=1b20f2c4-70b6-43c3-b9bd-0062cc9e57ac,load=0,resource_versions=,resources_synced=,started_at=2021-11-23T19:25:15Z,topic='l3_agent')) {'router_ids': ['01438284-e62a-4056-8ee2-4899a051e144'], 'active': True} {{(pid=102994) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 23 19:41:17.245564 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.plugins.ml2.db [None req-1b89c8ed-f374-4317-acb3-9d0fbdbba0f5 admin admin] For port a6140c41-82e2-4d62-8e5f-f3fc119a374e, host dv-cinder-819011-1-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-819011-1-iscsi',level=0,port_id=a6140c41-82e2-4d62-8e5f-f3fc119a374e,segment=NetworkSegment(3cb5e60b-103a-47d0-a28b-d68e3159d032),segment_id=3cb5e60b-103a-47d0-a28b-d68e3159d032)] {{(pid=102993) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 23 19:41:17.245974 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-1b89c8ed-f374-4317-acb3-9d0fbdbba0f5 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-927332'] for port, precommit_delete {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:41:17.258421 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.plugins.ml2.plugin [None req-1b89c8ed-f374-4317-acb3-9d0fbdbba0f5 admin admin] Calling delete_port for a6140c41-82e2-4d62-8e5f-f3fc119a374e owned by network:router_gateway {{(pid=102993) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 23 19:41:17.277731 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.db.l3_dvr_db [None req-3ff41e49-e206-4db5-bde3-5e6801705565 None None] Set router 01438284-e62a-4056-8ee2-4899a051e144 gateway port host: None {{(pid=102994) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 23 19:41:17.336249 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.db.l3_hamode_db [None req-3ff41e49-e206-4db5-bde3-5e6801705565 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '01438284-e62a-4056-8ee2-4899a051e144', 'name': 'tempest-AttachVolumeShelveTestJSON-1609224522-router', 'tenant_id': '2d925fb59ba34355aa85758374d76928', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-23T19:33:21Z', 'updated_at': '2021-11-23T19:41:17Z', 'revision_number': 6, 'project_id': '2d925fb59ba34355aa85758374d76928', 'gw_port_host': None}], 'dv-cinder-819011-1-iscsi', False) {} {{(pid=102994) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 23 19:41:17.337982 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron_lib.callbacks.manager [None req-eb87b2c3-3339-4249-8b85-e695b5b4e1f9 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8783631323329', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7978582'] for agent, after_update {{(pid=102994) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:41:17.367118 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-3ff41e49-e206-4db5-bde3-5e6801705565 None None] The sync data for ids ['01438284-e62a-4056-8ee2-4899a051e144'] in dv-cinder-819011-1-iscsi is: [{'id': '01438284-e62a-4056-8ee2-4899a051e144', 'name': 'tempest-AttachVolumeShelveTestJSON-1609224522-router', 'tenant_id': '2d925fb59ba34355aa85758374d76928', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-23T19:33:21Z', 'updated_at': '2021-11-23T19:41:17Z', 'revision_number': 6, 'project_id': '2d925fb59ba34355aa85758374d76928', 'gw_port_host': None}] {{(pid=102994) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 23 19:41:17.463820 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-1b89c8ed-f374-4317-acb3-9d0fbdbba0f5 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7918660', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-15067', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560168', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8783631424624', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8783631008723', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-17257496'] for port, after_delete {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:41:17.487030 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1b89c8ed-f374-4317-acb3-9d0fbdbba0f5 admin admin] Pushing event deleted for resources: {'Port': ['ID=a6140c41-82e2-4d62-8e5f-f3fc119a374e,revision_number=None']} {{(pid=102993) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 23 19:41:17.550943 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-1b89c8ed-f374-4317-acb3-9d0fbdbba0f5 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-926585'] for router_gateway, after_delete {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:41:17.638005 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-1b89c8ed-f374-4317-acb3-9d0fbdbba0f5 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-932919', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-13457'] for router, precommit_delete {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:41:17.640620 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-1b89c8ed-f374-4317-acb3-9d0fbdbba0f5 admin admin] Publish callbacks [] for router_controller, precommit_delete_associations {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:41:17.738862 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-1b89c8ed-f374-4317-acb3-9d0fbdbba0f5 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-926715'] for router, after_delete {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:41:17.741110 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-1b89c8ed-f374-4317-acb3-9d0fbdbba0f5 admin admin] Fanout notify agent at l3_agent the message router_deleted on router 01438284-e62a-4056-8ee2-4899a051e144 {{(pid=102993) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Nov 23 19:41:17.747410 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-1b89c8ed-f374-4317-acb3-9d0fbdbba0f5 admin admin] Publish callbacks [] for router, before_response {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:41:17.748921 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [None req-1b89c8ed-f374-4317-acb3-9d0fbdbba0f5 admin admin] 10.222.0.62 "DELETE /v2.0/routers/01438284-e62a-4056-8ee2-4899a051e144 HTTP/1.1" status: 204 len: 168 time: 0.8960781 Nov 23 19:41:17.752180 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.wsgi [-] (102992) accepted ('10.222.0.62', 50306) {{(pid=102992) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 23 19:41:17.803122 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.db.db_base_plugin_v2 [None req-63ce30cb-0bee-4975-a510-e6f7dd35903b admin admin] Deleting subnet 2caca985-6ed6-4ef7-ba49-7b7410bea160 {{(pid=102992) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Nov 23 19:41:17.806314 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [None req-63ce30cb-0bee-4975-a510-e6f7dd35903b admin admin] Publish callbacks [] for subnet, before_delete {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:41:17.839830 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [None req-63ce30cb-0bee-4975-a510-e6f7dd35903b admin admin] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-25272549'] for subnet, precommit_delete_associations {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:41:17.914246 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [None req-63ce30cb-0bee-4975-a510-e6f7dd35903b admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-7975863'] for subnet, precommit_delete {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:41:18.035706 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [None req-63ce30cb-0bee-4975-a510-e6f7dd35903b admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-7982148', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-554858', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560168', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-25199822', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-25999729'] for subnet, after_delete {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:41:18.065902 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-63ce30cb-0bee-4975-a510-e6f7dd35903b admin admin] Pushing event deleted for resources: {'Subnet': ['ID=2caca985-6ed6-4ef7-ba49-7b7410bea160,revision_number=None']} {{(pid=102992) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 23 19:41:18.070694 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [None req-63ce30cb-0bee-4975-a510-e6f7dd35903b admin admin] Publish callbacks [] for subnet, before_response {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:41:18.075862 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-accaaccf-411b-426a-9164-41bc631d75f5 None None] Network fc901312-2937-4784-8a6d-c046666e8bf8 requested from dv-cinder-819011-1-iscsi {{(pid=102994) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 23 19:41:18.077975 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.wsgi [-] (102993) accepted ('10.222.0.62', 50308) {{(pid=102993) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 23 19:41:18.078399 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [None req-63ce30cb-0bee-4975-a510-e6f7dd35903b admin admin] 10.222.0.62 "DELETE /v2.0/subnets/2caca985-6ed6-4ef7-ba49-7b7410bea160 HTTP/1.1" status: 204 len: 168 time: 0.3248363 Nov 23 19:41:18.163015 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-07c4e788-cc77-48c1-a2fe-38beaa9df2f6 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-8133038'] for network, before_delete {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:41:18.212549 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.plugins.ml2.rpc [None req-eb87b2c3-3339-4249-8b85-e695b5b4e1f9 None None] Device a6140c41-82e2-4d62-8e5f-f3fc119a374e no longer exists at agent ovs-agent-dv-cinder-819011-1-iscsi {{(pid=102994) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 23 19:41:18.223389 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.plugins.ml2.plugin [None req-07c4e788-cc77-48c1-a2fe-38beaa9df2f6 admin admin] Deleting port 32f2a89f-0f71-4db4-a1fd-d54f31e610e0 {{(pid=102993) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 23 19:41:18.223729 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-07c4e788-cc77-48c1-a2fe-38beaa9df2f6 admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8783631423070'] for port, before_delete {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:41:18.237761 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.plugins.ml2.plugin [None req-eb87b2c3-3339-4249-8b85-e695b5b4e1f9 None None] No Port match for: a6140c41-82e2-4d62-8e5f-f3fc119a374e {{(pid=102994) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 23 19:41:18.238124 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.plugins.ml2.rpc [None req-eb87b2c3-3339-4249-8b85-e695b5b4e1f9 None None] Device a6140c41-82e2-4d62-8e5f-f3fc119a374e not bound to the agent host dv-cinder-819011-1-iscsi {{(pid=102994) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 23 19:41:18.238528 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.plugins.ml2.rpc [None req-eb87b2c3-3339-4249-8b85-e695b5b4e1f9 None None] Device c96e4c46-b1fa-4e6c-9fe8-9c516c4ee278 no longer exists at agent ovs-agent-dv-cinder-819011-1-iscsi {{(pid=102994) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 23 19:41:18.262133 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.plugins.ml2.plugin [None req-eb87b2c3-3339-4249-8b85-e695b5b4e1f9 None None] No Port match for: c96e4c46-b1fa-4e6c-9fe8-9c516c4ee278 {{(pid=102994) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 23 19:41:18.262479 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.plugins.ml2.rpc [None req-eb87b2c3-3339-4249-8b85-e695b5b4e1f9 None None] Device c96e4c46-b1fa-4e6c-9fe8-9c516c4ee278 not bound to the agent host dv-cinder-819011-1-iscsi {{(pid=102994) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 23 19:41:18.289858 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-b47bab37-05d7-4a81-85b7-8285732d6ef4 None None] DHCP port deletion for fc901312-2937-4784-8a6d-c046666e8bf8 request from dv-cinder-819011-1-iscsi {{(pid=102994) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:266}} Nov 23 19:41:18.297185 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.plugins.ml2.db [None req-07c4e788-cc77-48c1-a2fe-38beaa9df2f6 admin admin] For port 32f2a89f-0f71-4db4-a1fd-d54f31e610e0, host dv-cinder-819011-1-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-819011-1-iscsi',level=0,port_id=32f2a89f-0f71-4db4-a1fd-d54f31e610e0,segment=NetworkSegment(b4453f21-ac7f-498c-8316-73b738820700),segment_id=b4453f21-ac7f-498c-8316-73b738820700)] {{(pid=102993) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 23 19:41:18.297622 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-07c4e788-cc77-48c1-a2fe-38beaa9df2f6 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-927332'] for port, precommit_delete {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:41:18.314333 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.plugins.ml2.plugin [None req-07c4e788-cc77-48c1-a2fe-38beaa9df2f6 admin admin] Calling delete_port for 32f2a89f-0f71-4db4-a1fd-d54f31e610e0 owned by network:dhcp {{(pid=102993) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 23 19:41:18.341072 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.plugins.ml2.plugin [None req-b47bab37-05d7-4a81-85b7-8285732d6ef4 None None] Deleting port 32f2a89f-0f71-4db4-a1fd-d54f31e610e0 {{(pid=102994) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 23 19:41:18.341579 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron_lib.callbacks.manager [None req-b47bab37-05d7-4a81-85b7-8285732d6ef4 None None] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8783631423070'] for port, before_delete {{(pid=102994) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:41:18.412935 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.plugins.ml2.db [None req-b47bab37-05d7-4a81-85b7-8285732d6ef4 None None] For port 32f2a89f-0f71-4db4-a1fd-d54f31e610e0, host dv-cinder-819011-1-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-819011-1-iscsi',level=0,port_id=32f2a89f-0f71-4db4-a1fd-d54f31e610e0,segment=NetworkSegment(b4453f21-ac7f-498c-8316-73b738820700),segment_id=b4453f21-ac7f-498c-8316-73b738820700)] {{(pid=102994) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 23 19:41:18.413264 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron_lib.callbacks.manager [None req-b47bab37-05d7-4a81-85b7-8285732d6ef4 None None] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-927332'] for port, precommit_delete {{(pid=102994) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:41:18.427016 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.plugins.ml2.plugin [None req-b47bab37-05d7-4a81-85b7-8285732d6ef4 None None] Calling delete_port for 32f2a89f-0f71-4db4-a1fd-d54f31e610e0 owned by network:dhcp {{(pid=102994) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 23 19:41:18.579557 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-07c4e788-cc77-48c1-a2fe-38beaa9df2f6 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7918660', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-15067', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560168', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8783631424624', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8783631008723', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-17257496'] for port, after_delete {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:41:18.585282 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron_lib.callbacks.manager [None req-b47bab37-05d7-4a81-85b7-8285732d6ef4 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7918660', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-15067', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560168', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8783631424624', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8783631008723'] for port, after_delete {{(pid=102994) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:41:18.607188 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.db.l3_dvrscheduler_db [None req-07c4e788-cc77-48c1-a2fe-38beaa9df2f6 admin admin] No DVR routers for this DVR port 32f2a89f-0f71-4db4-a1fd-d54f31e610e0 on host dv-cinder-819011-1-iscsi {{(pid=102993) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 23 19:41:18.609504 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-07c4e788-cc77-48c1-a2fe-38beaa9df2f6 admin admin] Pushing event deleted for resources: {'Port': ['ID=32f2a89f-0f71-4db4-a1fd-d54f31e610e0,revision_number=None']} {{(pid=102993) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 23 19:41:18.612110 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b47bab37-05d7-4a81-85b7-8285732d6ef4 None None] Pushing event deleted for resources: {'Port': ['ID=32f2a89f-0f71-4db4-a1fd-d54f31e610e0,revision_number=None']} {{(pid=102994) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 23 19:41:18.614011 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.db.l3_dvrscheduler_db [None req-b47bab37-05d7-4a81-85b7-8285732d6ef4 None None] No DVR routers for this DVR port 32f2a89f-0f71-4db4-a1fd-d54f31e610e0 on host dv-cinder-819011-1-iscsi {{(pid=102994) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 23 19:41:18.685358 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-07c4e788-cc77-48c1-a2fe-38beaa9df2f6 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-7977576', 'neutron.services.segments.db._delete_segments_for_network-8783631323320'] for network, precommit_delete {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:41:18.707900 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.services.segments.db [None req-07c4e788-cc77-48c1-a2fe-38beaa9df2f6 admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['fc901312-2937-4784-8a6d-c046666e8bf8']}} {{(pid=102993) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 23 19:41:18.716894 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.services.segments.db [None req-07c4e788-cc77-48c1-a2fe-38beaa9df2f6 admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, 'b4453f21-ac7f-498c-8316-73b738820700') {'for_net_delete': True} {{(pid=102993) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 23 19:41:18.717809 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.services.segments.db [None req-07c4e788-cc77-48c1-a2fe-38beaa9df2f6 admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, 'b4453f21-ac7f-498c-8316-73b738820700') {} {{(pid=102993) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 23 19:41:18.727069 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-07c4e788-cc77-48c1-a2fe-38beaa9df2f6 admin admin] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8783631432524', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-16914685'] for segment, before_delete {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:41:18.740547 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-07c4e788-cc77-48c1-a2fe-38beaa9df2f6 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7982218'] for segment, precommit_delete {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:41:18.746432 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-07c4e788-cc77-48c1-a2fe-38beaa9df2f6 admin admin] Releasing vlan 825 on physical network physnet1 to pool {{(pid=102993) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Nov 23 19:41:18.746813 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-07c4e788-cc77-48c1-a2fe-38beaa9df2f6 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7982218', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-17258441'] for segment, after_delete {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:41:18.749020 dv-cinder-819011-1-iscsi neutron-server[102993]: Traceback (most recent call last): Nov 23 19:41:18.749020 dv-cinder-819011-1-iscsi neutron-server[102993]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Nov 23 19:41:18.749020 dv-cinder-819011-1-iscsi neutron-server[102993]: timer() Nov 23 19:41:18.749020 dv-cinder-819011-1-iscsi neutron-server[102993]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 23 19:41:18.749020 dv-cinder-819011-1-iscsi neutron-server[102993]: cb(*args, **kw) Nov 23 19:41:18.749020 dv-cinder-819011-1-iscsi neutron-server[102993]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Nov 23 19:41:18.749020 dv-cinder-819011-1-iscsi neutron-server[102993]: return func(*args, **kwargs) Nov 23 19:41:18.749020 dv-cinder-819011-1-iscsi neutron-server[102993]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 23 19:41:18.749020 dv-cinder-819011-1-iscsi neutron-server[102993]: self._notify() Nov 23 19:41:18.749020 dv-cinder-819011-1-iscsi neutron-server[102993]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 23 19:41:18.749020 dv-cinder-819011-1-iscsi neutron-server[102993]: self.callback(batched_events) Nov 23 19:41:18.749020 dv-cinder-819011-1-iscsi neutron-server[102993]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 23 19:41:18.749020 dv-cinder-819011-1-iscsi neutron-server[102993]: event.method(event) Nov 23 19:41:18.749020 dv-cinder-819011-1-iscsi neutron-server[102993]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Nov 23 19:41:18.749020 dv-cinder-819011-1-iscsi neutron-server[102993]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 23 19:41:18.749020 dv-cinder-819011-1-iscsi neutron-server[102993]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Nov 23 19:41:18.749020 dv-cinder-819011-1-iscsi neutron-server[102993]: aggregate_uuid = self.p_client.list_aggregates( Nov 23 19:41:18.749020 dv-cinder-819011-1-iscsi neutron-server[102993]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Nov 23 19:41:18.749020 dv-cinder-819011-1-iscsi neutron-server[102993]: return f(self, *a, **k) Nov 23 19:41:18.749020 dv-cinder-819011-1-iscsi neutron-server[102993]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 23 19:41:18.749020 dv-cinder-819011-1-iscsi neutron-server[102993]: return self._get(url).json() Nov 23 19:41:18.749020 dv-cinder-819011-1-iscsi neutron-server[102993]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 23 19:41:18.749020 dv-cinder-819011-1-iscsi neutron-server[102993]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 23 19:41:18.749020 dv-cinder-819011-1-iscsi neutron-server[102993]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Nov 23 19:41:18.749020 dv-cinder-819011-1-iscsi neutron-server[102993]: return self.request(url, 'GET', **kwargs) Nov 23 19:41:18.749020 dv-cinder-819011-1-iscsi neutron-server[102993]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Nov 23 19:41:18.749020 dv-cinder-819011-1-iscsi neutron-server[102993]: base_url = self.get_endpoint(auth, allow=allow, Nov 23 19:41:18.749020 dv-cinder-819011-1-iscsi neutron-server[102993]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Nov 23 19:41:18.749020 dv-cinder-819011-1-iscsi neutron-server[102993]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 23 19:41:18.749020 dv-cinder-819011-1-iscsi neutron-server[102993]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Nov 23 19:41:18.749020 dv-cinder-819011-1-iscsi neutron-server[102993]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 23 19:41:18.749020 dv-cinder-819011-1-iscsi neutron-server[102993]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 23 19:41:18.886833 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-07c4e788-cc77-48c1-a2fe-38beaa9df2f6 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-7977567', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-554949', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560168', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-926557'] for network, after_delete {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:41:18.892837 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-07c4e788-cc77-48c1-a2fe-38beaa9df2f6 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-560186'] for network, before_response {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:41:18.896152 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [None req-07c4e788-cc77-48c1-a2fe-38beaa9df2f6 admin admin] 10.222.0.62 "DELETE /v2.0/networks/fc901312-2937-4784-8a6d-c046666e8bf8 HTTP/1.1" status: 204 len: 168 time: 0.8165727 Nov 23 19:41:18.907329 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-07c4e788-cc77-48c1-a2fe-38beaa9df2f6 admin admin] Pushing event deleted for resources: {'Network': ['ID=fc901312-2937-4784-8a6d-c046666e8bf8,revision_number=None']} {{(pid=102993) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 23 19:41:19.207199 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.wsgi [-] (102993) accepted ('10.222.0.62', 50320) {{(pid=102993) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 23 19:41:19.251406 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [None req-f4c57348-c99e-46ec-bacf-bd81b5416d3c admin admin] 10.222.0.62 "GET /v2.0/security-groups?tenant_id=2d925fb59ba34355aa85758374d76928&name=default HTTP/1.1" status: 200 len: 2992 time: 0.0429175 Nov 23 19:41:19.253803 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.wsgi [-] (102993) accepted ('10.222.0.62', 50322) {{(pid=102993) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 23 19:41:19.300314 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-fb870e34-161d-461a-b5ee-85e2a8d501cd admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:41:19.323349 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-fb870e34-161d-461a-b5ee-85e2a8d501cd admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:41:19.482566 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9f4750bb-06ab-4499-a49e-91766fc89101 req-3cbea604-f51b-4f1f-9973-b6a2d714f46e tempest-AttachVolumeTestJSON-1120920040 tempest-AttachVolumeTestJSON-1120920040-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102993) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:41:19.484053 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-9f4750bb-06ab-4499-a49e-91766fc89101 req-3cbea604-f51b-4f1f-9973-b6a2d714f46e tempest-AttachVolumeTestJSON-1120920040 tempest-AttachVolumeTestJSON-1120920040-project] 10.222.0.62 "GET /v2.0/ports?device_id=029fedce-3168-4d1d-992e-a9466fe3e886 HTTP/1.1" status: 200 len: 945 time: 0.0488420 Nov 23 19:41:19.496946 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-fb870e34-161d-461a-b5ee-85e2a8d501cd admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-623933'] for security_group, after_delete {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:41:19.499700 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-fb870e34-161d-461a-b5ee-85e2a8d501cd admin admin] Publish callbacks [] for security_group, before_response {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:41:19.500752 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [None req-fb870e34-161d-461a-b5ee-85e2a8d501cd admin admin] 10.222.0.62 "DELETE /v2.0/security-groups/d8ef3615-d8e9-4f33-b439-9c44891c7a34 HTTP/1.1" status: 204 len: 168 time: 0.2460356 Nov 23 19:41:19.520355 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fb870e34-161d-461a-b5ee-85e2a8d501cd admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=d8ef3615-d8e9-4f33-b439-9c44891c7a34,revision_number=None']} {{(pid=102993) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 23 19:41:19.546368 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-9f4750bb-06ab-4499-a49e-91766fc89101 req-b5f9382d-fa00-429b-97da-fdbe311a9ef4 tempest-AttachVolumeTestJSON-1120920040 tempest-AttachVolumeTestJSON-1120920040-project] 10.222.0.62 "GET /v2.0/security-groups?id=f8cf4027-ad94-4b78-b429-c3f2d7f9d324&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0557480 Nov 23 19:41:20.187058 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.plugins.ml2.rpc [None req-eb87b2c3-3339-4249-8b85-e695b5b4e1f9 None None] Device 32f2a89f-0f71-4db4-a1fd-d54f31e610e0 no longer exists at agent ovs-agent-dv-cinder-819011-1-iscsi {{(pid=102994) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 23 19:41:20.207060 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.plugins.ml2.plugin [None req-eb87b2c3-3339-4249-8b85-e695b5b4e1f9 None None] No Port match for: 32f2a89f-0f71-4db4-a1fd-d54f31e610e0 {{(pid=102994) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 23 19:41:20.207408 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.plugins.ml2.rpc [None req-eb87b2c3-3339-4249-8b85-e695b5b4e1f9 None None] Device 32f2a89f-0f71-4db4-a1fd-d54f31e610e0 not bound to the agent host dv-cinder-819011-1-iscsi {{(pid=102994) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 23 19:41:20.551374 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.wsgi [-] (102993) accepted ('10.222.0.62', 50346) {{(pid=102993) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 23 19:41:20.649663 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.api.v2.base [None req-4d5df186-1308-444a-b0c0-783c646577a5 admin admin] Request body: {'network': {'name': 'tempest-AttachVolumeNegativeTest-1044817371-network', 'tenant_id': 'e738acf03acd4f9d90b4dc46fb48bb06'}} {{(pid=102993) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 23 19:41:20.664848 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-97574c9b-3bfd-401c-be0b-e69f58ad3401 req-d15b502e-ee53-439d-a98e-d63cb3cea7b6 tempest-AttachVolumeTestJSON-1120920040 tempest-AttachVolumeTestJSON-1120920040-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102992) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:41:20.666481 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-97574c9b-3bfd-401c-be0b-e69f58ad3401 req-d15b502e-ee53-439d-a98e-d63cb3cea7b6 tempest-AttachVolumeTestJSON-1120920040 tempest-AttachVolumeTestJSON-1120920040-project] 10.222.0.62 "GET /v2.0/ports?device_id=029fedce-3168-4d1d-992e-a9466fe3e886 HTTP/1.1" status: 200 len: 945 time: 0.0500667 Nov 23 19:41:20.713767 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-97574c9b-3bfd-401c-be0b-e69f58ad3401 req-ac3766d1-7fd5-4efc-8f4e-905db8928ffd tempest-AttachVolumeTestJSON-1120920040 tempest-AttachVolumeTestJSON-1120920040-project] 10.222.0.62 "GET /v2.0/security-groups?id=f8cf4027-ad94-4b78-b429-c3f2d7f9d324&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0405562 Nov 23 19:41:20.721484 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-4d5df186-1308-444a-b0c0-783c646577a5 admin admin] Made reservation on behalf of e738acf03acd4f9d90b4dc46fb48bb06 for: {'network': 1} {{(pid=102993) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 23 19:41:20.723924 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-4d5df186-1308-444a-b0c0-783c646577a5 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7921281'] for network, before_create {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:41:20.736094 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-4d5df186-1308-444a-b0c0-783c646577a5 admin admin] Publish callbacks [] for security_group, before_create {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:41:20.806992 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-4d5df186-1308-444a-b0c0-783c646577a5 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:41:20.886821 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-4d5df186-1308-444a-b0c0-783c646577a5 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-623933'] for security_group, after_create {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:41:20.912084 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-4d5df186-1308-444a-b0c0-783c646577a5 admin admin] vlan segment allocate from pool success with {'vlan_id': 832, 'physical_network': 'physnet1'} {{(pid=102993) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 23 19:41:20.922681 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4d5df186-1308-444a-b0c0-783c646577a5 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=78a07d59-fd8e-4f94-9dfc-099d7d04efec,revision_number=1']} {{(pid=102993) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 23 19:41:20.927495 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-4d5df186-1308-444a-b0c0-783c646577a5 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7982218'] for segment, precommit_create {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:41:20.927833 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.db.segments_db [None req-4d5df186-1308-444a-b0c0-783c646577a5 admin admin] Added segment a14a7aae-c481-4c86-92ee-f7808a54fd04 of type vlan for network 5f438c34-aac6-400d-bc7e-2e0506f124a9 Nov 23 19:41:20.969722 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-4d5df186-1308-444a-b0c0-783c646577a5 admin admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8783630993713'] for network, precommit_create {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:41:21.058247 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-4d5df186-1308-444a-b0c0-783c646577a5 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-554949', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560168'] for network, after_create {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:41:21.059197 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-4d5df186-1308-444a-b0c0-783c646577a5 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102993) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:41:21.059793 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-4d5df186-1308-444a-b0c0-783c646577a5 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-560186'] for network, before_response {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:41:21.121203 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4d5df186-1308-444a-b0c0-783c646577a5 admin admin] Pushing event updated for resources: {'Network': ['ID=5f438c34-aac6-400d-bc7e-2e0506f124a9,revision_number=1']} {{(pid=102993) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 23 19:41:21.132556 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.plugins.ml2.rpc [None req-eb87b2c3-3339-4249-8b85-e695b5b4e1f9 None None] Network 5f438c34-aac6-400d-bc7e-2e0506f124a9 details requested by agent ovs-agent-dv-cinder-819011-1-iscsi with host dv-cinder-819011-1-iscsi {{(pid=102994) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Nov 23 19:41:21.152692 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [None req-4d5df186-1308-444a-b0c0-783c646577a5 admin admin] 10.222.0.62 "POST /v2.0/networks HTTP/1.1" status: 201 len: 888 time: 0.5999544 Nov 23 19:41:21.155315 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.wsgi [-] (102993) accepted ('10.222.0.62', 50352) {{(pid=102993) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 23 19:41:21.160046 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.api.v2.base [None req-3965abec-78a8-46ca-891a-d96c2160d1b2 admin admin] Request body: {'subnet': {'network_id': '5f438c34-aac6-400d-bc7e-2e0506f124a9', 'cidr': '172.20.0.0/28', 'name': 'tempest-AttachVolumeNegativeTest-1044817371-subnet', 'tenant_id': 'e738acf03acd4f9d90b4dc46fb48bb06', 'enable_dhcp': False, 'ip_version': 4}} {{(pid=102993) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 23 19:41:21.235485 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-3965abec-78a8-46ca-891a-d96c2160d1b2 admin admin] Made reservation on behalf of e738acf03acd4f9d90b4dc46fb48bb06 for: {'subnet': 1} {{(pid=102993) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 23 19:41:21.237821 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-3965abec-78a8-46ca-891a-d96c2160d1b2 admin admin] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-17772934'] for subnet, before_create {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:41:21.441578 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-3965abec-78a8-46ca-891a-d96c2160d1b2 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-554858', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560168', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-17257652', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-17772948'] for subnet, after_create {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:41:21.495976 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3965abec-78a8-46ca-891a-d96c2160d1b2 admin admin] Pushing event updated for resources: {'Subnet': ['ID=ffd14982-fec3-42b1-9d92-f2ed87a640f4,revision_number=0']} {{(pid=102993) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 23 19:41:21.505297 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-3965abec-78a8-46ca-891a-d96c2160d1b2 admin admin] Checking segment: {'id': 'a14a7aae-c481-4c86-92ee-f7808a54fd04', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 832, 'network_id': '5f438c34-aac6-400d-bc7e-2e0506f124a9'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102993) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 23 19:41:21.505685 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-3965abec-78a8-46ca-891a-d96c2160d1b2 admin admin] Network hostable DHCP agents. Network: 5f438c34-aac6-400d-bc7e-2e0506f124a9, hostable agents: ['e51c95c7-6a36-4263-ba47-1839054f3e7a'], hosted agents: [] {{(pid=102993) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 23 19:41:21.578408 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-3965abec-78a8-46ca-891a-d96c2160d1b2 admin admin] Network 5f438c34-aac6-400d-bc7e-2e0506f124a9 is scheduled to be hosted by DHCP agent e51c95c7-6a36-4263-ba47-1839054f3e7a with binding_index 1 {{(pid=102993) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 23 19:41:21.669642 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.scheduler.base_scheduler [None req-3965abec-78a8-46ca-891a-d96c2160d1b2 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-819011-1-iscsi, 5f438c34-aac6-400d-bc7e-2e0506f124a9) {{(pid=102993) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 23 19:41:21.674083 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-3965abec-78a8-46ca-891a-d96c2160d1b2 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=102993) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:41:21.674677 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-3965abec-78a8-46ca-891a-d96c2160d1b2 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-560186'] for subnet, before_response {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:41:21.678993 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-db09dc55-1075-4cdc-97ef-a8fcf58062af None None] Network 5f438c34-aac6-400d-bc7e-2e0506f124a9 requested from dv-cinder-819011-1-iscsi {{(pid=102994) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 23 19:41:21.762085 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [None req-3965abec-78a8-46ca-891a-d96c2160d1b2 admin admin] 10.222.0.62 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 852 time: 0.5974748 Nov 23 19:41:21.809565 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-5c142d99-7a0f-4c74-acaa-f4908fd2092e None None] Network 5f438c34-aac6-400d-bc7e-2e0506f124a9 requested from dv-cinder-819011-1-iscsi {{(pid=102994) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 23 19:41:21.839077 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0fc49062-1e41-42c0-9313-5def937e4c24 req-206c803e-eca8-4388-ac99-9ce204b7333a tempest-AttachVolumeTestJSON-1120920040 tempest-AttachVolumeTestJSON-1120920040-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102992) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:41:21.841101 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-0fc49062-1e41-42c0-9313-5def937e4c24 req-206c803e-eca8-4388-ac99-9ce204b7333a tempest-AttachVolumeTestJSON-1120920040 tempest-AttachVolumeTestJSON-1120920040-project] 10.222.0.41 "GET /v2.0/ports?device_id=029fedce-3168-4d1d-992e-a9466fe3e886 HTTP/1.1" status: 200 len: 945 time: 0.0745537 Nov 23 19:41:21.850002 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c3aebaf2-8f32-47e5-85ed-87496fa47945 req-bafd5953-c9c7-46e3-824b-3fbd50c72fdb tempest-AttachVolumeTestJSON-1120920040 tempest-AttachVolumeTestJSON-1120920040-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102993) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:41:21.851736 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-c3aebaf2-8f32-47e5-85ed-87496fa47945 req-bafd5953-c9c7-46e3-824b-3fbd50c72fdb tempest-AttachVolumeTestJSON-1120920040 tempest-AttachVolumeTestJSON-1120920040-project] 10.222.0.62 "GET /v2.0/ports?device_id=029fedce-3168-4d1d-992e-a9466fe3e886 HTTP/1.1" status: 200 len: 945 time: 0.0585904 Nov 23 19:41:21.921306 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-c3aebaf2-8f32-47e5-85ed-87496fa47945 req-acdfa7b2-cb09-49ba-a4d7-cf0a9f64931a tempest-AttachVolumeTestJSON-1120920040 tempest-AttachVolumeTestJSON-1120920040-project] 10.222.0.62 "GET /v2.0/security-groups?id=f8cf4027-ad94-4b78-b429-c3f2d7f9d324&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0599530 Nov 23 19:41:21.962895 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.plugins.ml2.plugin [req-0fc49062-1e41-42c0-9313-5def937e4c24 req-b8e12ffd-9316-49f8-9881-8ed3915d8106 tempest-AttachVolumeTestJSON-1120920040 tempest-AttachVolumeTestJSON-1120920040-project] Deleting port 2872cb22-0134-49c4-b6d7-034ca4132327 {{(pid=102992) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 23 19:41:21.966142 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [req-0fc49062-1e41-42c0-9313-5def937e4c24 req-b8e12ffd-9316-49f8-9881-8ed3915d8106 tempest-AttachVolumeTestJSON-1120920040 tempest-AttachVolumeTestJSON-1120920040-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8783631423070'] for port, before_delete {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:41:22.054149 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.plugins.ml2.db [req-0fc49062-1e41-42c0-9313-5def937e4c24 req-b8e12ffd-9316-49f8-9881-8ed3915d8106 tempest-AttachVolumeTestJSON-1120920040 tempest-AttachVolumeTestJSON-1120920040-project] For port 2872cb22-0134-49c4-b6d7-034ca4132327, host hv-cinder-81901, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81901',level=0,port_id=2872cb22-0134-49c4-b6d7-034ca4132327,segment=NetworkSegment(1a7bcd69-381b-4068-88df-df74b53e9d61),segment_id=1a7bcd69-381b-4068-88df-df74b53e9d61)] {{(pid=102992) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 23 19:41:22.054523 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [req-0fc49062-1e41-42c0-9313-5def937e4c24 req-b8e12ffd-9316-49f8-9881-8ed3915d8106 tempest-AttachVolumeTestJSON-1120920040 tempest-AttachVolumeTestJSON-1120920040-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-927332'] for port, precommit_delete {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:41:22.303456 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [req-0fc49062-1e41-42c0-9313-5def937e4c24 req-b8e12ffd-9316-49f8-9881-8ed3915d8106 tempest-AttachVolumeTestJSON-1120920040 tempest-AttachVolumeTestJSON-1120920040-project] Publish callbacks [] for floatingip, precommit_update {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:41:22.303689 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [req-0fc49062-1e41-42c0-9313-5def937e4c24 req-b8e12ffd-9316-49f8-9881-8ed3915d8106 tempest-AttachVolumeTestJSON-1120920040 tempest-AttachVolumeTestJSON-1120920040-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-926531'] for floatingip, after_update {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:41:22.303804 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.db.l3_db [req-0fc49062-1e41-42c0-9313-5def937e4c24 req-b8e12ffd-9316-49f8-9881-8ed3915d8106 tempest-AttachVolumeTestJSON-1120920040 tempest-AttachVolumeTestJSON-1120920040-project] Floating IP a621b55c-734d-4ae5-8844-c2140ad172fa disassociated. External IP: 172.27.1.128, port: 2872cb22-0134-49c4-b6d7-034ca4132327. Nov 23 19:41:22.304149 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.plugins.ml2.plugin [req-0fc49062-1e41-42c0-9313-5def937e4c24 req-b8e12ffd-9316-49f8-9881-8ed3915d8106 tempest-AttachVolumeTestJSON-1120920040 tempest-AttachVolumeTestJSON-1120920040-project] Calling delete_port for 2872cb22-0134-49c4-b6d7-034ca4132327 owned by compute:nova {{(pid=102992) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 23 19:41:22.312662 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b57271e2-f7ba-4402-bf5f-123dc19ff7cd req-8873caf3-9a69-49d4-b0e9-4092b5354365 tempest-AttachVolumeNegativeTest-754998453 tempest-AttachVolumeNegativeTest-754998453-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=102992) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:41:22.314418 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-b57271e2-f7ba-4402-bf5f-123dc19ff7cd req-8873caf3-9a69-49d4-b0e9-4092b5354365 tempest-AttachVolumeNegativeTest-754998453 tempest-AttachVolumeNegativeTest-754998453-project] 10.222.0.62 "GET /v2.0/networks?id=5f438c34-aac6-400d-bc7e-2e0506f124a9 HTTP/1.1" status: 200 len: 815 time: 0.1886053 Nov 23 19:41:22.363746 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-b57271e2-f7ba-4402-bf5f-123dc19ff7cd req-a46e2517-938b-424e-97ad-885f412d8a78 tempest-AttachVolumeNegativeTest-754998453 tempest-AttachVolumeNegativeTest-754998453-project] 10.222.0.62 "GET /v2.0/quotas/e738acf03acd4f9d90b4dc46fb48bb06 HTTP/1.1" status: 200 len: 375 time: 0.0421782 Nov 23 19:41:22.403308 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-b57271e2-f7ba-4402-bf5f-123dc19ff7cd req-1627a7fa-440b-4197-96d5-62faa62f5919 tempest-AttachVolumeNegativeTest-754998453 tempest-AttachVolumeNegativeTest-754998453-project] 10.222.0.62 "GET /v2.0/ports?tenant_id=e738acf03acd4f9d90b4dc46fb48bb06&fields=id HTTP/1.1" status: 200 len: 210 time: 0.0330868 Nov 23 19:41:22.556244 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-b57271e2-f7ba-4402-bf5f-123dc19ff7cd req-46305fef-99c4-4dd9-a4a0-aea93434ada5 service neutron] 10.222.0.62 "GET /v2.0/networks/5f438c34-aac6-400d-bc7e-2e0506f124a9?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1454620 Nov 23 19:41:22.561780 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [req-0fc49062-1e41-42c0-9313-5def937e4c24 req-b8e12ffd-9316-49f8-9881-8ed3915d8106 tempest-AttachVolumeTestJSON-1120920040 tempest-AttachVolumeTestJSON-1120920040-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7918660', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-15067', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560168', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8783631424624', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8783631008723', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-25199805'] for port, after_delete {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:41:22.604065 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b8e12ffd-9316-49f8-9881-8ed3915d8106 tempest-AttachVolumeTestJSON-1120920040 tempest-AttachVolumeTestJSON-1120920040-project] Pushing event deleted for resources: {'Port': ['ID=2872cb22-0134-49c4-b6d7-034ca4132327,revision_number=None']} {{(pid=102992) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 23 19:41:22.749392 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-b57271e2-f7ba-4402-bf5f-123dc19ff7cd req-cddb5763-0373-42a0-beaa-feb2fc7692ef service neutron] 10.222.0.62 "GET /v2.0/networks/5f438c34-aac6-400d-bc7e-2e0506f124a9?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1853917 Nov 23 19:41:22.773325 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.scheduler.l3_agent_scheduler [req-0fc49062-1e41-42c0-9313-5def937e4c24 req-b8e12ffd-9316-49f8-9881-8ed3915d8106 tempest-AttachVolumeTestJSON-1120920040 tempest-AttachVolumeTestJSON-1120920040-project] Router c925adea-d520-48c2-a2b3-fdb5661aaf95 has already been hosted by L3 agent 1b20f2c4-70b6-43c3-b9bd-0062cc9e57ac {{(pid=102992) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 23 19:41:22.880103 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [req-0fc49062-1e41-42c0-9313-5def937e4c24 req-b8e12ffd-9316-49f8-9881-8ed3915d8106 tempest-AttachVolumeTestJSON-1120920040 tempest-AttachVolumeTestJSON-1120920040-project] Notify agent at l3_agent.dv-cinder-819011-1-iscsi the message routers_updated {{(pid=102992) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 23 19:41:22.890658 dv-cinder-819011-1-iscsi neutron-server[102995]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-916f9339-3471-4ce5-86df-539d00caf5ae None None] Sync routers for ids ['c925adea-d520-48c2-a2b3-fdb5661aaf95'] in dv-cinder-819011-1-iscsi {{(pid=102995) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 23 19:41:22.899934 dv-cinder-819011-1-iscsi neutron-server[102995]: DEBUG neutron.db.l3_dvrscheduler_db [None req-916f9339-3471-4ce5-86df-539d00caf5ae None None] Routers {'c925adea-d520-48c2-a2b3-fdb5661aaf95'} bound to L3 agent in host dv-cinder-819011-1-iscsi {{(pid=102995) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 23 19:41:22.900553 dv-cinder-819011-1-iscsi neutron-server[102995]: DEBUG neutron.db.l3_hamode_db [None req-916f9339-3471-4ce5-86df-539d00caf5ae None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-819011-1-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 7, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 7, "log_agent_heartbeats": false, "routers": 7},created_at=2021-11-23T19:25:14Z,description=,heartbeat_timestamp=2021-11-23T19:41:14Z,host='dv-cinder-819011-1-iscsi',id=1b20f2c4-70b6-43c3-b9bd-0062cc9e57ac,load=0,resource_versions=,resources_synced=,started_at=2021-11-23T19:25:15Z,topic='l3_agent')) {'router_ids': ['c925adea-d520-48c2-a2b3-fdb5661aaf95'], 'active': True} {{(pid=102995) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 23 19:41:22.921656 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.db.l3_dvrscheduler_db [req-0fc49062-1e41-42c0-9313-5def937e4c24 req-b8e12ffd-9316-49f8-9881-8ed3915d8106 tempest-AttachVolumeTestJSON-1120920040 tempest-AttachVolumeTestJSON-1120920040-project] No DVR routers for this DVR port 2872cb22-0134-49c4-b6d7-034ca4132327 on host hv-cinder-81901 {{(pid=102992) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 23 19:41:22.924033 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [req-0fc49062-1e41-42c0-9313-5def937e4c24 req-b8e12ffd-9316-49f8-9881-8ed3915d8106 tempest-AttachVolumeTestJSON-1120920040 tempest-AttachVolumeTestJSON-1120920040-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-514902'] for port, before_response {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:41:22.927540 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-0fc49062-1e41-42c0-9313-5def937e4c24 req-b8e12ffd-9316-49f8-9881-8ed3915d8106 tempest-AttachVolumeTestJSON-1120920040 tempest-AttachVolumeTestJSON-1120920040-project] 10.222.0.41 "DELETE /v2.0/ports/2872cb22-0134-49c4-b6d7-034ca4132327 HTTP/1.1" status: 204 len: 173 time: 1.0767961 Nov 23 19:41:22.927982 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '029fedce-3168-4d1d-992e-a9466fe3e886', 'name': 'network-vif-deleted', 'tag': '2872cb22-0134-49c4-b6d7-034ca4132327'}] {{(pid=102992) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 23 19:41:22.930234 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.62/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}f86c332b591ae691ababa4b64e0601cbf242a448242f95367ce03daabfb7e1ce" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-b2fd9bab-5643-49d7-b664-7066948584ab" -d '{"events": [{"server_uuid": "029fedce-3168-4d1d-992e-a9466fe3e886", "name": "network-vif-deleted", "tag": "2872cb22-0134-49c4-b6d7-034ca4132327"}]}' {{(pid=102992) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 23 19:41:23.018347 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 23 Nov 2021 19:41:22 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-dba7430e-a3d5-4118-b7d6-62122d43ef5c x-openstack-request-id: req-dba7430e-a3d5-4118-b7d6-62122d43ef5c {{(pid=102992) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 23 19:41:23.018852 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "029fedce-3168-4d1d-992e-a9466fe3e886", "name": "network-vif-deleted", "tag": "2872cb22-0134-49c4-b6d7-034ca4132327", "status": "completed", "code": 200}]} {{(pid=102992) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 23 19:41:23.019264 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.62/compute/v2.1/os-server-external-events used request id req-dba7430e-a3d5-4118-b7d6-62122d43ef5c {{(pid=102992) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 23 19:41:23.019832 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '029fedce-3168-4d1d-992e-a9466fe3e886', 'name': 'network-vif-deleted', 'tag': '2872cb22-0134-49c4-b6d7-034ca4132327', 'status': 'completed', 'code': 200} Nov 23 19:41:23.034140 dv-cinder-819011-1-iscsi neutron-server[102995]: DEBUG neutron.db.l3_dvr_db [None req-916f9339-3471-4ce5-86df-539d00caf5ae None None] Set router c925adea-d520-48c2-a2b3-fdb5661aaf95 gateway port host: dv-cinder-819011-1-iscsi {{(pid=102995) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 23 19:41:23.090475 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-3b070b90-e402-4926-bc41-11727b3a733c req-bb844115-8431-4feb-a6de-936c072589d8 tempest-AttachVolumeTestJSON-1120920040 tempest-AttachVolumeTestJSON-1120920040-project] 10.222.0.62 "GET /v2.0/ports?device_id=029fedce-3168-4d1d-992e-a9466fe3e886 HTTP/1.1" status: 200 len: 210 time: 0.0668428 Nov 23 19:41:23.126420 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-66bd2d3e-e781-4696-b11a-f284b68af5b8 req-cc5dcf0c-c5a7-41b3-af78-a7117e18e322 tempest-AttachVolumeNegativeTest-754998453 tempest-AttachVolumeNegativeTest-754998453-project] 10.222.0.62 "GET /v2.0/ports?device_id=e88dbfaf-c15b-4506-b81e-3abeb760ae36 HTTP/1.1" status: 200 len: 210 time: 0.0359502 Nov 23 19:41:23.359628 dv-cinder-819011-1-iscsi neutron-server[102995]: DEBUG neutron.db.l3_hamode_db [None req-916f9339-3471-4ce5-86df-539d00caf5ae None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'c925adea-d520-48c2-a2b3-fdb5661aaf95', 'name': 'tempest-AttachVolumeTestJSON-1672505821-router', 'tenant_id': 'c9d53f0599374b679185cc73383b417c', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'a93e254e-aac9-4233-9e4d-4290fd0458e4', 'external_fixed_ips': [{'subnet_id': 'e0b32f3d-83d6-439a-bbed-01df7cf01051', 'ip_address': '172.27.1.34'}], 'enable_snat': True}, 'gw_port_id': '41109199-34e8-4da6-963c-4a47600cb432', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-23T19:37:05Z', 'updated_at': '2021-11-23T19:37:09Z', 'revision_number': 4, 'project_id': 'c9d53f0599374b679185cc73383b417c', 'gw_port': {'id': '41109199-34e8-4da6-963c-4a47600cb432', 'name': '', 'network_id': 'a93e254e-aac9-4233-9e4d-4290fd0458e4', 'tenant_id': '', 'mac_address': 'fa:16:3e:52:78:cc', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'c925adea-d520-48c2-a2b3-fdb5661aaf95', 'device_owner': 'network:router_gateway', 'standard_attr_id': 486, 'fixed_ips': [{'subnet_id': 'e0b32f3d-83d6-439a-bbed-01df7cf01051', 'ip_address': '172.27.1.34', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-819011-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-23T19:37:06Z', 'updated_at': '2021-11-23T19:37:12Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'e0b32f3d-83d6-439a-bbed-01df7cf01051', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-819011-1-iscsi', '_interfaces': [{'id': '75766f49-5d4b-4c87-b9ea-e4dd672df213', 'name': '', 'network_id': '41fa5020-8aad-49ce-b2a6-39d87c9e6042', 'tenant_id': 'c9d53f0599374b679185cc73383b417c', 'mac_address': 'fa:16:3e:31:a3:fa', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'c925adea-d520-48c2-a2b3-fdb5661aaf95', 'device_owner': 'network:router_interface', 'standard_attr_id': 487, 'fixed_ips': [{'subnet_id': '8f74a1ae-f892-4057-89a5-ca78a259b1bd', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-819011-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-23T19:37:08Z', 'updated_at': '2021-11-23T19:37:14Z', 'revision_number': 5, 'project_id': 'c9d53f0599374b679185cc73383b417c', 'subnets': [{'id': '8f74a1ae-f892-4057-89a5-ca78a259b1bd', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-819011-1-iscsi', False) {} {{(pid=102995) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 23 19:41:23.385652 dv-cinder-819011-1-iscsi neutron-server[102995]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-916f9339-3471-4ce5-86df-539d00caf5ae None None] Checking router: c925adea-d520-48c2-a2b3-fdb5661aaf95 for host: dv-cinder-819011-1-iscsi {{(pid=102995) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 23 19:41:23.393940 dv-cinder-819011-1-iscsi neutron-server[102995]: DEBUG neutron.db.l3_dvrscheduler_db [None req-916f9339-3471-4ce5-86df-539d00caf5ae None None] Routers {'c925adea-d520-48c2-a2b3-fdb5661aaf95'} bound to L3 agent in host dv-cinder-819011-1-iscsi {{(pid=102995) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 23 19:41:23.394539 dv-cinder-819011-1-iscsi neutron-server[102995]: DEBUG neutron.db.l3_hamode_db [None req-916f9339-3471-4ce5-86df-539d00caf5ae None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-819011-1-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 7, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 7, "log_agent_heartbeats": false, "routers": 7},created_at=2021-11-23T19:25:14Z,description=,heartbeat_timestamp=2021-11-23T19:41:14Z,host='dv-cinder-819011-1-iscsi',id=1b20f2c4-70b6-43c3-b9bd-0062cc9e57ac,load=0,resource_versions=,resources_synced=,started_at=2021-11-23T19:25:15Z,topic='l3_agent')) {'router_ids': ['c925adea-d520-48c2-a2b3-fdb5661aaf95'], 'active': True} {{(pid=102995) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 23 19:41:23.499880 dv-cinder-819011-1-iscsi neutron-server[102995]: DEBUG neutron.db.l3_dvr_db [None req-916f9339-3471-4ce5-86df-539d00caf5ae None None] Set router c925adea-d520-48c2-a2b3-fdb5661aaf95 gateway port host: dv-cinder-819011-1-iscsi {{(pid=102995) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 23 19:41:23.703979 dv-cinder-819011-1-iscsi neutron-server[102995]: DEBUG neutron.db.l3_hamode_db [None req-916f9339-3471-4ce5-86df-539d00caf5ae None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'c925adea-d520-48c2-a2b3-fdb5661aaf95', 'name': 'tempest-AttachVolumeTestJSON-1672505821-router', 'tenant_id': 'c9d53f0599374b679185cc73383b417c', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'a93e254e-aac9-4233-9e4d-4290fd0458e4', 'external_fixed_ips': [{'subnet_id': 'e0b32f3d-83d6-439a-bbed-01df7cf01051', 'ip_address': '172.27.1.34'}], 'enable_snat': True}, 'gw_port_id': '41109199-34e8-4da6-963c-4a47600cb432', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-23T19:37:05Z', 'updated_at': '2021-11-23T19:37:09Z', 'revision_number': 4, 'project_id': 'c9d53f0599374b679185cc73383b417c', 'gw_port': {'id': '41109199-34e8-4da6-963c-4a47600cb432', 'name': '', 'network_id': 'a93e254e-aac9-4233-9e4d-4290fd0458e4', 'tenant_id': '', 'mac_address': 'fa:16:3e:52:78:cc', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'c925adea-d520-48c2-a2b3-fdb5661aaf95', 'device_owner': 'network:router_gateway', 'standard_attr_id': 486, 'fixed_ips': [{'subnet_id': 'e0b32f3d-83d6-439a-bbed-01df7cf01051', 'ip_address': '172.27.1.34', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-819011-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-23T19:37:06Z', 'updated_at': '2021-11-23T19:37:12Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'e0b32f3d-83d6-439a-bbed-01df7cf01051', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-819011-1-iscsi', '_interfaces': [{'id': '75766f49-5d4b-4c87-b9ea-e4dd672df213', 'name': '', 'network_id': '41fa5020-8aad-49ce-b2a6-39d87c9e6042', 'tenant_id': 'c9d53f0599374b679185cc73383b417c', 'mac_address': 'fa:16:3e:31:a3:fa', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'c925adea-d520-48c2-a2b3-fdb5661aaf95', 'device_owner': 'network:router_interface', 'standard_attr_id': 487, 'fixed_ips': [{'subnet_id': '8f74a1ae-f892-4057-89a5-ca78a259b1bd', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-819011-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-23T19:37:08Z', 'updated_at': '2021-11-23T19:37:14Z', 'revision_number': 5, 'project_id': 'c9d53f0599374b679185cc73383b417c', 'subnets': [{'id': '8f74a1ae-f892-4057-89a5-ca78a259b1bd', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-819011-1-iscsi', False) {} {{(pid=102995) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 23 19:41:23.731753 dv-cinder-819011-1-iscsi neutron-server[102995]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-916f9339-3471-4ce5-86df-539d00caf5ae None None] The sync data for ids ['c925adea-d520-48c2-a2b3-fdb5661aaf95'] in dv-cinder-819011-1-iscsi is: [{'id': 'c925adea-d520-48c2-a2b3-fdb5661aaf95', 'name': 'tempest-AttachVolumeTestJSON-1672505821-router', 'tenant_id': 'c9d53f0599374b679185cc73383b417c', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'a93e254e-aac9-4233-9e4d-4290fd0458e4', 'external_fixed_ips': [{'subnet_id': 'e0b32f3d-83d6-439a-bbed-01df7cf01051', 'ip_address': '172.27.1.34'}], 'enable_snat': True}, 'gw_port_id': '41109199-34e8-4da6-963c-4a47600cb432', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-23T19:37:05Z', 'updated_at': '2021-11-23T19:37:09Z', 'revision_number': 4, 'project_id': 'c9d53f0599374b679185cc73383b417c', 'gw_port': {'id': '41109199-34e8-4da6-963c-4a47600cb432', 'name': '', 'network_id': 'a93e254e-aac9-4233-9e4d-4290fd0458e4', 'tenant_id': '', 'mac_address': 'fa:16:3e:52:78:cc', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'c925adea-d520-48c2-a2b3-fdb5661aaf95', 'device_owner': 'network:router_gateway', 'standard_attr_id': 486, 'fixed_ips': [{'subnet_id': 'e0b32f3d-83d6-439a-bbed-01df7cf01051', 'ip_address': '172.27.1.34', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-819011-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-23T19:37:06Z', 'updated_at': '2021-11-23T19:37:12Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'e0b32f3d-83d6-439a-bbed-01df7cf01051', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-819011-1-iscsi', '_interfaces': [{'id': '75766f49-5d4b-4c87-b9ea-e4dd672df213', 'name': '', 'network_id': '41fa5020-8aad-49ce-b2a6-39d87c9e6042', 'tenant_id': 'c9d53f0599374b679185cc73383b417c', 'mac_address': 'fa:16:3e:31:a3:fa', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'c925adea-d520-48c2-a2b3-fdb5661aaf95', 'device_owner': 'network:router_interface', 'standard_attr_id': 487, 'fixed_ips': [{'subnet_id': '8f74a1ae-f892-4057-89a5-ca78a259b1bd', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-819011-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-23T19:37:08Z', 'updated_at': '2021-11-23T19:37:14Z', 'revision_number': 5, 'project_id': 'c9d53f0599374b679185cc73383b417c', 'subnets': [{'id': '8f74a1ae-f892-4057-89a5-ca78a259b1bd', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=102995) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 23 19:41:23.950882 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-dcecd82f-5ecd-42f3-b38e-b6e762c4af45 None None] New status for floating IP a621b55c-734d-4ae5-8844-c2140ad172fa: DOWN {{(pid=102994) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Nov 23 19:41:24.224320 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-4662995a-d548-48a2-9c97-33d85fb377b4 req-d4146f70-7b57-40ce-8414-a33a275d5827 tempest-AttachVolumeNegativeTest-754998453 tempest-AttachVolumeNegativeTest-754998453-project] 10.222.0.62 "GET /v2.0/ports?device_id=e88dbfaf-c15b-4506-b81e-3abeb760ae36 HTTP/1.1" status: 200 len: 210 time: 0.0259874 Nov 23 19:41:24.240281 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.wsgi [-] (102993) accepted ('10.222.0.62', 50394) {{(pid=102993) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 23 19:41:24.290625 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-c13eaa5a-39fd-4633-a168-b8fbfdc0b17e tempest-AttachVolumeTestJSON-1120920040 tempest-AttachVolumeTestJSON-1120920040-project] Publish callbacks [] for security_group, before_delete {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:41:24.315158 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-c13eaa5a-39fd-4633-a168-b8fbfdc0b17e tempest-AttachVolumeTestJSON-1120920040 tempest-AttachVolumeTestJSON-1120920040-project] Publish callbacks [] for security_group, precommit_delete {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:41:24.418341 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-c13eaa5a-39fd-4633-a168-b8fbfdc0b17e tempest-AttachVolumeTestJSON-1120920040 tempest-AttachVolumeTestJSON-1120920040-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-623933'] for security_group, after_delete {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:41:24.421657 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-c13eaa5a-39fd-4633-a168-b8fbfdc0b17e tempest-AttachVolumeTestJSON-1120920040 tempest-AttachVolumeTestJSON-1120920040-project] Publish callbacks [] for security_group, before_response {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:41:24.422807 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [None req-c13eaa5a-39fd-4633-a168-b8fbfdc0b17e tempest-AttachVolumeTestJSON-1120920040 tempest-AttachVolumeTestJSON-1120920040-project] 10.222.0.62 "DELETE /v2.0/security-groups/f8cf4027-ad94-4b78-b429-c3f2d7f9d324 HTTP/1.1" status: 204 len: 168 time: 0.1839085 Nov 23 19:41:24.425638 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.wsgi [-] (102992) accepted ('10.222.0.62', 50396) {{(pid=102992) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 23 19:41:24.432227 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c13eaa5a-39fd-4633-a168-b8fbfdc0b17e tempest-AttachVolumeTestJSON-1120920040 tempest-AttachVolumeTestJSON-1120920040-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=f8cf4027-ad94-4b78-b429-c3f2d7f9d324,revision_number=None']} {{(pid=102993) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 23 19:41:24.445659 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.api.v2.resource [None req-9e4121bd-85ce-4269-989c-24f6346c7b97 tempest-AttachVolumeTestJSON-1120920040 tempest-AttachVolumeTestJSON-1120920040-project] show failed (client error): The resource could not be found. Nov 23 19:41:24.446696 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [None req-9e4121bd-85ce-4269-989c-24f6346c7b97 tempest-AttachVolumeTestJSON-1120920040 tempest-AttachVolumeTestJSON-1120920040-project] 10.222.0.62 "GET /v2.0/security-groups/f8cf4027-ad94-4b78-b429-c3f2d7f9d324 HTTP/1.1" status: 404 len: 347 time: 0.0198653 Nov 23 19:41:24.449564 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.wsgi [-] (102992) accepted ('10.222.0.62', 50398) {{(pid=102992) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 23 19:41:24.575717 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.plugins.ml2.plugin [None req-9beda3ee-6252-4980-934f-54122b0e9600 tempest-AttachVolumeTestJSON-1120920040 tempest-AttachVolumeTestJSON-1120920040-project] Deleting port 7e010f5c-586e-471a-bb46-61c29dd85a61 {{(pid=102992) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 23 19:41:24.576063 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [None req-9beda3ee-6252-4980-934f-54122b0e9600 tempest-AttachVolumeTestJSON-1120920040 tempest-AttachVolumeTestJSON-1120920040-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8783631423070'] for port, before_delete {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:41:24.653957 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [None req-9beda3ee-6252-4980-934f-54122b0e9600 tempest-AttachVolumeTestJSON-1120920040 tempest-AttachVolumeTestJSON-1120920040-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-927332'] for port, precommit_delete {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:41:24.654203 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [None req-9beda3ee-6252-4980-934f-54122b0e9600 tempest-AttachVolumeTestJSON-1120920040 tempest-AttachVolumeTestJSON-1120920040-project] Publish callbacks [] for floatingip, precommit_delete {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:41:24.666083 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.plugins.ml2.plugin [None req-9beda3ee-6252-4980-934f-54122b0e9600 tempest-AttachVolumeTestJSON-1120920040 tempest-AttachVolumeTestJSON-1120920040-project] Calling delete_port for 7e010f5c-586e-471a-bb46-61c29dd85a61 owned by network:floatingip {{(pid=102992) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 23 19:41:24.852219 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [None req-9beda3ee-6252-4980-934f-54122b0e9600 tempest-AttachVolumeTestJSON-1120920040 tempest-AttachVolumeTestJSON-1120920040-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7918660', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-15067', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560168', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8783631424624', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8783631008723', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-25199805'] for port, after_delete {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:41:24.878260 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9beda3ee-6252-4980-934f-54122b0e9600 tempest-AttachVolumeTestJSON-1120920040 tempest-AttachVolumeTestJSON-1120920040-project] Pushing event deleted for resources: {'Port': ['ID=7e010f5c-586e-471a-bb46-61c29dd85a61,revision_number=None']} {{(pid=102992) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 23 19:41:24.939555 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [None req-9beda3ee-6252-4980-934f-54122b0e9600 tempest-AttachVolumeTestJSON-1120920040 tempest-AttachVolumeTestJSON-1120920040-project] Publish callbacks [] for floatingip, after_delete {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:41:24.942440 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [None req-9beda3ee-6252-4980-934f-54122b0e9600 tempest-AttachVolumeTestJSON-1120920040 tempest-AttachVolumeTestJSON-1120920040-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-514902'] for floatingip, before_response {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:41:24.943672 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [None req-9beda3ee-6252-4980-934f-54122b0e9600 tempest-AttachVolumeTestJSON-1120920040 tempest-AttachVolumeTestJSON-1120920040-project] 10.222.0.62 "DELETE /v2.0/floatingips/a621b55c-734d-4ae5-8844-c2140ad172fa HTTP/1.1" status: 204 len: 168 time: 0.4930601 Nov 23 19:41:25.052515 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.plugins.ml2.rpc [None req-4bf48ff4-ecfb-4168-8b63-249b8c6e9f04 None None] Device 2872cb22-0134-49c4-b6d7-034ca4132327 no longer exists at agent hyperv_hv-cinder-81901 {{(pid=102994) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 23 19:41:25.073622 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.plugins.ml2.plugin [None req-4bf48ff4-ecfb-4168-8b63-249b8c6e9f04 None None] No Port match for: 2872cb22-0134-49c4-b6d7-034ca4132327 {{(pid=102994) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 23 19:41:25.074126 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.plugins.ml2.rpc [None req-4bf48ff4-ecfb-4168-8b63-249b8c6e9f04 None None] Device 2872cb22-0134-49c4-b6d7-034ca4132327 not bound to the agent host hv-cinder-81901 {{(pid=102994) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 23 19:41:25.150931 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b57271e2-f7ba-4402-bf5f-123dc19ff7cd req-0a1f9ed4-c2c0-4bee-960b-71a81c2f2c85 tempest-AttachVolumeNegativeTest-754998453 tempest-AttachVolumeNegativeTest-754998453-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=102992) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:41:25.152802 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-b57271e2-f7ba-4402-bf5f-123dc19ff7cd req-0a1f9ed4-c2c0-4bee-960b-71a81c2f2c85 tempest-AttachVolumeNegativeTest-754998453 tempest-AttachVolumeNegativeTest-754998453-project] 10.222.0.41 "GET /v2.0/networks?id=5f438c34-aac6-400d-bc7e-2e0506f124a9 HTTP/1.1" status: 200 len: 815 time: 0.1123981 Nov 23 19:41:25.168273 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.api.v2.base [req-b57271e2-f7ba-4402-bf5f-123dc19ff7cd req-28377170-bf99-42bd-8608-60d2df46c4b4 tempest-AttachVolumeNegativeTest-754998453 tempest-AttachVolumeNegativeTest-754998453-project] Request body: {'port': {'device_id': 'e88dbfaf-c15b-4506-b81e-3abeb760ae36', 'network_id': '5f438c34-aac6-400d-bc7e-2e0506f124a9', 'admin_state_up': True, 'tenant_id': 'e738acf03acd4f9d90b4dc46fb48bb06'}} {{(pid=102992) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 23 19:41:25.326760 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-65691edc-82be-4731-b31a-fab5e736d5a3 req-d137c33f-68ab-4bd5-a28b-493584e75da0 tempest-AttachVolumeNegativeTest-754998453 tempest-AttachVolumeNegativeTest-754998453-project] 10.222.0.62 "GET /v2.0/ports?device_id=e88dbfaf-c15b-4506-b81e-3abeb760ae36 HTTP/1.1" status: 200 len: 210 time: 0.0305142 Nov 23 19:41:25.372465 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-b57271e2-f7ba-4402-bf5f-123dc19ff7cd req-28377170-bf99-42bd-8608-60d2df46c4b4 tempest-AttachVolumeNegativeTest-754998453 tempest-AttachVolumeNegativeTest-754998453-project] Made reservation on behalf of e738acf03acd4f9d90b4dc46fb48bb06 for: {'port': 1} {{(pid=102992) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 23 19:41:25.379006 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [req-b57271e2-f7ba-4402-bf5f-123dc19ff7cd req-28377170-bf99-42bd-8608-60d2df46c4b4 tempest-AttachVolumeNegativeTest-754998453 tempest-AttachVolumeNegativeTest-754998453-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7921281'] for port, before_create {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:41:25.414479 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.wsgi [-] (102993) accepted ('10.222.0.62', 50408) {{(pid=102993) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 23 19:41:25.417518 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.api.v2.base [None req-d8425778-527b-4b8d-9605-ae4a09d738e1 tempest-AttachVolumeTestJSON-1120920040 tempest-AttachVolumeTestJSON-1120920040-project] Request body: {'security_group': {'name': 'tempest-securitygroup--587618527', 'description': 'tempest-description--2080465656'}} {{(pid=102993) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 23 19:41:25.503959 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-d8425778-527b-4b8d-9605-ae4a09d738e1 tempest-AttachVolumeTestJSON-1120920040 tempest-AttachVolumeTestJSON-1120920040-project] Publish callbacks [] for security_group, before_create {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:41:25.509417 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.db.db_base_plugin_common [req-b57271e2-f7ba-4402-bf5f-123dc19ff7cd req-28377170-bf99-42bd-8608-60d2df46c4b4 tempest-AttachVolumeNegativeTest-754998453 tempest-AttachVolumeNegativeTest-754998453-project] Allocated IP 172.20.0.6 (5f438c34-aac6-400d-bc7e-2e0506f124a9/ffd14982-fec3-42b1-9d92-f2ed87a640f4/e8dc7322-0b92-4637-a298-0a114bf01c42) {{(pid=102992) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 23 19:41:25.571698 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-d8425778-527b-4b8d-9605-ae4a09d738e1 tempest-AttachVolumeTestJSON-1120920040 tempest-AttachVolumeTestJSON-1120920040-project] Publish callbacks [] for security_group, precommit_create {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:41:25.624611 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-d8425778-527b-4b8d-9605-ae4a09d738e1 tempest-AttachVolumeTestJSON-1120920040 tempest-AttachVolumeTestJSON-1120920040-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-623933'] for security_group, after_create {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:41:25.652880 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d8425778-527b-4b8d-9605-ae4a09d738e1 tempest-AttachVolumeTestJSON-1120920040 tempest-AttachVolumeTestJSON-1120920040-project] Pushing event updated for resources: {'SecurityGroup': ['ID=72babeb5-3fe0-4e83-bab0-53665ab366a2,revision_number=1']} {{(pid=102993) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 23 19:41:25.659297 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [req-b57271e2-f7ba-4402-bf5f-123dc19ff7cd req-28377170-bf99-42bd-8608-60d2df46c4b4 tempest-AttachVolumeNegativeTest-754998453 tempest-AttachVolumeNegativeTest-754998453-project] Publish callbacks [] for port, precommit_create {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:41:25.700491 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-d8425778-527b-4b8d-9605-ae4a09d738e1 tempest-AttachVolumeTestJSON-1120920040 tempest-AttachVolumeTestJSON-1120920040-project] Publish callbacks [] for security_group, before_response {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:41:25.701928 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [None req-d8425778-527b-4b8d-9605-ae4a09d738e1 tempest-AttachVolumeTestJSON-1120920040 tempest-AttachVolumeTestJSON-1120920040-project] 10.222.0.62 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1796 time: 0.2879925 Nov 23 19:41:25.704662 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.wsgi [-] (102993) accepted ('10.222.0.62', 50410) {{(pid=102993) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 23 19:41:25.709010 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.api.v2.base [None req-8e304039-2d3f-4780-9acc-432a6540edfa tempest-AttachVolumeTestJSON-1120920040 tempest-AttachVolumeTestJSON-1120920040-project] Request body: {'security_group_rule': {'security_group_id': '72babeb5-3fe0-4e83-bab0-53665ab366a2', 'protocol': 'tcp', 'ethertype': 'IPv4', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'ingress'}} {{(pid=102993) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 23 19:41:25.727315 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [req-b57271e2-f7ba-4402-bf5f-123dc19ff7cd req-28377170-bf99-42bd-8608-60d2df46c4b4 tempest-AttachVolumeNegativeTest-754998453 tempest-AttachVolumeNegativeTest-754998453-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7918660', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-15067', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560168', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8783631008714', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-25199805'] for port, after_create {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:41:25.772605 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-b57271e2-f7ba-4402-bf5f-123dc19ff7cd req-28377170-bf99-42bd-8608-60d2df46c4b4 tempest-AttachVolumeNegativeTest-754998453 tempest-AttachVolumeNegativeTest-754998453-project] Network 5f438c34-aac6-400d-bc7e-2e0506f124a9 is already hosted by enough agents. {{(pid=102992) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 23 19:41:25.775493 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.scheduler.base_scheduler [req-b57271e2-f7ba-4402-bf5f-123dc19ff7cd req-28377170-bf99-42bd-8608-60d2df46c4b4 tempest-AttachVolumeNegativeTest-754998453 tempest-AttachVolumeNegativeTest-754998453-project] Resources bound (agent type, host, resource id): {{(pid=102992) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 23 19:41:25.777194 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-8e304039-2d3f-4780-9acc-432a6540edfa tempest-AttachVolumeTestJSON-1120920040 tempest-AttachVolumeTestJSON-1120920040-project] Publish callbacks [] for security_group_rule, before_create {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:41:25.779076 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.db.l3_dvrscheduler_db [req-b57271e2-f7ba-4402-bf5f-123dc19ff7cd req-28377170-bf99-42bd-8608-60d2df46c4b4 tempest-AttachVolumeNegativeTest-754998453 tempest-AttachVolumeNegativeTest-754998453-project] Received port after_create {{(pid=102992) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 23 19:41:25.809050 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-28377170-bf99-42bd-8608-60d2df46c4b4 tempest-AttachVolumeNegativeTest-754998453 tempest-AttachVolumeNegativeTest-754998453-project] Pushing event updated for resources: {'Port': ['ID=e8dc7322-0b92-4637-a298-0a114bf01c42,revision_number=1']} {{(pid=102992) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 23 19:41:25.822904 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-28377170-bf99-42bd-8608-60d2df46c4b4 tempest-AttachVolumeNegativeTest-754998453 tempest-AttachVolumeNegativeTest-754998453-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-819011-1-iscsi {{(pid=102992) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 23 19:41:25.823260 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-28377170-bf99-42bd-8608-60d2df46c4b4 tempest-AttachVolumeNegativeTest-754998453 tempest-AttachVolumeNegativeTest-754998453-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-819011-1-iscsi {{(pid=102992) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 23 19:41:25.823616 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-28377170-bf99-42bd-8608-60d2df46c4b4 tempest-AttachVolumeNegativeTest-754998453 tempest-AttachVolumeNegativeTest-754998453-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-819011-1-iscsi {{(pid=102992) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 23 19:41:25.823961 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-28377170-bf99-42bd-8608-60d2df46c4b4 tempest-AttachVolumeNegativeTest-754998453 tempest-AttachVolumeNegativeTest-754998453-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-819011-1-iscsi {{(pid=102992) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 23 19:41:25.824330 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-28377170-bf99-42bd-8608-60d2df46c4b4 tempest-AttachVolumeNegativeTest-754998453 tempest-AttachVolumeNegativeTest-754998453-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-819011-1-iscsi {{(pid=102992) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 23 19:41:25.824670 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-28377170-bf99-42bd-8608-60d2df46c4b4 tempest-AttachVolumeNegativeTest-754998453 tempest-AttachVolumeNegativeTest-754998453-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-819011-1-iscsi {{(pid=102992) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 23 19:41:25.825008 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-28377170-bf99-42bd-8608-60d2df46c4b4 tempest-AttachVolumeNegativeTest-754998453 tempest-AttachVolumeNegativeTest-754998453-project] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-819011-1-iscsi {{(pid=102992) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 23 19:41:25.825343 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-28377170-bf99-42bd-8608-60d2df46c4b4 tempest-AttachVolumeNegativeTest-754998453 tempest-AttachVolumeNegativeTest-754998453-project] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-819011-1-iscsi {{(pid=102992) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 23 19:41:25.825708 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-28377170-bf99-42bd-8608-60d2df46c4b4 tempest-AttachVolumeNegativeTest-754998453 tempest-AttachVolumeNegativeTest-754998453-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-819011-1-iscsi {{(pid=102992) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 23 19:41:25.826038 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-28377170-bf99-42bd-8608-60d2df46c4b4 tempest-AttachVolumeNegativeTest-754998453 tempest-AttachVolumeNegativeTest-754998453-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-819011-1-iscsi {{(pid=102992) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 23 19:41:25.827051 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-28377170-bf99-42bd-8608-60d2df46c4b4 tempest-AttachVolumeNegativeTest-754998453 tempest-AttachVolumeNegativeTest-754998453-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-819011-1-iscsi {{(pid=102992) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 23 19:41:25.827475 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-28377170-bf99-42bd-8608-60d2df46c4b4 tempest-AttachVolumeNegativeTest-754998453 tempest-AttachVolumeNegativeTest-754998453-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-819011-1-iscsi {{(pid=102992) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 23 19:41:25.839051 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-8e304039-2d3f-4780-9acc-432a6540edfa tempest-AttachVolumeTestJSON-1120920040 tempest-AttachVolumeTestJSON-1120920040-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:41:25.850739 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b57271e2-f7ba-4402-bf5f-123dc19ff7cd req-28377170-bf99-42bd-8608-60d2df46c4b4 tempest-AttachVolumeNegativeTest-754998453 tempest-AttachVolumeNegativeTest-754998453-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=102992) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:41:25.850739 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [req-b57271e2-f7ba-4402-bf5f-123dc19ff7cd req-28377170-bf99-42bd-8608-60d2df46c4b4 tempest-AttachVolumeNegativeTest-754998453 tempest-AttachVolumeNegativeTest-754998453-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-514902'] for port, before_response {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:41:25.932100 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-8e304039-2d3f-4780-9acc-432a6540edfa tempest-AttachVolumeTestJSON-1120920040 tempest-AttachVolumeTestJSON-1120920040-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-601991'] for security_group_rule, after_create {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:41:25.941051 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-b57271e2-f7ba-4402-bf5f-123dc19ff7cd req-28377170-bf99-42bd-8608-60d2df46c4b4 tempest-AttachVolumeNegativeTest-754998453 tempest-AttachVolumeNegativeTest-754998453-project] 10.222.0.41 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 0.7765920 Nov 23 19:41:25.951006 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8e304039-2d3f-4780-9acc-432a6540edfa tempest-AttachVolumeTestJSON-1120920040 tempest-AttachVolumeTestJSON-1120920040-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=8255a0e0-077e-4815-9e5e-5fc741a819b9,revision_number=0']} {{(pid=102993) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 23 19:41:25.954643 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.api.v2.base [req-b57271e2-f7ba-4402-bf5f-123dc19ff7cd req-fcee9319-bad5-4505-9cf2-e9ab823ca717 service neutron] Request body: {'port': {'device_id': 'e88dbfaf-c15b-4506-b81e-3abeb760ae36', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-81901'}} {{(pid=102992) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 23 19:41:26.043110 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-8e304039-2d3f-4780-9acc-432a6540edfa tempest-AttachVolumeTestJSON-1120920040 tempest-AttachVolumeTestJSON-1120920040-project] Publish callbacks [] for security_group_rule, before_response {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:41:26.044349 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [None req-8e304039-2d3f-4780-9acc-432a6540edfa tempest-AttachVolumeTestJSON-1120920040 tempest-AttachVolumeTestJSON-1120920040-project] 10.222.0.62 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 764 time: 0.3387561 Nov 23 19:41:26.047370 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.wsgi [-] (102993) accepted ('10.222.0.62', 50412) {{(pid=102993) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 23 19:41:26.052035 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.api.v2.base [None req-11604722-8a96-4bed-8490-82080565a99f tempest-AttachVolumeTestJSON-1120920040 tempest-AttachVolumeTestJSON-1120920040-project] Request body: {'security_group_rule': {'security_group_id': '72babeb5-3fe0-4e83-bab0-53665ab366a2', 'protocol': 'icmp', 'ethertype': 'IPv4', 'direction': 'ingress'}} {{(pid=102993) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 23 19:41:26.131935 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-11604722-8a96-4bed-8490-82080565a99f tempest-AttachVolumeTestJSON-1120920040 tempest-AttachVolumeTestJSON-1120920040-project] Publish callbacks [] for security_group_rule, before_create {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:41:26.193351 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-11604722-8a96-4bed-8490-82080565a99f tempest-AttachVolumeTestJSON-1120920040 tempest-AttachVolumeTestJSON-1120920040-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:41:26.246816 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-11604722-8a96-4bed-8490-82080565a99f tempest-AttachVolumeTestJSON-1120920040 tempest-AttachVolumeTestJSON-1120920040-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-601991'] for security_group_rule, after_create {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:41:26.265114 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-11604722-8a96-4bed-8490-82080565a99f tempest-AttachVolumeTestJSON-1120920040 tempest-AttachVolumeTestJSON-1120920040-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=ac5f25e3-b47e-41f6-a003-2b4c7ca1bdbd,revision_number=0']} {{(pid=102993) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 23 19:41:26.265771 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [req-b57271e2-f7ba-4402-bf5f-123dc19ff7cd req-fcee9319-bad5-4505-9cf2-e9ab823ca717 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7921281'] for port, before_update {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:41:26.340397 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-11604722-8a96-4bed-8490-82080565a99f tempest-AttachVolumeTestJSON-1120920040 tempest-AttachVolumeTestJSON-1120920040-project] Publish callbacks [] for security_group_rule, before_response {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:41:26.341553 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [None req-11604722-8a96-4bed-8490-82080565a99f tempest-AttachVolumeTestJSON-1120920040 tempest-AttachVolumeTestJSON-1120920040-project] 10.222.0.62 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 769 time: 0.2931235 Nov 23 19:41:26.344729 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.wsgi [-] (102993) accepted ('10.222.0.62', 50414) {{(pid=102993) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 23 19:41:26.349519 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.api.v2.base [None req-29a68d2b-21da-4d85-a948-bf21d4cf0a55 tempest-AttachVolumeTestJSON-1120920040 tempest-AttachVolumeTestJSON-1120920040-project] Request body: {'floatingip': {'floating_network_id': 'a93e254e-aac9-4233-9e4d-4290fd0458e4'}} {{(pid=102993) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 23 19:41:26.452607 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-29a68d2b-21da-4d85-a948-bf21d4cf0a55 tempest-AttachVolumeTestJSON-1120920040 tempest-AttachVolumeTestJSON-1120920040-project] Publish callbacks [] for floatingip, before_create {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:41:26.490133 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-02118eb7-3ce1-4abc-bb8a-b1b168092703 req-bbded262-333d-4661-8ace-f2fba18e5a33 tempest-AttachVolumeNegativeTest-754998453 tempest-AttachVolumeNegativeTest-754998453-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102992) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:41:26.491654 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-02118eb7-3ce1-4abc-bb8a-b1b168092703 req-bbded262-333d-4661-8ace-f2fba18e5a33 tempest-AttachVolumeNegativeTest-754998453 tempest-AttachVolumeNegativeTest-754998453-project] 10.222.0.62 "GET /v2.0/ports?device_id=e88dbfaf-c15b-4506-b81e-3abeb760ae36 HTTP/1.1" status: 200 len: 931 time: 0.0929587 Nov 23 19:41:26.551356 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-29a68d2b-21da-4d85-a948-bf21d4cf0a55 tempest-AttachVolumeTestJSON-1120920040 tempest-AttachVolumeTestJSON-1120920040-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7921281'] for port, before_create {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:41:26.583718 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-02118eb7-3ce1-4abc-bb8a-b1b168092703 req-1205c8e6-0367-4e12-ab53-a847916cb5fe tempest-AttachVolumeNegativeTest-754998453 tempest-AttachVolumeNegativeTest-754998453-project] 10.222.0.62 "GET /v2.0/security-groups?id=78a07d59-fd8e-4f94-9dfc-099d7d04efec&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0825052 Nov 23 19:41:26.600292 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.notifiers.nova [req-b57271e2-f7ba-4402-bf5f-123dc19ff7cd req-fcee9319-bad5-4505-9cf2-e9ab823ca717 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id e8dc7322-0b92-4637-a298-0a114bf01c42 {{(pid=102992) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 23 19:41:26.607914 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [req-b57271e2-f7ba-4402-bf5f-123dc19ff7cd req-fcee9319-bad5-4505-9cf2-e9ab823ca717 service neutron] Publish callbacks [] for port, precommit_update {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:41:26.619888 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.db.provisioning_blocks [req-b57271e2-f7ba-4402-bf5f-123dc19ff7cd req-fcee9319-bad5-4505-9cf2-e9ab823ca717 service neutron] Transition to ACTIVE for port object e8dc7322-0b92-4637-a298-0a114bf01c42 will not be triggered until provisioned by entity L2. {{(pid=102992) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 23 19:41:26.655847 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.db.db_base_plugin_common [None req-29a68d2b-21da-4d85-a948-bf21d4cf0a55 tempest-AttachVolumeTestJSON-1120920040 tempest-AttachVolumeTestJSON-1120920040-project] Allocated IP 172.27.1.48 (a93e254e-aac9-4233-9e4d-4290fd0458e4/e0b32f3d-83d6-439a-bbed-01df7cf01051/a1b7e213-0cec-4dad-9556-c0839c43711d) {{(pid=102993) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 23 19:41:26.675185 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [req-b57271e2-f7ba-4402-bf5f-123dc19ff7cd req-fcee9319-bad5-4505-9cf2-e9ab823ca717 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7918660', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-15067', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560168', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8783631423946', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8783631008732', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8783631008750', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-25199748'] for port, after_update {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:41:26.728669 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fcee9319-bad5-4505-9cf2-e9ab823ca717 service neutron] Pushing event updated for resources: {'Port': ['ID=e8dc7322-0b92-4637-a298-0a114bf01c42,revision_number=2']} {{(pid=102992) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 23 19:41:26.761533 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-29a68d2b-21da-4d85-a948-bf21d4cf0a55 tempest-AttachVolumeTestJSON-1120920040 tempest-AttachVolumeTestJSON-1120920040-project] Publish callbacks [] for port, precommit_create {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:41:26.796126 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.plugins.ml2.managers [req-b57271e2-f7ba-4402-bf5f-123dc19ff7cd req-fcee9319-bad5-4505-9cf2-e9ab823ca717 service neutron] Attempting to bind port e8dc7322-0b92-4637-a298-0a114bf01c42 on host hv-cinder-81901 for vnic_type normal with profile {{(pid=102992) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 23 19:41:26.796470 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.plugins.ml2.managers [req-b57271e2-f7ba-4402-bf5f-123dc19ff7cd req-fcee9319-bad5-4505-9cf2-e9ab823ca717 service neutron] Attempting to bind port e8dc7322-0b92-4637-a298-0a114bf01c42 by drivers openvswitch,hyperv on host hv-cinder-81901 at level 0 using segments [{'id': 'a14a7aae-c481-4c86-92ee-f7808a54fd04', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 832, 'network_id': '5f438c34-aac6-400d-bc7e-2e0506f124a9'}] {{(pid=102992) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 23 19:41:26.796803 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-b57271e2-f7ba-4402-bf5f-123dc19ff7cd req-fcee9319-bad5-4505-9cf2-e9ab823ca717 service neutron] Attempting to bind port e8dc7322-0b92-4637-a298-0a114bf01c42 on network 5f438c34-aac6-400d-bc7e-2e0506f124a9 {{(pid=102992) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 23 19:41:26.801132 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-b57271e2-f7ba-4402-bf5f-123dc19ff7cd req-fcee9319-bad5-4505-9cf2-e9ab823ca717 service neutron] Port e8dc7322-0b92-4637-a298-0a114bf01c42 on network 5f438c34-aac6-400d-bc7e-2e0506f124a9 not bound, no agent of type Open vSwitch agent registered on host hv-cinder-81901 {{(pid=102992) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Nov 23 19:41:26.801482 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-b57271e2-f7ba-4402-bf5f-123dc19ff7cd req-fcee9319-bad5-4505-9cf2-e9ab823ca717 service neutron] Attempting to bind port e8dc7322-0b92-4637-a298-0a114bf01c42 on network 5f438c34-aac6-400d-bc7e-2e0506f124a9 {{(pid=102992) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 23 19:41:26.806308 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-b57271e2-f7ba-4402-bf5f-123dc19ff7cd req-fcee9319-bad5-4505-9cf2-e9ab823ca717 service neutron] Checking agent: {'id': '14e5d049-431d-466a-8d1c-264e5129d376', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-81901', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 23, 19, 31, 29), 'started_at': datetime.datetime(2021, 11, 23, 19, 31, 29), 'heartbeat_timestamp': datetime.datetime(2021, 11, 23, 19, 41), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=102992) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 23 19:41:26.811881 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-b57271e2-f7ba-4402-bf5f-123dc19ff7cd req-fcee9319-bad5-4505-9cf2-e9ab823ca717 service neutron] Checking segment: {'id': 'a14a7aae-c481-4c86-92ee-f7808a54fd04', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 832, 'network_id': '5f438c34-aac6-400d-bc7e-2e0506f124a9'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102992) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 23 19:41:26.811881 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-b57271e2-f7ba-4402-bf5f-123dc19ff7cd req-fcee9319-bad5-4505-9cf2-e9ab823ca717 service neutron] Bound using segment: {'id': 'a14a7aae-c481-4c86-92ee-f7808a54fd04', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 832, 'network_id': '5f438c34-aac6-400d-bc7e-2e0506f124a9'} {{(pid=102992) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 23 19:41:26.811881 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.plugins.ml2.managers [req-b57271e2-f7ba-4402-bf5f-123dc19ff7cd req-fcee9319-bad5-4505-9cf2-e9ab823ca717 service neutron] Bound port: e8dc7322-0b92-4637-a298-0a114bf01c42, host: hv-cinder-81901, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': 'a14a7aae-c481-4c86-92ee-f7808a54fd04', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 832, 'network_id': '5f438c34-aac6-400d-bc7e-2e0506f124a9'}}] {{(pid=102992) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 23 19:41:26.811881 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [req-b57271e2-f7ba-4402-bf5f-123dc19ff7cd req-fcee9319-bad5-4505-9cf2-e9ab823ca717 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7921281'] for port, before_update {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:41:26.847061 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-29a68d2b-21da-4d85-a948-bf21d4cf0a55 tempest-AttachVolumeTestJSON-1120920040 tempest-AttachVolumeTestJSON-1120920040-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7918660', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-15067', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560168', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8783631008714', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-17257496'] for port, after_create {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:41:26.871014 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.plugins.ml2.db [req-b57271e2-f7ba-4402-bf5f-123dc19ff7cd req-fcee9319-bad5-4505-9cf2-e9ab823ca717 service neutron] For port e8dc7322-0b92-4637-a298-0a114bf01c42, host hv-cinder-81901, cleared binding levels {{(pid=102992) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 23 19:41:26.874916 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.plugins.ml2.db [req-b57271e2-f7ba-4402-bf5f-123dc19ff7cd req-fcee9319-bad5-4505-9cf2-e9ab823ca717 service neutron] For port e8dc7322-0b92-4637-a298-0a114bf01c42, host hv-cinder-81901, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81901',level=0,port_id=e8dc7322-0b92-4637-a298-0a114bf01c42,segment=NetworkSegment(a14a7aae-c481-4c86-92ee-f7808a54fd04),segment_id=a14a7aae-c481-4c86-92ee-f7808a54fd04)] {{(pid=102992) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 23 19:41:26.882984 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-29a68d2b-21da-4d85-a948-bf21d4cf0a55 tempest-AttachVolumeTestJSON-1120920040 tempest-AttachVolumeTestJSON-1120920040-project] Network a93e254e-aac9-4233-9e4d-4290fd0458e4 is already hosted by enough agents. {{(pid=102993) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 23 19:41:26.887692 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.scheduler.base_scheduler [None req-29a68d2b-21da-4d85-a948-bf21d4cf0a55 tempest-AttachVolumeTestJSON-1120920040 tempest-AttachVolumeTestJSON-1120920040-project] Resources bound (agent type, host, resource id): {{(pid=102993) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 23 19:41:26.891816 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.db.l3_dvrscheduler_db [None req-29a68d2b-21da-4d85-a948-bf21d4cf0a55 tempest-AttachVolumeTestJSON-1120920040 tempest-AttachVolumeTestJSON-1120920040-project] Received port after_create {{(pid=102993) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 23 19:41:26.914810 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-29a68d2b-21da-4d85-a948-bf21d4cf0a55 tempest-AttachVolumeTestJSON-1120920040 tempest-AttachVolumeTestJSON-1120920040-project] Pushing event updated for resources: {'Port': ['ID=a1b7e213-0cec-4dad-9556-c0839c43711d,revision_number=1']} {{(pid=102993) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 23 19:41:26.933079 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [req-b57271e2-f7ba-4402-bf5f-123dc19ff7cd req-fcee9319-bad5-4505-9cf2-e9ab823ca717 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7918660', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-15067', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560168', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8783631423946', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8783631008732', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8783631008750', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-25199748'] for port, after_update {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:41:26.967285 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b57271e2-f7ba-4402-bf5f-123dc19ff7cd req-fcee9319-bad5-4505-9cf2-e9ab823ca717 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102992) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:41:26.968136 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [req-b57271e2-f7ba-4402-bf5f-123dc19ff7cd req-fcee9319-bad5-4505-9cf2-e9ab823ca717 service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-514902'] for port, before_response {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:41:26.969562 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-b57271e2-f7ba-4402-bf5f-123dc19ff7cd req-fcee9319-bad5-4505-9cf2-e9ab823ca717 service neutron] 10.222.0.41 "PUT /v2.0/ports/e8dc7322-0b92-4637-a298-0a114bf01c42 HTTP/1.1" status: 200 len: 1093 time: 1.0195737 Nov 23 19:41:26.971790 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'e88dbfaf-c15b-4506-b81e-3abeb760ae36', 'tag': 'e8dc7322-0b92-4637-a298-0a114bf01c42'}] {{(pid=102992) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 23 19:41:26.974775 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.62/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}f86c332b591ae691ababa4b64e0601cbf242a448242f95367ce03daabfb7e1ce" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-457f5147-36a6-4069-b7e3-6e60d0650779" -d '{"events": [{"name": "network-changed", "server_uuid": "e88dbfaf-c15b-4506-b81e-3abeb760ae36", "tag": "e8dc7322-0b92-4637-a298-0a114bf01c42"}]}' {{(pid=102992) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 23 19:41:26.978827 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-29a68d2b-21da-4d85-a948-bf21d4cf0a55 tempest-AttachVolumeTestJSON-1120920040 tempest-AttachVolumeTestJSON-1120920040-project] Publish callbacks [] for floatingip, precommit_create {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:41:27.001317 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fcee9319-bad5-4505-9cf2-e9ab823ca717 service neutron] Pushing event updated for resources: {'Port': ['ID=e8dc7322-0b92-4637-a298-0a114bf01c42,revision_number=3']} {{(pid=102992) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 23 19:41:27.020632 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Tue, 23 Nov 2021 19:41:26 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-30c76ce7-471c-4f81-8084-ed9372bf045a x-openstack-request-id: req-30c76ce7-471c-4f81-8084-ed9372bf045a {{(pid=102992) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 23 19:41:27.020937 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "e88dbfaf-c15b-4506-b81e-3abeb760ae36", "tag": "e8dc7322-0b92-4637-a298-0a114bf01c42", "status": "completed", "code": 200}]} {{(pid=102992) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 23 19:41:27.021223 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.62/compute/v2.1/os-server-external-events used request id req-30c76ce7-471c-4f81-8084-ed9372bf045a {{(pid=102992) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 23 19:41:27.021689 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'e88dbfaf-c15b-4506-b81e-3abeb760ae36', 'tag': 'e8dc7322-0b92-4637-a298-0a114bf01c42', 'status': 'completed', 'code': 200} Nov 23 19:41:27.082913 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-29a68d2b-21da-4d85-a948-bf21d4cf0a55 tempest-AttachVolumeTestJSON-1120920040 tempest-AttachVolumeTestJSON-1120920040-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7921281'] for port, before_update {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:41:27.093842 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-457f5147-36a6-4069-b7e3-6e60d0650779 req-1bedef3c-7530-4615-b16b-4720ef933d9c service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102992) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:41:27.095371 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-457f5147-36a6-4069-b7e3-6e60d0650779 req-1bedef3c-7530-4615-b16b-4720ef933d9c service neutron] 10.222.0.41 "GET /v2.0/ports?tenant_id=e738acf03acd4f9d90b4dc46fb48bb06&device_id=e88dbfaf-c15b-4506-b81e-3abeb760ae36 HTTP/1.1" status: 200 len: 1096 time: 0.0482404 Nov 23 19:41:27.202249 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-457f5147-36a6-4069-b7e3-6e60d0650779 req-0556429f-16b1-439b-9a60-678ad448b9e3 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102992) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:41:27.203891 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-457f5147-36a6-4069-b7e3-6e60d0650779 req-0556429f-16b1-439b-9a60-678ad448b9e3 service neutron] 10.222.0.41 "GET /v2.0/networks?tenant_id=e738acf03acd4f9d90b4dc46fb48bb06&shared=False HTTP/1.1" status: 200 len: 916 time: 0.0983765 Nov 23 19:41:27.241147 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-29a68d2b-21da-4d85-a948-bf21d4cf0a55 tempest-AttachVolumeTestJSON-1120920040 tempest-AttachVolumeTestJSON-1120920040-project] Publish callbacks [] for port, precommit_update {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:41:27.303481 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-29a68d2b-21da-4d85-a948-bf21d4cf0a55 tempest-AttachVolumeTestJSON-1120920040 tempest-AttachVolumeTestJSON-1120920040-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7918660', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-15067', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560168', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8783631423946', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8783631008732', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8783631008750', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-17257505'] for port, after_update {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:41:27.309091 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-457f5147-36a6-4069-b7e3-6e60d0650779 req-bfec7ef3-7781-4eec-b2ed-d248c7a854fe service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102992) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:41:27.311246 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-457f5147-36a6-4069-b7e3-6e60d0650779 req-bfec7ef3-7781-4eec-b2ed-d248c7a854fe service neutron] 10.222.0.41 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 870 time: 0.0992432 Nov 23 19:41:27.383148 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-29a68d2b-21da-4d85-a948-bf21d4cf0a55 tempest-AttachVolumeTestJSON-1120920040 tempest-AttachVolumeTestJSON-1120920040-project] Pushing event updated for resources: {'Port': ['ID=a1b7e213-0cec-4dad-9556-c0839c43711d,revision_number=2']} {{(pid=102993) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 23 19:41:27.391923 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-29a68d2b-21da-4d85-a948-bf21d4cf0a55 tempest-AttachVolumeTestJSON-1120920040 tempest-AttachVolumeTestJSON-1120920040-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-926531'] for floatingip, after_create {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:41:27.407405 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b57271e2-f7ba-4402-bf5f-123dc19ff7cd req-d5d3e978-e094-403e-8a5d-91ae92300ecb service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102992) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:41:27.408899 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-b57271e2-f7ba-4402-bf5f-123dc19ff7cd req-d5d3e978-e094-403e-8a5d-91ae92300ecb service neutron] 10.222.0.41 "GET /v2.0/ports?tenant_id=e738acf03acd4f9d90b4dc46fb48bb06&device_id=e88dbfaf-c15b-4506-b81e-3abeb760ae36 HTTP/1.1" status: 200 len: 1096 time: 0.0425754 Nov 23 19:41:27.462956 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-b57271e2-f7ba-4402-bf5f-123dc19ff7cd req-571f858e-e17d-4205-85fd-2c6edb377e45 service neutron] 10.222.0.41 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.6&port_id=e8dc7322-0b92-4637-a298-0a114bf01c42 HTTP/1.1" status: 200 len: 217 time: 0.0385470 Nov 23 19:41:27.477363 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-29a68d2b-21da-4d85-a948-bf21d4cf0a55 tempest-AttachVolumeTestJSON-1120920040 tempest-AttachVolumeTestJSON-1120920040-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-514902'] for floatingip, before_response {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:41:27.486546 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [None req-29a68d2b-21da-4d85-a948-bf21d4cf0a55 tempest-AttachVolumeTestJSON-1120920040 tempest-AttachVolumeTestJSON-1120920040-project] 10.222.0.62 "POST /v2.0/floatingips HTTP/1.1" status: 201 len: 692 time: 1.1327670 Nov 23 19:41:27.523504 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b57271e2-f7ba-4402-bf5f-123dc19ff7cd req-617f3226-c889-49ad-a02b-79f83762b79e service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102992) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:41:27.525073 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-b57271e2-f7ba-4402-bf5f-123dc19ff7cd req-617f3226-c889-49ad-a02b-79f83762b79e service neutron] 10.222.0.41 "GET /v2.0/subnets?id=ffd14982-fec3-42b1-9d92-f2ed87a640f4 HTTP/1.1" status: 200 len: 855 time: 0.0456047 Nov 23 19:41:27.559545 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-b57271e2-f7ba-4402-bf5f-123dc19ff7cd req-9e257ddd-d205-4494-82fd-23fff57e1442 service neutron] 10.222.0.41 "GET /v2.0/ports?network_id=5f438c34-aac6-400d-bc7e-2e0506f124a9&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0257585 Nov 23 19:41:27.695125 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-b57271e2-f7ba-4402-bf5f-123dc19ff7cd req-008126a4-1280-47c5-bd15-991c529ac1e0 service neutron] 10.222.0.41 "GET /v2.0/networks/5f438c34-aac6-400d-bc7e-2e0506f124a9?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1248908 Nov 23 19:41:27.703318 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-bc6db1e1-7813-4557-b897-01ef53d313e4 req-78eeff71-64d2-4db7-ab8a-4bd07a8cf10a tempest-AttachVolumeTestJSON-1120920040 tempest-AttachVolumeTestJSON-1120920040-project] 10.222.0.62 "GET /v2.0/security-groups?name=tempest-securitygroup--587618527&fields=id&tenant_id=c9d53f0599374b679185cc73383b417c HTTP/1.1" status: 200 len: 267 time: 0.0648680 Nov 23 19:41:27.709006 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cc9dc4fe-4a3a-4783-af99-8c1541ab0f1a req-48cb9730-3504-46d4-af56-ede96f09050e tempest-AttachVolumeNegativeTest-754998453 tempest-AttachVolumeNegativeTest-754998453-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102993) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:41:27.710699 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-cc9dc4fe-4a3a-4783-af99-8c1541ab0f1a req-48cb9730-3504-46d4-af56-ede96f09050e tempest-AttachVolumeNegativeTest-754998453 tempest-AttachVolumeNegativeTest-754998453-project] 10.222.0.62 "GET /v2.0/ports?device_id=e88dbfaf-c15b-4506-b81e-3abeb760ae36 HTTP/1.1" status: 200 len: 943 time: 0.0518503 Nov 23 19:41:27.758740 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-cc9dc4fe-4a3a-4783-af99-8c1541ab0f1a req-5ada929a-39df-4176-96aa-80b707dabd49 tempest-AttachVolumeNegativeTest-754998453 tempest-AttachVolumeNegativeTest-754998453-project] 10.222.0.62 "GET /v2.0/security-groups?id=78a07d59-fd8e-4f94-9dfc-099d7d04efec&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0421240 Nov 23 19:41:27.875615 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-b57271e2-f7ba-4402-bf5f-123dc19ff7cd req-f2913386-f830-47f4-bde7-192b2f1e58df service neutron] 10.222.0.41 "GET /v2.0/networks/5f438c34-aac6-400d-bc7e-2e0506f124a9?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1695921 Nov 23 19:41:27.882689 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bc6db1e1-7813-4557-b897-01ef53d313e4 req-fee28f42-9406-4f3b-9701-3717961bcf39 tempest-AttachVolumeTestJSON-1120920040 tempest-AttachVolumeTestJSON-1120920040-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=102992) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:41:27.884711 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-bc6db1e1-7813-4557-b897-01ef53d313e4 req-fee28f42-9406-4f3b-9701-3717961bcf39 tempest-AttachVolumeTestJSON-1120920040 tempest-AttachVolumeTestJSON-1120920040-project] 10.222.0.62 "GET /v2.0/networks?id=41fa5020-8aad-49ce-b2a6-39d87c9e6042 HTTP/1.1" status: 200 len: 811 time: 0.1705351 Nov 23 19:41:27.900739 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-bc6db1e1-7813-4557-b897-01ef53d313e4 req-8ec7b667-fce3-41a0-976a-32936cdcbdcb tempest-AttachVolumeTestJSON-1120920040 tempest-AttachVolumeTestJSON-1120920040-project] 10.222.0.62 "GET /v2.0/quotas/c9d53f0599374b679185cc73383b417c HTTP/1.1" status: 200 len: 375 time: 0.0096509 Nov 23 19:41:27.953884 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-bc6db1e1-7813-4557-b897-01ef53d313e4 req-47bca98f-83e3-4202-960d-037fce6f8886 tempest-AttachVolumeTestJSON-1120920040 tempest-AttachVolumeTestJSON-1120920040-project] 10.222.0.62 "GET /v2.0/ports?tenant_id=c9d53f0599374b679185cc73383b417c&fields=id HTTP/1.1" status: 200 len: 302 time: 0.0469363 Nov 23 19:41:28.051349 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-bc6db1e1-7813-4557-b897-01ef53d313e4 req-580e2ef9-4ddb-4323-b36b-90e42e39bb14 service neutron] 10.222.0.62 "GET /v2.0/networks/41fa5020-8aad-49ce-b2a6-39d87c9e6042?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0856266 Nov 23 19:41:28.143879 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-bc6db1e1-7813-4557-b897-01ef53d313e4 req-b8178fa2-29bf-485f-aa72-d6c1c5fee13f service neutron] 10.222.0.62 "GET /v2.0/networks/41fa5020-8aad-49ce-b2a6-39d87c9e6042?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0827603 Nov 23 19:41:28.366096 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-fc63cdab-2c4f-46b8-8d85-75e37d4e8105 req-cc5e94ae-65ce-404f-8c32-4891d0eb3a58 tempest-AttachVolumeTestJSON-1120920040 tempest-AttachVolumeTestJSON-1120920040-project] 10.222.0.62 "GET /v2.0/ports?device_id=9e87242f-98ef-4e64-9f5f-1371a11fc350 HTTP/1.1" status: 200 len: 210 time: 0.0297923 Nov 23 19:41:28.883932 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9095b8c4-2643-4f38-94e7-735641ddc7ff req-675edb2a-15fd-4268-abe9-b28257319da3 tempest-AttachVolumeNegativeTest-754998453 tempest-AttachVolumeNegativeTest-754998453-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102992) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:41:28.885317 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-9095b8c4-2643-4f38-94e7-735641ddc7ff req-675edb2a-15fd-4268-abe9-b28257319da3 tempest-AttachVolumeNegativeTest-754998453 tempest-AttachVolumeNegativeTest-754998453-project] 10.222.0.62 "GET /v2.0/ports?device_id=e88dbfaf-c15b-4506-b81e-3abeb760ae36 HTTP/1.1" status: 200 len: 943 time: 0.0519419 Nov 23 19:41:28.931747 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-9095b8c4-2643-4f38-94e7-735641ddc7ff req-e2c29f36-be25-4aab-917a-f4ae988488fa tempest-AttachVolumeNegativeTest-754998453 tempest-AttachVolumeNegativeTest-754998453-project] 10.222.0.62 "GET /v2.0/security-groups?id=78a07d59-fd8e-4f94-9dfc-099d7d04efec&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0398588 Nov 23 19:41:29.233243 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-a9e5db45-a898-42f3-b3c4-06dc4b000993 req-9b5ecaf6-bfe1-4cf0-af48-26383b9ee4da service neutron] 10.222.0.41 "GET /v2.0/ports?device_id=b504cdb2-6182-4c24-9b46-6dc0f85da342&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 275 time: 0.0385780 Nov 23 19:41:29.296958 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a9e5db45-a898-42f3-b3c4-06dc4b000993 req-fa15e926-fbcc-4be0-9479-97e88a6b2eab service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102992) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:41:29.298476 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-a9e5db45-a898-42f3-b3c4-06dc4b000993 req-fa15e926-fbcc-4be0-9479-97e88a6b2eab service neutron] 10.222.0.41 "GET /v2.0/ports?tenant_id=35f8a5017a27449084aabd12f27f5a8a&device_id=b504cdb2-6182-4c24-9b46-6dc0f85da342 HTTP/1.1" status: 200 len: 1099 time: 0.0401506 Nov 23 19:41:29.409237 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a9e5db45-a898-42f3-b3c4-06dc4b000993 req-10fd9d61-e398-4a9f-bd3d-f18255da7a97 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102992) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:41:29.410773 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-a9e5db45-a898-42f3-b3c4-06dc4b000993 req-10fd9d61-e398-4a9f-bd3d-f18255da7a97 service neutron] 10.222.0.41 "GET /v2.0/networks?id=87e46ab6-0f90-430f-930f-9ea1580c04c3 HTTP/1.1" status: 200 len: 909 time: 0.0903461 Nov 23 19:41:29.489565 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-a9e5db45-a898-42f3-b3c4-06dc4b000993 req-2ff2a892-fa7b-4e4c-87ea-a1aff9e1d7f5 service neutron] 10.222.0.41 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.13&port_id=bbafb0bb-163c-43f4-8d2c-2f5304e0bd04 HTTP/1.1" status: 200 len: 1002 time: 0.0667658 Nov 23 19:41:29.559202 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a9e5db45-a898-42f3-b3c4-06dc4b000993 req-d94cece6-08cf-455d-9f4f-e497f0d1df08 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102992) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:41:29.560814 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-a9e5db45-a898-42f3-b3c4-06dc4b000993 req-d94cece6-08cf-455d-9f4f-e497f0d1df08 service neutron] 10.222.0.41 "GET /v2.0/subnets?id=afa5bc59-f70c-409d-8c15-be2dcdce66a3 HTTP/1.1" status: 200 len: 847 time: 0.0607591 Nov 23 19:41:29.619884 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a9e5db45-a898-42f3-b3c4-06dc4b000993 req-2b436480-eb7c-4450-8074-455904cc2e1c service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102992) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:41:29.621540 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-a9e5db45-a898-42f3-b3c4-06dc4b000993 req-2b436480-eb7c-4450-8074-455904cc2e1c service neutron] 10.222.0.41 "GET /v2.0/ports?network_id=87e46ab6-0f90-430f-930f-9ea1580c04c3&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0478668 Nov 23 19:41:29.728276 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-a9e5db45-a898-42f3-b3c4-06dc4b000993 req-4adfcefb-db75-40c3-8ef7-09628e7acddb service neutron] 10.222.0.41 "GET /v2.0/networks/87e46ab6-0f90-430f-930f-9ea1580c04c3?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0977116 Nov 23 19:41:29.750434 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-20845f68-8706-4d04-aa53-fac724b5c591 req-0ef6777f-88fb-44d4-a3b4-bc6c5039039b tempest-AttachVolumeTestJSON-1120920040 tempest-AttachVolumeTestJSON-1120920040-project] 10.222.0.62 "GET /v2.0/ports?device_id=9e87242f-98ef-4e64-9f5f-1371a11fc350 HTTP/1.1" status: 200 len: 210 time: 0.3124526 Nov 23 19:41:29.783385 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron_lib.callbacks.manager [None req-4bf48ff4-ecfb-4168-8b63-249b8c6e9f04 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8783631323329', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7978582'] for agent, after_update {{(pid=102994) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:41:29.829802 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-a9e5db45-a898-42f3-b3c4-06dc4b000993 req-fc243031-eaf0-4dd4-aea6-333fc2a6ad19 service neutron] 10.222.0.41 "GET /v2.0/networks/87e46ab6-0f90-430f-930f-9ea1580c04c3?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0922916 Nov 23 19:41:30.048333 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-33a6a8f6-fe5a-4e49-83f8-883f348cf82d req-447f6ac6-5943-48b7-b781-4d7699b2dd9c tempest-AttachVolumeNegativeTest-754998453 tempest-AttachVolumeNegativeTest-754998453-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102992) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:41:30.049758 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-33a6a8f6-fe5a-4e49-83f8-883f348cf82d req-447f6ac6-5943-48b7-b781-4d7699b2dd9c tempest-AttachVolumeNegativeTest-754998453 tempest-AttachVolumeNegativeTest-754998453-project] 10.222.0.62 "GET /v2.0/ports?device_id=e88dbfaf-c15b-4506-b81e-3abeb760ae36 HTTP/1.1" status: 200 len: 943 time: 0.0505490 Nov 23 19:41:30.097590 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-33a6a8f6-fe5a-4e49-83f8-883f348cf82d req-56c4ccd6-b25b-4ff8-b48f-924ddd575544 tempest-AttachVolumeNegativeTest-754998453 tempest-AttachVolumeNegativeTest-754998453-project] 10.222.0.62 "GET /v2.0/security-groups?id=78a07d59-fd8e-4f94-9dfc-099d7d04efec&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0415881 Nov 23 19:41:30.228013 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bc6db1e1-7813-4557-b897-01ef53d313e4 req-b401e771-8511-4e2e-9529-e32184e70102 tempest-AttachVolumeTestJSON-1120920040 tempest-AttachVolumeTestJSON-1120920040-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=102992) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:41:30.229461 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-bc6db1e1-7813-4557-b897-01ef53d313e4 req-b401e771-8511-4e2e-9529-e32184e70102 tempest-AttachVolumeTestJSON-1120920040 tempest-AttachVolumeTestJSON-1120920040-project] 10.222.0.41 "GET /v2.0/networks?id=41fa5020-8aad-49ce-b2a6-39d87c9e6042 HTTP/1.1" status: 200 len: 811 time: 0.1039712 Nov 23 19:41:30.291880 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-bc6db1e1-7813-4557-b897-01ef53d313e4 req-bba0a813-47e4-4355-afc5-715ba49d97ff tempest-AttachVolumeTestJSON-1120920040 tempest-AttachVolumeTestJSON-1120920040-project] 10.222.0.41 "GET /v2.0/security-groups?fields=id&fields=name&tenant_id=c9d53f0599374b679185cc73383b417c HTTP/1.1" status: 200 len: 379 time: 0.0508571 Nov 23 19:41:30.305948 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.api.v2.base [req-bc6db1e1-7813-4557-b897-01ef53d313e4 req-9f3b5e55-13eb-42c2-a0b6-e95a09e31ce4 tempest-AttachVolumeTestJSON-1120920040 tempest-AttachVolumeTestJSON-1120920040-project] Request body: {'port': {'device_id': '9e87242f-98ef-4e64-9f5f-1371a11fc350', 'network_id': '41fa5020-8aad-49ce-b2a6-39d87c9e6042', 'admin_state_up': True, 'tenant_id': 'c9d53f0599374b679185cc73383b417c', 'security_groups': ['72babeb5-3fe0-4e83-bab0-53665ab366a2']}} {{(pid=102992) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 23 19:41:30.470118 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-bc6db1e1-7813-4557-b897-01ef53d313e4 req-9f3b5e55-13eb-42c2-a0b6-e95a09e31ce4 tempest-AttachVolumeTestJSON-1120920040 tempest-AttachVolumeTestJSON-1120920040-project] Made reservation on behalf of c9d53f0599374b679185cc73383b417c for: {'port': 1} {{(pid=102992) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 23 19:41:30.473879 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [req-bc6db1e1-7813-4557-b897-01ef53d313e4 req-9f3b5e55-13eb-42c2-a0b6-e95a09e31ce4 tempest-AttachVolumeTestJSON-1120920040 tempest-AttachVolumeTestJSON-1120920040-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7921281'] for port, before_create {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:41:30.597254 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.db.db_base_plugin_common [req-bc6db1e1-7813-4557-b897-01ef53d313e4 req-9f3b5e55-13eb-42c2-a0b6-e95a09e31ce4 tempest-AttachVolumeTestJSON-1120920040 tempest-AttachVolumeTestJSON-1120920040-project] Allocated IP 172.20.0.6 (41fa5020-8aad-49ce-b2a6-39d87c9e6042/8f74a1ae-f892-4057-89a5-ca78a259b1bd/a289ac30-8b2a-4448-8e4b-53dbabc0c2e7) {{(pid=102992) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 23 19:41:30.733391 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [req-bc6db1e1-7813-4557-b897-01ef53d313e4 req-9f3b5e55-13eb-42c2-a0b6-e95a09e31ce4 tempest-AttachVolumeTestJSON-1120920040 tempest-AttachVolumeTestJSON-1120920040-project] Publish callbacks [] for port, precommit_create {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:41:30.823876 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [req-bc6db1e1-7813-4557-b897-01ef53d313e4 req-9f3b5e55-13eb-42c2-a0b6-e95a09e31ce4 tempest-AttachVolumeTestJSON-1120920040 tempest-AttachVolumeTestJSON-1120920040-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7918660', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-15067', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560168', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8783631008714', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-25199805'] for port, after_create {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:41:30.857246 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f08a4bd3-6033-4f01-9b40-ba8279cc8299 req-83067b52-2d97-434d-b428-617d253ec88c tempest-AttachVolumeTestJSON-1120920040 tempest-AttachVolumeTestJSON-1120920040-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102993) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:41:30.858670 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-f08a4bd3-6033-4f01-9b40-ba8279cc8299 req-83067b52-2d97-434d-b428-617d253ec88c tempest-AttachVolumeTestJSON-1120920040 tempest-AttachVolumeTestJSON-1120920040-project] 10.222.0.62 "GET /v2.0/ports?device_id=9e87242f-98ef-4e64-9f5f-1371a11fc350 HTTP/1.1" status: 200 len: 931 time: 0.0476916 Nov 23 19:41:30.862497 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-bc6db1e1-7813-4557-b897-01ef53d313e4 req-9f3b5e55-13eb-42c2-a0b6-e95a09e31ce4 tempest-AttachVolumeTestJSON-1120920040 tempest-AttachVolumeTestJSON-1120920040-project] Network 41fa5020-8aad-49ce-b2a6-39d87c9e6042 is already hosted by enough agents. {{(pid=102992) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 23 19:41:30.865636 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.scheduler.base_scheduler [req-bc6db1e1-7813-4557-b897-01ef53d313e4 req-9f3b5e55-13eb-42c2-a0b6-e95a09e31ce4 tempest-AttachVolumeTestJSON-1120920040 tempest-AttachVolumeTestJSON-1120920040-project] Resources bound (agent type, host, resource id): {{(pid=102992) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 23 19:41:30.869267 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.db.l3_dvrscheduler_db [req-bc6db1e1-7813-4557-b897-01ef53d313e4 req-9f3b5e55-13eb-42c2-a0b6-e95a09e31ce4 tempest-AttachVolumeTestJSON-1120920040 tempest-AttachVolumeTestJSON-1120920040-project] Received port after_create {{(pid=102992) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 23 19:41:30.911299 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9f3b5e55-13eb-42c2-a0b6-e95a09e31ce4 tempest-AttachVolumeTestJSON-1120920040 tempest-AttachVolumeTestJSON-1120920040-project] Pushing event updated for resources: {'Port': ['ID=a289ac30-8b2a-4448-8e4b-53dbabc0c2e7,revision_number=1']} {{(pid=102992) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 23 19:41:30.922637 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-f08a4bd3-6033-4f01-9b40-ba8279cc8299 req-ee1ba8d5-10f8-4cbb-88e5-c948ac2afe28 tempest-AttachVolumeTestJSON-1120920040 tempest-AttachVolumeTestJSON-1120920040-project] 10.222.0.62 "GET /v2.0/security-groups?id=72babeb5-3fe0-4e83-bab0-53665ab366a2&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0561810 Nov 23 19:41:30.934284 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bc6db1e1-7813-4557-b897-01ef53d313e4 req-9f3b5e55-13eb-42c2-a0b6-e95a09e31ce4 tempest-AttachVolumeTestJSON-1120920040 tempest-AttachVolumeTestJSON-1120920040-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=102992) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:41:30.934757 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [req-bc6db1e1-7813-4557-b897-01ef53d313e4 req-9f3b5e55-13eb-42c2-a0b6-e95a09e31ce4 tempest-AttachVolumeTestJSON-1120920040 tempest-AttachVolumeTestJSON-1120920040-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-514902'] for port, before_response {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:41:31.054848 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-bc6db1e1-7813-4557-b897-01ef53d313e4 req-9f3b5e55-13eb-42c2-a0b6-e95a09e31ce4 tempest-AttachVolumeTestJSON-1120920040 tempest-AttachVolumeTestJSON-1120920040-project] 10.222.0.41 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 0.7524457 Nov 23 19:41:31.068398 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.api.v2.base [req-bc6db1e1-7813-4557-b897-01ef53d313e4 req-63befe82-8984-48ea-a0f8-87c98ba6ff87 service neutron] Request body: {'port': {'device_id': '9e87242f-98ef-4e64-9f5f-1371a11fc350', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-81901'}} {{(pid=102992) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 23 19:41:31.086567 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.plugins.ml2.rpc [None req-4bf48ff4-ecfb-4168-8b63-249b8c6e9f04 None None] Device e8dc7322-0b92-4637-a298-0a114bf01c42 details requested by agent hyperv_hv-cinder-81901 with host hv-cinder-81901 {{(pid=102994) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Nov 23 19:41:31.121853 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [req-bc6db1e1-7813-4557-b897-01ef53d313e4 req-63befe82-8984-48ea-a0f8-87c98ba6ff87 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7921281'] for port, before_update {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:41:31.137574 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.db.provisioning_blocks [None req-29438138-a9a5-4684-a4eb-db35e2fdb5ef None None] Provisioning complete for port a289ac30-8b2a-4448-8e4b-53dbabc0c2e7 triggered by entity DHCP. {{(pid=102994) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 23 19:41:31.137953 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron_lib.callbacks.manager [None req-29438138-a9a5-4684-a4eb-db35e2fdb5ef None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-8355713'] for port, provisioning_complete {{(pid=102994) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:41:31.210642 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.plugins.ml2.plugin [None req-29438138-a9a5-4684-a4eb-db35e2fdb5ef None None] Port a289ac30-8b2a-4448-8e4b-53dbabc0c2e7 cannot update to ACTIVE because it is not bound. {{(pid=102994) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 23 19:41:31.228030 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.plugins.ml2.db [None req-4bf48ff4-ecfb-4168-8b63-249b8c6e9f04 None None] For port e8dc7322-0b92-4637-a298-0a114bf01c42, host hv-cinder-81901, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81901',level=0,port_id=e8dc7322-0b92-4637-a298-0a114bf01c42,segment=NetworkSegment(a14a7aae-c481-4c86-92ee-f7808a54fd04),segment_id=a14a7aae-c481-4c86-92ee-f7808a54fd04)] {{(pid=102994) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 23 19:41:31.238738 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.plugins.ml2.rpc [None req-4bf48ff4-ecfb-4168-8b63-249b8c6e9f04 None None] Returning: {'device': 'e8dc7322-0b92-4637-a298-0a114bf01c42', 'network_id': '5f438c34-aac6-400d-bc7e-2e0506f124a9', 'port_id': 'e8dc7322-0b92-4637-a298-0a114bf01c42', 'mac_address': 'fa:16:3e:ca:d0:3f', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 832, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'ffd14982-fec3-42b1-9d92-f2ed87a640f4', 'ip_address': '172.20.0.6'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=102994) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Nov 23 19:41:31.294940 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-055d5516-46bd-44fd-94da-47c426fc453c req-b4c5ec1d-c81e-4cf4-8a81-83f779dfde69 tempest-AttachVolumeNegativeTest-754998453 tempest-AttachVolumeNegativeTest-754998453-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102992) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:41:31.296619 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-055d5516-46bd-44fd-94da-47c426fc453c req-b4c5ec1d-c81e-4cf4-8a81-83f779dfde69 tempest-AttachVolumeNegativeTest-754998453 tempest-AttachVolumeNegativeTest-754998453-project] 10.222.0.62 "GET /v2.0/ports?device_id=e88dbfaf-c15b-4506-b81e-3abeb760ae36 HTTP/1.1" status: 200 len: 943 time: 0.1299484 Nov 23 19:41:31.402029 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-055d5516-46bd-44fd-94da-47c426fc453c req-f72fb9c3-49d2-4452-b509-7c9ac30365f3 tempest-AttachVolumeNegativeTest-754998453 tempest-AttachVolumeNegativeTest-754998453-project] 10.222.0.62 "GET /v2.0/security-groups?id=78a07d59-fd8e-4f94-9dfc-099d7d04efec&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0955722 Nov 23 19:41:31.407054 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron_lib.callbacks.manager [None req-4bf48ff4-ecfb-4168-8b63-249b8c6e9f04 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7921281'] for port, before_update {{(pid=102994) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:41:31.422715 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.notifiers.nova [None req-4bf48ff4-ecfb-4168-8b63-249b8c6e9f04 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id e8dc7322-0b92-4637-a298-0a114bf01c42 {{(pid=102994) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 23 19:41:31.440384 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.plugins.ml2.db [None req-4bf48ff4-ecfb-4168-8b63-249b8c6e9f04 None None] For port e8dc7322-0b92-4637-a298-0a114bf01c42, host hv-cinder-81901, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81901',level=0,port_id=e8dc7322-0b92-4637-a298-0a114bf01c42,segment=NetworkSegment(a14a7aae-c481-4c86-92ee-f7808a54fd04),segment_id=a14a7aae-c481-4c86-92ee-f7808a54fd04)] {{(pid=102994) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 23 19:41:31.465033 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.notifiers.nova [req-bc6db1e1-7813-4557-b897-01ef53d313e4 req-63befe82-8984-48ea-a0f8-87c98ba6ff87 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id a289ac30-8b2a-4448-8e4b-53dbabc0c2e7 {{(pid=102992) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 23 19:41:31.472643 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [req-bc6db1e1-7813-4557-b897-01ef53d313e4 req-63befe82-8984-48ea-a0f8-87c98ba6ff87 service neutron] Publish callbacks [] for port, precommit_update {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:41:31.484302 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.db.provisioning_blocks [req-bc6db1e1-7813-4557-b897-01ef53d313e4 req-63befe82-8984-48ea-a0f8-87c98ba6ff87 service neutron] Transition to ACTIVE for port object a289ac30-8b2a-4448-8e4b-53dbabc0c2e7 will not be triggered until provisioned by entity L2. {{(pid=102992) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 23 19:41:31.497773 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron_lib.callbacks.manager [None req-4bf48ff4-ecfb-4168-8b63-249b8c6e9f04 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7918660', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-15067', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560168', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8783631423946', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8783631008732', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8783631008750'] for port, after_update {{(pid=102994) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:41:31.532230 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [req-bc6db1e1-7813-4557-b897-01ef53d313e4 req-63befe82-8984-48ea-a0f8-87c98ba6ff87 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7918660', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-15067', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560168', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8783631423946', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8783631008732', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8783631008750', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-25199748'] for port, after_update {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:41:31.544925 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4bf48ff4-ecfb-4168-8b63-249b8c6e9f04 None None] Pushing event updated for resources: {'Port': ['ID=e8dc7322-0b92-4637-a298-0a114bf01c42,revision_number=4']} {{(pid=102994) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 23 19:41:31.584860 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-63befe82-8984-48ea-a0f8-87c98ba6ff87 service neutron] Pushing event updated for resources: {'Port': ['ID=a289ac30-8b2a-4448-8e4b-53dbabc0c2e7,revision_number=2']} {{(pid=102992) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 23 19:41:31.653585 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.plugins.ml2.managers [req-bc6db1e1-7813-4557-b897-01ef53d313e4 req-63befe82-8984-48ea-a0f8-87c98ba6ff87 service neutron] Attempting to bind port a289ac30-8b2a-4448-8e4b-53dbabc0c2e7 on host hv-cinder-81901 for vnic_type normal with profile {{(pid=102992) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 23 19:41:31.653847 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.plugins.ml2.managers [req-bc6db1e1-7813-4557-b897-01ef53d313e4 req-63befe82-8984-48ea-a0f8-87c98ba6ff87 service neutron] Attempting to bind port a289ac30-8b2a-4448-8e4b-53dbabc0c2e7 by drivers openvswitch,hyperv on host hv-cinder-81901 at level 0 using segments [{'id': '1a7bcd69-381b-4068-88df-df74b53e9d61', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 824, 'network_id': '41fa5020-8aad-49ce-b2a6-39d87c9e6042'}] {{(pid=102992) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 23 19:41:31.654178 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-bc6db1e1-7813-4557-b897-01ef53d313e4 req-63befe82-8984-48ea-a0f8-87c98ba6ff87 service neutron] Attempting to bind port a289ac30-8b2a-4448-8e4b-53dbabc0c2e7 on network 41fa5020-8aad-49ce-b2a6-39d87c9e6042 {{(pid=102992) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 23 19:41:31.659089 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-bc6db1e1-7813-4557-b897-01ef53d313e4 req-63befe82-8984-48ea-a0f8-87c98ba6ff87 service neutron] Port a289ac30-8b2a-4448-8e4b-53dbabc0c2e7 on network 41fa5020-8aad-49ce-b2a6-39d87c9e6042 not bound, no agent of type Open vSwitch agent registered on host hv-cinder-81901 {{(pid=102992) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Nov 23 19:41:31.659647 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-bc6db1e1-7813-4557-b897-01ef53d313e4 req-63befe82-8984-48ea-a0f8-87c98ba6ff87 service neutron] Attempting to bind port a289ac30-8b2a-4448-8e4b-53dbabc0c2e7 on network 41fa5020-8aad-49ce-b2a6-39d87c9e6042 {{(pid=102992) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 23 19:41:31.665074 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-bc6db1e1-7813-4557-b897-01ef53d313e4 req-63befe82-8984-48ea-a0f8-87c98ba6ff87 service neutron] Checking agent: {'id': '14e5d049-431d-466a-8d1c-264e5129d376', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-81901', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 23, 19, 31, 29), 'started_at': datetime.datetime(2021, 11, 23, 19, 31, 29), 'heartbeat_timestamp': datetime.datetime(2021, 11, 23, 19, 41, 30), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=102992) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 23 19:41:31.665446 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-bc6db1e1-7813-4557-b897-01ef53d313e4 req-63befe82-8984-48ea-a0f8-87c98ba6ff87 service neutron] Checking segment: {'id': '1a7bcd69-381b-4068-88df-df74b53e9d61', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 824, 'network_id': '41fa5020-8aad-49ce-b2a6-39d87c9e6042'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102992) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 23 19:41:31.665843 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-bc6db1e1-7813-4557-b897-01ef53d313e4 req-63befe82-8984-48ea-a0f8-87c98ba6ff87 service neutron] Bound using segment: {'id': '1a7bcd69-381b-4068-88df-df74b53e9d61', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 824, 'network_id': '41fa5020-8aad-49ce-b2a6-39d87c9e6042'} {{(pid=102992) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 23 19:41:31.666456 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.plugins.ml2.managers [req-bc6db1e1-7813-4557-b897-01ef53d313e4 req-63befe82-8984-48ea-a0f8-87c98ba6ff87 service neutron] Bound port: a289ac30-8b2a-4448-8e4b-53dbabc0c2e7, host: hv-cinder-81901, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '1a7bcd69-381b-4068-88df-df74b53e9d61', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 824, 'network_id': '41fa5020-8aad-49ce-b2a6-39d87c9e6042'}}] {{(pid=102992) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 23 19:41:31.666633 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [req-bc6db1e1-7813-4557-b897-01ef53d313e4 req-63befe82-8984-48ea-a0f8-87c98ba6ff87 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7921281'] for port, before_update {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:41:31.732191 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.plugins.ml2.db [req-bc6db1e1-7813-4557-b897-01ef53d313e4 req-63befe82-8984-48ea-a0f8-87c98ba6ff87 service neutron] For port a289ac30-8b2a-4448-8e4b-53dbabc0c2e7, host hv-cinder-81901, cleared binding levels {{(pid=102992) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 23 19:41:31.735949 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.plugins.ml2.db [req-bc6db1e1-7813-4557-b897-01ef53d313e4 req-63befe82-8984-48ea-a0f8-87c98ba6ff87 service neutron] For port a289ac30-8b2a-4448-8e4b-53dbabc0c2e7, host hv-cinder-81901, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81901',level=0,port_id=a289ac30-8b2a-4448-8e4b-53dbabc0c2e7,segment=NetworkSegment(1a7bcd69-381b-4068-88df-df74b53e9d61),segment_id=1a7bcd69-381b-4068-88df-df74b53e9d61)] {{(pid=102992) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 23 19:41:31.764476 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.plugins.ml2.db [None req-4bf48ff4-ecfb-4168-8b63-249b8c6e9f04 None None] get_ports_and_sgs() called for port_ids ['e8dc7322-0b92-4637-a298-0a114bf01c42'] {{(pid=102994) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 23 19:41:31.818525 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [req-bc6db1e1-7813-4557-b897-01ef53d313e4 req-63befe82-8984-48ea-a0f8-87c98ba6ff87 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7918660', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-15067', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560168', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8783631423946', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8783631008732', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8783631008750', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-25199748'] for port, after_update {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:41:31.853887 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bc6db1e1-7813-4557-b897-01ef53d313e4 req-63befe82-8984-48ea-a0f8-87c98ba6ff87 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102992) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:41:31.854721 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [req-bc6db1e1-7813-4557-b897-01ef53d313e4 req-63befe82-8984-48ea-a0f8-87c98ba6ff87 service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-514902'] for port, before_response {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:41:31.856319 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-bc6db1e1-7813-4557-b897-01ef53d313e4 req-63befe82-8984-48ea-a0f8-87c98ba6ff87 service neutron] 10.222.0.41 "PUT /v2.0/ports/a289ac30-8b2a-4448-8e4b-53dbabc0c2e7 HTTP/1.1" status: 200 len: 1093 time: 0.7920566 Nov 23 19:41:31.857072 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '9e87242f-98ef-4e64-9f5f-1371a11fc350', 'tag': 'a289ac30-8b2a-4448-8e4b-53dbabc0c2e7'}] {{(pid=102992) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 23 19:41:31.859343 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.62/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}f86c332b591ae691ababa4b64e0601cbf242a448242f95367ce03daabfb7e1ce" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-e6cbd58f-86f1-4a73-9ead-e352fc39fe35" -d '{"events": [{"name": "network-changed", "server_uuid": "9e87242f-98ef-4e64-9f5f-1371a11fc350", "tag": "a289ac30-8b2a-4448-8e4b-53dbabc0c2e7"}]}' {{(pid=102992) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 23 19:41:31.885946 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-63befe82-8984-48ea-a0f8-87c98ba6ff87 service neutron] Pushing event updated for resources: {'Port': ['ID=a289ac30-8b2a-4448-8e4b-53dbabc0c2e7,revision_number=3']} {{(pid=102992) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 23 19:41:31.921984 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Tue, 23 Nov 2021 19:41:31 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-d4d398c6-47b2-4604-9dc9-14f477b3c8c2 x-openstack-request-id: req-d4d398c6-47b2-4604-9dc9-14f477b3c8c2 {{(pid=102992) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 23 19:41:31.926497 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "9e87242f-98ef-4e64-9f5f-1371a11fc350", "tag": "a289ac30-8b2a-4448-8e4b-53dbabc0c2e7", "status": "completed", "code": 200}]} {{(pid=102992) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 23 19:41:31.926497 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.62/compute/v2.1/os-server-external-events used request id req-d4d398c6-47b2-4604-9dc9-14f477b3c8c2 {{(pid=102992) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 23 19:41:31.926497 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '9e87242f-98ef-4e64-9f5f-1371a11fc350', 'tag': 'a289ac30-8b2a-4448-8e4b-53dbabc0c2e7', 'status': 'completed', 'code': 200} Nov 23 19:41:32.013429 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e6cbd58f-86f1-4a73-9ead-e352fc39fe35 req-f1fc7ebd-cbce-4004-859a-3856e22891e1 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102992) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:41:32.014968 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-e6cbd58f-86f1-4a73-9ead-e352fc39fe35 req-f1fc7ebd-cbce-4004-859a-3856e22891e1 service neutron] 10.222.0.41 "GET /v2.0/ports?tenant_id=c9d53f0599374b679185cc73383b417c&device_id=9e87242f-98ef-4e64-9f5f-1371a11fc350 HTTP/1.1" status: 200 len: 1096 time: 0.0640540 Nov 23 19:41:32.109243 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9d6fa6c1-f81a-43ba-8282-0be587e98fa0 req-2adeb980-b6c8-4015-91f5-aa006832f79e tempest-AttachVolumeTestJSON-1120920040 tempest-AttachVolumeTestJSON-1120920040-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102992) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:41:32.111089 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-9d6fa6c1-f81a-43ba-8282-0be587e98fa0 req-2adeb980-b6c8-4015-91f5-aa006832f79e tempest-AttachVolumeTestJSON-1120920040 tempest-AttachVolumeTestJSON-1120920040-project] 10.222.0.62 "GET /v2.0/ports?device_id=9e87242f-98ef-4e64-9f5f-1371a11fc350 HTTP/1.1" status: 200 len: 943 time: 0.1160955 Nov 23 19:41:32.152396 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e6cbd58f-86f1-4a73-9ead-e352fc39fe35 req-061b56ba-3f3c-4800-9d64-ca2978cfc8d5 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102992) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:41:32.153893 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-e6cbd58f-86f1-4a73-9ead-e352fc39fe35 req-061b56ba-3f3c-4800-9d64-ca2978cfc8d5 service neutron] 10.222.0.41 "GET /v2.0/networks?tenant_id=c9d53f0599374b679185cc73383b417c&shared=False HTTP/1.1" status: 200 len: 912 time: 0.1255984 Nov 23 19:41:32.198561 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-9d6fa6c1-f81a-43ba-8282-0be587e98fa0 req-ec390c17-b5c8-483e-b067-8690d04c2c55 tempest-AttachVolumeTestJSON-1120920040 tempest-AttachVolumeTestJSON-1120920040-project] 10.222.0.62 "GET /v2.0/security-groups?id=72babeb5-3fe0-4e83-bab0-53665ab366a2&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0805013 Nov 23 19:41:32.265959 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e6cbd58f-86f1-4a73-9ead-e352fc39fe35 req-9c2538b1-dcd6-43d8-abc5-3ea9487c9f44 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102992) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:41:32.267441 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-e6cbd58f-86f1-4a73-9ead-e352fc39fe35 req-9c2538b1-dcd6-43d8-abc5-3ea9487c9f44 service neutron] 10.222.0.41 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 870 time: 0.1033239 Nov 23 19:41:32.347047 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bc6db1e1-7813-4557-b897-01ef53d313e4 req-8943efb2-a40a-457a-af8b-cecd2136260c service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102992) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:41:32.348512 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-bc6db1e1-7813-4557-b897-01ef53d313e4 req-8943efb2-a40a-457a-af8b-cecd2136260c service neutron] 10.222.0.41 "GET /v2.0/ports?tenant_id=c9d53f0599374b679185cc73383b417c&device_id=9e87242f-98ef-4e64-9f5f-1371a11fc350 HTTP/1.1" status: 200 len: 1096 time: 0.0404160 Nov 23 19:41:32.396523 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-bc6db1e1-7813-4557-b897-01ef53d313e4 req-4c18e5b5-75db-4636-8447-cc682d701998 service neutron] 10.222.0.41 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.6&port_id=a289ac30-8b2a-4448-8e4b-53dbabc0c2e7 HTTP/1.1" status: 200 len: 217 time: 0.0381114 Nov 23 19:41:32.447898 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bc6db1e1-7813-4557-b897-01ef53d313e4 req-d007ea58-7fab-425a-821d-40fb519cc0e5 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102992) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:41:32.449532 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-bc6db1e1-7813-4557-b897-01ef53d313e4 req-d007ea58-7fab-425a-821d-40fb519cc0e5 service neutron] 10.222.0.41 "GET /v2.0/subnets?id=8f74a1ae-f892-4057-89a5-ca78a259b1bd HTTP/1.1" status: 200 len: 850 time: 0.0444882 Nov 23 19:41:32.496402 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bc6db1e1-7813-4557-b897-01ef53d313e4 req-76c40830-47ab-4cb0-87cb-64fd10e2243e service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102992) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:41:32.497940 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-bc6db1e1-7813-4557-b897-01ef53d313e4 req-76c40830-47ab-4cb0-87cb-64fd10e2243e service neutron] 10.222.0.41 "GET /v2.0/ports?network_id=41fa5020-8aad-49ce-b2a6-39d87c9e6042&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0398855 Nov 23 19:41:32.520011 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c9894850-35e1-4a9a-b5f0-efb79e00745c req-8f77df32-365b-43d2-93d3-696f432ffb35 tempest-AttachVolumeNegativeTest-754998453 tempest-AttachVolumeNegativeTest-754998453-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102993) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:41:32.521567 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-c9894850-35e1-4a9a-b5f0-efb79e00745c req-8f77df32-365b-43d2-93d3-696f432ffb35 tempest-AttachVolumeNegativeTest-754998453 tempest-AttachVolumeNegativeTest-754998453-project] 10.222.0.62 "GET /v2.0/ports?device_id=e88dbfaf-c15b-4506-b81e-3abeb760ae36 HTTP/1.1" status: 200 len: 944 time: 0.0483880 Nov 23 19:41:32.572503 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-c9894850-35e1-4a9a-b5f0-efb79e00745c req-f6a4447d-7804-4ea9-88de-7539e389c900 tempest-AttachVolumeNegativeTest-754998453 tempest-AttachVolumeNegativeTest-754998453-project] 10.222.0.62 "GET /v2.0/security-groups?id=78a07d59-fd8e-4f94-9dfc-099d7d04efec&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0448909 Nov 23 19:41:32.600856 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-bc6db1e1-7813-4557-b897-01ef53d313e4 req-db99d8c5-b48c-415c-82df-08d6d680f50f service neutron] 10.222.0.41 "GET /v2.0/networks/41fa5020-8aad-49ce-b2a6-39d87c9e6042?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0867984 Nov 23 19:41:32.686749 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-bc6db1e1-7813-4557-b897-01ef53d313e4 req-f7bb55af-82dc-4959-abc2-f6ca16d81ead service neutron] 10.222.0.41 "GET /v2.0/networks/41fa5020-8aad-49ce-b2a6-39d87c9e6042?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0787337 Nov 23 19:41:33.081119 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.plugins.ml2.rpc [None req-4bf48ff4-ecfb-4168-8b63-249b8c6e9f04 None None] Device e8dc7322-0b92-4637-a298-0a114bf01c42 up at agent hyperv_hv-cinder-81901 {{(pid=102994) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 23 19:41:33.189341 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.db.provisioning_blocks [None req-4bf48ff4-ecfb-4168-8b63-249b8c6e9f04 None None] Provisioning for port e8dc7322-0b92-4637-a298-0a114bf01c42 completed by entity L2. {{(pid=102994) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 23 19:41:33.193317 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.db.provisioning_blocks [None req-4bf48ff4-ecfb-4168-8b63-249b8c6e9f04 None None] Provisioning complete for port e8dc7322-0b92-4637-a298-0a114bf01c42 triggered by entity L2. {{(pid=102994) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 23 19:41:33.193728 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron_lib.callbacks.manager [None req-4bf48ff4-ecfb-4168-8b63-249b8c6e9f04 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-8355713'] for port, provisioning_complete {{(pid=102994) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:41:33.276345 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron_lib.callbacks.manager [None req-4bf48ff4-ecfb-4168-8b63-249b8c6e9f04 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7921281'] for port, before_update {{(pid=102994) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:41:33.300315 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'e88dbfaf-c15b-4506-b81e-3abeb760ae36', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'e8dc7322-0b92-4637-a298-0a114bf01c42'}] {{(pid=102994) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 23 19:41:33.302599 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.62/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}09a7511da0d2ba1d728b27e36a8467ec5289399952f0059588048a7cb66d3a43" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-c5119115-33cd-45a0-a218-b676fd539eeb" -d '{"events": [{"server_uuid": "e88dbfaf-c15b-4506-b81e-3abeb760ae36", "name": "network-vif-plugged", "status": "completed", "tag": "e8dc7322-0b92-4637-a298-0a114bf01c42"}]}' {{(pid=102994) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 23 19:41:33.316377 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.plugins.ml2.db [None req-4bf48ff4-ecfb-4168-8b63-249b8c6e9f04 None None] For port e8dc7322-0b92-4637-a298-0a114bf01c42, host hv-cinder-81901, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81901',level=0,port_id=e8dc7322-0b92-4637-a298-0a114bf01c42,segment=NetworkSegment(a14a7aae-c481-4c86-92ee-f7808a54fd04),segment_id=a14a7aae-c481-4c86-92ee-f7808a54fd04)] {{(pid=102994) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 23 19:41:33.317957 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-878a4c00-4a31-4fa6-a7dc-c0006ab74f02 req-66df6028-9765-4b1f-a3f7-3d0d08f8d4fd tempest-AttachVolumeTestJSON-1120920040 tempest-AttachVolumeTestJSON-1120920040-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102992) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:41:33.319539 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-878a4c00-4a31-4fa6-a7dc-c0006ab74f02 req-66df6028-9765-4b1f-a3f7-3d0d08f8d4fd tempest-AttachVolumeTestJSON-1120920040 tempest-AttachVolumeTestJSON-1120920040-project] 10.222.0.62 "GET /v2.0/ports?device_id=9e87242f-98ef-4e64-9f5f-1371a11fc350 HTTP/1.1" status: 200 len: 943 time: 0.0555050 Nov 23 19:41:33.343002 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 23 Nov 2021 19:41:33 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-bf1f5b9a-5cb1-4c24-85c5-1c6eceef0817 x-openstack-request-id: req-bf1f5b9a-5cb1-4c24-85c5-1c6eceef0817 {{(pid=102994) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 23 19:41:33.343305 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "e88dbfaf-c15b-4506-b81e-3abeb760ae36", "name": "network-vif-plugged", "status": "completed", "tag": "e8dc7322-0b92-4637-a298-0a114bf01c42", "code": 200}]} {{(pid=102994) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 23 19:41:33.343559 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.62/compute/v2.1/os-server-external-events used request id req-bf1f5b9a-5cb1-4c24-85c5-1c6eceef0817 {{(pid=102994) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 23 19:41:33.343956 dv-cinder-819011-1-iscsi neutron-server[102994]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'e88dbfaf-c15b-4506-b81e-3abeb760ae36', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'e8dc7322-0b92-4637-a298-0a114bf01c42', 'code': 200} Nov 23 19:41:33.376358 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-878a4c00-4a31-4fa6-a7dc-c0006ab74f02 req-a2a30d55-20ca-4ac0-ba04-780115d9350a tempest-AttachVolumeTestJSON-1120920040 tempest-AttachVolumeTestJSON-1120920040-project] 10.222.0.62 "GET /v2.0/security-groups?id=72babeb5-3fe0-4e83-bab0-53665ab366a2&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0504639 Nov 23 19:41:33.384230 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron_lib.callbacks.manager [None req-4bf48ff4-ecfb-4168-8b63-249b8c6e9f04 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7918660', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-15067', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560168', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8783631423946', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8783631008732', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8783631008750'] for port, after_update {{(pid=102994) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:41:33.442539 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4bf48ff4-ecfb-4168-8b63-249b8c6e9f04 None None] Pushing event updated for resources: {'Port': ['ID=e8dc7322-0b92-4637-a298-0a114bf01c42,revision_number=5']} {{(pid=102994) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 23 19:41:33.635235 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cec4d5f2-2c34-4ed1-b415-525d93619d97 req-a4068148-5c86-4826-bd8a-0ccd8648ccb0 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102992) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:41:33.636728 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-cec4d5f2-2c34-4ed1-b415-525d93619d97 req-a4068148-5c86-4826-bd8a-0ccd8648ccb0 service neutron] 10.222.0.41 "GET /v2.0/ports?device_id=e88dbfaf-c15b-4506-b81e-3abeb760ae36 HTTP/1.1" status: 200 len: 1098 time: 0.0394802 Nov 23 19:41:33.681480 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-cec4d5f2-2c34-4ed1-b415-525d93619d97 req-928e3010-92ff-48d5-b3c4-a773e0b8b6ed service neutron] 10.222.0.41 "GET /v2.0/security-groups?id=78a07d59-fd8e-4f94-9dfc-099d7d04efec&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0369709 Nov 23 19:41:33.689549 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5f7099b9-dc38-489b-98e1-bbcb07e4eca1 req-1f81cbb1-1c4c-4e90-9c03-3215a751dd36 tempest-AttachVolumeNegativeTest-754998453 tempest-AttachVolumeNegativeTest-754998453-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102993) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:41:33.690991 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-5f7099b9-dc38-489b-98e1-bbcb07e4eca1 req-1f81cbb1-1c4c-4e90-9c03-3215a751dd36 tempest-AttachVolumeNegativeTest-754998453 tempest-AttachVolumeNegativeTest-754998453-project] 10.222.0.62 "GET /v2.0/ports?device_id=e88dbfaf-c15b-4506-b81e-3abeb760ae36 HTTP/1.1" status: 200 len: 945 time: 0.0479584 Nov 23 19:41:33.736551 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-5f7099b9-dc38-489b-98e1-bbcb07e4eca1 req-9944b85b-c234-49b7-8c2a-9a211a07c704 tempest-AttachVolumeNegativeTest-754998453 tempest-AttachVolumeNegativeTest-754998453-project] 10.222.0.62 "GET /v2.0/security-groups?id=78a07d59-fd8e-4f94-9dfc-099d7d04efec&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0396383 Nov 23 19:41:34.489966 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5fea14f3-bd0e-44bd-ab7e-ba069b4aeec7 req-c37b553b-d62b-4ed0-9e5a-8569460be6a3 tempest-AttachVolumeTestJSON-1120920040 tempest-AttachVolumeTestJSON-1120920040-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102992) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:41:34.492712 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-5fea14f3-bd0e-44bd-ab7e-ba069b4aeec7 req-c37b553b-d62b-4ed0-9e5a-8569460be6a3 tempest-AttachVolumeTestJSON-1120920040 tempest-AttachVolumeTestJSON-1120920040-project] 10.222.0.62 "GET /v2.0/ports?device_id=9e87242f-98ef-4e64-9f5f-1371a11fc350 HTTP/1.1" status: 200 len: 943 time: 0.0474946 Nov 23 19:41:34.541201 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-5fea14f3-bd0e-44bd-ab7e-ba069b4aeec7 req-c723cfd2-8908-4af6-993f-2ac2d06e94fa tempest-AttachVolumeTestJSON-1120920040 tempest-AttachVolumeTestJSON-1120920040-project] 10.222.0.62 "GET /v2.0/security-groups?id=72babeb5-3fe0-4e83-bab0-53665ab366a2&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0438991 Nov 23 19:41:34.851964 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-df54f737-01bb-4a1f-8196-c4692cf3486f req-d5b2c23f-279d-41e0-9983-05c8ce9ac336 tempest-AttachVolumeNegativeTest-754998453 tempest-AttachVolumeNegativeTest-754998453-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102993) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:41:34.853591 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-df54f737-01bb-4a1f-8196-c4692cf3486f req-d5b2c23f-279d-41e0-9983-05c8ce9ac336 tempest-AttachVolumeNegativeTest-754998453 tempest-AttachVolumeNegativeTest-754998453-project] 10.222.0.62 "GET /v2.0/ports?device_id=e88dbfaf-c15b-4506-b81e-3abeb760ae36 HTTP/1.1" status: 200 len: 945 time: 0.0492432 Nov 23 19:41:34.901017 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-df54f737-01bb-4a1f-8196-c4692cf3486f req-6bc8cce6-e1ee-4003-82d0-80c3491903a4 tempest-AttachVolumeNegativeTest-754998453 tempest-AttachVolumeNegativeTest-754998453-project] 10.222.0.62 "GET /v2.0/security-groups?id=78a07d59-fd8e-4f94-9dfc-099d7d04efec&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0415382 Nov 23 19:41:35.084680 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.plugins.ml2.rpc [None req-4bf48ff4-ecfb-4168-8b63-249b8c6e9f04 None None] Device a289ac30-8b2a-4448-8e4b-53dbabc0c2e7 details requested by agent hyperv_hv-cinder-81901 with host hv-cinder-81901 {{(pid=102994) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Nov 23 19:41:35.181058 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.plugins.ml2.db [None req-4bf48ff4-ecfb-4168-8b63-249b8c6e9f04 None None] For port a289ac30-8b2a-4448-8e4b-53dbabc0c2e7, host hv-cinder-81901, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81901',level=0,port_id=a289ac30-8b2a-4448-8e4b-53dbabc0c2e7,segment=NetworkSegment(1a7bcd69-381b-4068-88df-df74b53e9d61),segment_id=1a7bcd69-381b-4068-88df-df74b53e9d61)] {{(pid=102994) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 23 19:41:35.192641 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.plugins.ml2.rpc [None req-4bf48ff4-ecfb-4168-8b63-249b8c6e9f04 None None] Returning: {'device': 'a289ac30-8b2a-4448-8e4b-53dbabc0c2e7', 'network_id': '41fa5020-8aad-49ce-b2a6-39d87c9e6042', 'port_id': 'a289ac30-8b2a-4448-8e4b-53dbabc0c2e7', 'mac_address': 'fa:16:3e:8b:a0:d9', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 824, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '8f74a1ae-f892-4057-89a5-ca78a259b1bd', 'ip_address': '172.20.0.6'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=102994) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Nov 23 19:41:35.231008 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron_lib.callbacks.manager [None req-4bf48ff4-ecfb-4168-8b63-249b8c6e9f04 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7921281'] for port, before_update {{(pid=102994) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:41:35.243656 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.notifiers.nova [None req-4bf48ff4-ecfb-4168-8b63-249b8c6e9f04 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id a289ac30-8b2a-4448-8e4b-53dbabc0c2e7 {{(pid=102994) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 23 19:41:35.263079 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.plugins.ml2.db [None req-4bf48ff4-ecfb-4168-8b63-249b8c6e9f04 None None] For port a289ac30-8b2a-4448-8e4b-53dbabc0c2e7, host hv-cinder-81901, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81901',level=0,port_id=a289ac30-8b2a-4448-8e4b-53dbabc0c2e7,segment=NetworkSegment(1a7bcd69-381b-4068-88df-df74b53e9d61),segment_id=1a7bcd69-381b-4068-88df-df74b53e9d61)] {{(pid=102994) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 23 19:41:35.326019 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron_lib.callbacks.manager [None req-4bf48ff4-ecfb-4168-8b63-249b8c6e9f04 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7918660', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-15067', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560168', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8783631423946', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8783631008732', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8783631008750'] for port, after_update {{(pid=102994) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:41:35.372242 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4bf48ff4-ecfb-4168-8b63-249b8c6e9f04 None None] Pushing event updated for resources: {'Port': ['ID=a289ac30-8b2a-4448-8e4b-53dbabc0c2e7,revision_number=4']} {{(pid=102994) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 23 19:41:35.585192 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.plugins.ml2.db [None req-4bf48ff4-ecfb-4168-8b63-249b8c6e9f04 None None] get_ports_and_sgs() called for port_ids ['a289ac30-8b2a-4448-8e4b-53dbabc0c2e7'] {{(pid=102994) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 23 19:41:35.659849 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ea7b81cb-d39e-4e73-a654-6a371404bf23 req-f4610283-2a9f-4e90-abf6-ebfc3851ae10 tempest-AttachVolumeTestJSON-1120920040 tempest-AttachVolumeTestJSON-1120920040-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102992) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:41:35.661250 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-ea7b81cb-d39e-4e73-a654-6a371404bf23 req-f4610283-2a9f-4e90-abf6-ebfc3851ae10 tempest-AttachVolumeTestJSON-1120920040 tempest-AttachVolumeTestJSON-1120920040-project] 10.222.0.62 "GET /v2.0/ports?device_id=9e87242f-98ef-4e64-9f5f-1371a11fc350 HTTP/1.1" status: 200 len: 944 time: 0.0531287 Nov 23 19:41:35.708387 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-ea7b81cb-d39e-4e73-a654-6a371404bf23 req-a5f93022-8bac-4631-aaf0-5116c2992216 tempest-AttachVolumeTestJSON-1120920040 tempest-AttachVolumeTestJSON-1120920040-project] 10.222.0.62 "GET /v2.0/security-groups?id=72babeb5-3fe0-4e83-bab0-53665ab366a2&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0409424 Nov 23 19:41:36.019342 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f170995d-74d5-4ba6-9f2b-77b928aebb04 req-4274a1a8-1668-497a-bd29-9be52812555f tempest-AttachVolumeNegativeTest-754998453 tempest-AttachVolumeNegativeTest-754998453-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102993) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:41:36.020802 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-f170995d-74d5-4ba6-9f2b-77b928aebb04 req-4274a1a8-1668-497a-bd29-9be52812555f tempest-AttachVolumeNegativeTest-754998453 tempest-AttachVolumeNegativeTest-754998453-project] 10.222.0.62 "GET /v2.0/ports?device_id=e88dbfaf-c15b-4506-b81e-3abeb760ae36 HTTP/1.1" status: 200 len: 945 time: 0.0528424 Nov 23 19:41:36.066637 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-f170995d-74d5-4ba6-9f2b-77b928aebb04 req-b64b3fb7-5c08-45f5-aca8-59cb2cdc8b87 tempest-AttachVolumeNegativeTest-754998453 tempest-AttachVolumeNegativeTest-754998453-project] 10.222.0.62 "GET /v2.0/security-groups?id=78a07d59-fd8e-4f94-9dfc-099d7d04efec&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0398939 Nov 23 19:41:36.822709 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c7f9428b-c3c1-48d8-bf70-baef2997513d req-e844d28a-9fc9-448b-b4ee-44d24d3317c9 tempest-AttachVolumeTestJSON-1120920040 tempest-AttachVolumeTestJSON-1120920040-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102992) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:41:36.824211 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-c7f9428b-c3c1-48d8-bf70-baef2997513d req-e844d28a-9fc9-448b-b4ee-44d24d3317c9 tempest-AttachVolumeTestJSON-1120920040 tempest-AttachVolumeTestJSON-1120920040-project] 10.222.0.62 "GET /v2.0/ports?device_id=9e87242f-98ef-4e64-9f5f-1371a11fc350 HTTP/1.1" status: 200 len: 944 time: 0.0495467 Nov 23 19:41:36.872013 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-c7f9428b-c3c1-48d8-bf70-baef2997513d req-cf38f4c2-a184-4978-b424-5090f7bf0bca tempest-AttachVolumeTestJSON-1120920040 tempest-AttachVolumeTestJSON-1120920040-project] 10.222.0.62 "GET /v2.0/security-groups?id=72babeb5-3fe0-4e83-bab0-53665ab366a2&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0417500 Nov 23 19:41:37.081602 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.plugins.ml2.rpc [None req-4bf48ff4-ecfb-4168-8b63-249b8c6e9f04 None None] Device a289ac30-8b2a-4448-8e4b-53dbabc0c2e7 up at agent hyperv_hv-cinder-81901 {{(pid=102994) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 23 19:41:37.183404 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.db.provisioning_blocks [None req-4bf48ff4-ecfb-4168-8b63-249b8c6e9f04 None None] Provisioning for port a289ac30-8b2a-4448-8e4b-53dbabc0c2e7 completed by entity L2. {{(pid=102994) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 23 19:41:37.187979 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.db.provisioning_blocks [None req-4bf48ff4-ecfb-4168-8b63-249b8c6e9f04 None None] Provisioning complete for port a289ac30-8b2a-4448-8e4b-53dbabc0c2e7 triggered by entity L2. {{(pid=102994) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 23 19:41:37.188473 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron_lib.callbacks.manager [None req-4bf48ff4-ecfb-4168-8b63-249b8c6e9f04 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-8355713'] for port, provisioning_complete {{(pid=102994) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:41:37.268388 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron_lib.callbacks.manager [None req-4bf48ff4-ecfb-4168-8b63-249b8c6e9f04 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7921281'] for port, before_update {{(pid=102994) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:41:37.290812 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '9e87242f-98ef-4e64-9f5f-1371a11fc350', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'a289ac30-8b2a-4448-8e4b-53dbabc0c2e7'}] {{(pid=102994) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 23 19:41:37.293011 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.62/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}09a7511da0d2ba1d728b27e36a8467ec5289399952f0059588048a7cb66d3a43" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-8472a067-6486-4755-8dc7-9f2447eeb130" -d '{"events": [{"server_uuid": "9e87242f-98ef-4e64-9f5f-1371a11fc350", "name": "network-vif-plugged", "status": "completed", "tag": "a289ac30-8b2a-4448-8e4b-53dbabc0c2e7"}]}' {{(pid=102994) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 23 19:41:37.305786 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.plugins.ml2.db [None req-4bf48ff4-ecfb-4168-8b63-249b8c6e9f04 None None] For port a289ac30-8b2a-4448-8e4b-53dbabc0c2e7, host hv-cinder-81901, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81901',level=0,port_id=a289ac30-8b2a-4448-8e4b-53dbabc0c2e7,segment=NetworkSegment(1a7bcd69-381b-4068-88df-df74b53e9d61),segment_id=1a7bcd69-381b-4068-88df-df74b53e9d61)] {{(pid=102994) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 23 19:41:37.340398 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 23 Nov 2021 19:41:37 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-25c3142d-2294-4b90-85a1-6ef9d57f67ae x-openstack-request-id: req-25c3142d-2294-4b90-85a1-6ef9d57f67ae {{(pid=102994) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 23 19:41:37.340398 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "9e87242f-98ef-4e64-9f5f-1371a11fc350", "name": "network-vif-plugged", "status": "completed", "tag": "a289ac30-8b2a-4448-8e4b-53dbabc0c2e7", "code": 200}]} {{(pid=102994) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 23 19:41:37.340398 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.62/compute/v2.1/os-server-external-events used request id req-25c3142d-2294-4b90-85a1-6ef9d57f67ae {{(pid=102994) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 23 19:41:37.340398 dv-cinder-819011-1-iscsi neutron-server[102994]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '9e87242f-98ef-4e64-9f5f-1371a11fc350', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'a289ac30-8b2a-4448-8e4b-53dbabc0c2e7', 'code': 200} Nov 23 19:41:37.361354 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron_lib.callbacks.manager [None req-4bf48ff4-ecfb-4168-8b63-249b8c6e9f04 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7918660', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-15067', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560168', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8783631423946', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8783631008732', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8783631008750'] for port, after_update {{(pid=102994) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:41:37.412015 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4bf48ff4-ecfb-4168-8b63-249b8c6e9f04 None None] Pushing event updated for resources: {'Port': ['ID=a289ac30-8b2a-4448-8e4b-53dbabc0c2e7,revision_number=5']} {{(pid=102994) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 23 19:41:37.614732 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fd2a0d50-d37a-4b3c-8867-3f70dc830fc5 req-d1696639-d6b6-45fe-b4e8-74a9a02689da service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102992) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:41:37.616190 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-fd2a0d50-d37a-4b3c-8867-3f70dc830fc5 req-d1696639-d6b6-45fe-b4e8-74a9a02689da service neutron] 10.222.0.41 "GET /v2.0/ports?device_id=9e87242f-98ef-4e64-9f5f-1371a11fc350 HTTP/1.1" status: 200 len: 1098 time: 0.0432129 Nov 23 19:41:37.662514 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-fd2a0d50-d37a-4b3c-8867-3f70dc830fc5 req-7ce9d8e4-e029-43bc-a42e-77e0b9620ef2 service neutron] 10.222.0.41 "GET /v2.0/security-groups?id=72babeb5-3fe0-4e83-bab0-53665ab366a2&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0382156 Nov 23 19:41:37.986926 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b72a41a7-f601-47a4-b445-f64bf5383298 req-47177e94-9365-4ddd-8534-d934a4024d2e tempest-AttachVolumeTestJSON-1120920040 tempest-AttachVolumeTestJSON-1120920040-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102993) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:41:37.988392 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-b72a41a7-f601-47a4-b445-f64bf5383298 req-47177e94-9365-4ddd-8534-d934a4024d2e tempest-AttachVolumeTestJSON-1120920040 tempest-AttachVolumeTestJSON-1120920040-project] 10.222.0.62 "GET /v2.0/ports?device_id=9e87242f-98ef-4e64-9f5f-1371a11fc350 HTTP/1.1" status: 200 len: 945 time: 0.0487244 Nov 23 19:41:38.038884 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-b72a41a7-f601-47a4-b445-f64bf5383298 req-893eaada-1a94-4da9-8d48-f613a10f2904 tempest-AttachVolumeTestJSON-1120920040 tempest-AttachVolumeTestJSON-1120920040-project] 10.222.0.62 "GET /v2.0/security-groups?id=72babeb5-3fe0-4e83-bab0-53665ab366a2&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0445352 Nov 23 19:41:39.163414 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fe78b139-6e89-443d-98b0-6df36f791ad8 req-ddb86a0e-200f-4a97-bc1e-4c83d8e63eb7 tempest-AttachVolumeTestJSON-1120920040 tempest-AttachVolumeTestJSON-1120920040-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102993) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:41:39.165084 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-fe78b139-6e89-443d-98b0-6df36f791ad8 req-ddb86a0e-200f-4a97-bc1e-4c83d8e63eb7 tempest-AttachVolumeTestJSON-1120920040 tempest-AttachVolumeTestJSON-1120920040-project] 10.222.0.62 "GET /v2.0/ports?device_id=9e87242f-98ef-4e64-9f5f-1371a11fc350 HTTP/1.1" status: 200 len: 945 time: 0.0562837 Nov 23 19:41:39.212868 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-fe78b139-6e89-443d-98b0-6df36f791ad8 req-fbfc60bc-8caa-4f58-93c6-d8d3b8cce83a tempest-AttachVolumeTestJSON-1120920040 tempest-AttachVolumeTestJSON-1120920040-project] 10.222.0.62 "GET /v2.0/security-groups?id=72babeb5-3fe0-4e83-bab0-53665ab366a2&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0418410 Nov 23 19:41:39.323519 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0a470069-10c1-4e08-ad29-90dc2bd59ac9 req-56c34019-44e1-4f48-9cdf-1a7210c09176 tempest-AttachVolumeTestJSON-1120920040 tempest-AttachVolumeTestJSON-1120920040-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102992) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:41:39.324898 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-0a470069-10c1-4e08-ad29-90dc2bd59ac9 req-56c34019-44e1-4f48-9cdf-1a7210c09176 tempest-AttachVolumeTestJSON-1120920040 tempest-AttachVolumeTestJSON-1120920040-project] 10.222.0.62 "GET /v2.0/ports?device_id=9e87242f-98ef-4e64-9f5f-1371a11fc350 HTTP/1.1" status: 200 len: 945 time: 0.0477197 Nov 23 19:41:39.333900 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.wsgi [-] (102992) accepted ('10.222.0.62', 50506) {{(pid=102992) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 23 19:41:39.338164 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.api.v2.base [None req-cef826ee-2dd1-4299-b743-b896bd4a0128 tempest-AttachVolumeTestJSON-1120920040 tempest-AttachVolumeTestJSON-1120920040-project] Request body: {'floatingip': {'port_id': 'a289ac30-8b2a-4448-8e4b-53dbabc0c2e7'}} {{(pid=102992) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 23 19:41:39.378176 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [None req-cef826ee-2dd1-4299-b743-b896bd4a0128 tempest-AttachVolumeTestJSON-1120920040 tempest-AttachVolumeTestJSON-1120920040-project] Publish callbacks [] for floatingip, before_update {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:41:40.056657 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [None req-cef826ee-2dd1-4299-b743-b896bd4a0128 tempest-AttachVolumeTestJSON-1120920040 tempest-AttachVolumeTestJSON-1120920040-project] Publish callbacks [] for floatingip, precommit_update {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:41:40.131668 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [None req-cef826ee-2dd1-4299-b743-b896bd4a0128 tempest-AttachVolumeTestJSON-1120920040 tempest-AttachVolumeTestJSON-1120920040-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-926531'] for floatingip, after_update {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:41:40.230721 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.db.l3_db [None req-cef826ee-2dd1-4299-b743-b896bd4a0128 tempest-AttachVolumeTestJSON-1120920040 tempest-AttachVolumeTestJSON-1120920040-project] Floating IP ef077627-e9bd-4654-9bca-52037bf76a41 associated. External IP: 172.27.1.48, port: a289ac30-8b2a-4448-8e4b-53dbabc0c2e7. Nov 23 19:41:40.432535 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-cef826ee-2dd1-4299-b743-b896bd4a0128 tempest-AttachVolumeTestJSON-1120920040 tempest-AttachVolumeTestJSON-1120920040-project] Router c925adea-d520-48c2-a2b3-fdb5661aaf95 has already been hosted by L3 agent 1b20f2c4-70b6-43c3-b9bd-0062cc9e57ac {{(pid=102992) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 23 19:41:40.538803 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-cef826ee-2dd1-4299-b743-b896bd4a0128 tempest-AttachVolumeTestJSON-1120920040 tempest-AttachVolumeTestJSON-1120920040-project] Notify agent at l3_agent.dv-cinder-819011-1-iscsi the message routers_updated {{(pid=102992) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 23 19:41:40.543741 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [None req-cef826ee-2dd1-4299-b743-b896bd4a0128 tempest-AttachVolumeTestJSON-1120920040 tempest-AttachVolumeTestJSON-1120920040-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-514902'] for floatingip, before_response {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:41:40.549581 dv-cinder-819011-1-iscsi neutron-server[102995]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-26c4add9-3e62-401f-a7f5-bad7240c0a22 None None] Sync routers for ids ['c925adea-d520-48c2-a2b3-fdb5661aaf95'] in dv-cinder-819011-1-iscsi {{(pid=102995) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 23 19:41:40.561970 dv-cinder-819011-1-iscsi neutron-server[102995]: DEBUG neutron.db.l3_dvrscheduler_db [None req-26c4add9-3e62-401f-a7f5-bad7240c0a22 None None] Routers {'c925adea-d520-48c2-a2b3-fdb5661aaf95'} bound to L3 agent in host dv-cinder-819011-1-iscsi {{(pid=102995) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 23 19:41:40.563706 dv-cinder-819011-1-iscsi neutron-server[102995]: DEBUG neutron.db.l3_hamode_db [None req-26c4add9-3e62-401f-a7f5-bad7240c0a22 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-819011-1-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 7, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 7, "log_agent_heartbeats": false, "routers": 7},created_at=2021-11-23T19:25:14Z,description=,heartbeat_timestamp=2021-11-23T19:41:14Z,host='dv-cinder-819011-1-iscsi',id=1b20f2c4-70b6-43c3-b9bd-0062cc9e57ac,load=0,resource_versions=,resources_synced=,started_at=2021-11-23T19:25:15Z,topic='l3_agent')) {'router_ids': ['c925adea-d520-48c2-a2b3-fdb5661aaf95'], 'active': True} {{(pid=102995) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 23 19:41:40.572062 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [None req-cef826ee-2dd1-4299-b743-b896bd4a0128 tempest-AttachVolumeTestJSON-1120920040 tempest-AttachVolumeTestJSON-1120920040-project] 10.222.0.62 "PUT /v2.0/floatingips/ef077627-e9bd-4654-9bca-52037bf76a41 HTTP/1.1" status: 200 len: 990 time: 1.2371161 Nov 23 19:41:40.572668 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '9e87242f-98ef-4e64-9f5f-1371a11fc350', 'tag': 'a289ac30-8b2a-4448-8e4b-53dbabc0c2e7'}] {{(pid=102992) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 23 19:41:40.575002 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.62/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}f86c332b591ae691ababa4b64e0601cbf242a448242f95367ce03daabfb7e1ce" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-38a70af1-05d1-4545-b259-914ebb68806e" -d '{"events": [{"name": "network-changed", "server_uuid": "9e87242f-98ef-4e64-9f5f-1371a11fc350", "tag": "a289ac30-8b2a-4448-8e4b-53dbabc0c2e7"}]}' {{(pid=102992) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 23 19:41:40.615974 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Tue, 23 Nov 2021 19:41:40 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-91c4e971-ea7f-4ed0-87bf-b9cb18bd57d7 x-openstack-request-id: req-91c4e971-ea7f-4ed0-87bf-b9cb18bd57d7 {{(pid=102992) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 23 19:41:40.616139 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "9e87242f-98ef-4e64-9f5f-1371a11fc350", "tag": "a289ac30-8b2a-4448-8e4b-53dbabc0c2e7", "status": "completed", "code": 200}]} {{(pid=102992) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 23 19:41:40.616398 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.62/compute/v2.1/os-server-external-events used request id req-91c4e971-ea7f-4ed0-87bf-b9cb18bd57d7 {{(pid=102992) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 23 19:41:40.616804 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '9e87242f-98ef-4e64-9f5f-1371a11fc350', 'tag': 'a289ac30-8b2a-4448-8e4b-53dbabc0c2e7', 'status': 'completed', 'code': 200} Nov 23 19:41:40.686234 dv-cinder-819011-1-iscsi neutron-server[102995]: DEBUG neutron.db.l3_dvr_db [None req-26c4add9-3e62-401f-a7f5-bad7240c0a22 None None] Set router c925adea-d520-48c2-a2b3-fdb5661aaf95 gateway port host: dv-cinder-819011-1-iscsi {{(pid=102995) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 23 19:41:40.686852 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-38a70af1-05d1-4545-b259-914ebb68806e req-b4eb8ab6-2292-477f-9b59-f81bc914529d service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102992) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:41:40.689521 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-38a70af1-05d1-4545-b259-914ebb68806e req-b4eb8ab6-2292-477f-9b59-f81bc914529d service neutron] 10.222.0.41 "GET /v2.0/ports?tenant_id=c9d53f0599374b679185cc73383b417c&device_id=9e87242f-98ef-4e64-9f5f-1371a11fc350 HTTP/1.1" status: 200 len: 1098 time: 0.0433352 Nov 23 19:41:40.783026 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-38a70af1-05d1-4545-b259-914ebb68806e req-4a685187-e0e1-49f9-8b1d-de08f89dd4f1 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102992) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:41:40.784556 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-38a70af1-05d1-4545-b259-914ebb68806e req-4a685187-e0e1-49f9-8b1d-de08f89dd4f1 service neutron] 10.222.0.41 "GET /v2.0/networks?id=41fa5020-8aad-49ce-b2a6-39d87c9e6042 HTTP/1.1" status: 200 len: 912 time: 0.0863552 Nov 23 19:41:40.850149 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-38a70af1-05d1-4545-b259-914ebb68806e req-2e64fd96-e4d9-4360-b103-4c0d6bca1f53 service neutron] 10.222.0.41 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.6&port_id=a289ac30-8b2a-4448-8e4b-53dbabc0c2e7 HTTP/1.1" status: 200 len: 998 time: 0.0580628 Nov 23 19:41:40.905915 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-38a70af1-05d1-4545-b259-914ebb68806e req-46af4f96-d6bc-4829-b20d-69eadb2174a4 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102992) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:41:40.907852 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-38a70af1-05d1-4545-b259-914ebb68806e req-46af4f96-d6bc-4829-b20d-69eadb2174a4 service neutron] 10.222.0.41 "GET /v2.0/subnets?id=8f74a1ae-f892-4057-89a5-ca78a259b1bd HTTP/1.1" status: 200 len: 850 time: 0.0489275 Nov 23 19:41:40.911752 dv-cinder-819011-1-iscsi neutron-server[102995]: DEBUG neutron.db.l3_hamode_db [None req-26c4add9-3e62-401f-a7f5-bad7240c0a22 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'c925adea-d520-48c2-a2b3-fdb5661aaf95', 'name': 'tempest-AttachVolumeTestJSON-1672505821-router', 'tenant_id': 'c9d53f0599374b679185cc73383b417c', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'a93e254e-aac9-4233-9e4d-4290fd0458e4', 'external_fixed_ips': [{'subnet_id': 'e0b32f3d-83d6-439a-bbed-01df7cf01051', 'ip_address': '172.27.1.34'}], 'enable_snat': True}, 'gw_port_id': '41109199-34e8-4da6-963c-4a47600cb432', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-23T19:37:05Z', 'updated_at': '2021-11-23T19:37:09Z', 'revision_number': 4, 'project_id': 'c9d53f0599374b679185cc73383b417c', 'gw_port': {'id': '41109199-34e8-4da6-963c-4a47600cb432', 'name': '', 'network_id': 'a93e254e-aac9-4233-9e4d-4290fd0458e4', 'tenant_id': '', 'mac_address': 'fa:16:3e:52:78:cc', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'c925adea-d520-48c2-a2b3-fdb5661aaf95', 'device_owner': 'network:router_gateway', 'standard_attr_id': 486, 'fixed_ips': [{'subnet_id': 'e0b32f3d-83d6-439a-bbed-01df7cf01051', 'ip_address': '172.27.1.34', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-819011-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-23T19:37:06Z', 'updated_at': '2021-11-23T19:37:12Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'e0b32f3d-83d6-439a-bbed-01df7cf01051', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-819011-1-iscsi', '_floatingips': [{'id': 'ef077627-e9bd-4654-9bca-52037bf76a41', 'tenant_id': 'c9d53f0599374b679185cc73383b417c', 'floating_ip_address': '172.27.1.48', 'floating_network_id': 'a93e254e-aac9-4233-9e4d-4290fd0458e4', 'router_id': 'c925adea-d520-48c2-a2b3-fdb5661aaf95', 'port_id': 'a289ac30-8b2a-4448-8e4b-53dbabc0c2e7', 'fixed_ip_address': '172.20.0.6', 'status': 'DOWN', 'standard_attr_id': 609, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '41fa5020-8aad-49ce-b2a6-39d87c9e6042', 'mac_address': 'fa:16:3e:8b:a0:d9', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '9e87242f-98ef-4e64-9f5f-1371a11fc350', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-23T19:41:26Z', 'updated_at': '2021-11-23T19:41:39Z', 'revision_number': 1, 'project_id': 'c9d53f0599374b679185cc73383b417c', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '75766f49-5d4b-4c87-b9ea-e4dd672df213', 'name': '', 'network_id': '41fa5020-8aad-49ce-b2a6-39d87c9e6042', 'tenant_id': 'c9d53f0599374b679185cc73383b417c', 'mac_address': 'fa:16:3e:31:a3:fa', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'c925adea-d520-48c2-a2b3-fdb5661aaf95', 'device_owner': 'network:router_interface', 'standard_attr_id': 487, 'fixed_ips': [{'subnet_id': '8f74a1ae-f892-4057-89a5-ca78a259b1bd', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-819011-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-23T19:37:08Z', 'updated_at': '2021-11-23T19:37:14Z', 'revision_number': 5, 'project_id': 'c9d53f0599374b679185cc73383b417c', 'subnets': [{'id': '8f74a1ae-f892-4057-89a5-ca78a259b1bd', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-819011-1-iscsi', False) {} {{(pid=102995) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 23 19:41:40.938611 dv-cinder-819011-1-iscsi neutron-server[102995]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-26c4add9-3e62-401f-a7f5-bad7240c0a22 None None] Checking router: c925adea-d520-48c2-a2b3-fdb5661aaf95 for host: dv-cinder-819011-1-iscsi {{(pid=102995) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 23 19:41:40.947851 dv-cinder-819011-1-iscsi neutron-server[102995]: DEBUG neutron.db.l3_dvrscheduler_db [None req-26c4add9-3e62-401f-a7f5-bad7240c0a22 None None] Routers {'c925adea-d520-48c2-a2b3-fdb5661aaf95'} bound to L3 agent in host dv-cinder-819011-1-iscsi {{(pid=102995) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 23 19:41:40.948447 dv-cinder-819011-1-iscsi neutron-server[102995]: DEBUG neutron.db.l3_hamode_db [None req-26c4add9-3e62-401f-a7f5-bad7240c0a22 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-819011-1-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 7, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 7, "log_agent_heartbeats": false, "routers": 7},created_at=2021-11-23T19:25:14Z,description=,heartbeat_timestamp=2021-11-23T19:41:14Z,host='dv-cinder-819011-1-iscsi',id=1b20f2c4-70b6-43c3-b9bd-0062cc9e57ac,load=0,resource_versions=,resources_synced=,started_at=2021-11-23T19:25:15Z,topic='l3_agent')) {'router_ids': ['c925adea-d520-48c2-a2b3-fdb5661aaf95'], 'active': True} {{(pid=102995) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 23 19:41:40.957569 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-38a70af1-05d1-4545-b259-914ebb68806e req-b36669fa-efc1-49d2-a956-b2dcc9e1087b service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102992) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:41:40.959106 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-38a70af1-05d1-4545-b259-914ebb68806e req-b36669fa-efc1-49d2-a956-b2dcc9e1087b service neutron] 10.222.0.41 "GET /v2.0/ports?network_id=41fa5020-8aad-49ce-b2a6-39d87c9e6042&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0430894 Nov 23 19:41:41.055578 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-38a70af1-05d1-4545-b259-914ebb68806e req-b91bdbc0-1458-49f0-90a8-bf89887cc6a1 service neutron] 10.222.0.41 "GET /v2.0/networks/41fa5020-8aad-49ce-b2a6-39d87c9e6042?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0866168 Nov 23 19:41:41.057924 dv-cinder-819011-1-iscsi neutron-server[102995]: DEBUG neutron.db.l3_dvr_db [None req-26c4add9-3e62-401f-a7f5-bad7240c0a22 None None] Set router c925adea-d520-48c2-a2b3-fdb5661aaf95 gateway port host: dv-cinder-819011-1-iscsi {{(pid=102995) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 23 19:41:41.151187 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-38a70af1-05d1-4545-b259-914ebb68806e req-75bee1cd-7237-4c59-9ab3-daea09c01349 service neutron] 10.222.0.41 "GET /v2.0/networks/41fa5020-8aad-49ce-b2a6-39d87c9e6042?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0865119 Nov 23 19:41:41.280942 dv-cinder-819011-1-iscsi neutron-server[102995]: DEBUG neutron.db.l3_hamode_db [None req-26c4add9-3e62-401f-a7f5-bad7240c0a22 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'c925adea-d520-48c2-a2b3-fdb5661aaf95', 'name': 'tempest-AttachVolumeTestJSON-1672505821-router', 'tenant_id': 'c9d53f0599374b679185cc73383b417c', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'a93e254e-aac9-4233-9e4d-4290fd0458e4', 'external_fixed_ips': [{'subnet_id': 'e0b32f3d-83d6-439a-bbed-01df7cf01051', 'ip_address': '172.27.1.34'}], 'enable_snat': True}, 'gw_port_id': '41109199-34e8-4da6-963c-4a47600cb432', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-23T19:37:05Z', 'updated_at': '2021-11-23T19:37:09Z', 'revision_number': 4, 'project_id': 'c9d53f0599374b679185cc73383b417c', 'gw_port': {'id': '41109199-34e8-4da6-963c-4a47600cb432', 'name': '', 'network_id': 'a93e254e-aac9-4233-9e4d-4290fd0458e4', 'tenant_id': '', 'mac_address': 'fa:16:3e:52:78:cc', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'c925adea-d520-48c2-a2b3-fdb5661aaf95', 'device_owner': 'network:router_gateway', 'standard_attr_id': 486, 'fixed_ips': [{'subnet_id': 'e0b32f3d-83d6-439a-bbed-01df7cf01051', 'ip_address': '172.27.1.34', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-819011-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-23T19:37:06Z', 'updated_at': '2021-11-23T19:37:12Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'e0b32f3d-83d6-439a-bbed-01df7cf01051', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-819011-1-iscsi', '_floatingips': [{'id': 'ef077627-e9bd-4654-9bca-52037bf76a41', 'tenant_id': 'c9d53f0599374b679185cc73383b417c', 'floating_ip_address': '172.27.1.48', 'floating_network_id': 'a93e254e-aac9-4233-9e4d-4290fd0458e4', 'router_id': 'c925adea-d520-48c2-a2b3-fdb5661aaf95', 'port_id': 'a289ac30-8b2a-4448-8e4b-53dbabc0c2e7', 'fixed_ip_address': '172.20.0.6', 'status': 'DOWN', 'standard_attr_id': 609, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '41fa5020-8aad-49ce-b2a6-39d87c9e6042', 'mac_address': 'fa:16:3e:8b:a0:d9', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '9e87242f-98ef-4e64-9f5f-1371a11fc350', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-23T19:41:26Z', 'updated_at': '2021-11-23T19:41:39Z', 'revision_number': 1, 'project_id': 'c9d53f0599374b679185cc73383b417c', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '75766f49-5d4b-4c87-b9ea-e4dd672df213', 'name': '', 'network_id': '41fa5020-8aad-49ce-b2a6-39d87c9e6042', 'tenant_id': 'c9d53f0599374b679185cc73383b417c', 'mac_address': 'fa:16:3e:31:a3:fa', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'c925adea-d520-48c2-a2b3-fdb5661aaf95', 'device_owner': 'network:router_interface', 'standard_attr_id': 487, 'fixed_ips': [{'subnet_id': '8f74a1ae-f892-4057-89a5-ca78a259b1bd', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-819011-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-23T19:37:08Z', 'updated_at': '2021-11-23T19:37:14Z', 'revision_number': 5, 'project_id': 'c9d53f0599374b679185cc73383b417c', 'subnets': [{'id': '8f74a1ae-f892-4057-89a5-ca78a259b1bd', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-819011-1-iscsi', False) {} {{(pid=102995) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 23 19:41:41.307152 dv-cinder-819011-1-iscsi neutron-server[102995]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-26c4add9-3e62-401f-a7f5-bad7240c0a22 None None] The sync data for ids ['c925adea-d520-48c2-a2b3-fdb5661aaf95'] in dv-cinder-819011-1-iscsi is: [{'id': 'c925adea-d520-48c2-a2b3-fdb5661aaf95', 'name': 'tempest-AttachVolumeTestJSON-1672505821-router', 'tenant_id': 'c9d53f0599374b679185cc73383b417c', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'a93e254e-aac9-4233-9e4d-4290fd0458e4', 'external_fixed_ips': [{'subnet_id': 'e0b32f3d-83d6-439a-bbed-01df7cf01051', 'ip_address': '172.27.1.34'}], 'enable_snat': True}, 'gw_port_id': '41109199-34e8-4da6-963c-4a47600cb432', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-23T19:37:05Z', 'updated_at': '2021-11-23T19:37:09Z', 'revision_number': 4, 'project_id': 'c9d53f0599374b679185cc73383b417c', 'gw_port': {'id': '41109199-34e8-4da6-963c-4a47600cb432', 'name': '', 'network_id': 'a93e254e-aac9-4233-9e4d-4290fd0458e4', 'tenant_id': '', 'mac_address': 'fa:16:3e:52:78:cc', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'c925adea-d520-48c2-a2b3-fdb5661aaf95', 'device_owner': 'network:router_gateway', 'standard_attr_id': 486, 'fixed_ips': [{'subnet_id': 'e0b32f3d-83d6-439a-bbed-01df7cf01051', 'ip_address': '172.27.1.34', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-819011-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-23T19:37:06Z', 'updated_at': '2021-11-23T19:37:12Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'e0b32f3d-83d6-439a-bbed-01df7cf01051', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-819011-1-iscsi', '_floatingips': [{'id': 'ef077627-e9bd-4654-9bca-52037bf76a41', 'tenant_id': 'c9d53f0599374b679185cc73383b417c', 'floating_ip_address': '172.27.1.48', 'floating_network_id': 'a93e254e-aac9-4233-9e4d-4290fd0458e4', 'router_id': 'c925adea-d520-48c2-a2b3-fdb5661aaf95', 'port_id': 'a289ac30-8b2a-4448-8e4b-53dbabc0c2e7', 'fixed_ip_address': '172.20.0.6', 'status': 'DOWN', 'standard_attr_id': 609, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '41fa5020-8aad-49ce-b2a6-39d87c9e6042', 'mac_address': 'fa:16:3e:8b:a0:d9', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '9e87242f-98ef-4e64-9f5f-1371a11fc350', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-23T19:41:26Z', 'updated_at': '2021-11-23T19:41:39Z', 'revision_number': 1, 'project_id': 'c9d53f0599374b679185cc73383b417c', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '75766f49-5d4b-4c87-b9ea-e4dd672df213', 'name': '', 'network_id': '41fa5020-8aad-49ce-b2a6-39d87c9e6042', 'tenant_id': 'c9d53f0599374b679185cc73383b417c', 'mac_address': 'fa:16:3e:31:a3:fa', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'c925adea-d520-48c2-a2b3-fdb5661aaf95', 'device_owner': 'network:router_interface', 'standard_attr_id': 487, 'fixed_ips': [{'subnet_id': '8f74a1ae-f892-4057-89a5-ca78a259b1bd', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-819011-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-23T19:37:08Z', 'updated_at': '2021-11-23T19:37:14Z', 'revision_number': 5, 'project_id': 'c9d53f0599374b679185cc73383b417c', 'subnets': [{'id': '8f74a1ae-f892-4057-89a5-ca78a259b1bd', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=102995) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 23 19:41:41.493227 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-e760c30b-097c-4204-8b95-ac636063431f None None] New status for floating IP ef077627-e9bd-4654-9bca-52037bf76a41: ACTIVE {{(pid=102994) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Nov 23 19:41:41.743340 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron_lib.callbacks.manager [None req-44f5e4ff-6650-482b-91b1-776664305d64 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8783631323329', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7978582'] for agent, after_update {{(pid=102994) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:41:44.200355 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron_lib.callbacks.manager [None req-02ab778c-d78f-46f0-8451-7774c3ee4ecd None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8783631323329', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7978582'] for agent, after_update {{(pid=102994) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:41:45.126445 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron_lib.callbacks.manager [None req-8346ef05-f685-4c3d-af3d-a159b683bec2 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8783631323329', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7978582'] for agent, after_update {{(pid=102994) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:41:46.123727 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9b9037de-5e2a-4e30-8888-d60dbed07da2 req-6609f076-8a9b-4e7d-9995-43da42ee1a72 tempest-AttachVolumeNegativeTest-754998453 tempest-AttachVolumeNegativeTest-754998453-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=102992) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:41:46.125205 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-9b9037de-5e2a-4e30-8888-d60dbed07da2 req-6609f076-8a9b-4e7d-9995-43da42ee1a72 tempest-AttachVolumeNegativeTest-754998453 tempest-AttachVolumeNegativeTest-754998453-project] 10.222.0.62 "GET /v2.0/networks?id=5f438c34-aac6-400d-bc7e-2e0506f124a9 HTTP/1.1" status: 200 len: 815 time: 0.1078577 Nov 23 19:41:46.139746 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-9b9037de-5e2a-4e30-8888-d60dbed07da2 req-03d3d800-b7d4-4916-919e-36213c34ae97 tempest-AttachVolumeNegativeTest-754998453 tempest-AttachVolumeNegativeTest-754998453-project] 10.222.0.62 "GET /v2.0/quotas/e738acf03acd4f9d90b4dc46fb48bb06 HTTP/1.1" status: 200 len: 375 time: 0.0087738 Nov 23 19:41:46.187473 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-9b9037de-5e2a-4e30-8888-d60dbed07da2 req-734d0072-5cab-4efd-be19-ec207b5272a2 tempest-AttachVolumeNegativeTest-754998453 tempest-AttachVolumeNegativeTest-754998453-project] 10.222.0.62 "GET /v2.0/ports?tenant_id=e738acf03acd4f9d90b4dc46fb48bb06&fields=id HTTP/1.1" status: 200 len: 255 time: 0.0422416 Nov 23 19:41:46.273702 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-9b9037de-5e2a-4e30-8888-d60dbed07da2 req-fdd6f805-ea89-46f3-9395-9f38d244d8e5 service neutron] 10.222.0.62 "GET /v2.0/networks/5f438c34-aac6-400d-bc7e-2e0506f124a9?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0792491 Nov 23 19:41:46.364672 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-9b9037de-5e2a-4e30-8888-d60dbed07da2 req-5bc9ecfd-cc51-4a4b-8ab8-3fc4ef325826 service neutron] 10.222.0.62 "GET /v2.0/networks/5f438c34-aac6-400d-bc7e-2e0506f124a9?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0850523 Nov 23 19:41:46.605965 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-8a6ef856-a68e-49e2-8919-83bd2864ce50 req-f3b4b410-5a86-43f6-983b-23635bf650de tempest-AttachVolumeNegativeTest-754998453 tempest-AttachVolumeNegativeTest-754998453-project] 10.222.0.62 "GET /v2.0/ports?device_id=063b0eee-501d-4da3-84b3-fa0731492f5f HTTP/1.1" status: 200 len: 210 time: 0.0283895 Nov 23 19:41:46.612280 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron_lib.callbacks.manager [None req-785c1d26-11ba-42d8-b5a6-51a8b3daeef0 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8783631323329', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7978582'] for agent, after_update {{(pid=102994) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:41:47.302837 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron_lib.callbacks.manager [None req-eb87b2c3-3339-4249-8b85-e695b5b4e1f9 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8783631323329', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7978582'] for agent, after_update {{(pid=102994) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:41:47.704462 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-e429d554-6d82-467f-bff5-e63d4d5426b5 req-be9d09e3-96c5-4f7a-b5f3-e285edb0db74 tempest-AttachVolumeNegativeTest-754998453 tempest-AttachVolumeNegativeTest-754998453-project] 10.222.0.62 "GET /v2.0/ports?device_id=063b0eee-501d-4da3-84b3-fa0731492f5f HTTP/1.1" status: 200 len: 210 time: 0.0272462 Nov 23 19:41:48.542257 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9b9037de-5e2a-4e30-8888-d60dbed07da2 req-537e4848-9a43-429a-bc9b-d9d2c52dab3b tempest-AttachVolumeNegativeTest-754998453 tempest-AttachVolumeNegativeTest-754998453-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=102992) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:41:48.543709 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-9b9037de-5e2a-4e30-8888-d60dbed07da2 req-537e4848-9a43-429a-bc9b-d9d2c52dab3b tempest-AttachVolumeNegativeTest-754998453 tempest-AttachVolumeNegativeTest-754998453-project] 10.222.0.41 "GET /v2.0/networks?id=5f438c34-aac6-400d-bc7e-2e0506f124a9 HTTP/1.1" status: 200 len: 815 time: 0.1067057 Nov 23 19:41:48.569451 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.api.v2.base [req-9b9037de-5e2a-4e30-8888-d60dbed07da2 req-df572502-280c-476a-958b-2cf387d72107 tempest-AttachVolumeNegativeTest-754998453 tempest-AttachVolumeNegativeTest-754998453-project] Request body: {'port': {'device_id': '063b0eee-501d-4da3-84b3-fa0731492f5f', 'network_id': '5f438c34-aac6-400d-bc7e-2e0506f124a9', 'admin_state_up': True, 'tenant_id': 'e738acf03acd4f9d90b4dc46fb48bb06'}} {{(pid=102992) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 23 19:41:48.737685 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-9b9037de-5e2a-4e30-8888-d60dbed07da2 req-df572502-280c-476a-958b-2cf387d72107 tempest-AttachVolumeNegativeTest-754998453 tempest-AttachVolumeNegativeTest-754998453-project] Made reservation on behalf of e738acf03acd4f9d90b4dc46fb48bb06 for: {'port': 1} {{(pid=102992) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 23 19:41:48.741232 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [req-9b9037de-5e2a-4e30-8888-d60dbed07da2 req-df572502-280c-476a-958b-2cf387d72107 tempest-AttachVolumeNegativeTest-754998453 tempest-AttachVolumeNegativeTest-754998453-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7921281'] for port, before_create {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:41:48.802953 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-5fdcab8b-b2e5-4bd1-91aa-3bc8a7435439 req-147c23ab-1f0d-44ea-8b6a-2c82b2c5646c tempest-AttachVolumeNegativeTest-754998453 tempest-AttachVolumeNegativeTest-754998453-project] 10.222.0.62 "GET /v2.0/ports?device_id=063b0eee-501d-4da3-84b3-fa0731492f5f HTTP/1.1" status: 200 len: 210 time: 0.0279253 Nov 23 19:41:48.878521 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.db.db_base_plugin_common [req-9b9037de-5e2a-4e30-8888-d60dbed07da2 req-df572502-280c-476a-958b-2cf387d72107 tempest-AttachVolumeNegativeTest-754998453 tempest-AttachVolumeNegativeTest-754998453-project] Allocated IP 172.20.0.5 (5f438c34-aac6-400d-bc7e-2e0506f124a9/ffd14982-fec3-42b1-9d92-f2ed87a640f4/a2ad1558-284e-4085-92ca-d32f3052846b) {{(pid=102992) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 23 19:41:49.020619 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [req-9b9037de-5e2a-4e30-8888-d60dbed07da2 req-df572502-280c-476a-958b-2cf387d72107 tempest-AttachVolumeNegativeTest-754998453 tempest-AttachVolumeNegativeTest-754998453-project] Publish callbacks [] for port, precommit_create {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:41:49.200697 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [req-9b9037de-5e2a-4e30-8888-d60dbed07da2 req-df572502-280c-476a-958b-2cf387d72107 tempest-AttachVolumeNegativeTest-754998453 tempest-AttachVolumeNegativeTest-754998453-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7918660', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-15067', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560168', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8783631008714', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-25199805'] for port, after_create {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:41:49.215771 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.plugins.ml2.db [None req-4bf48ff4-ecfb-4168-8b63-249b8c6e9f04 None None] get_ports_and_sgs() called for port_ids ['e8dc7322-0b92-4637-a298-0a114bf01c42'] {{(pid=102994) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 23 19:41:49.247593 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-9b9037de-5e2a-4e30-8888-d60dbed07da2 req-df572502-280c-476a-958b-2cf387d72107 tempest-AttachVolumeNegativeTest-754998453 tempest-AttachVolumeNegativeTest-754998453-project] Network 5f438c34-aac6-400d-bc7e-2e0506f124a9 is already hosted by enough agents. {{(pid=102992) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 23 19:41:49.253338 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.scheduler.base_scheduler [req-9b9037de-5e2a-4e30-8888-d60dbed07da2 req-df572502-280c-476a-958b-2cf387d72107 tempest-AttachVolumeNegativeTest-754998453 tempest-AttachVolumeNegativeTest-754998453-project] Resources bound (agent type, host, resource id): {{(pid=102992) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 23 19:41:49.255943 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.db.l3_dvrscheduler_db [req-9b9037de-5e2a-4e30-8888-d60dbed07da2 req-df572502-280c-476a-958b-2cf387d72107 tempest-AttachVolumeNegativeTest-754998453 tempest-AttachVolumeNegativeTest-754998453-project] Received port after_create {{(pid=102992) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 23 19:41:49.287005 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-df572502-280c-476a-958b-2cf387d72107 tempest-AttachVolumeNegativeTest-754998453 tempest-AttachVolumeNegativeTest-754998453-project] Pushing event updated for resources: {'Port': ['ID=a2ad1558-284e-4085-92ca-d32f3052846b,revision_number=1']} {{(pid=102992) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 23 19:41:49.315304 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9b9037de-5e2a-4e30-8888-d60dbed07da2 req-df572502-280c-476a-958b-2cf387d72107 tempest-AttachVolumeNegativeTest-754998453 tempest-AttachVolumeNegativeTest-754998453-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=102992) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:41:49.317645 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [req-9b9037de-5e2a-4e30-8888-d60dbed07da2 req-df572502-280c-476a-958b-2cf387d72107 tempest-AttachVolumeNegativeTest-754998453 tempest-AttachVolumeNegativeTest-754998453-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-514902'] for port, before_response {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:41:49.381109 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-9b9037de-5e2a-4e30-8888-d60dbed07da2 req-df572502-280c-476a-958b-2cf387d72107 tempest-AttachVolumeNegativeTest-754998453 tempest-AttachVolumeNegativeTest-754998453-project] 10.222.0.41 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 0.8152869 Nov 23 19:41:49.397601 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.api.v2.base [req-9b9037de-5e2a-4e30-8888-d60dbed07da2 req-5fa242e7-e44b-443e-ac24-e56f8192f624 service neutron] Request body: {'port': {'device_id': '063b0eee-501d-4da3-84b3-fa0731492f5f', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-81901'}} {{(pid=102992) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 23 19:41:49.454387 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [req-9b9037de-5e2a-4e30-8888-d60dbed07da2 req-5fa242e7-e44b-443e-ac24-e56f8192f624 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7921281'] for port, before_update {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:41:49.727850 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.notifiers.nova [req-9b9037de-5e2a-4e30-8888-d60dbed07da2 req-5fa242e7-e44b-443e-ac24-e56f8192f624 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id a2ad1558-284e-4085-92ca-d32f3052846b {{(pid=102992) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 23 19:41:49.736299 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [req-9b9037de-5e2a-4e30-8888-d60dbed07da2 req-5fa242e7-e44b-443e-ac24-e56f8192f624 service neutron] Publish callbacks [] for port, precommit_update {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:41:49.747793 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.db.provisioning_blocks [req-9b9037de-5e2a-4e30-8888-d60dbed07da2 req-5fa242e7-e44b-443e-ac24-e56f8192f624 service neutron] Transition to ACTIVE for port object a2ad1558-284e-4085-92ca-d32f3052846b will not be triggered until provisioned by entity L2. {{(pid=102992) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 23 19:41:49.805682 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [req-9b9037de-5e2a-4e30-8888-d60dbed07da2 req-5fa242e7-e44b-443e-ac24-e56f8192f624 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7918660', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-15067', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560168', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8783631423946', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8783631008732', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8783631008750', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-25199748'] for port, after_update {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:41:49.858069 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5fa242e7-e44b-443e-ac24-e56f8192f624 service neutron] Pushing event updated for resources: {'Port': ['ID=a2ad1558-284e-4085-92ca-d32f3052846b,revision_number=2']} {{(pid=102992) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 23 19:41:49.921597 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d02e6c93-78d1-4169-8e3a-4dd38fac02ff req-1953e153-1b9b-4f44-8713-45ff8c3b9781 tempest-AttachVolumeNegativeTest-754998453 tempest-AttachVolumeNegativeTest-754998453-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102993) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:41:49.923781 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-d02e6c93-78d1-4169-8e3a-4dd38fac02ff req-1953e153-1b9b-4f44-8713-45ff8c3b9781 tempest-AttachVolumeNegativeTest-754998453 tempest-AttachVolumeNegativeTest-754998453-project] 10.222.0.62 "GET /v2.0/ports?device_id=063b0eee-501d-4da3-84b3-fa0731492f5f HTTP/1.1" status: 200 len: 943 time: 0.0502846 Nov 23 19:41:49.927365 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.plugins.ml2.managers [req-9b9037de-5e2a-4e30-8888-d60dbed07da2 req-5fa242e7-e44b-443e-ac24-e56f8192f624 service neutron] Attempting to bind port a2ad1558-284e-4085-92ca-d32f3052846b on host hv-cinder-81901 for vnic_type normal with profile {{(pid=102992) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 23 19:41:49.927707 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.plugins.ml2.managers [req-9b9037de-5e2a-4e30-8888-d60dbed07da2 req-5fa242e7-e44b-443e-ac24-e56f8192f624 service neutron] Attempting to bind port a2ad1558-284e-4085-92ca-d32f3052846b by drivers openvswitch,hyperv on host hv-cinder-81901 at level 0 using segments [{'id': 'a14a7aae-c481-4c86-92ee-f7808a54fd04', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 832, 'network_id': '5f438c34-aac6-400d-bc7e-2e0506f124a9'}] {{(pid=102992) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 23 19:41:49.928041 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-9b9037de-5e2a-4e30-8888-d60dbed07da2 req-5fa242e7-e44b-443e-ac24-e56f8192f624 service neutron] Attempting to bind port a2ad1558-284e-4085-92ca-d32f3052846b on network 5f438c34-aac6-400d-bc7e-2e0506f124a9 {{(pid=102992) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 23 19:41:49.932312 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-9b9037de-5e2a-4e30-8888-d60dbed07da2 req-5fa242e7-e44b-443e-ac24-e56f8192f624 service neutron] Port a2ad1558-284e-4085-92ca-d32f3052846b on network 5f438c34-aac6-400d-bc7e-2e0506f124a9 not bound, no agent of type Open vSwitch agent registered on host hv-cinder-81901 {{(pid=102992) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Nov 23 19:41:49.932635 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-9b9037de-5e2a-4e30-8888-d60dbed07da2 req-5fa242e7-e44b-443e-ac24-e56f8192f624 service neutron] Attempting to bind port a2ad1558-284e-4085-92ca-d32f3052846b on network 5f438c34-aac6-400d-bc7e-2e0506f124a9 {{(pid=102992) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 23 19:41:49.937835 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-9b9037de-5e2a-4e30-8888-d60dbed07da2 req-5fa242e7-e44b-443e-ac24-e56f8192f624 service neutron] Checking agent: {'id': '14e5d049-431d-466a-8d1c-264e5129d376', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-81901', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 23, 19, 31, 29), 'started_at': datetime.datetime(2021, 11, 23, 19, 31, 29), 'heartbeat_timestamp': datetime.datetime(2021, 11, 23, 19, 41, 30), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=102992) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 23 19:41:49.938245 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-9b9037de-5e2a-4e30-8888-d60dbed07da2 req-5fa242e7-e44b-443e-ac24-e56f8192f624 service neutron] Checking segment: {'id': 'a14a7aae-c481-4c86-92ee-f7808a54fd04', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 832, 'network_id': '5f438c34-aac6-400d-bc7e-2e0506f124a9'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102992) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 23 19:41:49.938637 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-9b9037de-5e2a-4e30-8888-d60dbed07da2 req-5fa242e7-e44b-443e-ac24-e56f8192f624 service neutron] Bound using segment: {'id': 'a14a7aae-c481-4c86-92ee-f7808a54fd04', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 832, 'network_id': '5f438c34-aac6-400d-bc7e-2e0506f124a9'} {{(pid=102992) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 23 19:41:49.939067 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.plugins.ml2.managers [req-9b9037de-5e2a-4e30-8888-d60dbed07da2 req-5fa242e7-e44b-443e-ac24-e56f8192f624 service neutron] Bound port: a2ad1558-284e-4085-92ca-d32f3052846b, host: hv-cinder-81901, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': 'a14a7aae-c481-4c86-92ee-f7808a54fd04', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 832, 'network_id': '5f438c34-aac6-400d-bc7e-2e0506f124a9'}}] {{(pid=102992) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 23 19:41:49.939425 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [req-9b9037de-5e2a-4e30-8888-d60dbed07da2 req-5fa242e7-e44b-443e-ac24-e56f8192f624 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7921281'] for port, before_update {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:41:49.974939 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-d02e6c93-78d1-4169-8e3a-4dd38fac02ff req-50ffb495-3257-4826-9c4d-d3945ad68948 tempest-AttachVolumeNegativeTest-754998453 tempest-AttachVolumeNegativeTest-754998453-project] 10.222.0.62 "GET /v2.0/security-groups?id=78a07d59-fd8e-4f94-9dfc-099d7d04efec&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0447094 Nov 23 19:41:50.005753 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.plugins.ml2.db [req-9b9037de-5e2a-4e30-8888-d60dbed07da2 req-5fa242e7-e44b-443e-ac24-e56f8192f624 service neutron] For port a2ad1558-284e-4085-92ca-d32f3052846b, host hv-cinder-81901, cleared binding levels {{(pid=102992) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 23 19:41:50.008716 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.plugins.ml2.db [req-9b9037de-5e2a-4e30-8888-d60dbed07da2 req-5fa242e7-e44b-443e-ac24-e56f8192f624 service neutron] For port a2ad1558-284e-4085-92ca-d32f3052846b, host hv-cinder-81901, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81901',level=0,port_id=a2ad1558-284e-4085-92ca-d32f3052846b,segment=NetworkSegment(a14a7aae-c481-4c86-92ee-f7808a54fd04),segment_id=a14a7aae-c481-4c86-92ee-f7808a54fd04)] {{(pid=102992) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 23 19:41:50.063923 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [req-9b9037de-5e2a-4e30-8888-d60dbed07da2 req-5fa242e7-e44b-443e-ac24-e56f8192f624 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7918660', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-15067', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560168', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8783631423946', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8783631008732', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8783631008750', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-25199748'] for port, after_update {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:41:50.099044 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9b9037de-5e2a-4e30-8888-d60dbed07da2 req-5fa242e7-e44b-443e-ac24-e56f8192f624 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102992) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:41:50.099940 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [req-9b9037de-5e2a-4e30-8888-d60dbed07da2 req-5fa242e7-e44b-443e-ac24-e56f8192f624 service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-514902'] for port, before_response {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:41:50.101341 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-9b9037de-5e2a-4e30-8888-d60dbed07da2 req-5fa242e7-e44b-443e-ac24-e56f8192f624 service neutron] 10.222.0.41 "PUT /v2.0/ports/a2ad1558-284e-4085-92ca-d32f3052846b HTTP/1.1" status: 200 len: 1093 time: 0.7085538 Nov 23 19:41:50.103634 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '063b0eee-501d-4da3-84b3-fa0731492f5f', 'tag': 'a2ad1558-284e-4085-92ca-d32f3052846b'}] {{(pid=102992) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 23 19:41:50.105900 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.62/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}f86c332b591ae691ababa4b64e0601cbf242a448242f95367ce03daabfb7e1ce" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-f5af5040-36be-4ed7-8cff-ac2b57c19e52" -d '{"events": [{"name": "network-changed", "server_uuid": "063b0eee-501d-4da3-84b3-fa0731492f5f", "tag": "a2ad1558-284e-4085-92ca-d32f3052846b"}]}' {{(pid=102992) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 23 19:41:50.131592 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5fa242e7-e44b-443e-ac24-e56f8192f624 service neutron] Pushing event updated for resources: {'Port': ['ID=a2ad1558-284e-4085-92ca-d32f3052846b,revision_number=3']} {{(pid=102992) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 23 19:41:50.144865 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Tue, 23 Nov 2021 19:41:50 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-025bf037-2b6e-4f29-b59a-5524d880aea1 x-openstack-request-id: req-025bf037-2b6e-4f29-b59a-5524d880aea1 {{(pid=102992) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 23 19:41:50.145166 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "063b0eee-501d-4da3-84b3-fa0731492f5f", "tag": "a2ad1558-284e-4085-92ca-d32f3052846b", "status": "completed", "code": 200}]} {{(pid=102992) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 23 19:41:50.145453 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.62/compute/v2.1/os-server-external-events used request id req-025bf037-2b6e-4f29-b59a-5524d880aea1 {{(pid=102992) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 23 19:41:50.145861 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '063b0eee-501d-4da3-84b3-fa0731492f5f', 'tag': 'a2ad1558-284e-4085-92ca-d32f3052846b', 'status': 'completed', 'code': 200} Nov 23 19:41:51.106913 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7a9be49a-a58f-441a-92b4-39a13a84e564 req-e3563fe1-e916-404e-a551-5b3aef7ebc0a tempest-AttachVolumeNegativeTest-754998453 tempest-AttachVolumeNegativeTest-754998453-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102992) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:41:51.108400 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-7a9be49a-a58f-441a-92b4-39a13a84e564 req-e3563fe1-e916-404e-a551-5b3aef7ebc0a tempest-AttachVolumeNegativeTest-754998453 tempest-AttachVolumeNegativeTest-754998453-project] 10.222.0.62 "GET /v2.0/ports?device_id=063b0eee-501d-4da3-84b3-fa0731492f5f HTTP/1.1" status: 200 len: 943 time: 0.0586100 Nov 23 19:41:51.155067 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-7a9be49a-a58f-441a-92b4-39a13a84e564 req-9b41b099-e36b-46f4-901d-217405c45247 tempest-AttachVolumeNegativeTest-754998453 tempest-AttachVolumeNegativeTest-754998453-project] 10.222.0.62 "GET /v2.0/security-groups?id=78a07d59-fd8e-4f94-9dfc-099d7d04efec&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0403259 Nov 23 19:41:52.005490 dv-cinder-819011-1-iscsi neutron-server[102995]: DEBUG neutron.db.agents_db [None req-84bdc9b2-57ea-4bdb-a245-07c78d37cea8 None None] Agent healthcheck: found 6 active agents {{(pid=102995) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 23 19:41:52.275265 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-910c2eab-7f4c-495f-b5eb-1e1b392be9b7 req-024d7310-6763-4d51-bcfe-550628005043 tempest-AttachVolumeNegativeTest-754998453 tempest-AttachVolumeNegativeTest-754998453-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102992) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:41:52.276650 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-910c2eab-7f4c-495f-b5eb-1e1b392be9b7 req-024d7310-6763-4d51-bcfe-550628005043 tempest-AttachVolumeNegativeTest-754998453 tempest-AttachVolumeNegativeTest-754998453-project] 10.222.0.62 "GET /v2.0/ports?device_id=063b0eee-501d-4da3-84b3-fa0731492f5f HTTP/1.1" status: 200 len: 943 time: 0.0532467 Nov 23 19:41:52.323743 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-910c2eab-7f4c-495f-b5eb-1e1b392be9b7 req-3b0b9ab2-08ac-41e0-bdc5-f756560fdef5 tempest-AttachVolumeNegativeTest-754998453 tempest-AttachVolumeNegativeTest-754998453-project] 10.222.0.62 "GET /v2.0/security-groups?id=78a07d59-fd8e-4f94-9dfc-099d7d04efec&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0407567 Nov 23 19:41:52.832792 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f5af5040-36be-4ed7-8cff-ac2b57c19e52 req-a2f590c0-a1f1-4e43-bb50-1cafea0f00b8 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102992) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:41:52.834322 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-f5af5040-36be-4ed7-8cff-ac2b57c19e52 req-a2f590c0-a1f1-4e43-bb50-1cafea0f00b8 service neutron] 10.222.0.41 "GET /v2.0/ports?tenant_id=e738acf03acd4f9d90b4dc46fb48bb06&device_id=063b0eee-501d-4da3-84b3-fa0731492f5f HTTP/1.1" status: 200 len: 1096 time: 0.0420828 Nov 23 19:41:52.935776 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f5af5040-36be-4ed7-8cff-ac2b57c19e52 req-78c0f549-0501-48df-8725-85e6c3298e02 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102992) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:41:52.937467 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-f5af5040-36be-4ed7-8cff-ac2b57c19e52 req-78c0f549-0501-48df-8725-85e6c3298e02 service neutron] 10.222.0.41 "GET /v2.0/networks?tenant_id=e738acf03acd4f9d90b4dc46fb48bb06&shared=False HTTP/1.1" status: 200 len: 916 time: 0.0933914 Nov 23 19:41:53.029699 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f5af5040-36be-4ed7-8cff-ac2b57c19e52 req-58d99328-1911-4887-bdc5-a391400e67dd service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102992) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:41:53.031895 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-f5af5040-36be-4ed7-8cff-ac2b57c19e52 req-58d99328-1911-4887-bdc5-a391400e67dd service neutron] 10.222.0.41 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 870 time: 0.0860591 Nov 23 19:41:53.110632 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9b9037de-5e2a-4e30-8888-d60dbed07da2 req-5c716f49-98e1-4806-989a-9ea544509b48 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102992) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:41:53.112260 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-9b9037de-5e2a-4e30-8888-d60dbed07da2 req-5c716f49-98e1-4806-989a-9ea544509b48 service neutron] 10.222.0.41 "GET /v2.0/ports?tenant_id=e738acf03acd4f9d90b4dc46fb48bb06&device_id=063b0eee-501d-4da3-84b3-fa0731492f5f HTTP/1.1" status: 200 len: 1096 time: 0.0419028 Nov 23 19:41:53.159122 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-9b9037de-5e2a-4e30-8888-d60dbed07da2 req-b347d375-51f7-4703-a042-8be6b47ac199 service neutron] 10.222.0.41 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.5&port_id=a2ad1558-284e-4085-92ca-d32f3052846b HTTP/1.1" status: 200 len: 217 time: 0.0385818 Nov 23 19:41:53.209876 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9b9037de-5e2a-4e30-8888-d60dbed07da2 req-67c92be2-b07d-4c07-833e-880a8f1b7bd8 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102992) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:41:53.211308 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-9b9037de-5e2a-4e30-8888-d60dbed07da2 req-67c92be2-b07d-4c07-833e-880a8f1b7bd8 service neutron] 10.222.0.41 "GET /v2.0/subnets?id=ffd14982-fec3-42b1-9d92-f2ed87a640f4 HTTP/1.1" status: 200 len: 855 time: 0.0441489 Nov 23 19:41:53.243599 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-9b9037de-5e2a-4e30-8888-d60dbed07da2 req-0c613fa1-b214-4e52-b96f-6f8cc14e033e service neutron] 10.222.0.41 "GET /v2.0/ports?network_id=5f438c34-aac6-400d-bc7e-2e0506f124a9&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0233505 Nov 23 19:41:53.340219 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-9b9037de-5e2a-4e30-8888-d60dbed07da2 req-2f823221-f56d-44bf-bd29-87c7c4cc7ebc service neutron] 10.222.0.41 "GET /v2.0/networks/5f438c34-aac6-400d-bc7e-2e0506f124a9?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0858417 Nov 23 19:41:53.463168 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-9b9037de-5e2a-4e30-8888-d60dbed07da2 req-3bd866ee-0801-4977-8d24-46b5a934080c service neutron] 10.222.0.41 "GET /v2.0/networks/5f438c34-aac6-400d-bc7e-2e0506f124a9?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1139085 Nov 23 19:41:53.475507 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8172ba59-f167-4dd2-9af8-8e271245dcf5 req-68830a6b-ddc2-41de-b342-44b6796c3f2e tempest-AttachVolumeNegativeTest-754998453 tempest-AttachVolumeNegativeTest-754998453-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102992) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:41:53.476981 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-8172ba59-f167-4dd2-9af8-8e271245dcf5 req-68830a6b-ddc2-41de-b342-44b6796c3f2e tempest-AttachVolumeNegativeTest-754998453 tempest-AttachVolumeNegativeTest-754998453-project] 10.222.0.62 "GET /v2.0/ports?device_id=063b0eee-501d-4da3-84b3-fa0731492f5f HTTP/1.1" status: 200 len: 943 time: 0.0740793 Nov 23 19:41:53.525550 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-8172ba59-f167-4dd2-9af8-8e271245dcf5 req-4941a6c4-1d6d-41e6-aeea-94e1f9f17aa7 tempest-AttachVolumeNegativeTest-754998453 tempest-AttachVolumeNegativeTest-754998453-project] 10.222.0.62 "GET /v2.0/security-groups?id=78a07d59-fd8e-4f94-9dfc-099d7d04efec&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0424936 Nov 23 19:41:54.645731 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4b3d938d-85f4-4440-9696-22cd644889f7 req-48595839-43dd-4114-bee7-ae702def346f tempest-AttachVolumeNegativeTest-754998453 tempest-AttachVolumeNegativeTest-754998453-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102992) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:41:54.647237 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-4b3d938d-85f4-4440-9696-22cd644889f7 req-48595839-43dd-4114-bee7-ae702def346f tempest-AttachVolumeNegativeTest-754998453 tempest-AttachVolumeNegativeTest-754998453-project] 10.222.0.62 "GET /v2.0/ports?device_id=063b0eee-501d-4da3-84b3-fa0731492f5f HTTP/1.1" status: 200 len: 943 time: 0.0498316 Nov 23 19:41:54.694319 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-4b3d938d-85f4-4440-9696-22cd644889f7 req-bbd1adbe-ffcb-488d-8bb2-50d5aa021b6f tempest-AttachVolumeNegativeTest-754998453 tempest-AttachVolumeNegativeTest-754998453-project] 10.222.0.62 "GET /v2.0/security-groups?id=78a07d59-fd8e-4f94-9dfc-099d7d04efec&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0412073 Nov 23 19:41:55.806472 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-185ae700-460f-4ece-9fa5-3f5d488d9a8f req-8c4dadb6-c976-4b3e-beb6-ae80a28c301b tempest-AttachVolumeNegativeTest-754998453 tempest-AttachVolumeNegativeTest-754998453-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102992) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:41:55.807918 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-185ae700-460f-4ece-9fa5-3f5d488d9a8f req-8c4dadb6-c976-4b3e-beb6-ae80a28c301b tempest-AttachVolumeNegativeTest-754998453 tempest-AttachVolumeNegativeTest-754998453-project] 10.222.0.62 "GET /v2.0/ports?device_id=063b0eee-501d-4da3-84b3-fa0731492f5f HTTP/1.1" status: 200 len: 943 time: 0.0473001 Nov 23 19:41:55.859127 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-185ae700-460f-4ece-9fa5-3f5d488d9a8f req-7ec03cf1-3cff-4c2b-84cc-0cbc3add8522 tempest-AttachVolumeNegativeTest-754998453 tempest-AttachVolumeNegativeTest-754998453-project] 10.222.0.62 "GET /v2.0/security-groups?id=78a07d59-fd8e-4f94-9dfc-099d7d04efec&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0440598 Nov 23 19:41:56.971694 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d16cc421-70ed-4a96-a993-8dc81c5837bb req-35cdde7e-d90a-42a6-b86b-01cf439ff58f tempest-AttachVolumeNegativeTest-754998453 tempest-AttachVolumeNegativeTest-754998453-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102992) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:41:56.973141 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-d16cc421-70ed-4a96-a993-8dc81c5837bb req-35cdde7e-d90a-42a6-b86b-01cf439ff58f tempest-AttachVolumeNegativeTest-754998453 tempest-AttachVolumeNegativeTest-754998453-project] 10.222.0.62 "GET /v2.0/ports?device_id=063b0eee-501d-4da3-84b3-fa0731492f5f HTTP/1.1" status: 200 len: 943 time: 0.0479622 Nov 23 19:41:57.019485 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-d16cc421-70ed-4a96-a993-8dc81c5837bb req-f7fd9fe1-e7ac-49ab-8139-e1eca78ff8c9 tempest-AttachVolumeNegativeTest-754998453 tempest-AttachVolumeNegativeTest-754998453-project] 10.222.0.62 "GET /v2.0/security-groups?id=78a07d59-fd8e-4f94-9dfc-099d7d04efec&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0404534 Nov 23 19:41:57.491028 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-6c723596-2e59-4f42-9f54-2ffaa881a079 req-a9b3eb27-8b93-45ed-a09e-bfae37d62a3f tempest-TestVolumeBootPattern-147141705 tempest-TestVolumeBootPattern-147141705-project] 10.222.0.62 "GET /v2.0/security-groups?name=tempest-secgroup-smoke-1973485717&fields=id&tenant_id=257b0b2e531441b4bb745e99cfd799f3 HTTP/1.1" status: 200 len: 267 time: 0.0434458 Nov 23 19:41:57.598337 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6c723596-2e59-4f42-9f54-2ffaa881a079 req-df1c5043-bb9f-403f-8431-faf84887da0b tempest-TestVolumeBootPattern-147141705 tempest-TestVolumeBootPattern-147141705-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=102992) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:41:57.599793 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-6c723596-2e59-4f42-9f54-2ffaa881a079 req-df1c5043-bb9f-403f-8431-faf84887da0b tempest-TestVolumeBootPattern-147141705 tempest-TestVolumeBootPattern-147141705-project] 10.222.0.62 "GET /v2.0/networks?id=226a519f-5f3e-4d80-bb8a-0e9fc4f64828 HTTP/1.1" status: 200 len: 810 time: 0.1021295 Nov 23 19:41:57.614842 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-6c723596-2e59-4f42-9f54-2ffaa881a079 req-8e8d9099-849c-43d1-ae27-fb884b278bb7 tempest-TestVolumeBootPattern-147141705 tempest-TestVolumeBootPattern-147141705-project] 10.222.0.62 "GET /v2.0/quotas/257b0b2e531441b4bb745e99cfd799f3 HTTP/1.1" status: 200 len: 375 time: 0.0094130 Nov 23 19:41:57.665790 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-6c723596-2e59-4f42-9f54-2ffaa881a079 req-3aec6f97-fecb-4e92-8348-c42a3d78c4bf tempest-TestVolumeBootPattern-147141705 tempest-TestVolumeBootPattern-147141705-project] 10.222.0.62 "GET /v2.0/ports?tenant_id=257b0b2e531441b4bb745e99cfd799f3&fields=id HTTP/1.1" status: 200 len: 348 time: 0.0456667 Nov 23 19:41:57.763529 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-6c723596-2e59-4f42-9f54-2ffaa881a079 req-1c4f412d-bea3-47dc-95e3-2848f5e8bdb0 service neutron] 10.222.0.62 "GET /v2.0/networks/226a519f-5f3e-4d80-bb8a-0e9fc4f64828?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0860777 Nov 23 19:41:57.798691 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.plugins.ml2.rpc [None req-4bf48ff4-ecfb-4168-8b63-249b8c6e9f04 None None] Device a2ad1558-284e-4085-92ca-d32f3052846b details requested by agent hyperv_hv-cinder-81901 with host hv-cinder-81901 {{(pid=102994) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Nov 23 19:41:57.852475 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-6c723596-2e59-4f42-9f54-2ffaa881a079 req-86e74cf1-ad02-4231-8797-cec994b21648 service neutron] 10.222.0.62 "GET /v2.0/networks/226a519f-5f3e-4d80-bb8a-0e9fc4f64828?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0824389 Nov 23 19:41:57.897104 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.plugins.ml2.db [None req-4bf48ff4-ecfb-4168-8b63-249b8c6e9f04 None None] For port a2ad1558-284e-4085-92ca-d32f3052846b, host hv-cinder-81901, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81901',level=0,port_id=a2ad1558-284e-4085-92ca-d32f3052846b,segment=NetworkSegment(a14a7aae-c481-4c86-92ee-f7808a54fd04),segment_id=a14a7aae-c481-4c86-92ee-f7808a54fd04)] {{(pid=102994) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 23 19:41:57.909046 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.plugins.ml2.rpc [None req-4bf48ff4-ecfb-4168-8b63-249b8c6e9f04 None None] Returning: {'device': 'a2ad1558-284e-4085-92ca-d32f3052846b', 'network_id': '5f438c34-aac6-400d-bc7e-2e0506f124a9', 'port_id': 'a2ad1558-284e-4085-92ca-d32f3052846b', 'mac_address': 'fa:16:3e:91:b2:8f', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 832, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'ffd14982-fec3-42b1-9d92-f2ed87a640f4', 'ip_address': '172.20.0.5'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=102994) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Nov 23 19:41:57.946078 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron_lib.callbacks.manager [None req-4bf48ff4-ecfb-4168-8b63-249b8c6e9f04 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7921281'] for port, before_update {{(pid=102994) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:41:57.959421 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.notifiers.nova [None req-4bf48ff4-ecfb-4168-8b63-249b8c6e9f04 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id a2ad1558-284e-4085-92ca-d32f3052846b {{(pid=102994) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 23 19:41:57.980405 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.plugins.ml2.db [None req-4bf48ff4-ecfb-4168-8b63-249b8c6e9f04 None None] For port a2ad1558-284e-4085-92ca-d32f3052846b, host hv-cinder-81901, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81901',level=0,port_id=a2ad1558-284e-4085-92ca-d32f3052846b,segment=NetworkSegment(a14a7aae-c481-4c86-92ee-f7808a54fd04),segment_id=a14a7aae-c481-4c86-92ee-f7808a54fd04)] {{(pid=102994) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 23 19:41:58.051513 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron_lib.callbacks.manager [None req-4bf48ff4-ecfb-4168-8b63-249b8c6e9f04 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7918660', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-15067', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560168', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8783631423946', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8783631008732', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8783631008750'] for port, after_update {{(pid=102994) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:41:58.104189 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4bf48ff4-ecfb-4168-8b63-249b8c6e9f04 None None] Pushing event updated for resources: {'Port': ['ID=a2ad1558-284e-4085-92ca-d32f3052846b,revision_number=4']} {{(pid=102994) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 23 19:41:58.112103 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4bf48ff4-ecfb-4168-8b63-249b8c6e9f04 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-819011-1-iscsi {{(pid=102994) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 23 19:41:58.112463 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4bf48ff4-ecfb-4168-8b63-249b8c6e9f04 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-819011-1-iscsi {{(pid=102994) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 23 19:41:58.112853 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4bf48ff4-ecfb-4168-8b63-249b8c6e9f04 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-819011-1-iscsi {{(pid=102994) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 23 19:41:58.113196 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4bf48ff4-ecfb-4168-8b63-249b8c6e9f04 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-819011-1-iscsi {{(pid=102994) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 23 19:41:58.113568 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4bf48ff4-ecfb-4168-8b63-249b8c6e9f04 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-819011-1-iscsi {{(pid=102994) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 23 19:41:58.113909 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4bf48ff4-ecfb-4168-8b63-249b8c6e9f04 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-819011-1-iscsi {{(pid=102994) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 23 19:41:58.114243 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4bf48ff4-ecfb-4168-8b63-249b8c6e9f04 None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-819011-1-iscsi {{(pid=102994) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 23 19:41:58.114575 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4bf48ff4-ecfb-4168-8b63-249b8c6e9f04 None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-819011-1-iscsi {{(pid=102994) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 23 19:41:58.114909 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4bf48ff4-ecfb-4168-8b63-249b8c6e9f04 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-819011-1-iscsi {{(pid=102994) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 23 19:41:58.115238 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4bf48ff4-ecfb-4168-8b63-249b8c6e9f04 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-819011-1-iscsi {{(pid=102994) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 23 19:41:58.115565 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4bf48ff4-ecfb-4168-8b63-249b8c6e9f04 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-819011-1-iscsi {{(pid=102994) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 23 19:41:58.115891 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4bf48ff4-ecfb-4168-8b63-249b8c6e9f04 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-819011-1-iscsi {{(pid=102994) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 23 19:41:58.139155 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-44cfeda7-06ac-4085-8b26-e7a8fa839531 req-1729d3af-768d-481e-ac02-8c5d88fcb1a6 tempest-AttachVolumeNegativeTest-754998453 tempest-AttachVolumeNegativeTest-754998453-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102993) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:41:58.140640 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-44cfeda7-06ac-4085-8b26-e7a8fa839531 req-1729d3af-768d-481e-ac02-8c5d88fcb1a6 tempest-AttachVolumeNegativeTest-754998453 tempest-AttachVolumeNegativeTest-754998453-project] 10.222.0.62 "GET /v2.0/ports?device_id=063b0eee-501d-4da3-84b3-fa0731492f5f HTTP/1.1" status: 200 len: 944 time: 0.0497296 Nov 23 19:41:58.189247 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-44cfeda7-06ac-4085-8b26-e7a8fa839531 req-75e99fea-c6ba-482b-9d37-a35b60f9256e tempest-AttachVolumeNegativeTest-754998453 tempest-AttachVolumeNegativeTest-754998453-project] 10.222.0.62 "GET /v2.0/security-groups?id=78a07d59-fd8e-4f94-9dfc-099d7d04efec&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0423272 Nov 23 19:41:58.354084 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.plugins.ml2.db [None req-4bf48ff4-ecfb-4168-8b63-249b8c6e9f04 None None] get_ports_and_sgs() called for port_ids ['a2ad1558-284e-4085-92ca-d32f3052846b'] {{(pid=102994) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 23 19:41:58.386066 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-5ef8e85f-eb19-41ff-9282-8adb858a75fb req-188b6f39-650f-45c6-95bd-bf49ab8ad7d3 tempest-TestVolumeBootPattern-147141705 tempest-TestVolumeBootPattern-147141705-project] 10.222.0.62 "GET /v2.0/ports?device_id=f48d7898-d8c9-4cfb-b340-c3a0d0009b87 HTTP/1.1" status: 200 len: 210 time: 0.0281405 Nov 23 19:41:59.305124 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dd677f73-91d8-4043-84a0-12bcce9e4611 req-9c5637eb-83d6-4bf8-8574-c9beda5b2d6b tempest-AttachVolumeNegativeTest-754998453 tempest-AttachVolumeNegativeTest-754998453-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102992) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:41:59.306631 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-dd677f73-91d8-4043-84a0-12bcce9e4611 req-9c5637eb-83d6-4bf8-8574-c9beda5b2d6b tempest-AttachVolumeNegativeTest-754998453 tempest-AttachVolumeNegativeTest-754998453-project] 10.222.0.62 "GET /v2.0/ports?device_id=063b0eee-501d-4da3-84b3-fa0731492f5f HTTP/1.1" status: 200 len: 944 time: 0.0495605 Nov 23 19:41:59.361944 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-dd677f73-91d8-4043-84a0-12bcce9e4611 req-7d32fc80-3f24-4a89-a73b-69c5402e961d tempest-AttachVolumeNegativeTest-754998453 tempest-AttachVolumeNegativeTest-754998453-project] 10.222.0.62 "GET /v2.0/security-groups?id=78a07d59-fd8e-4f94-9dfc-099d7d04efec&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0476553 Nov 23 19:41:59.483609 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-50a16edf-2de9-41dc-af17-b78f8173999b req-c9e91760-6fba-48e0-a913-698c842ab337 tempest-TestVolumeBootPattern-147141705 tempest-TestVolumeBootPattern-147141705-project] 10.222.0.62 "GET /v2.0/ports?device_id=f48d7898-d8c9-4cfb-b340-c3a0d0009b87 HTTP/1.1" status: 200 len: 210 time: 0.0258956 Nov 23 19:41:59.782752 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron_lib.callbacks.manager [None req-4bf48ff4-ecfb-4168-8b63-249b8c6e9f04 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8783631323329', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7978582'] for agent, after_update {{(pid=102994) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:41:59.814638 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.plugins.ml2.rpc [None req-4bf48ff4-ecfb-4168-8b63-249b8c6e9f04 None None] Device a2ad1558-284e-4085-92ca-d32f3052846b up at agent hyperv_hv-cinder-81901 {{(pid=102994) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 23 19:41:59.908007 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.db.provisioning_blocks [None req-4bf48ff4-ecfb-4168-8b63-249b8c6e9f04 None None] Provisioning for port a2ad1558-284e-4085-92ca-d32f3052846b completed by entity L2. {{(pid=102994) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 23 19:41:59.912468 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.db.provisioning_blocks [None req-4bf48ff4-ecfb-4168-8b63-249b8c6e9f04 None None] Provisioning complete for port a2ad1558-284e-4085-92ca-d32f3052846b triggered by entity L2. {{(pid=102994) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 23 19:41:59.912848 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron_lib.callbacks.manager [None req-4bf48ff4-ecfb-4168-8b63-249b8c6e9f04 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-8355713'] for port, provisioning_complete {{(pid=102994) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:41:59.988499 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron_lib.callbacks.manager [None req-4bf48ff4-ecfb-4168-8b63-249b8c6e9f04 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7921281'] for port, before_update {{(pid=102994) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:42:00.011391 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '063b0eee-501d-4da3-84b3-fa0731492f5f', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'a2ad1558-284e-4085-92ca-d32f3052846b'}] {{(pid=102994) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 23 19:42:00.013650 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.62/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}09a7511da0d2ba1d728b27e36a8467ec5289399952f0059588048a7cb66d3a43" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-0b1821b0-2533-432a-abd8-1bdbed6097b0" -d '{"events": [{"server_uuid": "063b0eee-501d-4da3-84b3-fa0731492f5f", "name": "network-vif-plugged", "status": "completed", "tag": "a2ad1558-284e-4085-92ca-d32f3052846b"}]}' {{(pid=102994) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 23 19:42:00.026586 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.plugins.ml2.db [None req-4bf48ff4-ecfb-4168-8b63-249b8c6e9f04 None None] For port a2ad1558-284e-4085-92ca-d32f3052846b, host hv-cinder-81901, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81901',level=0,port_id=a2ad1558-284e-4085-92ca-d32f3052846b,segment=NetworkSegment(a14a7aae-c481-4c86-92ee-f7808a54fd04),segment_id=a14a7aae-c481-4c86-92ee-f7808a54fd04)] {{(pid=102994) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 23 19:42:00.052230 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 23 Nov 2021 19:42:00 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-974a8739-bb41-4f73-aefa-7de7d860da9e x-openstack-request-id: req-974a8739-bb41-4f73-aefa-7de7d860da9e {{(pid=102994) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 23 19:42:00.052528 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "063b0eee-501d-4da3-84b3-fa0731492f5f", "name": "network-vif-plugged", "status": "completed", "tag": "a2ad1558-284e-4085-92ca-d32f3052846b", "code": 200}]} {{(pid=102994) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 23 19:42:00.052789 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.62/compute/v2.1/os-server-external-events used request id req-974a8739-bb41-4f73-aefa-7de7d860da9e {{(pid=102994) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 23 19:42:00.053186 dv-cinder-819011-1-iscsi neutron-server[102994]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '063b0eee-501d-4da3-84b3-fa0731492f5f', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'a2ad1558-284e-4085-92ca-d32f3052846b', 'code': 200} Nov 23 19:42:00.079851 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron_lib.callbacks.manager [None req-4bf48ff4-ecfb-4168-8b63-249b8c6e9f04 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7918660', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-15067', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560168', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8783631423946', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8783631008732', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8783631008750'] for port, after_update {{(pid=102994) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:42:00.132180 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4bf48ff4-ecfb-4168-8b63-249b8c6e9f04 None None] Pushing event updated for resources: {'Port': ['ID=a2ad1558-284e-4085-92ca-d32f3052846b,revision_number=5']} {{(pid=102994) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 23 19:42:00.274281 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6c723596-2e59-4f42-9f54-2ffaa881a079 req-ccbcddc3-c6d1-4d45-818f-4d3f174ab1b9 tempest-TestVolumeBootPattern-147141705 tempest-TestVolumeBootPattern-147141705-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=102992) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:42:00.275860 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-6c723596-2e59-4f42-9f54-2ffaa881a079 req-ccbcddc3-c6d1-4d45-818f-4d3f174ab1b9 tempest-TestVolumeBootPattern-147141705 tempest-TestVolumeBootPattern-147141705-project] 10.222.0.41 "GET /v2.0/networks?id=226a519f-5f3e-4d80-bb8a-0e9fc4f64828 HTTP/1.1" status: 200 len: 810 time: 0.1027889 Nov 23 19:42:00.352001 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-6c723596-2e59-4f42-9f54-2ffaa881a079 req-cc318585-da6e-4f9e-b8cf-023709456b7b tempest-TestVolumeBootPattern-147141705 tempest-TestVolumeBootPattern-147141705-project] 10.222.0.41 "GET /v2.0/security-groups?fields=id&fields=name&tenant_id=257b0b2e531441b4bb745e99cfd799f3 HTTP/1.1" status: 200 len: 380 time: 0.0612457 Nov 23 19:42:00.361932 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.api.v2.base [req-6c723596-2e59-4f42-9f54-2ffaa881a079 req-34d457e0-977b-46ae-ab33-d93506a18427 tempest-TestVolumeBootPattern-147141705 tempest-TestVolumeBootPattern-147141705-project] Request body: {'port': {'device_id': 'f48d7898-d8c9-4cfb-b340-c3a0d0009b87', 'network_id': '226a519f-5f3e-4d80-bb8a-0e9fc4f64828', 'admin_state_up': True, 'tenant_id': '257b0b2e531441b4bb745e99cfd799f3', 'security_groups': ['a6e2b133-1a9b-4dde-a188-1ce8bcdb7b5c']}} {{(pid=102992) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 23 19:42:00.391051 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d435488f-0494-4cfe-bf1b-35822230e3c6 req-f5118d76-1ef4-4db1-afa3-2c3bf51a4f6e service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102993) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:42:00.392582 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-d435488f-0494-4cfe-bf1b-35822230e3c6 req-f5118d76-1ef4-4db1-afa3-2c3bf51a4f6e service neutron] 10.222.0.41 "GET /v2.0/ports?device_id=063b0eee-501d-4da3-84b3-fa0731492f5f HTTP/1.1" status: 200 len: 1098 time: 0.0439105 Nov 23 19:42:00.459554 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-d435488f-0494-4cfe-bf1b-35822230e3c6 req-b2a60e0b-577c-4d9c-ba6c-f36b0f27e316 service neutron] 10.222.0.41 "GET /v2.0/security-groups?id=78a07d59-fd8e-4f94-9dfc-099d7d04efec&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0580244 Nov 23 19:42:00.517206 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-09935a04-f049-42b3-8f06-6b3d1f2b8f24 req-063978a7-36c6-4807-8b8a-e207404ea2c1 tempest-AttachVolumeNegativeTest-754998453 tempest-AttachVolumeNegativeTest-754998453-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102992) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:42:00.518699 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-09935a04-f049-42b3-8f06-6b3d1f2b8f24 req-063978a7-36c6-4807-8b8a-e207404ea2c1 tempest-AttachVolumeNegativeTest-754998453 tempest-AttachVolumeNegativeTest-754998453-project] 10.222.0.62 "GET /v2.0/ports?device_id=063b0eee-501d-4da3-84b3-fa0731492f5f HTTP/1.1" status: 200 len: 945 time: 0.0784936 Nov 23 19:42:00.571829 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-09935a04-f049-42b3-8f06-6b3d1f2b8f24 req-1ba052fd-aee2-4abd-94e0-e8aa3dbeaf8f tempest-AttachVolumeNegativeTest-754998453 tempest-AttachVolumeNegativeTest-754998453-project] 10.222.0.62 "GET /v2.0/security-groups?id=78a07d59-fd8e-4f94-9dfc-099d7d04efec&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0455322 Nov 23 19:42:00.622904 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-6c723596-2e59-4f42-9f54-2ffaa881a079 req-34d457e0-977b-46ae-ab33-d93506a18427 tempest-TestVolumeBootPattern-147141705 tempest-TestVolumeBootPattern-147141705-project] Made reservation on behalf of 257b0b2e531441b4bb745e99cfd799f3 for: {'port': 1} {{(pid=102992) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 23 19:42:00.626423 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [req-6c723596-2e59-4f42-9f54-2ffaa881a079 req-34d457e0-977b-46ae-ab33-d93506a18427 tempest-TestVolumeBootPattern-147141705 tempest-TestVolumeBootPattern-147141705-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7921281'] for port, before_create {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:42:00.661692 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-92dbcbac-aad6-4128-996f-802e232a6648 req-ed44d4e5-35d6-4417-bce9-d0f8c2156cbf tempest-TestVolumeBootPattern-147141705 tempest-TestVolumeBootPattern-147141705-project] 10.222.0.62 "GET /v2.0/ports?device_id=f48d7898-d8c9-4cfb-b340-c3a0d0009b87 HTTP/1.1" status: 200 len: 210 time: 0.0318828 Nov 23 19:42:00.780819 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.db.db_base_plugin_common [req-6c723596-2e59-4f42-9f54-2ffaa881a079 req-34d457e0-977b-46ae-ab33-d93506a18427 tempest-TestVolumeBootPattern-147141705 tempest-TestVolumeBootPattern-147141705-project] Allocated IP 172.20.0.6 (226a519f-5f3e-4d80-bb8a-0e9fc4f64828/88de785d-c540-4651-af1e-26f27ccaee3c/7bdc59b0-f473-4d83-9bf7-b5700274a507) {{(pid=102992) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 23 19:42:00.915211 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [req-6c723596-2e59-4f42-9f54-2ffaa881a079 req-34d457e0-977b-46ae-ab33-d93506a18427 tempest-TestVolumeBootPattern-147141705 tempest-TestVolumeBootPattern-147141705-project] Publish callbacks [] for port, precommit_create {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:42:00.994515 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [req-6c723596-2e59-4f42-9f54-2ffaa881a079 req-34d457e0-977b-46ae-ab33-d93506a18427 tempest-TestVolumeBootPattern-147141705 tempest-TestVolumeBootPattern-147141705-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7918660', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-15067', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560168', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8783631008714', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-25199805'] for port, after_create {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:42:01.041692 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-6c723596-2e59-4f42-9f54-2ffaa881a079 req-34d457e0-977b-46ae-ab33-d93506a18427 tempest-TestVolumeBootPattern-147141705 tempest-TestVolumeBootPattern-147141705-project] Network 226a519f-5f3e-4d80-bb8a-0e9fc4f64828 is already hosted by enough agents. {{(pid=102992) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 23 19:42:01.044561 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.scheduler.base_scheduler [req-6c723596-2e59-4f42-9f54-2ffaa881a079 req-34d457e0-977b-46ae-ab33-d93506a18427 tempest-TestVolumeBootPattern-147141705 tempest-TestVolumeBootPattern-147141705-project] Resources bound (agent type, host, resource id): {{(pid=102992) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 23 19:42:01.048088 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.db.l3_dvrscheduler_db [req-6c723596-2e59-4f42-9f54-2ffaa881a079 req-34d457e0-977b-46ae-ab33-d93506a18427 tempest-TestVolumeBootPattern-147141705 tempest-TestVolumeBootPattern-147141705-project] Received port after_create {{(pid=102992) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 23 19:42:01.054555 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-34d457e0-977b-46ae-ab33-d93506a18427 tempest-TestVolumeBootPattern-147141705 tempest-TestVolumeBootPattern-147141705-project] Pushing event updated for resources: {'Port': ['ID=7bdc59b0-f473-4d83-9bf7-b5700274a507,revision_number=1']} {{(pid=102992) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 23 19:42:01.103272 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6c723596-2e59-4f42-9f54-2ffaa881a079 req-34d457e0-977b-46ae-ab33-d93506a18427 tempest-TestVolumeBootPattern-147141705 tempest-TestVolumeBootPattern-147141705-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=102992) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:42:01.103899 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [req-6c723596-2e59-4f42-9f54-2ffaa881a079 req-34d457e0-977b-46ae-ab33-d93506a18427 tempest-TestVolumeBootPattern-147141705 tempest-TestVolumeBootPattern-147141705-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-514902'] for port, before_response {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:42:01.192135 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-6c723596-2e59-4f42-9f54-2ffaa881a079 req-34d457e0-977b-46ae-ab33-d93506a18427 tempest-TestVolumeBootPattern-147141705 tempest-TestVolumeBootPattern-147141705-project] 10.222.0.41 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 0.8340058 Nov 23 19:42:01.207659 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.api.v2.base [req-6c723596-2e59-4f42-9f54-2ffaa881a079 req-ad9fd7a3-2193-4212-9d39-8fcff0fbf100 service neutron] Request body: {'port': {'device_id': 'f48d7898-d8c9-4cfb-b340-c3a0d0009b87', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-81901'}} {{(pid=102992) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 23 19:42:01.259576 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [req-6c723596-2e59-4f42-9f54-2ffaa881a079 req-ad9fd7a3-2193-4212-9d39-8fcff0fbf100 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7921281'] for port, before_update {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:42:01.287304 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.db.provisioning_blocks [None req-1ea35f26-29d5-4e6e-92ab-08f299e889fc None None] Provisioning complete for port 7bdc59b0-f473-4d83-9bf7-b5700274a507 triggered by entity DHCP. {{(pid=102994) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 23 19:42:01.287893 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron_lib.callbacks.manager [None req-1ea35f26-29d5-4e6e-92ab-08f299e889fc None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-8355713'] for port, provisioning_complete {{(pid=102994) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:42:01.323360 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.plugins.ml2.plugin [None req-1ea35f26-29d5-4e6e-92ab-08f299e889fc None None] Port 7bdc59b0-f473-4d83-9bf7-b5700274a507 cannot update to ACTIVE because it is not bound. {{(pid=102994) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 23 19:42:01.793476 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-aecb7bf3-e734-463e-ac8b-fe4bb4db2be9 req-5db1c9a6-e5a5-4a45-a0b4-43b4165dc14f tempest-TestVolumeBootPattern-147141705 tempest-TestVolumeBootPattern-147141705-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102993) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:42:01.795620 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-aecb7bf3-e734-463e-ac8b-fe4bb4db2be9 req-5db1c9a6-e5a5-4a45-a0b4-43b4165dc14f tempest-TestVolumeBootPattern-147141705 tempest-TestVolumeBootPattern-147141705-project] 10.222.0.62 "GET /v2.0/ports?device_id=f48d7898-d8c9-4cfb-b340-c3a0d0009b87 HTTP/1.1" status: 200 len: 931 time: 0.0544040 Nov 23 19:42:01.840595 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8bc649a9-3c65-4f68-bff0-96eee502041a req-02854fab-ddac-461a-a454-c3f734df7264 tempest-AttachVolumeNegativeTest-754998453 tempest-AttachVolumeNegativeTest-754998453-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102992) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:42:01.842138 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-8bc649a9-3c65-4f68-bff0-96eee502041a req-02854fab-ddac-461a-a454-c3f734df7264 tempest-AttachVolumeNegativeTest-754998453 tempest-AttachVolumeNegativeTest-754998453-project] 10.222.0.62 "GET /v2.0/ports?device_id=063b0eee-501d-4da3-84b3-fa0731492f5f HTTP/1.1" status: 200 len: 945 time: 0.0926020 Nov 23 19:42:01.848452 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.notifiers.nova [req-6c723596-2e59-4f42-9f54-2ffaa881a079 req-ad9fd7a3-2193-4212-9d39-8fcff0fbf100 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 7bdc59b0-f473-4d83-9bf7-b5700274a507 {{(pid=102992) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 23 19:42:01.857798 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-aecb7bf3-e734-463e-ac8b-fe4bb4db2be9 req-8bd0b571-239f-4272-b7ab-f9f5601a90f6 tempest-TestVolumeBootPattern-147141705 tempest-TestVolumeBootPattern-147141705-project] 10.222.0.62 "GET /v2.0/security-groups?id=a6e2b133-1a9b-4dde-a188-1ce8bcdb7b5c&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0481045 Nov 23 19:42:01.862390 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [req-6c723596-2e59-4f42-9f54-2ffaa881a079 req-ad9fd7a3-2193-4212-9d39-8fcff0fbf100 service neutron] Publish callbacks [] for port, precommit_update {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:42:01.887909 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.db.provisioning_blocks [req-6c723596-2e59-4f42-9f54-2ffaa881a079 req-ad9fd7a3-2193-4212-9d39-8fcff0fbf100 service neutron] Transition to ACTIVE for port object 7bdc59b0-f473-4d83-9bf7-b5700274a507 will not be triggered until provisioned by entity L2. {{(pid=102992) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 23 19:42:01.914175 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-8bc649a9-3c65-4f68-bff0-96eee502041a req-5cc643de-5e48-44ed-a7e6-bd4f7b63d89a tempest-AttachVolumeNegativeTest-754998453 tempest-AttachVolumeNegativeTest-754998453-project] 10.222.0.62 "GET /v2.0/security-groups?id=78a07d59-fd8e-4f94-9dfc-099d7d04efec&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0607870 Nov 23 19:42:01.971323 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [req-6c723596-2e59-4f42-9f54-2ffaa881a079 req-ad9fd7a3-2193-4212-9d39-8fcff0fbf100 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7918660', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-15067', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560168', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8783631423946', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8783631008732', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8783631008750', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-25199748'] for port, after_update {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:42:02.039532 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ad9fd7a3-2193-4212-9d39-8fcff0fbf100 service neutron] Pushing event updated for resources: {'Port': ['ID=7bdc59b0-f473-4d83-9bf7-b5700274a507,revision_number=2']} {{(pid=102992) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 23 19:42:02.110994 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.plugins.ml2.managers [req-6c723596-2e59-4f42-9f54-2ffaa881a079 req-ad9fd7a3-2193-4212-9d39-8fcff0fbf100 service neutron] Attempting to bind port 7bdc59b0-f473-4d83-9bf7-b5700274a507 on host hv-cinder-81901 for vnic_type normal with profile {{(pid=102992) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 23 19:42:02.111377 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.plugins.ml2.managers [req-6c723596-2e59-4f42-9f54-2ffaa881a079 req-ad9fd7a3-2193-4212-9d39-8fcff0fbf100 service neutron] Attempting to bind port 7bdc59b0-f473-4d83-9bf7-b5700274a507 by drivers openvswitch,hyperv on host hv-cinder-81901 at level 0 using segments [{'id': '56316385-5b81-43f5-84db-b708b46f04eb', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 800, 'network_id': '226a519f-5f3e-4d80-bb8a-0e9fc4f64828'}] {{(pid=102992) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 23 19:42:02.111851 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-6c723596-2e59-4f42-9f54-2ffaa881a079 req-ad9fd7a3-2193-4212-9d39-8fcff0fbf100 service neutron] Attempting to bind port 7bdc59b0-f473-4d83-9bf7-b5700274a507 on network 226a519f-5f3e-4d80-bb8a-0e9fc4f64828 {{(pid=102992) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 23 19:42:02.117229 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-6c723596-2e59-4f42-9f54-2ffaa881a079 req-ad9fd7a3-2193-4212-9d39-8fcff0fbf100 service neutron] Port 7bdc59b0-f473-4d83-9bf7-b5700274a507 on network 226a519f-5f3e-4d80-bb8a-0e9fc4f64828 not bound, no agent of type Open vSwitch agent registered on host hv-cinder-81901 {{(pid=102992) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Nov 23 19:42:02.117597 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-6c723596-2e59-4f42-9f54-2ffaa881a079 req-ad9fd7a3-2193-4212-9d39-8fcff0fbf100 service neutron] Attempting to bind port 7bdc59b0-f473-4d83-9bf7-b5700274a507 on network 226a519f-5f3e-4d80-bb8a-0e9fc4f64828 {{(pid=102992) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 23 19:42:02.122782 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-6c723596-2e59-4f42-9f54-2ffaa881a079 req-ad9fd7a3-2193-4212-9d39-8fcff0fbf100 service neutron] Checking agent: {'id': '14e5d049-431d-466a-8d1c-264e5129d376', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-81901', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 23, 19, 31, 29), 'started_at': datetime.datetime(2021, 11, 23, 19, 31, 29), 'heartbeat_timestamp': datetime.datetime(2021, 11, 23, 19, 42), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=102992) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 23 19:42:02.123127 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-6c723596-2e59-4f42-9f54-2ffaa881a079 req-ad9fd7a3-2193-4212-9d39-8fcff0fbf100 service neutron] Checking segment: {'id': '56316385-5b81-43f5-84db-b708b46f04eb', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 800, 'network_id': '226a519f-5f3e-4d80-bb8a-0e9fc4f64828'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102992) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 23 19:42:02.123516 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-6c723596-2e59-4f42-9f54-2ffaa881a079 req-ad9fd7a3-2193-4212-9d39-8fcff0fbf100 service neutron] Bound using segment: {'id': '56316385-5b81-43f5-84db-b708b46f04eb', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 800, 'network_id': '226a519f-5f3e-4d80-bb8a-0e9fc4f64828'} {{(pid=102992) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 23 19:42:02.123944 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.plugins.ml2.managers [req-6c723596-2e59-4f42-9f54-2ffaa881a079 req-ad9fd7a3-2193-4212-9d39-8fcff0fbf100 service neutron] Bound port: 7bdc59b0-f473-4d83-9bf7-b5700274a507, host: hv-cinder-81901, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '56316385-5b81-43f5-84db-b708b46f04eb', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 800, 'network_id': '226a519f-5f3e-4d80-bb8a-0e9fc4f64828'}}] {{(pid=102992) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 23 19:42:02.124309 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [req-6c723596-2e59-4f42-9f54-2ffaa881a079 req-ad9fd7a3-2193-4212-9d39-8fcff0fbf100 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7921281'] for port, before_update {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:42:02.193998 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.plugins.ml2.db [req-6c723596-2e59-4f42-9f54-2ffaa881a079 req-ad9fd7a3-2193-4212-9d39-8fcff0fbf100 service neutron] For port 7bdc59b0-f473-4d83-9bf7-b5700274a507, host hv-cinder-81901, cleared binding levels {{(pid=102992) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 23 19:42:02.196937 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.plugins.ml2.db [req-6c723596-2e59-4f42-9f54-2ffaa881a079 req-ad9fd7a3-2193-4212-9d39-8fcff0fbf100 service neutron] For port 7bdc59b0-f473-4d83-9bf7-b5700274a507, host hv-cinder-81901, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81901',level=0,port_id=7bdc59b0-f473-4d83-9bf7-b5700274a507,segment=NetworkSegment(56316385-5b81-43f5-84db-b708b46f04eb),segment_id=56316385-5b81-43f5-84db-b708b46f04eb)] {{(pid=102992) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 23 19:42:02.263198 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [req-6c723596-2e59-4f42-9f54-2ffaa881a079 req-ad9fd7a3-2193-4212-9d39-8fcff0fbf100 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7918660', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-15067', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560168', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8783631423946', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8783631008732', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8783631008750', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-25199748'] for port, after_update {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:42:02.297295 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6c723596-2e59-4f42-9f54-2ffaa881a079 req-ad9fd7a3-2193-4212-9d39-8fcff0fbf100 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102992) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:42:02.297897 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [req-6c723596-2e59-4f42-9f54-2ffaa881a079 req-ad9fd7a3-2193-4212-9d39-8fcff0fbf100 service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-514902'] for port, before_response {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:42:02.299281 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-6c723596-2e59-4f42-9f54-2ffaa881a079 req-ad9fd7a3-2193-4212-9d39-8fcff0fbf100 service neutron] 10.222.0.41 "PUT /v2.0/ports/7bdc59b0-f473-4d83-9bf7-b5700274a507 HTTP/1.1" status: 200 len: 1093 time: 1.0969207 Nov 23 19:42:02.299719 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'f48d7898-d8c9-4cfb-b340-c3a0d0009b87', 'tag': '7bdc59b0-f473-4d83-9bf7-b5700274a507'}] {{(pid=102992) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 23 19:42:02.306115 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.62/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}f86c332b591ae691ababa4b64e0601cbf242a448242f95367ce03daabfb7e1ce" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-519504b8-f7bf-4cfb-93ea-cd88b374fab4" -d '{"events": [{"name": "network-changed", "server_uuid": "f48d7898-d8c9-4cfb-b340-c3a0d0009b87", "tag": "7bdc59b0-f473-4d83-9bf7-b5700274a507"}]}' {{(pid=102992) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 23 19:42:02.330663 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ad9fd7a3-2193-4212-9d39-8fcff0fbf100 service neutron] Pushing event updated for resources: {'Port': ['ID=7bdc59b0-f473-4d83-9bf7-b5700274a507,revision_number=3']} {{(pid=102992) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 23 19:42:02.353126 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Tue, 23 Nov 2021 19:42:02 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-b4dd1ab9-c09c-4b9f-801d-323bdc01915c x-openstack-request-id: req-b4dd1ab9-c09c-4b9f-801d-323bdc01915c {{(pid=102992) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 23 19:42:02.353540 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "f48d7898-d8c9-4cfb-b340-c3a0d0009b87", "tag": "7bdc59b0-f473-4d83-9bf7-b5700274a507", "status": "completed", "code": 200}]} {{(pid=102992) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 23 19:42:02.357168 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.62/compute/v2.1/os-server-external-events used request id req-b4dd1ab9-c09c-4b9f-801d-323bdc01915c {{(pid=102992) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 23 19:42:02.357168 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'f48d7898-d8c9-4cfb-b340-c3a0d0009b87', 'tag': '7bdc59b0-f473-4d83-9bf7-b5700274a507', 'status': 'completed', 'code': 200} Nov 23 19:42:02.421708 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-519504b8-f7bf-4cfb-93ea-cd88b374fab4 req-61b99c62-13dc-442d-ab8b-b4cdc75ecad3 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102992) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:42:02.423219 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-519504b8-f7bf-4cfb-93ea-cd88b374fab4 req-61b99c62-13dc-442d-ab8b-b4cdc75ecad3 service neutron] 10.222.0.41 "GET /v2.0/ports?tenant_id=257b0b2e531441b4bb745e99cfd799f3&device_id=f48d7898-d8c9-4cfb-b340-c3a0d0009b87 HTTP/1.1" status: 200 len: 1096 time: 0.0432057 Nov 23 19:42:02.529037 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-519504b8-f7bf-4cfb-93ea-cd88b374fab4 req-5e3cbafe-6642-4a79-adf5-6414bfac293e service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102992) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:42:02.530525 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-519504b8-f7bf-4cfb-93ea-cd88b374fab4 req-5e3cbafe-6642-4a79-adf5-6414bfac293e service neutron] 10.222.0.41 "GET /v2.0/networks?tenant_id=257b0b2e531441b4bb745e99cfd799f3&shared=False HTTP/1.1" status: 200 len: 911 time: 0.0972652 Nov 23 19:42:02.629083 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-519504b8-f7bf-4cfb-93ea-cd88b374fab4 req-24969fcb-e440-4cfb-ab5c-ab3c2186f793 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102992) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:42:02.630594 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-519504b8-f7bf-4cfb-93ea-cd88b374fab4 req-24969fcb-e440-4cfb-ab5c-ab3c2186f793 service neutron] 10.222.0.41 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 870 time: 0.0912271 Nov 23 19:42:02.715627 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6c723596-2e59-4f42-9f54-2ffaa881a079 req-b0f7e668-eab2-4982-9d8c-e92cf2cc9226 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102992) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:42:02.717100 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-6c723596-2e59-4f42-9f54-2ffaa881a079 req-b0f7e668-eab2-4982-9d8c-e92cf2cc9226 service neutron] 10.222.0.41 "GET /v2.0/ports?tenant_id=257b0b2e531441b4bb745e99cfd799f3&device_id=f48d7898-d8c9-4cfb-b340-c3a0d0009b87 HTTP/1.1" status: 200 len: 1096 time: 0.0409374 Nov 23 19:42:02.767123 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-6c723596-2e59-4f42-9f54-2ffaa881a079 req-62cb1bce-0e78-4be0-a7fe-27e5f8a5caf3 service neutron] 10.222.0.41 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.6&port_id=7bdc59b0-f473-4d83-9bf7-b5700274a507 HTTP/1.1" status: 200 len: 217 time: 0.0371547 Nov 23 19:42:02.819492 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6c723596-2e59-4f42-9f54-2ffaa881a079 req-953a0132-d31d-4e4a-8944-d2483bd9a1da service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102992) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:42:02.820949 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-6c723596-2e59-4f42-9f54-2ffaa881a079 req-953a0132-d31d-4e4a-8944-d2483bd9a1da service neutron] 10.222.0.41 "GET /v2.0/subnets?id=88de785d-c540-4651-af1e-26f27ccaee3c HTTP/1.1" status: 200 len: 849 time: 0.0448120 Nov 23 19:42:02.868131 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6c723596-2e59-4f42-9f54-2ffaa881a079 req-00179fd6-2725-463a-a50a-9f5950d72fbf service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102992) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:42:02.869518 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-6c723596-2e59-4f42-9f54-2ffaa881a079 req-00179fd6-2725-463a-a50a-9f5950d72fbf service neutron] 10.222.0.41 "GET /v2.0/ports?network_id=226a519f-5f3e-4d80-bb8a-0e9fc4f64828&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0394633 Nov 23 19:42:02.967932 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-6c723596-2e59-4f42-9f54-2ffaa881a079 req-57c37fa4-7bc6-43c7-aa41-737174a5f7de service neutron] 10.222.0.41 "GET /v2.0/networks/226a519f-5f3e-4d80-bb8a-0e9fc4f64828?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0890727 Nov 23 19:42:02.979397 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8bcaa4af-da8a-460f-a23a-c9cfc2aea4e9 req-b448c01d-3063-494e-b974-104519ea35e5 tempest-TestVolumeBootPattern-147141705 tempest-TestVolumeBootPattern-147141705-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102993) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:42:02.980891 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-8bcaa4af-da8a-460f-a23a-c9cfc2aea4e9 req-b448c01d-3063-494e-b974-104519ea35e5 tempest-TestVolumeBootPattern-147141705 tempest-TestVolumeBootPattern-147141705-project] 10.222.0.62 "GET /v2.0/ports?device_id=f48d7898-d8c9-4cfb-b340-c3a0d0009b87 HTTP/1.1" status: 200 len: 943 time: 0.0521848 Nov 23 19:42:03.029795 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-8bcaa4af-da8a-460f-a23a-c9cfc2aea4e9 req-d6b7b89d-4508-4aa7-a4b0-ba2aed44f5c3 tempest-TestVolumeBootPattern-147141705 tempest-TestVolumeBootPattern-147141705-project] 10.222.0.62 "GET /v2.0/security-groups?id=a6e2b133-1a9b-4dde-a188-1ce8bcdb7b5c&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0426877 Nov 23 19:42:03.090324 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9f5319f8-7443-4512-a6ca-9f77881e61b9 req-ee060d0a-d42e-4595-be05-cab981d017c3 tempest-AttachVolumeNegativeTest-754998453 tempest-AttachVolumeNegativeTest-754998453-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102992) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:42:03.091801 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-9f5319f8-7443-4512-a6ca-9f77881e61b9 req-ee060d0a-d42e-4595-be05-cab981d017c3 tempest-AttachVolumeNegativeTest-754998453 tempest-AttachVolumeNegativeTest-754998453-project] 10.222.0.62 "GET /v2.0/ports?device_id=063b0eee-501d-4da3-84b3-fa0731492f5f HTTP/1.1" status: 200 len: 945 time: 0.1015577 Nov 23 19:42:03.123761 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-6c723596-2e59-4f42-9f54-2ffaa881a079 req-57a6ac9d-65ee-43de-9522-9719fb246121 service neutron] 10.222.0.41 "GET /v2.0/networks/226a519f-5f3e-4d80-bb8a-0e9fc4f64828?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1410196 Nov 23 19:42:03.151948 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-9f5319f8-7443-4512-a6ca-9f77881e61b9 req-72712940-d5b7-4b37-a0f7-98131c4b01a7 tempest-AttachVolumeNegativeTest-754998453 tempest-AttachVolumeNegativeTest-754998453-project] 10.222.0.62 "GET /v2.0/security-groups?id=78a07d59-fd8e-4f94-9dfc-099d7d04efec&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0540307 Nov 23 19:42:04.147320 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ab867b70-0ee8-4ecc-bdd3-e84c81ffc876 req-c814a554-e2f9-4376-ad5d-7846bfbb0484 tempest-TestVolumeBootPattern-147141705 tempest-TestVolumeBootPattern-147141705-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102992) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:42:04.148789 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-ab867b70-0ee8-4ecc-bdd3-e84c81ffc876 req-c814a554-e2f9-4376-ad5d-7846bfbb0484 tempest-TestVolumeBootPattern-147141705 tempest-TestVolumeBootPattern-147141705-project] 10.222.0.62 "GET /v2.0/ports?device_id=f48d7898-d8c9-4cfb-b340-c3a0d0009b87 HTTP/1.1" status: 200 len: 943 time: 0.0484579 Nov 23 19:42:04.200024 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-ab867b70-0ee8-4ecc-bdd3-e84c81ffc876 req-36edb96c-5610-4ccd-894f-b1ff5b077da3 tempest-TestVolumeBootPattern-147141705 tempest-TestVolumeBootPattern-147141705-project] 10.222.0.62 "GET /v2.0/security-groups?id=a6e2b133-1a9b-4dde-a188-1ce8bcdb7b5c&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0451519 Nov 23 19:42:05.319920 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-067d22c8-9241-4ff6-ad14-6c90d4b902c5 req-d092e28b-947b-49c1-9c26-5e8f645c0220 tempest-TestVolumeBootPattern-147141705 tempest-TestVolumeBootPattern-147141705-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102993) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:42:05.321368 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-067d22c8-9241-4ff6-ad14-6c90d4b902c5 req-d092e28b-947b-49c1-9c26-5e8f645c0220 tempest-TestVolumeBootPattern-147141705 tempest-TestVolumeBootPattern-147141705-project] 10.222.0.62 "GET /v2.0/ports?device_id=f48d7898-d8c9-4cfb-b340-c3a0d0009b87 HTTP/1.1" status: 200 len: 943 time: 0.0524187 Nov 23 19:42:05.371168 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-067d22c8-9241-4ff6-ad14-6c90d4b902c5 req-196055fa-2659-4d70-9901-922a7f7bae94 tempest-TestVolumeBootPattern-147141705 tempest-TestVolumeBootPattern-147141705-project] 10.222.0.62 "GET /v2.0/security-groups?id=a6e2b133-1a9b-4dde-a188-1ce8bcdb7b5c&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0439506 Nov 23 19:42:06.082020 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-525e0c1b-62f5-4f50-b3a3-1dcf454f9c4c req-828cf596-c774-4865-85fd-1a64e51b0cd2 tempest-AttachVolumeNegativeTest-754998453 tempest-AttachVolumeNegativeTest-754998453-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=102993) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:42:06.083817 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-525e0c1b-62f5-4f50-b3a3-1dcf454f9c4c req-828cf596-c774-4865-85fd-1a64e51b0cd2 tempest-AttachVolumeNegativeTest-754998453 tempest-AttachVolumeNegativeTest-754998453-project] 10.222.0.62 "GET /v2.0/networks?id=5f438c34-aac6-400d-bc7e-2e0506f124a9 HTTP/1.1" status: 200 len: 815 time: 0.1057327 Nov 23 19:42:06.098520 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-525e0c1b-62f5-4f50-b3a3-1dcf454f9c4c req-f9b1b2be-5a73-471f-9c60-7986876e0920 tempest-AttachVolumeNegativeTest-754998453 tempest-AttachVolumeNegativeTest-754998453-project] 10.222.0.62 "GET /v2.0/quotas/e738acf03acd4f9d90b4dc46fb48bb06 HTTP/1.1" status: 200 len: 375 time: 0.0087283 Nov 23 19:42:06.148546 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-525e0c1b-62f5-4f50-b3a3-1dcf454f9c4c req-76d117db-29ed-4f99-ae05-d882cb0c69f1 tempest-AttachVolumeNegativeTest-754998453 tempest-AttachVolumeNegativeTest-754998453-project] 10.222.0.62 "GET /v2.0/ports?tenant_id=e738acf03acd4f9d90b4dc46fb48bb06&fields=id HTTP/1.1" status: 200 len: 302 time: 0.0448358 Nov 23 19:42:06.236485 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-525e0c1b-62f5-4f50-b3a3-1dcf454f9c4c req-2d51d4b6-71e9-437b-93b1-8defef8973f6 service neutron] 10.222.0.62 "GET /v2.0/networks/5f438c34-aac6-400d-bc7e-2e0506f124a9?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0809875 Nov 23 19:42:06.326885 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-525e0c1b-62f5-4f50-b3a3-1dcf454f9c4c req-65aaa6d7-d485-4ded-af40-fe4799a52bc6 service neutron] 10.222.0.62 "GET /v2.0/networks/5f438c34-aac6-400d-bc7e-2e0506f124a9?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0835285 Nov 23 19:42:06.561152 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ab9dc0bf-e050-4a8a-9e4b-47655ebbae4f req-1551bf77-1d09-4e75-a206-caf465fe8b06 tempest-TestVolumeBootPattern-147141705 tempest-TestVolumeBootPattern-147141705-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102992) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:42:06.562910 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-ab9dc0bf-e050-4a8a-9e4b-47655ebbae4f req-1551bf77-1d09-4e75-a206-caf465fe8b06 tempest-TestVolumeBootPattern-147141705 tempest-TestVolumeBootPattern-147141705-project] 10.222.0.62 "GET /v2.0/ports?device_id=f48d7898-d8c9-4cfb-b340-c3a0d0009b87 HTTP/1.1" status: 200 len: 943 time: 0.0535064 Nov 23 19:42:06.621516 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-ab9dc0bf-e050-4a8a-9e4b-47655ebbae4f req-5b5c0443-7769-4a7d-a444-5a233b6afaab tempest-TestVolumeBootPattern-147141705 tempest-TestVolumeBootPattern-147141705-project] 10.222.0.62 "GET /v2.0/security-groups?id=a6e2b133-1a9b-4dde-a188-1ce8bcdb7b5c&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0524449 Nov 23 19:42:06.631444 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-93eb1755-558b-40a2-a5c5-1aebcfa60a9a req-940e58e3-7521-4324-b7dd-2389d68a09d8 tempest-AttachVolumeNegativeTest-754998453 tempest-AttachVolumeNegativeTest-754998453-project] 10.222.0.62 "GET /v2.0/ports?device_id=4f9e5b06-00b6-4635-881c-06359237f669 HTTP/1.1" status: 200 len: 210 time: 0.0272031 Nov 23 19:42:07.730555 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-28146b53-f16a-4600-9f33-cbb63a0face3 req-c46f917f-74dd-44b2-97ab-84b824a4e6dc tempest-AttachVolumeNegativeTest-754998453 tempest-AttachVolumeNegativeTest-754998453-project] 10.222.0.62 "GET /v2.0/ports?device_id=4f9e5b06-00b6-4635-881c-06359237f669 HTTP/1.1" status: 200 len: 210 time: 0.0261176 Nov 23 19:42:07.741389 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e4e8470e-2fbf-4160-b17b-dd73f5103fa0 req-a92b5e7e-9c02-42e1-aa04-fa4a7ed1c8e3 tempest-TestVolumeBootPattern-147141705 tempest-TestVolumeBootPattern-147141705-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102993) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:42:07.752060 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-e4e8470e-2fbf-4160-b17b-dd73f5103fa0 req-a92b5e7e-9c02-42e1-aa04-fa4a7ed1c8e3 tempest-TestVolumeBootPattern-147141705 tempest-TestVolumeBootPattern-147141705-project] 10.222.0.62 "GET /v2.0/ports?device_id=f48d7898-d8c9-4cfb-b340-c3a0d0009b87 HTTP/1.1" status: 200 len: 943 time: 0.0507820 Nov 23 19:42:07.792977 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-e4e8470e-2fbf-4160-b17b-dd73f5103fa0 req-a3c51c57-32e7-4477-bd07-c2799190c117 tempest-TestVolumeBootPattern-147141705 tempest-TestVolumeBootPattern-147141705-project] 10.222.0.62 "GET /v2.0/security-groups?id=a6e2b133-1a9b-4dde-a188-1ce8bcdb7b5c&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0440915 Nov 23 19:42:08.516739 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-525e0c1b-62f5-4f50-b3a3-1dcf454f9c4c req-b31c2af3-9389-47c5-b374-0a3b6486b63d tempest-AttachVolumeNegativeTest-754998453 tempest-AttachVolumeNegativeTest-754998453-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=102992) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:42:08.518202 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-525e0c1b-62f5-4f50-b3a3-1dcf454f9c4c req-b31c2af3-9389-47c5-b374-0a3b6486b63d tempest-AttachVolumeNegativeTest-754998453 tempest-AttachVolumeNegativeTest-754998453-project] 10.222.0.41 "GET /v2.0/networks?id=5f438c34-aac6-400d-bc7e-2e0506f124a9 HTTP/1.1" status: 200 len: 815 time: 0.1034732 Nov 23 19:42:08.536655 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.api.v2.base [req-525e0c1b-62f5-4f50-b3a3-1dcf454f9c4c req-a6f8c651-8d07-49c2-b3ae-1567d9ba9436 tempest-AttachVolumeNegativeTest-754998453 tempest-AttachVolumeNegativeTest-754998453-project] Request body: {'port': {'device_id': '4f9e5b06-00b6-4635-881c-06359237f669', 'network_id': '5f438c34-aac6-400d-bc7e-2e0506f124a9', 'admin_state_up': True, 'tenant_id': 'e738acf03acd4f9d90b4dc46fb48bb06'}} {{(pid=102992) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 23 19:42:08.702674 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-525e0c1b-62f5-4f50-b3a3-1dcf454f9c4c req-a6f8c651-8d07-49c2-b3ae-1567d9ba9436 tempest-AttachVolumeNegativeTest-754998453 tempest-AttachVolumeNegativeTest-754998453-project] Made reservation on behalf of e738acf03acd4f9d90b4dc46fb48bb06 for: {'port': 1} {{(pid=102992) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 23 19:42:08.707121 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [req-525e0c1b-62f5-4f50-b3a3-1dcf454f9c4c req-a6f8c651-8d07-49c2-b3ae-1567d9ba9436 tempest-AttachVolumeNegativeTest-754998453 tempest-AttachVolumeNegativeTest-754998453-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7921281'] for port, before_create {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:42:08.836340 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-ac2f54ab-c149-4d67-a605-3cd2e1d49626 req-92b39393-16b7-41d3-93d8-be7e94ab6ff7 tempest-AttachVolumeNegativeTest-754998453 tempest-AttachVolumeNegativeTest-754998453-project] 10.222.0.62 "GET /v2.0/ports?device_id=4f9e5b06-00b6-4635-881c-06359237f669 HTTP/1.1" status: 200 len: 210 time: 0.0340867 Nov 23 19:42:08.843777 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.db.db_base_plugin_common [req-525e0c1b-62f5-4f50-b3a3-1dcf454f9c4c req-a6f8c651-8d07-49c2-b3ae-1567d9ba9436 tempest-AttachVolumeNegativeTest-754998453 tempest-AttachVolumeNegativeTest-754998453-project] Allocated IP 172.20.0.3 (5f438c34-aac6-400d-bc7e-2e0506f124a9/ffd14982-fec3-42b1-9d92-f2ed87a640f4/56425014-3b47-41cc-b7b9-4b72d31ef8c6) {{(pid=102992) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 23 19:42:08.988231 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bfcca56c-a323-4fc1-adc7-48de4ae8ac6b req-42e2d8f3-2302-448d-bc6a-8af3732f397c tempest-TestVolumeBootPattern-147141705 tempest-TestVolumeBootPattern-147141705-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102992) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:42:08.990240 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-bfcca56c-a323-4fc1-adc7-48de4ae8ac6b req-42e2d8f3-2302-448d-bc6a-8af3732f397c tempest-TestVolumeBootPattern-147141705 tempest-TestVolumeBootPattern-147141705-project] 10.222.0.62 "GET /v2.0/ports?device_id=f48d7898-d8c9-4cfb-b340-c3a0d0009b87 HTTP/1.1" status: 200 len: 943 time: 0.1126254 Nov 23 19:42:09.063673 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [req-525e0c1b-62f5-4f50-b3a3-1dcf454f9c4c req-a6f8c651-8d07-49c2-b3ae-1567d9ba9436 tempest-AttachVolumeNegativeTest-754998453 tempest-AttachVolumeNegativeTest-754998453-project] Publish callbacks [] for port, precommit_create {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:42:09.068841 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-bfcca56c-a323-4fc1-adc7-48de4ae8ac6b req-91cb94a0-1f3b-454a-88ad-cf709e1c534a tempest-TestVolumeBootPattern-147141705 tempest-TestVolumeBootPattern-147141705-project] 10.222.0.62 "GET /v2.0/security-groups?id=a6e2b133-1a9b-4dde-a188-1ce8bcdb7b5c&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0721016 Nov 23 19:42:09.137218 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [req-525e0c1b-62f5-4f50-b3a3-1dcf454f9c4c req-a6f8c651-8d07-49c2-b3ae-1567d9ba9436 tempest-AttachVolumeNegativeTest-754998453 tempest-AttachVolumeNegativeTest-754998453-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7918660', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-15067', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560168', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8783631008714', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-25199805'] for port, after_create {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:42:09.152824 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.plugins.ml2.db [None req-4bf48ff4-ecfb-4168-8b63-249b8c6e9f04 None None] get_ports_and_sgs() called for port_ids ['e8dc7322-0b92-4637-a298-0a114bf01c42', 'a2ad1558-284e-4085-92ca-d32f3052846b'] {{(pid=102994) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 23 19:42:09.181758 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-525e0c1b-62f5-4f50-b3a3-1dcf454f9c4c req-a6f8c651-8d07-49c2-b3ae-1567d9ba9436 tempest-AttachVolumeNegativeTest-754998453 tempest-AttachVolumeNegativeTest-754998453-project] Network 5f438c34-aac6-400d-bc7e-2e0506f124a9 is already hosted by enough agents. {{(pid=102992) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 23 19:42:09.187077 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.scheduler.base_scheduler [req-525e0c1b-62f5-4f50-b3a3-1dcf454f9c4c req-a6f8c651-8d07-49c2-b3ae-1567d9ba9436 tempest-AttachVolumeNegativeTest-754998453 tempest-AttachVolumeNegativeTest-754998453-project] Resources bound (agent type, host, resource id): {{(pid=102992) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 23 19:42:09.190640 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.db.l3_dvrscheduler_db [req-525e0c1b-62f5-4f50-b3a3-1dcf454f9c4c req-a6f8c651-8d07-49c2-b3ae-1567d9ba9436 tempest-AttachVolumeNegativeTest-754998453 tempest-AttachVolumeNegativeTest-754998453-project] Received port after_create {{(pid=102992) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 23 19:42:09.220749 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a6f8c651-8d07-49c2-b3ae-1567d9ba9436 tempest-AttachVolumeNegativeTest-754998453 tempest-AttachVolumeNegativeTest-754998453-project] Pushing event updated for resources: {'Port': ['ID=56425014-3b47-41cc-b7b9-4b72d31ef8c6,revision_number=1']} {{(pid=102992) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 23 19:42:09.250796 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-525e0c1b-62f5-4f50-b3a3-1dcf454f9c4c req-a6f8c651-8d07-49c2-b3ae-1567d9ba9436 tempest-AttachVolumeNegativeTest-754998453 tempest-AttachVolumeNegativeTest-754998453-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=102992) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:42:09.251423 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [req-525e0c1b-62f5-4f50-b3a3-1dcf454f9c4c req-a6f8c651-8d07-49c2-b3ae-1567d9ba9436 tempest-AttachVolumeNegativeTest-754998453 tempest-AttachVolumeNegativeTest-754998453-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-514902'] for port, before_response {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:42:09.322315 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-525e0c1b-62f5-4f50-b3a3-1dcf454f9c4c req-a6f8c651-8d07-49c2-b3ae-1567d9ba9436 tempest-AttachVolumeNegativeTest-754998453 tempest-AttachVolumeNegativeTest-754998453-project] 10.222.0.41 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 0.7890317 Nov 23 19:42:09.341696 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.api.v2.base [req-525e0c1b-62f5-4f50-b3a3-1dcf454f9c4c req-987d65df-07e8-463a-bf6c-674a645e1438 service neutron] Request body: {'port': {'device_id': '4f9e5b06-00b6-4635-881c-06359237f669', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-81901'}} {{(pid=102992) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 23 19:42:09.394416 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [req-525e0c1b-62f5-4f50-b3a3-1dcf454f9c4c req-987d65df-07e8-463a-bf6c-674a645e1438 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7921281'] for port, before_update {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:42:09.644776 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.notifiers.nova [req-525e0c1b-62f5-4f50-b3a3-1dcf454f9c4c req-987d65df-07e8-463a-bf6c-674a645e1438 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 56425014-3b47-41cc-b7b9-4b72d31ef8c6 {{(pid=102992) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 23 19:42:09.652211 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [req-525e0c1b-62f5-4f50-b3a3-1dcf454f9c4c req-987d65df-07e8-463a-bf6c-674a645e1438 service neutron] Publish callbacks [] for port, precommit_update {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:42:09.663915 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.db.provisioning_blocks [req-525e0c1b-62f5-4f50-b3a3-1dcf454f9c4c req-987d65df-07e8-463a-bf6c-674a645e1438 service neutron] Transition to ACTIVE for port object 56425014-3b47-41cc-b7b9-4b72d31ef8c6 will not be triggered until provisioned by entity L2. {{(pid=102992) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 23 19:42:09.725268 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [req-525e0c1b-62f5-4f50-b3a3-1dcf454f9c4c req-987d65df-07e8-463a-bf6c-674a645e1438 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7918660', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-15067', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560168', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8783631423946', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8783631008732', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8783631008750', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-25199748'] for port, after_update {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:42:09.800478 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-987d65df-07e8-463a-bf6c-674a645e1438 service neutron] Pushing event updated for resources: {'Port': ['ID=56425014-3b47-41cc-b7b9-4b72d31ef8c6,revision_number=2']} {{(pid=102992) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 23 19:42:09.852083 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.plugins.ml2.managers [req-525e0c1b-62f5-4f50-b3a3-1dcf454f9c4c req-987d65df-07e8-463a-bf6c-674a645e1438 service neutron] Attempting to bind port 56425014-3b47-41cc-b7b9-4b72d31ef8c6 on host hv-cinder-81901 for vnic_type normal with profile {{(pid=102992) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 23 19:42:09.852661 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.plugins.ml2.managers [req-525e0c1b-62f5-4f50-b3a3-1dcf454f9c4c req-987d65df-07e8-463a-bf6c-674a645e1438 service neutron] Attempting to bind port 56425014-3b47-41cc-b7b9-4b72d31ef8c6 by drivers openvswitch,hyperv on host hv-cinder-81901 at level 0 using segments [{'id': 'a14a7aae-c481-4c86-92ee-f7808a54fd04', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 832, 'network_id': '5f438c34-aac6-400d-bc7e-2e0506f124a9'}] {{(pid=102992) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 23 19:42:09.852836 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-525e0c1b-62f5-4f50-b3a3-1dcf454f9c4c req-987d65df-07e8-463a-bf6c-674a645e1438 service neutron] Attempting to bind port 56425014-3b47-41cc-b7b9-4b72d31ef8c6 on network 5f438c34-aac6-400d-bc7e-2e0506f124a9 {{(pid=102992) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 23 19:42:09.857194 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-525e0c1b-62f5-4f50-b3a3-1dcf454f9c4c req-987d65df-07e8-463a-bf6c-674a645e1438 service neutron] Port 56425014-3b47-41cc-b7b9-4b72d31ef8c6 on network 5f438c34-aac6-400d-bc7e-2e0506f124a9 not bound, no agent of type Open vSwitch agent registered on host hv-cinder-81901 {{(pid=102992) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Nov 23 19:42:09.857557 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-525e0c1b-62f5-4f50-b3a3-1dcf454f9c4c req-987d65df-07e8-463a-bf6c-674a645e1438 service neutron] Attempting to bind port 56425014-3b47-41cc-b7b9-4b72d31ef8c6 on network 5f438c34-aac6-400d-bc7e-2e0506f124a9 {{(pid=102992) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 23 19:42:09.862335 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-525e0c1b-62f5-4f50-b3a3-1dcf454f9c4c req-987d65df-07e8-463a-bf6c-674a645e1438 service neutron] Checking agent: {'id': '14e5d049-431d-466a-8d1c-264e5129d376', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-81901', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 23, 19, 31, 29), 'started_at': datetime.datetime(2021, 11, 23, 19, 31, 29), 'heartbeat_timestamp': datetime.datetime(2021, 11, 23, 19, 42), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=102992) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 23 19:42:09.862669 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-525e0c1b-62f5-4f50-b3a3-1dcf454f9c4c req-987d65df-07e8-463a-bf6c-674a645e1438 service neutron] Checking segment: {'id': 'a14a7aae-c481-4c86-92ee-f7808a54fd04', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 832, 'network_id': '5f438c34-aac6-400d-bc7e-2e0506f124a9'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102992) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 23 19:42:09.863049 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-525e0c1b-62f5-4f50-b3a3-1dcf454f9c4c req-987d65df-07e8-463a-bf6c-674a645e1438 service neutron] Bound using segment: {'id': 'a14a7aae-c481-4c86-92ee-f7808a54fd04', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 832, 'network_id': '5f438c34-aac6-400d-bc7e-2e0506f124a9'} {{(pid=102992) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 23 19:42:09.863473 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.plugins.ml2.managers [req-525e0c1b-62f5-4f50-b3a3-1dcf454f9c4c req-987d65df-07e8-463a-bf6c-674a645e1438 service neutron] Bound port: 56425014-3b47-41cc-b7b9-4b72d31ef8c6, host: hv-cinder-81901, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': 'a14a7aae-c481-4c86-92ee-f7808a54fd04', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 832, 'network_id': '5f438c34-aac6-400d-bc7e-2e0506f124a9'}}] {{(pid=102992) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 23 19:42:09.863825 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [req-525e0c1b-62f5-4f50-b3a3-1dcf454f9c4c req-987d65df-07e8-463a-bf6c-674a645e1438 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7921281'] for port, before_update {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:42:09.954032 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.plugins.ml2.db [req-525e0c1b-62f5-4f50-b3a3-1dcf454f9c4c req-987d65df-07e8-463a-bf6c-674a645e1438 service neutron] For port 56425014-3b47-41cc-b7b9-4b72d31ef8c6, host hv-cinder-81901, cleared binding levels {{(pid=102992) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 23 19:42:09.969481 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.plugins.ml2.db [req-525e0c1b-62f5-4f50-b3a3-1dcf454f9c4c req-987d65df-07e8-463a-bf6c-674a645e1438 service neutron] For port 56425014-3b47-41cc-b7b9-4b72d31ef8c6, host hv-cinder-81901, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81901',level=0,port_id=56425014-3b47-41cc-b7b9-4b72d31ef8c6,segment=NetworkSegment(a14a7aae-c481-4c86-92ee-f7808a54fd04),segment_id=a14a7aae-c481-4c86-92ee-f7808a54fd04)] {{(pid=102992) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 23 19:42:09.982287 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4e3ab50f-36fd-42ce-a554-6b2c2c2880b7 req-7149796a-da97-4ad4-b99d-f3deb375ec75 tempest-AttachVolumeNegativeTest-754998453 tempest-AttachVolumeNegativeTest-754998453-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102992) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:42:09.983786 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-4e3ab50f-36fd-42ce-a554-6b2c2c2880b7 req-7149796a-da97-4ad4-b99d-f3deb375ec75 tempest-AttachVolumeNegativeTest-754998453 tempest-AttachVolumeNegativeTest-754998453-project] 10.222.0.62 "GET /v2.0/ports?device_id=4f9e5b06-00b6-4635-881c-06359237f669 HTTP/1.1" status: 200 len: 943 time: 0.0669415 Nov 23 19:42:10.027856 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [req-525e0c1b-62f5-4f50-b3a3-1dcf454f9c4c req-987d65df-07e8-463a-bf6c-674a645e1438 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7918660', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-15067', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560168', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8783631423946', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8783631008732', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8783631008750', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-25199748'] for port, after_update {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:42:10.056061 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-4e3ab50f-36fd-42ce-a554-6b2c2c2880b7 req-1cbb26f9-cf60-47a3-9f5e-5c3ca382eb0e tempest-AttachVolumeNegativeTest-754998453 tempest-AttachVolumeNegativeTest-754998453-project] 10.222.0.62 "GET /v2.0/security-groups?id=78a07d59-fd8e-4f94-9dfc-099d7d04efec&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0664432 Nov 23 19:42:10.070497 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-525e0c1b-62f5-4f50-b3a3-1dcf454f9c4c req-987d65df-07e8-463a-bf6c-674a645e1438 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102992) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:42:10.071115 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [req-525e0c1b-62f5-4f50-b3a3-1dcf454f9c4c req-987d65df-07e8-463a-bf6c-674a645e1438 service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-514902'] for port, before_response {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:42:10.072494 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-525e0c1b-62f5-4f50-b3a3-1dcf454f9c4c req-987d65df-07e8-463a-bf6c-674a645e1438 service neutron] 10.222.0.41 "PUT /v2.0/ports/56425014-3b47-41cc-b7b9-4b72d31ef8c6 HTTP/1.1" status: 200 len: 1093 time: 0.7349348 Nov 23 19:42:10.072940 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '4f9e5b06-00b6-4635-881c-06359237f669', 'tag': '56425014-3b47-41cc-b7b9-4b72d31ef8c6'}] {{(pid=102992) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 23 19:42:10.075204 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.62/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}f86c332b591ae691ababa4b64e0601cbf242a448242f95367ce03daabfb7e1ce" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-5659d8ce-7ea4-4438-8a4c-1d5faeb955ba" -d '{"events": [{"name": "network-changed", "server_uuid": "4f9e5b06-00b6-4635-881c-06359237f669", "tag": "56425014-3b47-41cc-b7b9-4b72d31ef8c6"}]}' {{(pid=102992) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 23 19:42:10.093744 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-987d65df-07e8-463a-bf6c-674a645e1438 service neutron] Pushing event updated for resources: {'Port': ['ID=56425014-3b47-41cc-b7b9-4b72d31ef8c6,revision_number=3']} {{(pid=102992) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 23 19:42:10.117988 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Tue, 23 Nov 2021 19:42:10 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-378bd072-7f5b-4b83-8764-4067e88e7ca8 x-openstack-request-id: req-378bd072-7f5b-4b83-8764-4067e88e7ca8 {{(pid=102992) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 23 19:42:10.118314 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "4f9e5b06-00b6-4635-881c-06359237f669", "tag": "56425014-3b47-41cc-b7b9-4b72d31ef8c6", "status": "completed", "code": 200}]} {{(pid=102992) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 23 19:42:10.118582 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.62/compute/v2.1/os-server-external-events used request id req-378bd072-7f5b-4b83-8764-4067e88e7ca8 {{(pid=102992) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 23 19:42:10.118989 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '4f9e5b06-00b6-4635-881c-06359237f669', 'tag': '56425014-3b47-41cc-b7b9-4b72d31ef8c6', 'status': 'completed', 'code': 200} Nov 23 19:42:10.212434 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5659d8ce-7ea4-4438-8a4c-1d5faeb955ba req-68ecfde0-db29-4b6a-b174-ac00c527b197 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102992) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:42:10.213873 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-5659d8ce-7ea4-4438-8a4c-1d5faeb955ba req-68ecfde0-db29-4b6a-b174-ac00c527b197 service neutron] 10.222.0.41 "GET /v2.0/ports?tenant_id=e738acf03acd4f9d90b4dc46fb48bb06&device_id=4f9e5b06-00b6-4635-881c-06359237f669 HTTP/1.1" status: 200 len: 1096 time: 0.0658352 Nov 23 19:42:10.221281 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f2c5c58a-8f76-46d1-951c-e06647aba645 req-6d3ffe68-a5ec-4da1-b0c5-49e99f869f38 tempest-TestVolumeBootPattern-147141705 tempest-TestVolumeBootPattern-147141705-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102992) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:42:10.222673 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-f2c5c58a-8f76-46d1-951c-e06647aba645 req-6d3ffe68-a5ec-4da1-b0c5-49e99f869f38 tempest-TestVolumeBootPattern-147141705 tempest-TestVolumeBootPattern-147141705-project] 10.222.0.62 "GET /v2.0/ports?device_id=f48d7898-d8c9-4cfb-b340-c3a0d0009b87 HTTP/1.1" status: 200 len: 943 time: 0.0835147 Nov 23 19:42:10.331586 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-f2c5c58a-8f76-46d1-951c-e06647aba645 req-7c74615c-790d-4c8b-8698-c4f44e3b3296 tempest-TestVolumeBootPattern-147141705 tempest-TestVolumeBootPattern-147141705-project] 10.222.0.62 "GET /v2.0/security-groups?id=a6e2b133-1a9b-4dde-a188-1ce8bcdb7b5c&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0987966 Nov 23 19:42:10.352003 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5659d8ce-7ea4-4438-8a4c-1d5faeb955ba req-fad525ee-890a-43ce-bf62-14d4417ecd2f service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102992) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:42:10.353543 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-5659d8ce-7ea4-4438-8a4c-1d5faeb955ba req-fad525ee-890a-43ce-bf62-14d4417ecd2f service neutron] 10.222.0.41 "GET /v2.0/networks?tenant_id=e738acf03acd4f9d90b4dc46fb48bb06&shared=False HTTP/1.1" status: 200 len: 916 time: 0.1286087 Nov 23 19:42:10.448660 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5659d8ce-7ea4-4438-8a4c-1d5faeb955ba req-48ff1127-0d93-473a-a97d-af2004650e41 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102992) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:42:10.450146 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-5659d8ce-7ea4-4438-8a4c-1d5faeb955ba req-48ff1127-0d93-473a-a97d-af2004650e41 service neutron] 10.222.0.41 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 870 time: 0.0861471 Nov 23 19:42:10.534658 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-525e0c1b-62f5-4f50-b3a3-1dcf454f9c4c req-25943b0f-8040-43e8-966a-b5d8b2d37ad8 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102992) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:42:10.536141 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-525e0c1b-62f5-4f50-b3a3-1dcf454f9c4c req-25943b0f-8040-43e8-966a-b5d8b2d37ad8 service neutron] 10.222.0.41 "GET /v2.0/ports?tenant_id=e738acf03acd4f9d90b4dc46fb48bb06&device_id=4f9e5b06-00b6-4635-881c-06359237f669 HTTP/1.1" status: 200 len: 1096 time: 0.0399837 Nov 23 19:42:10.585489 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-525e0c1b-62f5-4f50-b3a3-1dcf454f9c4c req-b0efa8c1-8504-47f0-9d2b-b0c0195cad66 service neutron] 10.222.0.41 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.3&port_id=56425014-3b47-41cc-b7b9-4b72d31ef8c6 HTTP/1.1" status: 200 len: 217 time: 0.0367723 Nov 23 19:42:10.635590 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-525e0c1b-62f5-4f50-b3a3-1dcf454f9c4c req-15529bd5-818a-4811-a998-fc5bb2f7d38c service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102992) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:42:10.636997 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-525e0c1b-62f5-4f50-b3a3-1dcf454f9c4c req-15529bd5-818a-4811-a998-fc5bb2f7d38c service neutron] 10.222.0.41 "GET /v2.0/subnets?id=ffd14982-fec3-42b1-9d92-f2ed87a640f4 HTTP/1.1" status: 200 len: 855 time: 0.0432973 Nov 23 19:42:10.675040 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-525e0c1b-62f5-4f50-b3a3-1dcf454f9c4c req-66219b24-8a12-4b27-8787-00703bc50634 service neutron] 10.222.0.41 "GET /v2.0/ports?network_id=5f438c34-aac6-400d-bc7e-2e0506f124a9&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0231183 Nov 23 19:42:10.775095 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-525e0c1b-62f5-4f50-b3a3-1dcf454f9c4c req-8e216ade-e475-4d8a-9ce1-b7fc4b51ddb9 service neutron] 10.222.0.41 "GET /v2.0/networks/5f438c34-aac6-400d-bc7e-2e0506f124a9?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0852904 Nov 23 19:42:10.867615 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-525e0c1b-62f5-4f50-b3a3-1dcf454f9c4c req-0a13caca-8074-43c2-9efd-a984b17d2b63 service neutron] 10.222.0.41 "GET /v2.0/networks/5f438c34-aac6-400d-bc7e-2e0506f124a9?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0827379 Nov 23 19:42:11.174037 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dcf19124-9dad-4702-a8c8-6ee13270d0f9 req-189727bc-3f68-4d47-8343-07f67acb33b9 tempest-AttachVolumeNegativeTest-754998453 tempest-AttachVolumeNegativeTest-754998453-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102992) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:42:11.176632 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-dcf19124-9dad-4702-a8c8-6ee13270d0f9 req-189727bc-3f68-4d47-8343-07f67acb33b9 tempest-AttachVolumeNegativeTest-754998453 tempest-AttachVolumeNegativeTest-754998453-project] 10.222.0.62 "GET /v2.0/ports?device_id=4f9e5b06-00b6-4635-881c-06359237f669 HTTP/1.1" status: 200 len: 943 time: 0.0520897 Nov 23 19:42:11.228030 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-dcf19124-9dad-4702-a8c8-6ee13270d0f9 req-0932e5bb-d6d3-4f2e-aaf8-98a9de3d4ead tempest-AttachVolumeNegativeTest-754998453 tempest-AttachVolumeNegativeTest-754998453-project] 10.222.0.62 "GET /v2.0/security-groups?id=78a07d59-fd8e-4f94-9dfc-099d7d04efec&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0454779 Nov 23 19:42:11.449304 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3ece6d49-88d0-4125-a848-f54ab9a5ae01 req-9a185d33-c02f-4126-86d3-fb0adc51453c tempest-TestVolumeBootPattern-147141705 tempest-TestVolumeBootPattern-147141705-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102993) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:42:11.450792 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-3ece6d49-88d0-4125-a848-f54ab9a5ae01 req-9a185d33-c02f-4126-86d3-fb0adc51453c tempest-TestVolumeBootPattern-147141705 tempest-TestVolumeBootPattern-147141705-project] 10.222.0.62 "GET /v2.0/ports?device_id=f48d7898-d8c9-4cfb-b340-c3a0d0009b87 HTTP/1.1" status: 200 len: 943 time: 0.0487719 Nov 23 19:42:11.499850 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-3ece6d49-88d0-4125-a848-f54ab9a5ae01 req-0b9c9a04-cb67-4c88-bc5a-8acef603a0ff tempest-TestVolumeBootPattern-147141705 tempest-TestVolumeBootPattern-147141705-project] 10.222.0.62 "GET /v2.0/security-groups?id=a6e2b133-1a9b-4dde-a188-1ce8bcdb7b5c&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0433168 Nov 23 19:42:11.708036 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron_lib.callbacks.manager [None req-3b08e86d-e71e-43b8-9b31-0a38d58e7536 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8783631323329', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7978582'] for agent, after_update {{(pid=102994) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:42:11.875109 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.plugins.ml2.rpc [None req-4bf48ff4-ecfb-4168-8b63-249b8c6e9f04 None None] Device 7bdc59b0-f473-4d83-9bf7-b5700274a507 details requested by agent hyperv_hv-cinder-81901 with host hv-cinder-81901 {{(pid=102994) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Nov 23 19:42:11.970381 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.plugins.ml2.db [None req-4bf48ff4-ecfb-4168-8b63-249b8c6e9f04 None None] For port 7bdc59b0-f473-4d83-9bf7-b5700274a507, host hv-cinder-81901, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81901',level=0,port_id=7bdc59b0-f473-4d83-9bf7-b5700274a507,segment=NetworkSegment(56316385-5b81-43f5-84db-b708b46f04eb),segment_id=56316385-5b81-43f5-84db-b708b46f04eb)] {{(pid=102994) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 23 19:42:11.982338 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.plugins.ml2.rpc [None req-4bf48ff4-ecfb-4168-8b63-249b8c6e9f04 None None] Returning: {'device': '7bdc59b0-f473-4d83-9bf7-b5700274a507', 'network_id': '226a519f-5f3e-4d80-bb8a-0e9fc4f64828', 'port_id': '7bdc59b0-f473-4d83-9bf7-b5700274a507', 'mac_address': 'fa:16:3e:fd:cc:68', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 800, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '88de785d-c540-4651-af1e-26f27ccaee3c', 'ip_address': '172.20.0.6'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=102994) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Nov 23 19:42:12.023547 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron_lib.callbacks.manager [None req-4bf48ff4-ecfb-4168-8b63-249b8c6e9f04 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7921281'] for port, before_update {{(pid=102994) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:42:12.038001 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.notifiers.nova [None req-4bf48ff4-ecfb-4168-8b63-249b8c6e9f04 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 7bdc59b0-f473-4d83-9bf7-b5700274a507 {{(pid=102994) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 23 19:42:12.056663 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.plugins.ml2.db [None req-4bf48ff4-ecfb-4168-8b63-249b8c6e9f04 None None] For port 7bdc59b0-f473-4d83-9bf7-b5700274a507, host hv-cinder-81901, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81901',level=0,port_id=7bdc59b0-f473-4d83-9bf7-b5700274a507,segment=NetworkSegment(56316385-5b81-43f5-84db-b708b46f04eb),segment_id=56316385-5b81-43f5-84db-b708b46f04eb)] {{(pid=102994) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 23 19:42:12.131219 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron_lib.callbacks.manager [None req-4bf48ff4-ecfb-4168-8b63-249b8c6e9f04 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7918660', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-15067', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560168', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8783631423946', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8783631008732', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8783631008750'] for port, after_update {{(pid=102994) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:42:12.177708 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4bf48ff4-ecfb-4168-8b63-249b8c6e9f04 None None] Pushing event updated for resources: {'Port': ['ID=7bdc59b0-f473-4d83-9bf7-b5700274a507,revision_number=4']} {{(pid=102994) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 23 19:42:12.342340 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2d237951-e7a6-4e33-8837-10c59e2133a9 req-f04d5598-39fe-4f4e-aa5d-d204e38d65a4 tempest-AttachVolumeNegativeTest-754998453 tempest-AttachVolumeNegativeTest-754998453-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102993) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:42:12.343806 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-2d237951-e7a6-4e33-8837-10c59e2133a9 req-f04d5598-39fe-4f4e-aa5d-d204e38d65a4 tempest-AttachVolumeNegativeTest-754998453 tempest-AttachVolumeNegativeTest-754998453-project] 10.222.0.62 "GET /v2.0/ports?device_id=4f9e5b06-00b6-4635-881c-06359237f669 HTTP/1.1" status: 200 len: 943 time: 0.0490725 Nov 23 19:42:12.390045 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-2d237951-e7a6-4e33-8837-10c59e2133a9 req-516f1591-c91d-4a64-bcd1-3217fd89594d tempest-AttachVolumeNegativeTest-754998453 tempest-AttachVolumeNegativeTest-754998453-project] 10.222.0.62 "GET /v2.0/security-groups?id=78a07d59-fd8e-4f94-9dfc-099d7d04efec&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0396898 Nov 23 19:42:12.450272 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.plugins.ml2.db [None req-4bf48ff4-ecfb-4168-8b63-249b8c6e9f04 None None] get_ports_and_sgs() called for port_ids ['7bdc59b0-f473-4d83-9bf7-b5700274a507'] {{(pid=102994) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 23 19:42:12.620648 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-46deb4ff-0a19-4a80-a845-9c38ec9f3a20 req-0db2162b-fb1f-4e51-ac22-e651435626ca tempest-TestVolumeBootPattern-147141705 tempest-TestVolumeBootPattern-147141705-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102992) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:42:12.622180 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-46deb4ff-0a19-4a80-a845-9c38ec9f3a20 req-0db2162b-fb1f-4e51-ac22-e651435626ca tempest-TestVolumeBootPattern-147141705 tempest-TestVolumeBootPattern-147141705-project] 10.222.0.62 "GET /v2.0/ports?device_id=f48d7898-d8c9-4cfb-b340-c3a0d0009b87 HTTP/1.1" status: 200 len: 944 time: 0.0491757 Nov 23 19:42:12.671305 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-46deb4ff-0a19-4a80-a845-9c38ec9f3a20 req-093f7237-bad6-4c46-acd1-87b88c8a5a68 tempest-TestVolumeBootPattern-147141705 tempest-TestVolumeBootPattern-147141705-project] 10.222.0.62 "GET /v2.0/security-groups?id=a6e2b133-1a9b-4dde-a188-1ce8bcdb7b5c&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0431111 Nov 23 19:42:13.508508 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cdb2c869-14fa-4977-b750-ebd95206c65a req-7883cc4c-6ab4-4661-a1f8-830cf9ad748a tempest-AttachVolumeNegativeTest-754998453 tempest-AttachVolumeNegativeTest-754998453-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102992) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:42:13.510027 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-cdb2c869-14fa-4977-b750-ebd95206c65a req-7883cc4c-6ab4-4661-a1f8-830cf9ad748a tempest-AttachVolumeNegativeTest-754998453 tempest-AttachVolumeNegativeTest-754998453-project] 10.222.0.62 "GET /v2.0/ports?device_id=4f9e5b06-00b6-4635-881c-06359237f669 HTTP/1.1" status: 200 len: 943 time: 0.0524471 Nov 23 19:42:13.558219 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-cdb2c869-14fa-4977-b750-ebd95206c65a req-5ce44de7-8967-40cf-932d-8bf1a9714ce6 tempest-AttachVolumeNegativeTest-754998453 tempest-AttachVolumeNegativeTest-754998453-project] 10.222.0.62 "GET /v2.0/security-groups?id=78a07d59-fd8e-4f94-9dfc-099d7d04efec&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0421529 Nov 23 19:42:13.800842 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9310126f-5273-4131-a1f0-673167c8d3ab req-d74e8074-f3bc-4050-9cc7-29766f7c5f3e tempest-TestVolumeBootPattern-147141705 tempest-TestVolumeBootPattern-147141705-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102993) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:42:13.802972 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-9310126f-5273-4131-a1f0-673167c8d3ab req-d74e8074-f3bc-4050-9cc7-29766f7c5f3e tempest-TestVolumeBootPattern-147141705 tempest-TestVolumeBootPattern-147141705-project] 10.222.0.62 "GET /v2.0/ports?device_id=f48d7898-d8c9-4cfb-b340-c3a0d0009b87 HTTP/1.1" status: 200 len: 944 time: 0.0603681 Nov 23 19:42:13.854217 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-9310126f-5273-4131-a1f0-673167c8d3ab req-efec22a7-704c-490d-a8aa-1a8f05d2c83b tempest-TestVolumeBootPattern-147141705 tempest-TestVolumeBootPattern-147141705-project] 10.222.0.62 "GET /v2.0/security-groups?id=a6e2b133-1a9b-4dde-a188-1ce8bcdb7b5c&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0452988 Nov 23 19:42:13.879741 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.plugins.ml2.rpc [None req-4bf48ff4-ecfb-4168-8b63-249b8c6e9f04 None None] Device 56425014-3b47-41cc-b7b9-4b72d31ef8c6 details requested by agent hyperv_hv-cinder-81901 with host hv-cinder-81901 {{(pid=102994) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Nov 23 19:42:13.886505 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.plugins.ml2.rpc [None req-4bf48ff4-ecfb-4168-8b63-249b8c6e9f04 None None] Device 7bdc59b0-f473-4d83-9bf7-b5700274a507 up at agent hyperv_hv-cinder-81901 {{(pid=102994) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 23 19:42:14.041839 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.plugins.ml2.db [None req-4bf48ff4-ecfb-4168-8b63-249b8c6e9f04 None None] For port 56425014-3b47-41cc-b7b9-4b72d31ef8c6, host hv-cinder-81901, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81901',level=0,port_id=56425014-3b47-41cc-b7b9-4b72d31ef8c6,segment=NetworkSegment(a14a7aae-c481-4c86-92ee-f7808a54fd04),segment_id=a14a7aae-c481-4c86-92ee-f7808a54fd04)] {{(pid=102994) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 23 19:42:14.054603 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.plugins.ml2.rpc [None req-4bf48ff4-ecfb-4168-8b63-249b8c6e9f04 None None] Returning: {'device': '56425014-3b47-41cc-b7b9-4b72d31ef8c6', 'network_id': '5f438c34-aac6-400d-bc7e-2e0506f124a9', 'port_id': '56425014-3b47-41cc-b7b9-4b72d31ef8c6', 'mac_address': 'fa:16:3e:01:9a:ec', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 832, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'ffd14982-fec3-42b1-9d92-f2ed87a640f4', 'ip_address': '172.20.0.3'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=102994) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Nov 23 19:42:14.086845 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.db.provisioning_blocks [None req-4bf48ff4-ecfb-4168-8b63-249b8c6e9f04 None None] Provisioning for port 7bdc59b0-f473-4d83-9bf7-b5700274a507 completed by entity L2. {{(pid=102994) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 23 19:42:14.096800 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.db.provisioning_blocks [None req-4bf48ff4-ecfb-4168-8b63-249b8c6e9f04 None None] Provisioning complete for port 7bdc59b0-f473-4d83-9bf7-b5700274a507 triggered by entity L2. {{(pid=102994) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 23 19:42:14.097175 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron_lib.callbacks.manager [None req-4bf48ff4-ecfb-4168-8b63-249b8c6e9f04 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-8355713'] for port, provisioning_complete {{(pid=102994) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:42:14.134819 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron_lib.callbacks.manager [None req-4bf48ff4-ecfb-4168-8b63-249b8c6e9f04 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7921281'] for port, before_update {{(pid=102994) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:42:14.316123 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.notifiers.nova [None req-4bf48ff4-ecfb-4168-8b63-249b8c6e9f04 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 56425014-3b47-41cc-b7b9-4b72d31ef8c6 {{(pid=102994) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 23 19:42:14.342454 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.plugins.ml2.db [None req-4bf48ff4-ecfb-4168-8b63-249b8c6e9f04 None None] For port 56425014-3b47-41cc-b7b9-4b72d31ef8c6, host hv-cinder-81901, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81901',level=0,port_id=56425014-3b47-41cc-b7b9-4b72d31ef8c6,segment=NetworkSegment(a14a7aae-c481-4c86-92ee-f7808a54fd04),segment_id=a14a7aae-c481-4c86-92ee-f7808a54fd04)] {{(pid=102994) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 23 19:42:14.372699 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron_lib.callbacks.manager [None req-b78189e6-a12f-47ce-95d7-455793c6a683 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8783631323329', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7978582'] for agent, after_update {{(pid=102994) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:42:14.376006 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron_lib.callbacks.manager [None req-4bf48ff4-ecfb-4168-8b63-249b8c6e9f04 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7921281'] for port, before_update {{(pid=102994) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:42:14.399110 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'f48d7898-d8c9-4cfb-b340-c3a0d0009b87', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '7bdc59b0-f473-4d83-9bf7-b5700274a507'}] {{(pid=102994) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 23 19:42:14.401342 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.62/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}09a7511da0d2ba1d728b27e36a8467ec5289399952f0059588048a7cb66d3a43" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-606d427c-78ee-4bcf-bb9d-7bb7a63d52f2" -d '{"events": [{"server_uuid": "f48d7898-d8c9-4cfb-b340-c3a0d0009b87", "name": "network-vif-plugged", "status": "completed", "tag": "7bdc59b0-f473-4d83-9bf7-b5700274a507"}]}' {{(pid=102994) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 23 19:42:14.414301 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.plugins.ml2.db [None req-4bf48ff4-ecfb-4168-8b63-249b8c6e9f04 None None] For port 7bdc59b0-f473-4d83-9bf7-b5700274a507, host hv-cinder-81901, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81901',level=0,port_id=7bdc59b0-f473-4d83-9bf7-b5700274a507,segment=NetworkSegment(56316385-5b81-43f5-84db-b708b46f04eb),segment_id=56316385-5b81-43f5-84db-b708b46f04eb)] {{(pid=102994) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 23 19:42:14.428475 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron_lib.callbacks.manager [None req-4bf48ff4-ecfb-4168-8b63-249b8c6e9f04 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7918660', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-15067', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560168', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8783631423946', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8783631008732', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8783631008750'] for port, after_update {{(pid=102994) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:42:14.451655 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 23 Nov 2021 19:42:14 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-a0b0ee8c-7c5a-489b-845f-d631844f2aa1 x-openstack-request-id: req-a0b0ee8c-7c5a-489b-845f-d631844f2aa1 {{(pid=102994) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 23 19:42:14.451954 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "f48d7898-d8c9-4cfb-b340-c3a0d0009b87", "name": "network-vif-plugged", "status": "completed", "tag": "7bdc59b0-f473-4d83-9bf7-b5700274a507", "code": 200}]} {{(pid=102994) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 23 19:42:14.452212 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.62/compute/v2.1/os-server-external-events used request id req-a0b0ee8c-7c5a-489b-845f-d631844f2aa1 {{(pid=102994) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 23 19:42:14.452601 dv-cinder-819011-1-iscsi neutron-server[102994]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'f48d7898-d8c9-4cfb-b340-c3a0d0009b87', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '7bdc59b0-f473-4d83-9bf7-b5700274a507', 'code': 200} Nov 23 19:42:14.479206 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4bf48ff4-ecfb-4168-8b63-249b8c6e9f04 None None] Pushing event updated for resources: {'Port': ['ID=56425014-3b47-41cc-b7b9-4b72d31ef8c6,revision_number=4']} {{(pid=102994) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 23 19:42:14.484857 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron_lib.callbacks.manager [None req-4bf48ff4-ecfb-4168-8b63-249b8c6e9f04 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7918660', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-15067', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560168', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8783631423946', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8783631008732', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8783631008750'] for port, after_update {{(pid=102994) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:42:14.536816 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4bf48ff4-ecfb-4168-8b63-249b8c6e9f04 None None] Pushing event updated for resources: {'Port': ['ID=7bdc59b0-f473-4d83-9bf7-b5700274a507,revision_number=5']} {{(pid=102994) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 23 19:42:14.681635 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0ec49970-e9ea-4cc1-9f8c-0fbd0b9b6a5a req-925e195c-65ba-4233-ad8a-39ed5f867f28 tempest-AttachVolumeNegativeTest-754998453 tempest-AttachVolumeNegativeTest-754998453-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102992) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:42:14.683125 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-0ec49970-e9ea-4cc1-9f8c-0fbd0b9b6a5a req-925e195c-65ba-4233-ad8a-39ed5f867f28 tempest-AttachVolumeNegativeTest-754998453 tempest-AttachVolumeNegativeTest-754998453-project] 10.222.0.62 "GET /v2.0/ports?device_id=4f9e5b06-00b6-4635-881c-06359237f669 HTTP/1.1" status: 200 len: 944 time: 0.0533962 Nov 23 19:42:14.730809 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-0ec49970-e9ea-4cc1-9f8c-0fbd0b9b6a5a req-8e73dceb-c888-4ecf-a72a-9f7f365b3cc4 tempest-AttachVolumeNegativeTest-754998453 tempest-AttachVolumeNegativeTest-754998453-project] 10.222.0.62 "GET /v2.0/security-groups?id=78a07d59-fd8e-4f94-9dfc-099d7d04efec&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0414600 Nov 23 19:42:14.812012 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.plugins.ml2.db [None req-4bf48ff4-ecfb-4168-8b63-249b8c6e9f04 None None] get_ports_and_sgs() called for port_ids ['56425014-3b47-41cc-b7b9-4b72d31ef8c6'] {{(pid=102994) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 23 19:42:14.812234 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d5386e3d-a9d6-4197-aa2b-4ffccc1964d6 req-165c47f1-804f-4079-b774-5f0b07a194a5 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102992) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:42:14.818253 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-d5386e3d-a9d6-4197-aa2b-4ffccc1964d6 req-165c47f1-804f-4079-b774-5f0b07a194a5 service neutron] 10.222.0.41 "GET /v2.0/ports?device_id=f48d7898-d8c9-4cfb-b340-c3a0d0009b87 HTTP/1.1" status: 200 len: 1098 time: 0.0409129 Nov 23 19:42:14.861900 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-d5386e3d-a9d6-4197-aa2b-4ffccc1964d6 req-a63b5d22-61a5-4b02-88f1-75fbe2e0b99b service neutron] 10.222.0.41 "GET /v2.0/security-groups?id=a6e2b133-1a9b-4dde-a188-1ce8bcdb7b5c&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0400963 Nov 23 19:42:14.972002 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1622e467-41e3-455e-804f-be4e30e18b7c req-1d6769c9-cae5-488c-87e0-d905bf8b33a2 tempest-TestVolumeBootPattern-147141705 tempest-TestVolumeBootPattern-147141705-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102993) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:42:14.973568 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-1622e467-41e3-455e-804f-be4e30e18b7c req-1d6769c9-cae5-488c-87e0-d905bf8b33a2 tempest-TestVolumeBootPattern-147141705 tempest-TestVolumeBootPattern-147141705-project] 10.222.0.62 "GET /v2.0/ports?device_id=f48d7898-d8c9-4cfb-b340-c3a0d0009b87 HTTP/1.1" status: 200 len: 945 time: 0.0484588 Nov 23 19:42:15.023179 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-1622e467-41e3-455e-804f-be4e30e18b7c req-1abe08f4-630f-46bf-b853-bcd7720041fb tempest-TestVolumeBootPattern-147141705 tempest-TestVolumeBootPattern-147141705-project] 10.222.0.62 "GET /v2.0/security-groups?id=a6e2b133-1a9b-4dde-a188-1ce8bcdb7b5c&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0428329 Nov 23 19:42:15.096104 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron_lib.callbacks.manager [None req-8346ef05-f685-4c3d-af3d-a159b683bec2 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8783631323329', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7978582'] for agent, after_update {{(pid=102994) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:42:15.850769 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4cc157a7-efc1-4229-b01c-30b021313ba5 req-3b97b924-04b6-4132-b569-1b6bf3d0378b tempest-AttachVolumeNegativeTest-754998453 tempest-AttachVolumeNegativeTest-754998453-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102993) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:42:15.852243 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-4cc157a7-efc1-4229-b01c-30b021313ba5 req-3b97b924-04b6-4132-b569-1b6bf3d0378b tempest-AttachVolumeNegativeTest-754998453 tempest-AttachVolumeNegativeTest-754998453-project] 10.222.0.62 "GET /v2.0/ports?device_id=4f9e5b06-00b6-4635-881c-06359237f669 HTTP/1.1" status: 200 len: 944 time: 0.0527811 Nov 23 19:42:15.898694 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-4cc157a7-efc1-4229-b01c-30b021313ba5 req-07e2cd7d-9bbe-41f6-97d5-b2f9153e4c17 tempest-AttachVolumeNegativeTest-754998453 tempest-AttachVolumeNegativeTest-754998453-project] 10.222.0.62 "GET /v2.0/security-groups?id=78a07d59-fd8e-4f94-9dfc-099d7d04efec&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0406044 Nov 23 19:42:16.143333 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3a0e1ade-7cd6-400b-bf6e-6bb1d09bed3a req-99f966b4-bdef-4183-babf-c5b14a0794b3 tempest-TestVolumeBootPattern-147141705 tempest-TestVolumeBootPattern-147141705-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102992) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:42:16.144765 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-3a0e1ade-7cd6-400b-bf6e-6bb1d09bed3a req-99f966b4-bdef-4183-babf-c5b14a0794b3 tempest-TestVolumeBootPattern-147141705 tempest-TestVolumeBootPattern-147141705-project] 10.222.0.62 "GET /v2.0/ports?device_id=f48d7898-d8c9-4cfb-b340-c3a0d0009b87 HTTP/1.1" status: 200 len: 945 time: 0.0507698 Nov 23 19:42:16.194620 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-3a0e1ade-7cd6-400b-bf6e-6bb1d09bed3a req-d9f56c05-671a-4d07-8265-9e89a5d647f5 tempest-TestVolumeBootPattern-147141705 tempest-TestVolumeBootPattern-147141705-project] 10.222.0.62 "GET /v2.0/security-groups?id=a6e2b133-1a9b-4dde-a188-1ce8bcdb7b5c&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0434012 Nov 23 19:42:16.588098 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron_lib.callbacks.manager [None req-785c1d26-11ba-42d8-b5a6-51a8b3daeef0 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8783631323329', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7978582'] for agent, after_update {{(pid=102994) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:42:17.012859 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bda55358-075e-4ee0-9bb0-7e2bb77509c3 req-311cdbcb-c882-4df4-a883-9984ab73a130 tempest-AttachVolumeNegativeTest-754998453 tempest-AttachVolumeNegativeTest-754998453-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102992) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:42:17.014358 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-bda55358-075e-4ee0-9bb0-7e2bb77509c3 req-311cdbcb-c882-4df4-a883-9984ab73a130 tempest-AttachVolumeNegativeTest-754998453 tempest-AttachVolumeNegativeTest-754998453-project] 10.222.0.62 "GET /v2.0/ports?device_id=4f9e5b06-00b6-4635-881c-06359237f669 HTTP/1.1" status: 200 len: 944 time: 0.0479105 Nov 23 19:42:17.059479 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-bda55358-075e-4ee0-9bb0-7e2bb77509c3 req-7b5f4b24-f558-4878-944c-093e87e8d3b3 tempest-AttachVolumeNegativeTest-754998453 tempest-AttachVolumeNegativeTest-754998453-project] 10.222.0.62 "GET /v2.0/security-groups?id=78a07d59-fd8e-4f94-9dfc-099d7d04efec&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0392544 Nov 23 19:42:17.313445 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-af5625a6-b76d-4dd5-a9b6-953b2853b725 req-9db404c2-fb81-4edd-85fe-bf1b67607926 tempest-TestVolumeBootPattern-147141705 tempest-TestVolumeBootPattern-147141705-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102993) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:42:17.314851 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-af5625a6-b76d-4dd5-a9b6-953b2853b725 req-9db404c2-fb81-4edd-85fe-bf1b67607926 tempest-TestVolumeBootPattern-147141705 tempest-TestVolumeBootPattern-147141705-project] 10.222.0.62 "GET /v2.0/ports?device_id=f48d7898-d8c9-4cfb-b340-c3a0d0009b87 HTTP/1.1" status: 200 len: 945 time: 0.0499628 Nov 23 19:42:17.363775 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-af5625a6-b76d-4dd5-a9b6-953b2853b725 req-e99b1032-0e7c-4740-baf8-43dbbbfd58b0 tempest-TestVolumeBootPattern-147141705 tempest-TestVolumeBootPattern-147141705-project] 10.222.0.62 "GET /v2.0/security-groups?id=a6e2b133-1a9b-4dde-a188-1ce8bcdb7b5c&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0425186 Nov 23 19:42:17.399090 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron_lib.callbacks.manager [None req-eb87b2c3-3339-4249-8b85-e695b5b4e1f9 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8783631323329', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7978582'] for agent, after_update {{(pid=102994) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:42:17.483306 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5cffb5a9-76db-4667-a81e-8f09857038c0 req-2e8b4f98-1b60-4cce-917e-3a206a8a0a45 tempest-TestVolumeBootPattern-147141705 tempest-TestVolumeBootPattern-147141705-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102992) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:42:17.484749 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-5cffb5a9-76db-4667-a81e-8f09857038c0 req-2e8b4f98-1b60-4cce-917e-3a206a8a0a45 tempest-TestVolumeBootPattern-147141705 tempest-TestVolumeBootPattern-147141705-project] 10.222.0.62 "GET /v2.0/ports?device_id=f48d7898-d8c9-4cfb-b340-c3a0d0009b87 HTTP/1.1" status: 200 len: 945 time: 0.0472751 Nov 23 19:42:17.537794 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-5cffb5a9-76db-4667-a81e-8f09857038c0 req-4c3081ec-8fcd-45c6-b7ea-d83f9f13c3e0 tempest-TestVolumeBootPattern-147141705 tempest-TestVolumeBootPattern-147141705-project] 10.222.0.62 "GET /v2.0/security-groups?id=a6e2b133-1a9b-4dde-a188-1ce8bcdb7b5c&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0459890 Nov 23 19:42:17.560896 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.wsgi [-] (102993) accepted ('10.222.0.62', 50814) {{(pid=102993) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 23 19:42:17.699500 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-d21a9357-1f17-46cc-8bdd-34590b588611 tempest-TestVolumeBootPattern-762853593 tempest-TestVolumeBootPattern-762853593-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102993) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:42:17.701003 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [None req-d21a9357-1f17-46cc-8bdd-34590b588611 tempest-TestVolumeBootPattern-762853593 tempest-TestVolumeBootPattern-762853593-project-admin] 10.222.0.62 "GET /v2.0/ports?device_id=f48d7898-d8c9-4cfb-b340-c3a0d0009b87 HTTP/1.1" status: 200 len: 1093 time: 0.1387954 Nov 23 19:42:17.703766 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.wsgi [-] (102993) accepted ('10.222.0.62', 50818) {{(pid=102993) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 23 19:42:17.708056 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.api.v2.base [None req-a0732154-069f-4c23-b2f8-3ceb763406fa tempest-TestVolumeBootPattern-147141705 tempest-TestVolumeBootPattern-147141705-project] Request body: {'floatingip': {'floating_network_id': 'a93e254e-aac9-4233-9e4d-4290fd0458e4', 'port_id': '7bdc59b0-f473-4d83-9bf7-b5700274a507', 'tenant_id': '257b0b2e531441b4bb745e99cfd799f3', 'fixed_ip_address': '172.20.0.6'}} {{(pid=102993) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 23 19:42:17.770720 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-a0732154-069f-4c23-b2f8-3ceb763406fa tempest-TestVolumeBootPattern-147141705 tempest-TestVolumeBootPattern-147141705-project] Publish callbacks [] for floatingip, before_create {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:42:17.871148 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-a0732154-069f-4c23-b2f8-3ceb763406fa tempest-TestVolumeBootPattern-147141705 tempest-TestVolumeBootPattern-147141705-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7921281'] for port, before_create {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:42:17.900256 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.plugins.ml2.rpc [None req-4bf48ff4-ecfb-4168-8b63-249b8c6e9f04 None None] Device 56425014-3b47-41cc-b7b9-4b72d31ef8c6 up at agent hyperv_hv-cinder-81901 {{(pid=102994) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 23 19:42:17.979867 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.db.db_base_plugin_common [None req-a0732154-069f-4c23-b2f8-3ceb763406fa tempest-TestVolumeBootPattern-147141705 tempest-TestVolumeBootPattern-147141705-project] Allocated IP 172.27.1.149 (a93e254e-aac9-4233-9e4d-4290fd0458e4/e0b32f3d-83d6-439a-bbed-01df7cf01051/ca397baf-e9c7-466c-9eb3-569e1097810f) {{(pid=102993) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 23 19:42:18.010694 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.db.provisioning_blocks [None req-4bf48ff4-ecfb-4168-8b63-249b8c6e9f04 None None] Provisioning for port 56425014-3b47-41cc-b7b9-4b72d31ef8c6 completed by entity L2. {{(pid=102994) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 23 19:42:18.014597 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.db.provisioning_blocks [None req-4bf48ff4-ecfb-4168-8b63-249b8c6e9f04 None None] Provisioning complete for port 56425014-3b47-41cc-b7b9-4b72d31ef8c6 triggered by entity L2. {{(pid=102994) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 23 19:42:18.014972 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron_lib.callbacks.manager [None req-4bf48ff4-ecfb-4168-8b63-249b8c6e9f04 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-8355713'] for port, provisioning_complete {{(pid=102994) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:42:18.080933 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-a0732154-069f-4c23-b2f8-3ceb763406fa tempest-TestVolumeBootPattern-147141705 tempest-TestVolumeBootPattern-147141705-project] Publish callbacks [] for port, precommit_create {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:42:18.093362 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron_lib.callbacks.manager [None req-4bf48ff4-ecfb-4168-8b63-249b8c6e9f04 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7921281'] for port, before_update {{(pid=102994) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:42:18.120530 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '4f9e5b06-00b6-4635-881c-06359237f669', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '56425014-3b47-41cc-b7b9-4b72d31ef8c6'}] {{(pid=102994) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 23 19:42:18.123078 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.62/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}09a7511da0d2ba1d728b27e36a8467ec5289399952f0059588048a7cb66d3a43" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-d3b3cfb8-9b99-48c8-b4ef-bb455cb31317" -d '{"events": [{"server_uuid": "4f9e5b06-00b6-4635-881c-06359237f669", "name": "network-vif-plugged", "status": "completed", "tag": "56425014-3b47-41cc-b7b9-4b72d31ef8c6"}]}' {{(pid=102994) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 23 19:42:18.136793 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.plugins.ml2.db [None req-4bf48ff4-ecfb-4168-8b63-249b8c6e9f04 None None] For port 56425014-3b47-41cc-b7b9-4b72d31ef8c6, host hv-cinder-81901, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81901',level=0,port_id=56425014-3b47-41cc-b7b9-4b72d31ef8c6,segment=NetworkSegment(a14a7aae-c481-4c86-92ee-f7808a54fd04),segment_id=a14a7aae-c481-4c86-92ee-f7808a54fd04)] {{(pid=102994) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 23 19:42:18.164059 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 23 Nov 2021 19:42:18 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-3d70545f-59eb-485f-80e2-f779cf4d469a x-openstack-request-id: req-3d70545f-59eb-485f-80e2-f779cf4d469a {{(pid=102994) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 23 19:42:18.164360 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "4f9e5b06-00b6-4635-881c-06359237f669", "name": "network-vif-plugged", "status": "completed", "tag": "56425014-3b47-41cc-b7b9-4b72d31ef8c6", "code": 200}]} {{(pid=102994) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 23 19:42:18.164639 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.62/compute/v2.1/os-server-external-events used request id req-3d70545f-59eb-485f-80e2-f779cf4d469a {{(pid=102994) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 23 19:42:18.165100 dv-cinder-819011-1-iscsi neutron-server[102994]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '4f9e5b06-00b6-4635-881c-06359237f669', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '56425014-3b47-41cc-b7b9-4b72d31ef8c6', 'code': 200} Nov 23 19:42:18.177392 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-a0732154-069f-4c23-b2f8-3ceb763406fa tempest-TestVolumeBootPattern-147141705 tempest-TestVolumeBootPattern-147141705-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7918660', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-15067', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560168', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8783631008714', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-17257496'] for port, after_create {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:42:18.179074 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b7c96125-f558-4414-abd3-4518e579ff8d req-e8498956-76fc-47a9-b494-80b2d53ecc80 tempest-AttachVolumeNegativeTest-754998453 tempest-AttachVolumeNegativeTest-754998453-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102992) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:42:18.180619 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-b7c96125-f558-4414-abd3-4518e579ff8d req-e8498956-76fc-47a9-b494-80b2d53ecc80 tempest-AttachVolumeNegativeTest-754998453 tempest-AttachVolumeNegativeTest-754998453-project] 10.222.0.62 "GET /v2.0/ports?device_id=4f9e5b06-00b6-4635-881c-06359237f669 HTTP/1.1" status: 200 len: 944 time: 0.0523579 Nov 23 19:42:18.205707 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron_lib.callbacks.manager [None req-4bf48ff4-ecfb-4168-8b63-249b8c6e9f04 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7918660', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-15067', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560168', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8783631423946', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8783631008732', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8783631008750'] for port, after_update {{(pid=102994) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:42:18.217044 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-a0732154-069f-4c23-b2f8-3ceb763406fa tempest-TestVolumeBootPattern-147141705 tempest-TestVolumeBootPattern-147141705-project] Network a93e254e-aac9-4233-9e4d-4290fd0458e4 is already hosted by enough agents. {{(pid=102993) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 23 19:42:18.222132 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.scheduler.base_scheduler [None req-a0732154-069f-4c23-b2f8-3ceb763406fa tempest-TestVolumeBootPattern-147141705 tempest-TestVolumeBootPattern-147141705-project] Resources bound (agent type, host, resource id): {{(pid=102993) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 23 19:42:18.226737 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.db.l3_dvrscheduler_db [None req-a0732154-069f-4c23-b2f8-3ceb763406fa tempest-TestVolumeBootPattern-147141705 tempest-TestVolumeBootPattern-147141705-project] Received port after_create {{(pid=102993) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 23 19:42:18.240388 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-b7c96125-f558-4414-abd3-4518e579ff8d req-1d12aef1-482f-46cc-a493-70df86ed15e7 tempest-AttachVolumeNegativeTest-754998453 tempest-AttachVolumeNegativeTest-754998453-project] 10.222.0.62 "GET /v2.0/security-groups?id=78a07d59-fd8e-4f94-9dfc-099d7d04efec&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0503929 Nov 23 19:42:18.256351 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a0732154-069f-4c23-b2f8-3ceb763406fa tempest-TestVolumeBootPattern-147141705 tempest-TestVolumeBootPattern-147141705-project] Pushing event updated for resources: {'Port': ['ID=ca397baf-e9c7-466c-9eb3-569e1097810f,revision_number=1']} {{(pid=102993) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 23 19:42:18.271739 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a0732154-069f-4c23-b2f8-3ceb763406fa tempest-TestVolumeBootPattern-147141705 tempest-TestVolumeBootPattern-147141705-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-819011-1-iscsi {{(pid=102993) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 23 19:42:18.272097 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a0732154-069f-4c23-b2f8-3ceb763406fa tempest-TestVolumeBootPattern-147141705 tempest-TestVolumeBootPattern-147141705-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-819011-1-iscsi {{(pid=102993) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 23 19:42:18.272439 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a0732154-069f-4c23-b2f8-3ceb763406fa tempest-TestVolumeBootPattern-147141705 tempest-TestVolumeBootPattern-147141705-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-819011-1-iscsi {{(pid=102993) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 23 19:42:18.272779 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a0732154-069f-4c23-b2f8-3ceb763406fa tempest-TestVolumeBootPattern-147141705 tempest-TestVolumeBootPattern-147141705-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-819011-1-iscsi {{(pid=102993) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 23 19:42:18.273124 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a0732154-069f-4c23-b2f8-3ceb763406fa tempest-TestVolumeBootPattern-147141705 tempest-TestVolumeBootPattern-147141705-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-819011-1-iscsi {{(pid=102993) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 23 19:42:18.273479 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a0732154-069f-4c23-b2f8-3ceb763406fa tempest-TestVolumeBootPattern-147141705 tempest-TestVolumeBootPattern-147141705-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-819011-1-iscsi {{(pid=102993) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 23 19:42:18.273814 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a0732154-069f-4c23-b2f8-3ceb763406fa tempest-TestVolumeBootPattern-147141705 tempest-TestVolumeBootPattern-147141705-project] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-819011-1-iscsi {{(pid=102993) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 23 19:42:18.274146 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a0732154-069f-4c23-b2f8-3ceb763406fa tempest-TestVolumeBootPattern-147141705 tempest-TestVolumeBootPattern-147141705-project] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-819011-1-iscsi {{(pid=102993) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 23 19:42:18.274474 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a0732154-069f-4c23-b2f8-3ceb763406fa tempest-TestVolumeBootPattern-147141705 tempest-TestVolumeBootPattern-147141705-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-819011-1-iscsi {{(pid=102993) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 23 19:42:18.274800 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a0732154-069f-4c23-b2f8-3ceb763406fa tempest-TestVolumeBootPattern-147141705 tempest-TestVolumeBootPattern-147141705-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-819011-1-iscsi {{(pid=102993) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 23 19:42:18.275126 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a0732154-069f-4c23-b2f8-3ceb763406fa tempest-TestVolumeBootPattern-147141705 tempest-TestVolumeBootPattern-147141705-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-819011-1-iscsi {{(pid=102993) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 23 19:42:18.275447 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a0732154-069f-4c23-b2f8-3ceb763406fa tempest-TestVolumeBootPattern-147141705 tempest-TestVolumeBootPattern-147141705-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-819011-1-iscsi {{(pid=102993) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 23 19:42:18.276491 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4bf48ff4-ecfb-4168-8b63-249b8c6e9f04 None None] Pushing event updated for resources: {'Port': ['ID=56425014-3b47-41cc-b7b9-4b72d31ef8c6,revision_number=5']} {{(pid=102994) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 23 19:42:18.530292 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-441e9a52-bf81-4fc9-91eb-dc401361001d req-60b3e28c-ca41-4f14-867d-bcb0559516f0 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102992) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:42:18.531809 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-441e9a52-bf81-4fc9-91eb-dc401361001d req-60b3e28c-ca41-4f14-867d-bcb0559516f0 service neutron] 10.222.0.41 "GET /v2.0/ports?device_id=4f9e5b06-00b6-4635-881c-06359237f669 HTTP/1.1" status: 200 len: 1098 time: 0.0430448 Nov 23 19:42:18.578701 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-441e9a52-bf81-4fc9-91eb-dc401361001d req-d4dd16ec-f63f-48c6-bb2b-ca4859587c8f service neutron] 10.222.0.41 "GET /v2.0/security-groups?id=78a07d59-fd8e-4f94-9dfc-099d7d04efec&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0379512 Nov 23 19:42:18.617838 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-a0732154-069f-4c23-b2f8-3ceb763406fa tempest-TestVolumeBootPattern-147141705 tempest-TestVolumeBootPattern-147141705-project] Publish callbacks [] for floatingip, precommit_create {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:42:18.732206 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-a0732154-069f-4c23-b2f8-3ceb763406fa tempest-TestVolumeBootPattern-147141705 tempest-TestVolumeBootPattern-147141705-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7921281'] for port, before_update {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:42:18.880608 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-a0732154-069f-4c23-b2f8-3ceb763406fa tempest-TestVolumeBootPattern-147141705 tempest-TestVolumeBootPattern-147141705-project] Publish callbacks [] for port, precommit_update {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:42:18.930630 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-a0732154-069f-4c23-b2f8-3ceb763406fa tempest-TestVolumeBootPattern-147141705 tempest-TestVolumeBootPattern-147141705-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7918660', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-15067', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560168', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8783631423946', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8783631008732', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8783631008750', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-17257505'] for port, after_update {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:42:19.001330 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a0732154-069f-4c23-b2f8-3ceb763406fa tempest-TestVolumeBootPattern-147141705 tempest-TestVolumeBootPattern-147141705-project] Pushing event updated for resources: {'Port': ['ID=ca397baf-e9c7-466c-9eb3-569e1097810f,revision_number=2']} {{(pid=102993) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 23 19:42:19.013858 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-a0732154-069f-4c23-b2f8-3ceb763406fa tempest-TestVolumeBootPattern-147141705 tempest-TestVolumeBootPattern-147141705-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-926531'] for floatingip, after_create {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:42:19.116528 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.db.l3_db [None req-a0732154-069f-4c23-b2f8-3ceb763406fa tempest-TestVolumeBootPattern-147141705 tempest-TestVolumeBootPattern-147141705-project] Floating IP fa062c57-8451-4677-b877-05a9e7e1495a associated. External IP: 172.27.1.149, port: 7bdc59b0-f473-4d83-9bf7-b5700274a507. Nov 23 19:42:19.328047 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-a0732154-069f-4c23-b2f8-3ceb763406fa tempest-TestVolumeBootPattern-147141705 tempest-TestVolumeBootPattern-147141705-project] Router 0534bcc4-1e12-4026-90ce-1406543c7662 has already been hosted by L3 agent 1b20f2c4-70b6-43c3-b9bd-0062cc9e57ac {{(pid=102993) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 23 19:42:19.360328 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-253c984e-c0e7-4c83-b16d-529326247085 req-1af71f10-4576-45fe-b54e-61f8d84cc719 tempest-AttachVolumeNegativeTest-754998453 tempest-AttachVolumeNegativeTest-754998453-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102992) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:42:19.361868 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-253c984e-c0e7-4c83-b16d-529326247085 req-1af71f10-4576-45fe-b54e-61f8d84cc719 tempest-AttachVolumeNegativeTest-754998453 tempest-AttachVolumeNegativeTest-754998453-project] 10.222.0.62 "GET /v2.0/ports?device_id=4f9e5b06-00b6-4635-881c-06359237f669 HTTP/1.1" status: 200 len: 945 time: 0.0523381 Nov 23 19:42:19.410138 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-253c984e-c0e7-4c83-b16d-529326247085 req-6853c620-3b0d-4292-9081-8de45ca367ca tempest-AttachVolumeNegativeTest-754998453 tempest-AttachVolumeNegativeTest-754998453-project] 10.222.0.62 "GET /v2.0/security-groups?id=78a07d59-fd8e-4f94-9dfc-099d7d04efec&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0416820 Nov 23 19:42:19.436076 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-a0732154-069f-4c23-b2f8-3ceb763406fa tempest-TestVolumeBootPattern-147141705 tempest-TestVolumeBootPattern-147141705-project] Notify agent at l3_agent.dv-cinder-819011-1-iscsi the message routers_updated {{(pid=102993) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 23 19:42:19.447078 dv-cinder-819011-1-iscsi neutron-server[102995]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-7ed0ea9d-d62e-4ccf-8e54-1a8279fc51df None None] Sync routers for ids ['0534bcc4-1e12-4026-90ce-1406543c7662'] in dv-cinder-819011-1-iscsi {{(pid=102995) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 23 19:42:19.458396 dv-cinder-819011-1-iscsi neutron-server[102995]: DEBUG neutron.db.l3_dvrscheduler_db [None req-7ed0ea9d-d62e-4ccf-8e54-1a8279fc51df None None] Routers {'0534bcc4-1e12-4026-90ce-1406543c7662'} bound to L3 agent in host dv-cinder-819011-1-iscsi {{(pid=102995) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 23 19:42:19.459007 dv-cinder-819011-1-iscsi neutron-server[102995]: DEBUG neutron.db.l3_hamode_db [None req-7ed0ea9d-d62e-4ccf-8e54-1a8279fc51df None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-819011-1-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 6, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 6},created_at=2021-11-23T19:25:14Z,description=,heartbeat_timestamp=2021-11-23T19:42:14Z,host='dv-cinder-819011-1-iscsi',id=1b20f2c4-70b6-43c3-b9bd-0062cc9e57ac,load=0,resource_versions=,resources_synced=,started_at=2021-11-23T19:25:15Z,topic='l3_agent')) {'router_ids': ['0534bcc4-1e12-4026-90ce-1406543c7662'], 'active': True} {{(pid=102995) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 23 19:42:19.527196 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-a0732154-069f-4c23-b2f8-3ceb763406fa tempest-TestVolumeBootPattern-147141705 tempest-TestVolumeBootPattern-147141705-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-514902'] for floatingip, before_response {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:42:19.554831 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [None req-a0732154-069f-4c23-b2f8-3ceb763406fa tempest-TestVolumeBootPattern-147141705 tempest-TestVolumeBootPattern-147141705-project] 10.222.0.62 "POST /v2.0/floatingips HTTP/1.1" status: 201 len: 996 time: 1.8500388 Nov 23 19:42:19.555433 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'f48d7898-d8c9-4cfb-b340-c3a0d0009b87', 'tag': '7bdc59b0-f473-4d83-9bf7-b5700274a507'}] {{(pid=102993) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 23 19:42:19.557770 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.62/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}9b10b92acbee16fb695be1efeed0b68f7c36a5b215ec004a8d9d707fa3d35b2c" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-0ce7a842-d857-40f7-ab28-cc92bd3f07a3" -d '{"events": [{"name": "network-changed", "server_uuid": "f48d7898-d8c9-4cfb-b340-c3a0d0009b87", "tag": "7bdc59b0-f473-4d83-9bf7-b5700274a507"}]}' {{(pid=102993) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 23 19:42:19.597022 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Tue, 23 Nov 2021 19:42:19 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-ab466ee2-edac-402f-b282-6f91b80bb3f4 x-openstack-request-id: req-ab466ee2-edac-402f-b282-6f91b80bb3f4 {{(pid=102993) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 23 19:42:19.597319 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "f48d7898-d8c9-4cfb-b340-c3a0d0009b87", "tag": "7bdc59b0-f473-4d83-9bf7-b5700274a507", "status": "completed", "code": 200}]} {{(pid=102993) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 23 19:42:19.597619 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.62/compute/v2.1/os-server-external-events used request id req-ab466ee2-edac-402f-b282-6f91b80bb3f4 {{(pid=102993) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 23 19:42:19.598027 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'f48d7898-d8c9-4cfb-b340-c3a0d0009b87', 'tag': '7bdc59b0-f473-4d83-9bf7-b5700274a507', 'status': 'completed', 'code': 200} Nov 23 19:42:19.665731 dv-cinder-819011-1-iscsi neutron-server[102995]: DEBUG neutron.db.l3_dvr_db [None req-7ed0ea9d-d62e-4ccf-8e54-1a8279fc51df None None] Set router 0534bcc4-1e12-4026-90ce-1406543c7662 gateway port host: dv-cinder-819011-1-iscsi {{(pid=102995) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 23 19:42:19.676788 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0ce7a842-d857-40f7-ab28-cc92bd3f07a3 req-32fb6b23-749f-4085-b8b9-64a0da4824a3 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102992) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:42:19.678328 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-0ce7a842-d857-40f7-ab28-cc92bd3f07a3 req-32fb6b23-749f-4085-b8b9-64a0da4824a3 service neutron] 10.222.0.41 "GET /v2.0/ports?tenant_id=257b0b2e531441b4bb745e99cfd799f3&device_id=f48d7898-d8c9-4cfb-b340-c3a0d0009b87 HTTP/1.1" status: 200 len: 1098 time: 0.0408216 Nov 23 19:42:19.780635 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0ce7a842-d857-40f7-ab28-cc92bd3f07a3 req-7917fdb0-bc44-404e-a3cc-5ea522efc040 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102992) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:42:19.782141 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-0ce7a842-d857-40f7-ab28-cc92bd3f07a3 req-7917fdb0-bc44-404e-a3cc-5ea522efc040 service neutron] 10.222.0.41 "GET /v2.0/networks?id=226a519f-5f3e-4d80-bb8a-0e9fc4f64828 HTTP/1.1" status: 200 len: 911 time: 0.0876603 Nov 23 19:42:19.869346 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-0ce7a842-d857-40f7-ab28-cc92bd3f07a3 req-36b11de8-08b1-4f18-a68b-d458d7ed5398 service neutron] 10.222.0.41 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.6&port_id=7bdc59b0-f473-4d83-9bf7-b5700274a507 HTTP/1.1" status: 200 len: 999 time: 0.0702507 Nov 23 19:42:19.889837 dv-cinder-819011-1-iscsi neutron-server[102995]: DEBUG neutron.db.l3_hamode_db [None req-7ed0ea9d-d62e-4ccf-8e54-1a8279fc51df None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '0534bcc4-1e12-4026-90ce-1406543c7662', 'name': 'tempest-TestVolumeBootPattern-84632531-router', 'tenant_id': '257b0b2e531441b4bb745e99cfd799f3', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'a93e254e-aac9-4233-9e4d-4290fd0458e4', 'external_fixed_ips': [{'subnet_id': 'e0b32f3d-83d6-439a-bbed-01df7cf01051', 'ip_address': '172.27.1.154'}], 'enable_snat': True}, 'gw_port_id': 'c7996293-6188-4690-b614-395448e4dc25', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-23T19:35:29Z', 'updated_at': '2021-11-23T19:35:33Z', 'revision_number': 4, 'project_id': '257b0b2e531441b4bb745e99cfd799f3', 'gw_port': {'id': 'c7996293-6188-4690-b614-395448e4dc25', 'name': '', 'network_id': 'a93e254e-aac9-4233-9e4d-4290fd0458e4', 'tenant_id': '', 'mac_address': 'fa:16:3e:52:67:5e', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '0534bcc4-1e12-4026-90ce-1406543c7662', 'device_owner': 'network:router_gateway', 'standard_attr_id': 392, 'fixed_ips': [{'subnet_id': 'e0b32f3d-83d6-439a-bbed-01df7cf01051', 'ip_address': '172.27.1.154', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-819011-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-23T19:35:30Z', 'updated_at': '2021-11-23T19:35:34Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'e0b32f3d-83d6-439a-bbed-01df7cf01051', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-819011-1-iscsi', '_floatingips': [{'id': 'ea09a7d4-0775-4bc6-9310-f47e8ee059db', 'tenant_id': '257b0b2e531441b4bb745e99cfd799f3', 'floating_ip_address': '172.27.1.127', 'floating_network_id': 'a93e254e-aac9-4233-9e4d-4290fd0458e4', 'router_id': '0534bcc4-1e12-4026-90ce-1406543c7662', 'port_id': '3f7db100-6209-44d3-88c7-906fb1cec5cb', 'fixed_ip_address': '172.20.0.13', 'status': 'ACTIVE', 'standard_attr_id': 593, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '226a519f-5f3e-4d80-bb8a-0e9fc4f64828', 'mac_address': 'fa:16:3e:27:ae:a3', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '9e64d320-821f-4313-8dd0-3b327ba75634', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-23T19:39:56Z', 'updated_at': '2021-11-23T19:39:59Z', 'revision_number': 1, 'project_id': '257b0b2e531441b4bb745e99cfd799f3', 'fixed_ip_address_scope': None}, {'id': 'fa062c57-8451-4677-b877-05a9e7e1495a', 'tenant_id': '257b0b2e531441b4bb745e99cfd799f3', 'floating_ip_address': '172.27.1.149', 'floating_network_id': 'a93e254e-aac9-4233-9e4d-4290fd0458e4', 'router_id': '0534bcc4-1e12-4026-90ce-1406543c7662', 'port_id': '7bdc59b0-f473-4d83-9bf7-b5700274a507', 'fixed_ip_address': '172.20.0.6', 'status': 'DOWN', 'standard_attr_id': 615, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '226a519f-5f3e-4d80-bb8a-0e9fc4f64828', 'mac_address': 'fa:16:3e:fd:cc:68', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'f48d7898-d8c9-4cfb-b340-c3a0d0009b87', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-23T19:42:18Z', 'updated_at': '2021-11-23T19:42:18Z', 'revision_number': 0, 'project_id': '257b0b2e531441b4bb745e99cfd799f3', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '854821af-61e0-47e7-a603-95f500a49030', 'name': '', 'network_id': '226a519f-5f3e-4d80-bb8a-0e9fc4f64828', 'tenant_id': '257b0b2e531441b4bb745e99cfd799f3', 'mac_address': 'fa:16:3e:90:11:65', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '0534bcc4-1e12-4026-90ce-1406543c7662', 'device_owner': 'network:router_interface', 'standard_attr_id': 393, 'fixed_ips': [{'subnet_id': '88de785d-c540-4651-af1e-26f27ccaee3c', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-819011-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-23T19:35:32Z', 'updated_at': '2021-11-23T19:35:37Z', 'revision_number': 5, 'project_id': '257b0b2e531441b4bb745e99cfd799f3', 'subnets': [{'id': '88de785d-c540-4651-af1e-26f27ccaee3c', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-819011-1-iscsi', False) {} {{(pid=102995) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 23 19:42:19.915725 dv-cinder-819011-1-iscsi neutron-server[102995]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-7ed0ea9d-d62e-4ccf-8e54-1a8279fc51df None None] Checking router: 0534bcc4-1e12-4026-90ce-1406543c7662 for host: dv-cinder-819011-1-iscsi {{(pid=102995) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 23 19:42:19.919998 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0ce7a842-d857-40f7-ab28-cc92bd3f07a3 req-63074dae-801e-4914-b7ca-84802b735a12 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102992) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:42:19.921395 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-0ce7a842-d857-40f7-ab28-cc92bd3f07a3 req-63074dae-801e-4914-b7ca-84802b735a12 service neutron] 10.222.0.41 "GET /v2.0/subnets?id=88de785d-c540-4651-af1e-26f27ccaee3c HTTP/1.1" status: 200 len: 849 time: 0.0444863 Nov 23 19:42:19.923802 dv-cinder-819011-1-iscsi neutron-server[102995]: DEBUG neutron.db.l3_dvrscheduler_db [None req-7ed0ea9d-d62e-4ccf-8e54-1a8279fc51df None None] Routers {'0534bcc4-1e12-4026-90ce-1406543c7662'} bound to L3 agent in host dv-cinder-819011-1-iscsi {{(pid=102995) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 23 19:42:19.924401 dv-cinder-819011-1-iscsi neutron-server[102995]: DEBUG neutron.db.l3_hamode_db [None req-7ed0ea9d-d62e-4ccf-8e54-1a8279fc51df None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-819011-1-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 6, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 6},created_at=2021-11-23T19:25:14Z,description=,heartbeat_timestamp=2021-11-23T19:42:14Z,host='dv-cinder-819011-1-iscsi',id=1b20f2c4-70b6-43c3-b9bd-0062cc9e57ac,load=0,resource_versions=,resources_synced=,started_at=2021-11-23T19:25:15Z,topic='l3_agent')) {'router_ids': ['0534bcc4-1e12-4026-90ce-1406543c7662'], 'active': True} {{(pid=102995) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 23 19:42:19.987105 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0ce7a842-d857-40f7-ab28-cc92bd3f07a3 req-aa208465-cbf1-431a-ab9c-4b7abe34460f service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102992) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:42:19.988629 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-0ce7a842-d857-40f7-ab28-cc92bd3f07a3 req-aa208465-cbf1-431a-ab9c-4b7abe34460f service neutron] 10.222.0.41 "GET /v2.0/ports?network_id=226a519f-5f3e-4d80-bb8a-0e9fc4f64828&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0466211 Nov 23 19:42:20.031506 dv-cinder-819011-1-iscsi neutron-server[102995]: DEBUG neutron.db.l3_dvr_db [None req-7ed0ea9d-d62e-4ccf-8e54-1a8279fc51df None None] Set router 0534bcc4-1e12-4026-90ce-1406543c7662 gateway port host: dv-cinder-819011-1-iscsi {{(pid=102995) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 23 19:42:20.098842 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-0ce7a842-d857-40f7-ab28-cc92bd3f07a3 req-e7748a39-e44c-4e7e-8b78-68115fbb088c service neutron] 10.222.0.41 "GET /v2.0/networks/226a519f-5f3e-4d80-bb8a-0e9fc4f64828?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0846660 Nov 23 19:42:20.196990 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-0ce7a842-d857-40f7-ab28-cc92bd3f07a3 req-1ad977bb-55d4-4895-9920-99bdeb1cab96 service neutron] 10.222.0.41 "GET /v2.0/networks/226a519f-5f3e-4d80-bb8a-0e9fc4f64828?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0865865 Nov 23 19:42:20.259148 dv-cinder-819011-1-iscsi neutron-server[102995]: DEBUG neutron.db.l3_hamode_db [None req-7ed0ea9d-d62e-4ccf-8e54-1a8279fc51df None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '0534bcc4-1e12-4026-90ce-1406543c7662', 'name': 'tempest-TestVolumeBootPattern-84632531-router', 'tenant_id': '257b0b2e531441b4bb745e99cfd799f3', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'a93e254e-aac9-4233-9e4d-4290fd0458e4', 'external_fixed_ips': [{'subnet_id': 'e0b32f3d-83d6-439a-bbed-01df7cf01051', 'ip_address': '172.27.1.154'}], 'enable_snat': True}, 'gw_port_id': 'c7996293-6188-4690-b614-395448e4dc25', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-23T19:35:29Z', 'updated_at': '2021-11-23T19:35:33Z', 'revision_number': 4, 'project_id': '257b0b2e531441b4bb745e99cfd799f3', 'gw_port': {'id': 'c7996293-6188-4690-b614-395448e4dc25', 'name': '', 'network_id': 'a93e254e-aac9-4233-9e4d-4290fd0458e4', 'tenant_id': '', 'mac_address': 'fa:16:3e:52:67:5e', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '0534bcc4-1e12-4026-90ce-1406543c7662', 'device_owner': 'network:router_gateway', 'standard_attr_id': 392, 'fixed_ips': [{'subnet_id': 'e0b32f3d-83d6-439a-bbed-01df7cf01051', 'ip_address': '172.27.1.154', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-819011-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-23T19:35:30Z', 'updated_at': '2021-11-23T19:35:34Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'e0b32f3d-83d6-439a-bbed-01df7cf01051', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-819011-1-iscsi', '_floatingips': [{'id': 'ea09a7d4-0775-4bc6-9310-f47e8ee059db', 'tenant_id': '257b0b2e531441b4bb745e99cfd799f3', 'floating_ip_address': '172.27.1.127', 'floating_network_id': 'a93e254e-aac9-4233-9e4d-4290fd0458e4', 'router_id': '0534bcc4-1e12-4026-90ce-1406543c7662', 'port_id': '3f7db100-6209-44d3-88c7-906fb1cec5cb', 'fixed_ip_address': '172.20.0.13', 'status': 'ACTIVE', 'standard_attr_id': 593, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '226a519f-5f3e-4d80-bb8a-0e9fc4f64828', 'mac_address': 'fa:16:3e:27:ae:a3', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '9e64d320-821f-4313-8dd0-3b327ba75634', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-23T19:39:56Z', 'updated_at': '2021-11-23T19:39:59Z', 'revision_number': 1, 'project_id': '257b0b2e531441b4bb745e99cfd799f3', 'fixed_ip_address_scope': None}, {'id': 'fa062c57-8451-4677-b877-05a9e7e1495a', 'tenant_id': '257b0b2e531441b4bb745e99cfd799f3', 'floating_ip_address': '172.27.1.149', 'floating_network_id': 'a93e254e-aac9-4233-9e4d-4290fd0458e4', 'router_id': '0534bcc4-1e12-4026-90ce-1406543c7662', 'port_id': '7bdc59b0-f473-4d83-9bf7-b5700274a507', 'fixed_ip_address': '172.20.0.6', 'status': 'DOWN', 'standard_attr_id': 615, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '226a519f-5f3e-4d80-bb8a-0e9fc4f64828', 'mac_address': 'fa:16:3e:fd:cc:68', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'f48d7898-d8c9-4cfb-b340-c3a0d0009b87', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-23T19:42:18Z', 'updated_at': '2021-11-23T19:42:18Z', 'revision_number': 0, 'project_id': '257b0b2e531441b4bb745e99cfd799f3', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '854821af-61e0-47e7-a603-95f500a49030', 'name': '', 'network_id': '226a519f-5f3e-4d80-bb8a-0e9fc4f64828', 'tenant_id': '257b0b2e531441b4bb745e99cfd799f3', 'mac_address': 'fa:16:3e:90:11:65', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '0534bcc4-1e12-4026-90ce-1406543c7662', 'device_owner': 'network:router_interface', 'standard_attr_id': 393, 'fixed_ips': [{'subnet_id': '88de785d-c540-4651-af1e-26f27ccaee3c', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-819011-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-23T19:35:32Z', 'updated_at': '2021-11-23T19:35:37Z', 'revision_number': 5, 'project_id': '257b0b2e531441b4bb745e99cfd799f3', 'subnets': [{'id': '88de785d-c540-4651-af1e-26f27ccaee3c', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-819011-1-iscsi', False) {} {{(pid=102995) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 23 19:42:20.285020 dv-cinder-819011-1-iscsi neutron-server[102995]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-7ed0ea9d-d62e-4ccf-8e54-1a8279fc51df None None] The sync data for ids ['0534bcc4-1e12-4026-90ce-1406543c7662'] in dv-cinder-819011-1-iscsi is: [{'id': '0534bcc4-1e12-4026-90ce-1406543c7662', 'name': 'tempest-TestVolumeBootPattern-84632531-router', 'tenant_id': '257b0b2e531441b4bb745e99cfd799f3', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'a93e254e-aac9-4233-9e4d-4290fd0458e4', 'external_fixed_ips': [{'subnet_id': 'e0b32f3d-83d6-439a-bbed-01df7cf01051', 'ip_address': '172.27.1.154'}], 'enable_snat': True}, 'gw_port_id': 'c7996293-6188-4690-b614-395448e4dc25', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-23T19:35:29Z', 'updated_at': '2021-11-23T19:35:33Z', 'revision_number': 4, 'project_id': '257b0b2e531441b4bb745e99cfd799f3', 'gw_port': {'id': 'c7996293-6188-4690-b614-395448e4dc25', 'name': '', 'network_id': 'a93e254e-aac9-4233-9e4d-4290fd0458e4', 'tenant_id': '', 'mac_address': 'fa:16:3e:52:67:5e', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '0534bcc4-1e12-4026-90ce-1406543c7662', 'device_owner': 'network:router_gateway', 'standard_attr_id': 392, 'fixed_ips': [{'subnet_id': 'e0b32f3d-83d6-439a-bbed-01df7cf01051', 'ip_address': '172.27.1.154', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-819011-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-23T19:35:30Z', 'updated_at': '2021-11-23T19:35:34Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'e0b32f3d-83d6-439a-bbed-01df7cf01051', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-819011-1-iscsi', '_floatingips': [{'id': 'ea09a7d4-0775-4bc6-9310-f47e8ee059db', 'tenant_id': '257b0b2e531441b4bb745e99cfd799f3', 'floating_ip_address': '172.27.1.127', 'floating_network_id': 'a93e254e-aac9-4233-9e4d-4290fd0458e4', 'router_id': '0534bcc4-1e12-4026-90ce-1406543c7662', 'port_id': '3f7db100-6209-44d3-88c7-906fb1cec5cb', 'fixed_ip_address': '172.20.0.13', 'status': 'ACTIVE', 'standard_attr_id': 593, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '226a519f-5f3e-4d80-bb8a-0e9fc4f64828', 'mac_address': 'fa:16:3e:27:ae:a3', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '9e64d320-821f-4313-8dd0-3b327ba75634', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-23T19:39:56Z', 'updated_at': '2021-11-23T19:39:59Z', 'revision_number': 1, 'project_id': '257b0b2e531441b4bb745e99cfd799f3', 'fixed_ip_address_scope': None}, {'id': 'fa062c57-8451-4677-b877-05a9e7e1495a', 'tenant_id': '257b0b2e531441b4bb745e99cfd799f3', 'floating_ip_address': '172.27.1.149', 'floating_network_id': 'a93e254e-aac9-4233-9e4d-4290fd0458e4', 'router_id': '0534bcc4-1e12-4026-90ce-1406543c7662', 'port_id': '7bdc59b0-f473-4d83-9bf7-b5700274a507', 'fixed_ip_address': '172.20.0.6', 'status': 'DOWN', 'standard_attr_id': 615, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '226a519f-5f3e-4d80-bb8a-0e9fc4f64828', 'mac_address': 'fa:16:3e:fd:cc:68', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'f48d7898-d8c9-4cfb-b340-c3a0d0009b87', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-23T19:42:18Z', 'updated_at': '2021-11-23T19:42:18Z', 'revision_number': 0, 'project_id': '257b0b2e531441b4bb745e99cfd799f3', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '854821af-61e0-47e7-a603-95f500a49030', 'name': '', 'network_id': '226a519f-5f3e-4d80-bb8a-0e9fc4f64828', 'tenant_id': '257b0b2e531441b4bb745e99cfd799f3', 'mac_address': 'fa:16:3e:90:11:65', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '0534bcc4-1e12-4026-90ce-1406543c7662', 'device_owner': 'network:router_interface', 'standard_attr_id': 393, 'fixed_ips': [{'subnet_id': '88de785d-c540-4651-af1e-26f27ccaee3c', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-819011-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-23T19:35:32Z', 'updated_at': '2021-11-23T19:35:37Z', 'revision_number': 5, 'project_id': '257b0b2e531441b4bb745e99cfd799f3', 'subnets': [{'id': '88de785d-c540-4651-af1e-26f27ccaee3c', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=102995) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 23 19:42:20.494911 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-8503cd5e-d088-401b-9684-e0aaddf14bc0 None None] New status for floating IP fa062c57-8451-4677-b877-05a9e7e1495a: ACTIVE {{(pid=102994) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Nov 23 19:42:20.542673 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-66f19898-13e0-45b7-a511-b67815854fa1 req-14ab2651-733e-4900-83b1-7a7382380c17 tempest-AttachVolumeNegativeTest-754998453 tempest-AttachVolumeNegativeTest-754998453-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102993) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:42:20.544199 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-66f19898-13e0-45b7-a511-b67815854fa1 req-14ab2651-733e-4900-83b1-7a7382380c17 tempest-AttachVolumeNegativeTest-754998453 tempest-AttachVolumeNegativeTest-754998453-project] 10.222.0.62 "GET /v2.0/ports?device_id=4f9e5b06-00b6-4635-881c-06359237f669 HTTP/1.1" status: 200 len: 945 time: 0.0571640 Nov 23 19:42:20.595498 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-66f19898-13e0-45b7-a511-b67815854fa1 req-e7918dc2-9986-4640-bb6c-37359b0dd11e tempest-AttachVolumeNegativeTest-754998453 tempest-AttachVolumeNegativeTest-754998453-project] 10.222.0.62 "GET /v2.0/security-groups?id=78a07d59-fd8e-4f94-9dfc-099d7d04efec&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0451310 Nov 23 19:42:21.712796 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-66b49b31-80f4-445b-a872-a865074fd743 req-a047aa15-dd0d-4ff9-949d-41f4e0f262dc tempest-AttachVolumeNegativeTest-754998453 tempest-AttachVolumeNegativeTest-754998453-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102993) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:42:21.714271 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-66b49b31-80f4-445b-a872-a865074fd743 req-a047aa15-dd0d-4ff9-949d-41f4e0f262dc tempest-AttachVolumeNegativeTest-754998453 tempest-AttachVolumeNegativeTest-754998453-project] 10.222.0.62 "GET /v2.0/ports?device_id=4f9e5b06-00b6-4635-881c-06359237f669 HTTP/1.1" status: 200 len: 945 time: 0.0486429 Nov 23 19:42:21.764429 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-66b49b31-80f4-445b-a872-a865074fd743 req-dd901554-7b3a-4f0b-aa55-96253e77066b tempest-AttachVolumeNegativeTest-754998453 tempest-AttachVolumeNegativeTest-754998453-project] 10.222.0.62 "GET /v2.0/security-groups?id=78a07d59-fd8e-4f94-9dfc-099d7d04efec&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0443625 Nov 23 19:42:29.004234 dv-cinder-819011-1-iscsi neutron-server[102995]: DEBUG neutron.db.agents_db [None req-84bdc9b2-57ea-4bdb-a245-07c78d37cea8 None None] Agent healthcheck: found 6 active agents {{(pid=102995) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 23 19:42:29.423559 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.wsgi [-] (102993) accepted ('10.222.0.62', 50884) {{(pid=102993) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 23 19:42:29.744445 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.plugins.ml2.plugin [None req-bce900b0-391b-42af-b4b6-fa93253b02ce tempest-TestShelveInstance-292550524 tempest-TestShelveInstance-292550524-project] Deleting port 2924f18b-4542-476c-b3fa-0e833f92b914 {{(pid=102993) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 23 19:42:29.744782 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-bce900b0-391b-42af-b4b6-fa93253b02ce tempest-TestShelveInstance-292550524 tempest-TestShelveInstance-292550524-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8783631423070'] for port, before_delete {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:42:29.827583 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron_lib.callbacks.manager [None req-4bf48ff4-ecfb-4168-8b63-249b8c6e9f04 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8783631323329', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7978582'] for agent, after_update {{(pid=102994) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:42:29.828659 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-bce900b0-391b-42af-b4b6-fa93253b02ce tempest-TestShelveInstance-292550524 tempest-TestShelveInstance-292550524-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-927332'] for port, precommit_delete {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:42:29.829137 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-bce900b0-391b-42af-b4b6-fa93253b02ce tempest-TestShelveInstance-292550524 tempest-TestShelveInstance-292550524-project] Publish callbacks [] for floatingip, precommit_delete {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:42:29.842122 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.plugins.ml2.plugin [None req-bce900b0-391b-42af-b4b6-fa93253b02ce tempest-TestShelveInstance-292550524 tempest-TestShelveInstance-292550524-project] Calling delete_port for 2924f18b-4542-476c-b3fa-0e833f92b914 owned by network:floatingip {{(pid=102993) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 23 19:42:30.067739 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-bce900b0-391b-42af-b4b6-fa93253b02ce tempest-TestShelveInstance-292550524 tempest-TestShelveInstance-292550524-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7918660', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-15067', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560168', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8783631424624', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8783631008723', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-17257496'] for port, after_delete {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:42:30.094973 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bce900b0-391b-42af-b4b6-fa93253b02ce tempest-TestShelveInstance-292550524 tempest-TestShelveInstance-292550524-project] Pushing event deleted for resources: {'Port': ['ID=2924f18b-4542-476c-b3fa-0e833f92b914,revision_number=None']} {{(pid=102993) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 23 19:42:30.156285 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-bce900b0-391b-42af-b4b6-fa93253b02ce tempest-TestShelveInstance-292550524 tempest-TestShelveInstance-292550524-project] Publish callbacks [] for floatingip, after_delete {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:42:30.156604 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.db.l3_db [None req-bce900b0-391b-42af-b4b6-fa93253b02ce tempest-TestShelveInstance-292550524 tempest-TestShelveInstance-292550524-project] Floating IP 70beee90-321a-4490-94e6-7cfb57c5d0a8 disassociated (deleted). External IP: 172.27.1.163, port: bbafb0bb-163c-43f4-8d2c-2f5304e0bd04. Nov 23 19:42:30.313284 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-90a84561-afc1-4e34-ab49-95e3e47a3f2e req-1198e552-db39-4944-bdaa-7ffae8b62119 service neutron] 10.222.0.41 "GET /v2.0/ports?device_id=9e64d320-821f-4313-8dd0-3b327ba75634&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 275 time: 0.0385568 Nov 23 19:42:30.407381 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-90a84561-afc1-4e34-ab49-95e3e47a3f2e req-afc1b1df-a573-42cf-8ff4-cf0ea6558787 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102992) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:42:30.408875 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-90a84561-afc1-4e34-ab49-95e3e47a3f2e req-afc1b1df-a573-42cf-8ff4-cf0ea6558787 service neutron] 10.222.0.41 "GET /v2.0/ports?tenant_id=257b0b2e531441b4bb745e99cfd799f3&device_id=9e64d320-821f-4313-8dd0-3b327ba75634 HTTP/1.1" status: 200 len: 1099 time: 0.0506084 Nov 23 19:42:30.532498 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-90a84561-afc1-4e34-ab49-95e3e47a3f2e req-57c7682d-832e-4c62-8ad6-adbda615b2df service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102992) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:42:30.534007 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-90a84561-afc1-4e34-ab49-95e3e47a3f2e req-57c7682d-832e-4c62-8ad6-adbda615b2df service neutron] 10.222.0.41 "GET /v2.0/networks?id=226a519f-5f3e-4d80-bb8a-0e9fc4f64828 HTTP/1.1" status: 200 len: 911 time: 0.0936122 Nov 23 19:42:30.607149 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-90a84561-afc1-4e34-ab49-95e3e47a3f2e req-14a0cb55-6d26-45eb-8eb6-4dd4ee7e5c7b service neutron] 10.222.0.41 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.13&port_id=3f7db100-6209-44d3-88c7-906fb1cec5cb HTTP/1.1" status: 200 len: 1002 time: 0.0617750 Nov 23 19:42:30.651131 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-bce900b0-391b-42af-b4b6-fa93253b02ce tempest-TestShelveInstance-292550524 tempest-TestShelveInstance-292550524-project] Router 3524bcbc-06d6-4343-84f5-54d756e6dd80 has already been hosted by L3 agent 1b20f2c4-70b6-43c3-b9bd-0062cc9e57ac {{(pid=102993) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 23 19:42:30.679978 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-90a84561-afc1-4e34-ab49-95e3e47a3f2e req-be621ec0-c03b-446e-a985-70e3aecbebd7 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102992) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:42:30.681466 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-90a84561-afc1-4e34-ab49-95e3e47a3f2e req-be621ec0-c03b-446e-a985-70e3aecbebd7 service neutron] 10.222.0.41 "GET /v2.0/subnets?id=88de785d-c540-4651-af1e-26f27ccaee3c HTTP/1.1" status: 200 len: 849 time: 0.0477207 Nov 23 19:42:30.742726 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-90a84561-afc1-4e34-ab49-95e3e47a3f2e req-73d37c65-0550-4d0a-818b-ece8c9d59dbb service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102992) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:42:30.744248 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-90a84561-afc1-4e34-ab49-95e3e47a3f2e req-73d37c65-0550-4d0a-818b-ece8c9d59dbb service neutron] 10.222.0.41 "GET /v2.0/ports?network_id=226a519f-5f3e-4d80-bb8a-0e9fc4f64828&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0421362 Nov 23 19:42:30.759226 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-bce900b0-391b-42af-b4b6-fa93253b02ce tempest-TestShelveInstance-292550524 tempest-TestShelveInstance-292550524-project] Notify agent at l3_agent.dv-cinder-819011-1-iscsi the message routers_updated {{(pid=102993) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 23 19:42:30.763913 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-bce900b0-391b-42af-b4b6-fa93253b02ce tempest-TestShelveInstance-292550524 tempest-TestShelveInstance-292550524-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-514902'] for floatingip, before_response {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:42:30.769752 dv-cinder-819011-1-iscsi neutron-server[102995]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-5b2932bc-690f-4c25-a612-97e02f257cdd None None] Sync routers for ids ['3524bcbc-06d6-4343-84f5-54d756e6dd80'] in dv-cinder-819011-1-iscsi {{(pid=102995) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 23 19:42:30.781262 dv-cinder-819011-1-iscsi neutron-server[102995]: DEBUG neutron.db.l3_dvrscheduler_db [None req-5b2932bc-690f-4c25-a612-97e02f257cdd None None] Routers {'3524bcbc-06d6-4343-84f5-54d756e6dd80'} bound to L3 agent in host dv-cinder-819011-1-iscsi {{(pid=102995) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 23 19:42:30.781986 dv-cinder-819011-1-iscsi neutron-server[102995]: DEBUG neutron.db.l3_hamode_db [None req-5b2932bc-690f-4c25-a612-97e02f257cdd None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-819011-1-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 6, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 6},created_at=2021-11-23T19:25:14Z,description=,heartbeat_timestamp=2021-11-23T19:42:14Z,host='dv-cinder-819011-1-iscsi',id=1b20f2c4-70b6-43c3-b9bd-0062cc9e57ac,load=0,resource_versions=,resources_synced=,started_at=2021-11-23T19:25:15Z,topic='l3_agent')) {'router_ids': ['3524bcbc-06d6-4343-84f5-54d756e6dd80'], 'active': True} {{(pid=102995) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 23 19:42:30.796397 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [None req-bce900b0-391b-42af-b4b6-fa93253b02ce tempest-TestShelveInstance-292550524 tempest-TestShelveInstance-292550524-project] 10.222.0.62 "DELETE /v2.0/floatingips/70beee90-321a-4490-94e6-7cfb57c5d0a8 HTTP/1.1" status: 204 len: 168 time: 1.3716648 Nov 23 19:42:30.797006 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'b504cdb2-6182-4c24-9b46-6dc0f85da342', 'tag': 'bbafb0bb-163c-43f4-8d2c-2f5304e0bd04'}] {{(pid=102993) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 23 19:42:30.799394 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.62/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}9b10b92acbee16fb695be1efeed0b68f7c36a5b215ec004a8d9d707fa3d35b2c" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-f8cdb30e-1e0c-4aee-9f24-bc00919ac309" -d '{"events": [{"name": "network-changed", "server_uuid": "b504cdb2-6182-4c24-9b46-6dc0f85da342", "tag": "bbafb0bb-163c-43f4-8d2c-2f5304e0bd04"}]}' {{(pid=102993) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 23 19:42:30.839394 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Tue, 23 Nov 2021 19:42:30 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-f0947624-1b1e-4eb5-86b7-f127836c7b26 x-openstack-request-id: req-f0947624-1b1e-4eb5-86b7-f127836c7b26 {{(pid=102993) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 23 19:42:30.839894 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "b504cdb2-6182-4c24-9b46-6dc0f85da342", "tag": "bbafb0bb-163c-43f4-8d2c-2f5304e0bd04", "status": "completed", "code": 200}]} {{(pid=102993) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 23 19:42:30.840319 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.62/compute/v2.1/os-server-external-events used request id req-f0947624-1b1e-4eb5-86b7-f127836c7b26 {{(pid=102993) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 23 19:42:30.840877 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'b504cdb2-6182-4c24-9b46-6dc0f85da342', 'tag': 'bbafb0bb-163c-43f4-8d2c-2f5304e0bd04', 'status': 'completed', 'code': 200} Nov 23 19:42:30.861268 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-90a84561-afc1-4e34-ab49-95e3e47a3f2e req-e8f10d9e-2a25-4299-b15d-17b9dc05d535 service neutron] 10.222.0.41 "GET /v2.0/networks/226a519f-5f3e-4d80-bb8a-0e9fc4f64828?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1043055 Nov 23 19:42:30.916957 dv-cinder-819011-1-iscsi neutron-server[102995]: DEBUG neutron.db.l3_dvr_db [None req-5b2932bc-690f-4c25-a612-97e02f257cdd None None] Set router 3524bcbc-06d6-4343-84f5-54d756e6dd80 gateway port host: dv-cinder-819011-1-iscsi {{(pid=102995) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 23 19:42:30.931894 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f8cdb30e-1e0c-4aee-9f24-bc00919ac309 req-84da5e1b-2ae1-44ab-a7aa-b64931166bd1 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102993) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:42:30.933444 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-f8cdb30e-1e0c-4aee-9f24-bc00919ac309 req-84da5e1b-2ae1-44ab-a7aa-b64931166bd1 service neutron] 10.222.0.41 "GET /v2.0/ports?tenant_id=35f8a5017a27449084aabd12f27f5a8a&device_id=b504cdb2-6182-4c24-9b46-6dc0f85da342 HTTP/1.1" status: 200 len: 1099 time: 0.0446732 Nov 23 19:42:30.981520 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-90a84561-afc1-4e34-ab49-95e3e47a3f2e req-35b6e444-98a3-4259-b77c-09f1b7b8ce80 service neutron] 10.222.0.41 "GET /v2.0/networks/226a519f-5f3e-4d80-bb8a-0e9fc4f64828?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0982440 Nov 23 19:42:31.045261 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f8cdb30e-1e0c-4aee-9f24-bc00919ac309 req-52aaef54-d358-4412-bed9-b7b95c2f1227 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102993) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:42:31.046766 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-f8cdb30e-1e0c-4aee-9f24-bc00919ac309 req-52aaef54-d358-4412-bed9-b7b95c2f1227 service neutron] 10.222.0.41 "GET /v2.0/networks?id=87e46ab6-0f90-430f-930f-9ea1580c04c3 HTTP/1.1" status: 200 len: 909 time: 0.0916204 Nov 23 19:42:31.092433 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-f8cdb30e-1e0c-4aee-9f24-bc00919ac309 req-ff560baa-177a-4310-b8e9-05207314b0bf service neutron] 10.222.0.41 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.13&port_id=bbafb0bb-163c-43f4-8d2c-2f5304e0bd04 HTTP/1.1" status: 200 len: 217 time: 0.0344992 Nov 23 19:42:31.124505 dv-cinder-819011-1-iscsi neutron-server[102995]: DEBUG neutron.db.l3_hamode_db [None req-5b2932bc-690f-4c25-a612-97e02f257cdd None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '3524bcbc-06d6-4343-84f5-54d756e6dd80', 'name': 'tempest-TestShelveInstance-670557749-router', 'tenant_id': '35f8a5017a27449084aabd12f27f5a8a', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'a93e254e-aac9-4233-9e4d-4290fd0458e4', 'external_fixed_ips': [{'subnet_id': 'e0b32f3d-83d6-439a-bbed-01df7cf01051', 'ip_address': '172.27.1.194'}], 'enable_snat': True}, 'gw_port_id': 'abd59c5e-8249-4aba-855f-bf3ed33724b6', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-23T19:37:15Z', 'updated_at': '2021-11-23T19:37:18Z', 'revision_number': 4, 'project_id': '35f8a5017a27449084aabd12f27f5a8a', 'gw_port': {'id': 'abd59c5e-8249-4aba-855f-bf3ed33724b6', 'name': '', 'network_id': 'a93e254e-aac9-4233-9e4d-4290fd0458e4', 'tenant_id': '', 'mac_address': 'fa:16:3e:d7:89:48', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '3524bcbc-06d6-4343-84f5-54d756e6dd80', 'device_owner': 'network:router_gateway', 'standard_attr_id': 515, 'fixed_ips': [{'subnet_id': 'e0b32f3d-83d6-439a-bbed-01df7cf01051', 'ip_address': '172.27.1.194', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-819011-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-23T19:37:16Z', 'updated_at': '2021-11-23T19:37:22Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'e0b32f3d-83d6-439a-bbed-01df7cf01051', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-819011-1-iscsi', '_interfaces': [{'id': 'e277d91a-2f3d-4a95-80af-b6e6c458ebab', 'name': '', 'network_id': '87e46ab6-0f90-430f-930f-9ea1580c04c3', 'tenant_id': '35f8a5017a27449084aabd12f27f5a8a', 'mac_address': 'fa:16:3e:42:84:c0', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '3524bcbc-06d6-4343-84f5-54d756e6dd80', 'device_owner': 'network:router_interface', 'standard_attr_id': 517, 'fixed_ips': [{'subnet_id': 'afa5bc59-f70c-409d-8c15-be2dcdce66a3', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-819011-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-23T19:37:18Z', 'updated_at': '2021-11-23T19:37:25Z', 'revision_number': 5, 'project_id': '35f8a5017a27449084aabd12f27f5a8a', 'subnets': [{'id': 'afa5bc59-f70c-409d-8c15-be2dcdce66a3', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-819011-1-iscsi', False) {} {{(pid=102995) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 23 19:42:31.148031 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f8cdb30e-1e0c-4aee-9f24-bc00919ac309 req-482bd315-e999-4b9d-9b9a-f5f9e8425e90 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102993) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:42:31.148031 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-f8cdb30e-1e0c-4aee-9f24-bc00919ac309 req-482bd315-e999-4b9d-9b9a-f5f9e8425e90 service neutron] 10.222.0.41 "GET /v2.0/subnets?id=afa5bc59-f70c-409d-8c15-be2dcdce66a3 HTTP/1.1" status: 200 len: 847 time: 0.0435104 Nov 23 19:42:31.154145 dv-cinder-819011-1-iscsi neutron-server[102995]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-5b2932bc-690f-4c25-a612-97e02f257cdd None None] Checking router: 3524bcbc-06d6-4343-84f5-54d756e6dd80 for host: dv-cinder-819011-1-iscsi {{(pid=102995) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 23 19:42:31.162518 dv-cinder-819011-1-iscsi neutron-server[102995]: DEBUG neutron.db.l3_dvrscheduler_db [None req-5b2932bc-690f-4c25-a612-97e02f257cdd None None] Routers {'3524bcbc-06d6-4343-84f5-54d756e6dd80'} bound to L3 agent in host dv-cinder-819011-1-iscsi {{(pid=102995) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 23 19:42:31.163330 dv-cinder-819011-1-iscsi neutron-server[102995]: DEBUG neutron.db.l3_hamode_db [None req-5b2932bc-690f-4c25-a612-97e02f257cdd None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-819011-1-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 6, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 6},created_at=2021-11-23T19:25:14Z,description=,heartbeat_timestamp=2021-11-23T19:42:14Z,host='dv-cinder-819011-1-iscsi',id=1b20f2c4-70b6-43c3-b9bd-0062cc9e57ac,load=0,resource_versions=,resources_synced=,started_at=2021-11-23T19:25:15Z,topic='l3_agent')) {'router_ids': ['3524bcbc-06d6-4343-84f5-54d756e6dd80'], 'active': True} {{(pid=102995) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 23 19:42:31.228258 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f8cdb30e-1e0c-4aee-9f24-bc00919ac309 req-d2a3bcff-d649-4131-b5ea-99a89377681e service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102993) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:42:31.229792 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-f8cdb30e-1e0c-4aee-9f24-bc00919ac309 req-d2a3bcff-d649-4131-b5ea-99a89377681e service neutron] 10.222.0.41 "GET /v2.0/ports?network_id=87e46ab6-0f90-430f-930f-9ea1580c04c3&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0546050 Nov 23 19:42:31.247048 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-41ee7d35-2e5f-4645-a8dc-bdc51d688163 req-0a0abb5f-c045-43fe-b050-b68b6d6cbec5 tempest-TestShelveInstance-292550524 tempest-TestShelveInstance-292550524-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102992) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:42:31.248691 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-41ee7d35-2e5f-4645-a8dc-bdc51d688163 req-0a0abb5f-c045-43fe-b050-b68b6d6cbec5 tempest-TestShelveInstance-292550524 tempest-TestShelveInstance-292550524-project] 10.222.0.62 "GET /v2.0/ports?device_id=b504cdb2-6182-4c24-9b46-6dc0f85da342 HTTP/1.1" status: 200 len: 946 time: 0.0545361 Nov 23 19:42:31.306414 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-41ee7d35-2e5f-4645-a8dc-bdc51d688163 req-febfcb98-fbba-40e3-999c-b8529dcf6dce tempest-TestShelveInstance-292550524 tempest-TestShelveInstance-292550524-project] 10.222.0.62 "GET /v2.0/security-groups?id=7fe194e6-71c3-47a9-8f36-0dbb24d1f72d&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0504069 Nov 23 19:42:31.310103 dv-cinder-819011-1-iscsi neutron-server[102995]: DEBUG neutron.db.l3_dvr_db [None req-5b2932bc-690f-4c25-a612-97e02f257cdd None None] Set router 3524bcbc-06d6-4343-84f5-54d756e6dd80 gateway port host: dv-cinder-819011-1-iscsi {{(pid=102995) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 23 19:42:31.332440 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-f8cdb30e-1e0c-4aee-9f24-bc00919ac309 req-6bb2e55a-f6e2-45ab-b958-5b311e8eaa3b service neutron] 10.222.0.41 "GET /v2.0/networks/87e46ab6-0f90-430f-930f-9ea1580c04c3?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0915747 Nov 23 19:42:31.449624 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-f8cdb30e-1e0c-4aee-9f24-bc00919ac309 req-41ab07ab-67e9-441a-80ed-a235cf616a72 service neutron] 10.222.0.41 "GET /v2.0/networks/87e46ab6-0f90-430f-930f-9ea1580c04c3?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0920234 Nov 23 19:42:31.513739 dv-cinder-819011-1-iscsi neutron-server[102995]: DEBUG neutron.db.l3_hamode_db [None req-5b2932bc-690f-4c25-a612-97e02f257cdd None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '3524bcbc-06d6-4343-84f5-54d756e6dd80', 'name': 'tempest-TestShelveInstance-670557749-router', 'tenant_id': '35f8a5017a27449084aabd12f27f5a8a', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'a93e254e-aac9-4233-9e4d-4290fd0458e4', 'external_fixed_ips': [{'subnet_id': 'e0b32f3d-83d6-439a-bbed-01df7cf01051', 'ip_address': '172.27.1.194'}], 'enable_snat': True}, 'gw_port_id': 'abd59c5e-8249-4aba-855f-bf3ed33724b6', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-23T19:37:15Z', 'updated_at': '2021-11-23T19:37:18Z', 'revision_number': 4, 'project_id': '35f8a5017a27449084aabd12f27f5a8a', 'gw_port': {'id': 'abd59c5e-8249-4aba-855f-bf3ed33724b6', 'name': '', 'network_id': 'a93e254e-aac9-4233-9e4d-4290fd0458e4', 'tenant_id': '', 'mac_address': 'fa:16:3e:d7:89:48', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '3524bcbc-06d6-4343-84f5-54d756e6dd80', 'device_owner': 'network:router_gateway', 'standard_attr_id': 515, 'fixed_ips': [{'subnet_id': 'e0b32f3d-83d6-439a-bbed-01df7cf01051', 'ip_address': '172.27.1.194', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-819011-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-23T19:37:16Z', 'updated_at': '2021-11-23T19:37:22Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'e0b32f3d-83d6-439a-bbed-01df7cf01051', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-819011-1-iscsi', '_interfaces': [{'id': 'e277d91a-2f3d-4a95-80af-b6e6c458ebab', 'name': '', 'network_id': '87e46ab6-0f90-430f-930f-9ea1580c04c3', 'tenant_id': '35f8a5017a27449084aabd12f27f5a8a', 'mac_address': 'fa:16:3e:42:84:c0', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '3524bcbc-06d6-4343-84f5-54d756e6dd80', 'device_owner': 'network:router_interface', 'standard_attr_id': 517, 'fixed_ips': [{'subnet_id': 'afa5bc59-f70c-409d-8c15-be2dcdce66a3', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-819011-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-23T19:37:18Z', 'updated_at': '2021-11-23T19:37:25Z', 'revision_number': 5, 'project_id': '35f8a5017a27449084aabd12f27f5a8a', 'subnets': [{'id': 'afa5bc59-f70c-409d-8c15-be2dcdce66a3', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-819011-1-iscsi', False) {} {{(pid=102995) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 23 19:42:31.544549 dv-cinder-819011-1-iscsi neutron-server[102995]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-5b2932bc-690f-4c25-a612-97e02f257cdd None None] The sync data for ids ['3524bcbc-06d6-4343-84f5-54d756e6dd80'] in dv-cinder-819011-1-iscsi is: [{'id': '3524bcbc-06d6-4343-84f5-54d756e6dd80', 'name': 'tempest-TestShelveInstance-670557749-router', 'tenant_id': '35f8a5017a27449084aabd12f27f5a8a', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'a93e254e-aac9-4233-9e4d-4290fd0458e4', 'external_fixed_ips': [{'subnet_id': 'e0b32f3d-83d6-439a-bbed-01df7cf01051', 'ip_address': '172.27.1.194'}], 'enable_snat': True}, 'gw_port_id': 'abd59c5e-8249-4aba-855f-bf3ed33724b6', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-23T19:37:15Z', 'updated_at': '2021-11-23T19:37:18Z', 'revision_number': 4, 'project_id': '35f8a5017a27449084aabd12f27f5a8a', 'gw_port': {'id': 'abd59c5e-8249-4aba-855f-bf3ed33724b6', 'name': '', 'network_id': 'a93e254e-aac9-4233-9e4d-4290fd0458e4', 'tenant_id': '', 'mac_address': 'fa:16:3e:d7:89:48', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '3524bcbc-06d6-4343-84f5-54d756e6dd80', 'device_owner': 'network:router_gateway', 'standard_attr_id': 515, 'fixed_ips': [{'subnet_id': 'e0b32f3d-83d6-439a-bbed-01df7cf01051', 'ip_address': '172.27.1.194', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-819011-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-23T19:37:16Z', 'updated_at': '2021-11-23T19:37:22Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'e0b32f3d-83d6-439a-bbed-01df7cf01051', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-819011-1-iscsi', '_interfaces': [{'id': 'e277d91a-2f3d-4a95-80af-b6e6c458ebab', 'name': '', 'network_id': '87e46ab6-0f90-430f-930f-9ea1580c04c3', 'tenant_id': '35f8a5017a27449084aabd12f27f5a8a', 'mac_address': 'fa:16:3e:42:84:c0', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '3524bcbc-06d6-4343-84f5-54d756e6dd80', 'device_owner': 'network:router_interface', 'standard_attr_id': 517, 'fixed_ips': [{'subnet_id': 'afa5bc59-f70c-409d-8c15-be2dcdce66a3', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-819011-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-23T19:37:18Z', 'updated_at': '2021-11-23T19:37:25Z', 'revision_number': 5, 'project_id': '35f8a5017a27449084aabd12f27f5a8a', 'subnets': [{'id': 'afa5bc59-f70c-409d-8c15-be2dcdce66a3', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=102995) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 23 19:42:31.759534 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-cc659f11-0a8d-447d-82f3-9cca5b570f19 None None] New status for floating IP 70beee90-321a-4490-94e6-7cfb57c5d0a8: DOWN {{(pid=102994) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Nov 23 19:42:32.424243 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6e3230b9-0e50-4902-8c11-9cfab5e524b8 req-14905585-1001-4272-bb6a-60c402d2cda5 tempest-TestShelveInstance-292550524 tempest-TestShelveInstance-292550524-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102993) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:42:32.426376 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-6e3230b9-0e50-4902-8c11-9cfab5e524b8 req-14905585-1001-4272-bb6a-60c402d2cda5 tempest-TestShelveInstance-292550524 tempest-TestShelveInstance-292550524-project] 10.222.0.62 "GET /v2.0/ports?device_id=b504cdb2-6182-4c24-9b46-6dc0f85da342 HTTP/1.1" status: 200 len: 946 time: 0.0498519 Nov 23 19:42:32.476916 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-6e3230b9-0e50-4902-8c11-9cfab5e524b8 req-8c753c76-f9dc-4ce5-9fe1-604b5d4787f4 tempest-TestShelveInstance-292550524 tempest-TestShelveInstance-292550524-project] 10.222.0.62 "GET /v2.0/security-groups?id=7fe194e6-71c3-47a9-8f36-0dbb24d1f72d&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0436625 Nov 23 19:42:33.595844 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0d0f2aa6-963d-4c77-9884-cad10384a7d0 req-3346be1b-6723-4bf6-aea6-6a87ea21db88 tempest-TestShelveInstance-292550524 tempest-TestShelveInstance-292550524-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102992) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:42:33.597317 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-0d0f2aa6-963d-4c77-9884-cad10384a7d0 req-3346be1b-6723-4bf6-aea6-6a87ea21db88 tempest-TestShelveInstance-292550524 tempest-TestShelveInstance-292550524-project] 10.222.0.62 "GET /v2.0/ports?device_id=b504cdb2-6182-4c24-9b46-6dc0f85da342 HTTP/1.1" status: 200 len: 946 time: 0.0538366 Nov 23 19:42:33.646190 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-0d0f2aa6-963d-4c77-9884-cad10384a7d0 req-66bc539b-539d-4036-b84c-525a79877fe5 tempest-TestShelveInstance-292550524 tempest-TestShelveInstance-292550524-project] 10.222.0.62 "GET /v2.0/security-groups?id=7fe194e6-71c3-47a9-8f36-0dbb24d1f72d&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0418286 Nov 23 19:42:33.931837 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1cb0fbcb-e63b-4ad0-9eb1-89916a96240a req-330c577b-6b3a-4acb-a47e-85fdc02ad072 tempest-TestShelveInstance-292550524 tempest-TestShelveInstance-292550524-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102993) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:42:33.933593 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-1cb0fbcb-e63b-4ad0-9eb1-89916a96240a req-330c577b-6b3a-4acb-a47e-85fdc02ad072 tempest-TestShelveInstance-292550524 tempest-TestShelveInstance-292550524-project] 10.222.0.41 "GET /v2.0/ports?device_id=b504cdb2-6182-4c24-9b46-6dc0f85da342 HTTP/1.1" status: 200 len: 946 time: 0.0495274 Nov 23 19:42:34.038133 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.plugins.ml2.plugin [req-1cb0fbcb-e63b-4ad0-9eb1-89916a96240a req-3f1a4aeb-a27a-4db8-91e1-7707f29dbaec tempest-TestShelveInstance-292550524 tempest-TestShelveInstance-292550524-project] Deleting port bbafb0bb-163c-43f4-8d2c-2f5304e0bd04 {{(pid=102993) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 23 19:42:34.038467 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [req-1cb0fbcb-e63b-4ad0-9eb1-89916a96240a req-3f1a4aeb-a27a-4db8-91e1-7707f29dbaec tempest-TestShelveInstance-292550524 tempest-TestShelveInstance-292550524-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8783631423070'] for port, before_delete {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:42:34.132006 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.plugins.ml2.db [req-1cb0fbcb-e63b-4ad0-9eb1-89916a96240a req-3f1a4aeb-a27a-4db8-91e1-7707f29dbaec tempest-TestShelveInstance-292550524 tempest-TestShelveInstance-292550524-project] For port bbafb0bb-163c-43f4-8d2c-2f5304e0bd04, host hv-cinder-81901, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81901',level=0,port_id=bbafb0bb-163c-43f4-8d2c-2f5304e0bd04,segment=NetworkSegment(5c30b9a1-7b41-4664-aa24-084baf66a2d5),segment_id=5c30b9a1-7b41-4664-aa24-084baf66a2d5)] {{(pid=102993) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 23 19:42:34.132527 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [req-1cb0fbcb-e63b-4ad0-9eb1-89916a96240a req-3f1a4aeb-a27a-4db8-91e1-7707f29dbaec tempest-TestShelveInstance-292550524 tempest-TestShelveInstance-292550524-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-927332'] for port, precommit_delete {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:42:34.145840 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.plugins.ml2.plugin [req-1cb0fbcb-e63b-4ad0-9eb1-89916a96240a req-3f1a4aeb-a27a-4db8-91e1-7707f29dbaec tempest-TestShelveInstance-292550524 tempest-TestShelveInstance-292550524-project] Calling delete_port for bbafb0bb-163c-43f4-8d2c-2f5304e0bd04 owned by compute:nova {{(pid=102993) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 23 19:42:34.347779 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [req-1cb0fbcb-e63b-4ad0-9eb1-89916a96240a req-3f1a4aeb-a27a-4db8-91e1-7707f29dbaec tempest-TestShelveInstance-292550524 tempest-TestShelveInstance-292550524-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7918660', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-15067', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560168', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8783631424624', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8783631008723', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-17257496'] for port, after_delete {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:42:34.378517 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3f1a4aeb-a27a-4db8-91e1-7707f29dbaec tempest-TestShelveInstance-292550524 tempest-TestShelveInstance-292550524-project] Pushing event deleted for resources: {'Port': ['ID=bbafb0bb-163c-43f4-8d2c-2f5304e0bd04,revision_number=None']} {{(pid=102993) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 23 19:42:34.423172 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.db.l3_dvrscheduler_db [req-1cb0fbcb-e63b-4ad0-9eb1-89916a96240a req-3f1a4aeb-a27a-4db8-91e1-7707f29dbaec tempest-TestShelveInstance-292550524 tempest-TestShelveInstance-292550524-project] No DVR routers for this DVR port bbafb0bb-163c-43f4-8d2c-2f5304e0bd04 on host hv-cinder-81901 {{(pid=102993) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 23 19:42:34.425690 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [req-1cb0fbcb-e63b-4ad0-9eb1-89916a96240a req-3f1a4aeb-a27a-4db8-91e1-7707f29dbaec tempest-TestShelveInstance-292550524 tempest-TestShelveInstance-292550524-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-514902'] for port, before_response {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:42:34.429086 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-1cb0fbcb-e63b-4ad0-9eb1-89916a96240a req-3f1a4aeb-a27a-4db8-91e1-7707f29dbaec tempest-TestShelveInstance-292550524 tempest-TestShelveInstance-292550524-project] 10.222.0.41 "DELETE /v2.0/ports/bbafb0bb-163c-43f4-8d2c-2f5304e0bd04 HTTP/1.1" status: 204 len: 173 time: 0.4839346 Nov 23 19:42:34.429567 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'b504cdb2-6182-4c24-9b46-6dc0f85da342', 'name': 'network-vif-deleted', 'tag': 'bbafb0bb-163c-43f4-8d2c-2f5304e0bd04'}] {{(pid=102993) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 23 19:42:34.431806 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.62/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}9b10b92acbee16fb695be1efeed0b68f7c36a5b215ec004a8d9d707fa3d35b2c" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-ca56b3e8-187d-48eb-87aa-fb46d97485e5" -d '{"events": [{"server_uuid": "b504cdb2-6182-4c24-9b46-6dc0f85da342", "name": "network-vif-deleted", "tag": "bbafb0bb-163c-43f4-8d2c-2f5304e0bd04"}]}' {{(pid=102993) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 23 19:42:34.467471 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 23 Nov 2021 19:42:34 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-3bba644f-b108-49ba-9601-d8de7162db21 x-openstack-request-id: req-3bba644f-b108-49ba-9601-d8de7162db21 {{(pid=102993) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 23 19:42:34.467762 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "b504cdb2-6182-4c24-9b46-6dc0f85da342", "name": "network-vif-deleted", "tag": "bbafb0bb-163c-43f4-8d2c-2f5304e0bd04", "status": "completed", "code": 200}]} {{(pid=102993) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 23 19:42:34.468012 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.62/compute/v2.1/os-server-external-events used request id req-3bba644f-b108-49ba-9601-d8de7162db21 {{(pid=102993) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 23 19:42:34.468406 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'b504cdb2-6182-4c24-9b46-6dc0f85da342', 'name': 'network-vif-deleted', 'tag': 'bbafb0bb-163c-43f4-8d2c-2f5304e0bd04', 'status': 'completed', 'code': 200} Nov 23 19:42:34.745557 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-54594795-2288-4939-9c58-9ba3f4a8fbdb req-7b6f138e-8395-4a05-9481-994297e34887 tempest-TestShelveInstance-292550524 tempest-TestShelveInstance-292550524-project] 10.222.0.62 "GET /v2.0/ports?device_id=b504cdb2-6182-4c24-9b46-6dc0f85da342 HTTP/1.1" status: 200 len: 210 time: 0.0284212 Nov 23 19:42:35.405097 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-94a27c1c-ade1-4cc9-956b-4d009bc121da req-f16348f8-3550-4149-b703-7eef10d9bee4 tempest-AttachVolumeNegativeTest-754998453 tempest-AttachVolumeNegativeTest-754998453-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=102992) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:42:35.406651 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-94a27c1c-ade1-4cc9-956b-4d009bc121da req-f16348f8-3550-4149-b703-7eef10d9bee4 tempest-AttachVolumeNegativeTest-754998453 tempest-AttachVolumeNegativeTest-754998453-project] 10.222.0.62 "GET /v2.0/networks?id=5f438c34-aac6-400d-bc7e-2e0506f124a9 HTTP/1.1" status: 200 len: 815 time: 0.1048040 Nov 23 19:42:35.422846 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-94a27c1c-ade1-4cc9-956b-4d009bc121da req-2fd0e07d-d66c-4f25-8fab-082f9f2940e0 tempest-AttachVolumeNegativeTest-754998453 tempest-AttachVolumeNegativeTest-754998453-project] 10.222.0.62 "GET /v2.0/quotas/e738acf03acd4f9d90b4dc46fb48bb06 HTTP/1.1" status: 200 len: 375 time: 0.0101633 Nov 23 19:42:35.483771 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-94a27c1c-ade1-4cc9-956b-4d009bc121da req-d769c256-c9dc-4dd5-9411-8ba270869aae tempest-AttachVolumeNegativeTest-754998453 tempest-AttachVolumeNegativeTest-754998453-project] 10.222.0.62 "GET /v2.0/ports?tenant_id=e738acf03acd4f9d90b4dc46fb48bb06&fields=id HTTP/1.1" status: 200 len: 348 time: 0.0542376 Nov 23 19:42:35.574441 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-94a27c1c-ade1-4cc9-956b-4d009bc121da req-a3fe275f-df3e-4329-8c27-2e21338615ed service neutron] 10.222.0.62 "GET /v2.0/networks/5f438c34-aac6-400d-bc7e-2e0506f124a9?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0836208 Nov 23 19:42:35.938289 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-94a27c1c-ade1-4cc9-956b-4d009bc121da req-b47cfe1e-8ed0-407d-9c35-6688f277a98e service neutron] 10.222.0.62 "GET /v2.0/networks/5f438c34-aac6-400d-bc7e-2e0506f124a9?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.3577976 Nov 23 19:42:36.070955 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-bdd7089a-9b35-4e02-9d1d-e2d50543b756 req-144e9b9f-e87a-4a31-9c63-c062fe948025 tempest-TestShelveInstance-292550524 tempest-TestShelveInstance-292550524-project] 10.222.0.62 "GET /v2.0/ports?device_id=b504cdb2-6182-4c24-9b46-6dc0f85da342 HTTP/1.1" status: 200 len: 210 time: 0.0290282 Nov 23 19:42:36.181788 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-13847c20-4446-4339-8ae4-99b9c680a311 req-b123b373-99c5-4eda-b077-30d1cf061acd tempest-AttachVolumeNegativeTest-754998453 tempest-AttachVolumeNegativeTest-754998453-project] 10.222.0.62 "GET /v2.0/ports?device_id=b63ec72c-0e94-420e-a7b6-cb4ba7fe3c33 HTTP/1.1" status: 200 len: 210 time: 0.0288303 Nov 23 19:42:37.127594 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.wsgi [-] (102992) accepted ('10.222.0.62', 50988) {{(pid=102992) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 23 19:42:37.183495 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [None req-0e40f877-9004-40d0-90e5-1de68ad2640f tempest-TestShelveInstance-292550524 tempest-TestShelveInstance-292550524-project] Publish callbacks [] for security_group, before_delete {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:42:37.208149 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [None req-0e40f877-9004-40d0-90e5-1de68ad2640f tempest-TestShelveInstance-292550524 tempest-TestShelveInstance-292550524-project] Publish callbacks [] for security_group, precommit_delete {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:42:37.277534 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-c8c70a90-1c4e-4a46-9b7b-3dd21d64632b req-96c3b72a-67c1-4a4f-a770-d96357cbbc88 tempest-AttachVolumeNegativeTest-754998453 tempest-AttachVolumeNegativeTest-754998453-project] 10.222.0.62 "GET /v2.0/ports?device_id=b63ec72c-0e94-420e-a7b6-cb4ba7fe3c33 HTTP/1.1" status: 200 len: 210 time: 0.0271842 Nov 23 19:42:37.318824 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [None req-0e40f877-9004-40d0-90e5-1de68ad2640f tempest-TestShelveInstance-292550524 tempest-TestShelveInstance-292550524-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-623933'] for security_group, after_delete {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:42:37.322281 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [None req-0e40f877-9004-40d0-90e5-1de68ad2640f tempest-TestShelveInstance-292550524 tempest-TestShelveInstance-292550524-project] Publish callbacks [] for security_group, before_response {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:42:37.323419 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [None req-0e40f877-9004-40d0-90e5-1de68ad2640f tempest-TestShelveInstance-292550524 tempest-TestShelveInstance-292550524-project] 10.222.0.62 "DELETE /v2.0/security-groups/7fe194e6-71c3-47a9-8f36-0dbb24d1f72d HTTP/1.1" status: 204 len: 168 time: 0.1947968 Nov 23 19:42:37.332516 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0e40f877-9004-40d0-90e5-1de68ad2640f tempest-TestShelveInstance-292550524 tempest-TestShelveInstance-292550524-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=7fe194e6-71c3-47a9-8f36-0dbb24d1f72d,revision_number=None']} {{(pid=102992) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 23 19:42:37.340483 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0e40f877-9004-40d0-90e5-1de68ad2640f tempest-TestShelveInstance-292550524 tempest-TestShelveInstance-292550524-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-819011-1-iscsi {{(pid=102992) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 23 19:42:37.340835 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0e40f877-9004-40d0-90e5-1de68ad2640f tempest-TestShelveInstance-292550524 tempest-TestShelveInstance-292550524-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-819011-1-iscsi {{(pid=102992) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 23 19:42:37.341176 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0e40f877-9004-40d0-90e5-1de68ad2640f tempest-TestShelveInstance-292550524 tempest-TestShelveInstance-292550524-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-819011-1-iscsi {{(pid=102992) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 23 19:42:37.341539 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0e40f877-9004-40d0-90e5-1de68ad2640f tempest-TestShelveInstance-292550524 tempest-TestShelveInstance-292550524-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-819011-1-iscsi {{(pid=102992) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 23 19:42:37.341866 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0e40f877-9004-40d0-90e5-1de68ad2640f tempest-TestShelveInstance-292550524 tempest-TestShelveInstance-292550524-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-819011-1-iscsi {{(pid=102992) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 23 19:42:37.342197 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0e40f877-9004-40d0-90e5-1de68ad2640f tempest-TestShelveInstance-292550524 tempest-TestShelveInstance-292550524-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-819011-1-iscsi {{(pid=102992) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 23 19:42:37.342555 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0e40f877-9004-40d0-90e5-1de68ad2640f tempest-TestShelveInstance-292550524 tempest-TestShelveInstance-292550524-project] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-819011-1-iscsi {{(pid=102992) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 23 19:42:37.342880 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0e40f877-9004-40d0-90e5-1de68ad2640f tempest-TestShelveInstance-292550524 tempest-TestShelveInstance-292550524-project] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-819011-1-iscsi {{(pid=102992) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 23 19:42:37.343205 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0e40f877-9004-40d0-90e5-1de68ad2640f tempest-TestShelveInstance-292550524 tempest-TestShelveInstance-292550524-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-819011-1-iscsi {{(pid=102992) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 23 19:42:37.343527 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0e40f877-9004-40d0-90e5-1de68ad2640f tempest-TestShelveInstance-292550524 tempest-TestShelveInstance-292550524-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-819011-1-iscsi {{(pid=102992) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 23 19:42:37.344042 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0e40f877-9004-40d0-90e5-1de68ad2640f tempest-TestShelveInstance-292550524 tempest-TestShelveInstance-292550524-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-819011-1-iscsi {{(pid=102992) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 23 19:42:37.344368 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0e40f877-9004-40d0-90e5-1de68ad2640f tempest-TestShelveInstance-292550524 tempest-TestShelveInstance-292550524-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-819011-1-iscsi {{(pid=102992) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 23 19:42:37.463927 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.wsgi [-] (102993) accepted ('10.222.0.62', 50994) {{(pid=102993) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 23 19:42:37.850250 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-91d8fb46-428d-4ad3-92af-611264e34916 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-932931'] for router_interface, before_delete {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:42:38.008221 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.plugins.ml2.rpc [None req-4bf48ff4-ecfb-4168-8b63-249b8c6e9f04 None None] Device bbafb0bb-163c-43f4-8d2c-2f5304e0bd04 no longer exists at agent hyperv_hv-cinder-81901 {{(pid=102994) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 23 19:42:38.028032 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.plugins.ml2.plugin [None req-4bf48ff4-ecfb-4168-8b63-249b8c6e9f04 None None] No Port match for: bbafb0bb-163c-43f4-8d2c-2f5304e0bd04 {{(pid=102994) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 23 19:42:38.028383 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.plugins.ml2.rpc [None req-4bf48ff4-ecfb-4168-8b63-249b8c6e9f04 None None] Device bbafb0bb-163c-43f4-8d2c-2f5304e0bd04 not bound to the agent host hv-cinder-81901 {{(pid=102994) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 23 19:42:38.180078 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.plugins.ml2.plugin [None req-91d8fb46-428d-4ad3-92af-611264e34916 admin admin] Deleting port e277d91a-2f3d-4a95-80af-b6e6c458ebab {{(pid=102993) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 23 19:42:38.180411 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-91d8fb46-428d-4ad3-92af-611264e34916 admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8783631423070'] for port, before_delete {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:42:38.203274 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-94a27c1c-ade1-4cc9-956b-4d009bc121da req-d3774a7b-efb7-4b63-8f2c-38bfe3443014 tempest-AttachVolumeNegativeTest-754998453 tempest-AttachVolumeNegativeTest-754998453-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=102993) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:42:38.204687 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-94a27c1c-ade1-4cc9-956b-4d009bc121da req-d3774a7b-efb7-4b63-8f2c-38bfe3443014 tempest-AttachVolumeNegativeTest-754998453 tempest-AttachVolumeNegativeTest-754998453-project] 10.222.0.41 "GET /v2.0/networks?id=5f438c34-aac6-400d-bc7e-2e0506f124a9 HTTP/1.1" status: 200 len: 815 time: 0.1258974 Nov 23 19:42:38.220009 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.api.v2.base [req-94a27c1c-ade1-4cc9-956b-4d009bc121da req-e0bb70f8-0e1a-412e-b96c-9dbb43cdbd1c tempest-AttachVolumeNegativeTest-754998453 tempest-AttachVolumeNegativeTest-754998453-project] Request body: {'port': {'device_id': 'b63ec72c-0e94-420e-a7b6-cb4ba7fe3c33', 'network_id': '5f438c34-aac6-400d-bc7e-2e0506f124a9', 'admin_state_up': True, 'tenant_id': 'e738acf03acd4f9d90b4dc46fb48bb06'}} {{(pid=102993) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 23 19:42:38.336429 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.plugins.ml2.db [None req-91d8fb46-428d-4ad3-92af-611264e34916 admin admin] For port e277d91a-2f3d-4a95-80af-b6e6c458ebab, host dv-cinder-819011-1-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-819011-1-iscsi',level=0,port_id=e277d91a-2f3d-4a95-80af-b6e6c458ebab,segment=NetworkSegment(5c30b9a1-7b41-4664-aa24-084baf66a2d5),segment_id=5c30b9a1-7b41-4664-aa24-084baf66a2d5)] {{(pid=102993) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 23 19:42:38.337092 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-91d8fb46-428d-4ad3-92af-611264e34916 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-927332'] for port, precommit_delete {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:42:38.359715 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.plugins.ml2.plugin [None req-91d8fb46-428d-4ad3-92af-611264e34916 admin admin] Calling delete_port for e277d91a-2f3d-4a95-80af-b6e6c458ebab owned by network:router_interface {{(pid=102993) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 23 19:42:38.399423 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-f1f3a0b5-e9de-424a-9953-360e719aba36 req-50f9b5ae-3d9c-443c-a40b-c41ef6d183b6 tempest-AttachVolumeNegativeTest-754998453 tempest-AttachVolumeNegativeTest-754998453-project] 10.222.0.62 "GET /v2.0/ports?device_id=b63ec72c-0e94-420e-a7b6-cb4ba7fe3c33 HTTP/1.1" status: 200 len: 210 time: 0.0363543 Nov 23 19:42:38.496479 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-94a27c1c-ade1-4cc9-956b-4d009bc121da req-e0bb70f8-0e1a-412e-b96c-9dbb43cdbd1c tempest-AttachVolumeNegativeTest-754998453 tempest-AttachVolumeNegativeTest-754998453-project] Made reservation on behalf of e738acf03acd4f9d90b4dc46fb48bb06 for: {'port': 1} {{(pid=102993) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 23 19:42:38.499981 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [req-94a27c1c-ade1-4cc9-956b-4d009bc121da req-e0bb70f8-0e1a-412e-b96c-9dbb43cdbd1c tempest-AttachVolumeNegativeTest-754998453 tempest-AttachVolumeNegativeTest-754998453-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7921281'] for port, before_create {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:42:38.676279 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.db.db_base_plugin_common [req-94a27c1c-ade1-4cc9-956b-4d009bc121da req-e0bb70f8-0e1a-412e-b96c-9dbb43cdbd1c tempest-AttachVolumeNegativeTest-754998453 tempest-AttachVolumeNegativeTest-754998453-project] Allocated IP 172.20.0.4 (5f438c34-aac6-400d-bc7e-2e0506f124a9/ffd14982-fec3-42b1-9d92-f2ed87a640f4/b1a5b461-ffce-430d-9e3a-f6255af48107) {{(pid=102993) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 23 19:42:38.722060 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-91d8fb46-428d-4ad3-92af-611264e34916 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7918660', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-15067', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560168', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8783631424624', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8783631008723', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-17257496'] for port, after_delete {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:42:38.760178 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-91d8fb46-428d-4ad3-92af-611264e34916 admin admin] Pushing event deleted for resources: {'Port': ['ID=e277d91a-2f3d-4a95-80af-b6e6c458ebab,revision_number=None']} {{(pid=102993) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 23 19:42:38.940808 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [req-94a27c1c-ade1-4cc9-956b-4d009bc121da req-e0bb70f8-0e1a-412e-b96c-9dbb43cdbd1c tempest-AttachVolumeNegativeTest-754998453 tempest-AttachVolumeNegativeTest-754998453-project] Publish callbacks [] for port, precommit_create {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:42:39.015279 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-91d8fb46-428d-4ad3-92af-611264e34916 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-560161', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-933087'] for router_interface, after_delete {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:42:39.103238 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [req-94a27c1c-ade1-4cc9-956b-4d009bc121da req-e0bb70f8-0e1a-412e-b96c-9dbb43cdbd1c tempest-AttachVolumeNegativeTest-754998453 tempest-AttachVolumeNegativeTest-754998453-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7918660', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-15067', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560168', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8783631008714', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-17257496'] for port, after_create {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:42:39.126033 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.plugins.ml2.db [None req-4bf48ff4-ecfb-4168-8b63-249b8c6e9f04 None None] get_ports_and_sgs() called for port_ids ['e8dc7322-0b92-4637-a298-0a114bf01c42', 'a2ad1558-284e-4085-92ca-d32f3052846b', '56425014-3b47-41cc-b7b9-4b72d31ef8c6'] {{(pid=102994) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 23 19:42:39.156201 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-94a27c1c-ade1-4cc9-956b-4d009bc121da req-e0bb70f8-0e1a-412e-b96c-9dbb43cdbd1c tempest-AttachVolumeNegativeTest-754998453 tempest-AttachVolumeNegativeTest-754998453-project] Network 5f438c34-aac6-400d-bc7e-2e0506f124a9 is already hosted by enough agents. {{(pid=102993) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 23 19:42:39.164448 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.scheduler.base_scheduler [req-94a27c1c-ade1-4cc9-956b-4d009bc121da req-e0bb70f8-0e1a-412e-b96c-9dbb43cdbd1c tempest-AttachVolumeNegativeTest-754998453 tempest-AttachVolumeNegativeTest-754998453-project] Resources bound (agent type, host, resource id): {{(pid=102993) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 23 19:42:39.172332 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.db.l3_dvrscheduler_db [req-94a27c1c-ade1-4cc9-956b-4d009bc121da req-e0bb70f8-0e1a-412e-b96c-9dbb43cdbd1c tempest-AttachVolumeNegativeTest-754998453 tempest-AttachVolumeNegativeTest-754998453-project] Received port after_create {{(pid=102993) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 23 19:42:39.214284 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e0bb70f8-0e1a-412e-b96c-9dbb43cdbd1c tempest-AttachVolumeNegativeTest-754998453 tempest-AttachVolumeNegativeTest-754998453-project] Pushing event updated for resources: {'Port': ['ID=b1a5b461-ffce-430d-9e3a-f6255af48107,revision_number=1']} {{(pid=102993) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 23 19:42:39.270264 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-94a27c1c-ade1-4cc9-956b-4d009bc121da req-e0bb70f8-0e1a-412e-b96c-9dbb43cdbd1c tempest-AttachVolumeNegativeTest-754998453 tempest-AttachVolumeNegativeTest-754998453-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=102993) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:42:39.270877 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [req-94a27c1c-ade1-4cc9-956b-4d009bc121da req-e0bb70f8-0e1a-412e-b96c-9dbb43cdbd1c tempest-AttachVolumeNegativeTest-754998453 tempest-AttachVolumeNegativeTest-754998453-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-514902'] for port, before_response {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:42:39.350538 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-91d8fb46-428d-4ad3-92af-611264e34916 admin admin] Router 3524bcbc-06d6-4343-84f5-54d756e6dd80 has already been hosted by L3 agent 1b20f2c4-70b6-43c3-b9bd-0062cc9e57ac {{(pid=102993) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 23 19:42:39.399581 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-94a27c1c-ade1-4cc9-956b-4d009bc121da req-e0bb70f8-0e1a-412e-b96c-9dbb43cdbd1c tempest-AttachVolumeNegativeTest-754998453 tempest-AttachVolumeNegativeTest-754998453-project] 10.222.0.41 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 1.1831572 Nov 23 19:42:39.416723 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.api.v2.base [req-94a27c1c-ade1-4cc9-956b-4d009bc121da req-7893f31d-bcbb-4012-95ac-67aaffff7267 service neutron] Request body: {'port': {'device_id': 'b63ec72c-0e94-420e-a7b6-cb4ba7fe3c33', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-81901'}} {{(pid=102993) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 23 19:42:39.515674 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [req-94a27c1c-ade1-4cc9-956b-4d009bc121da req-7893f31d-bcbb-4012-95ac-67aaffff7267 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7921281'] for port, before_update {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:42:39.517884 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-91d8fb46-428d-4ad3-92af-611264e34916 admin admin] Notify agent at l3_agent.dv-cinder-819011-1-iscsi the message routers_updated {{(pid=102993) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 23 19:42:39.519119 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-186dc647-5b33-4f75-a483-b84f43939073 req-01420bd6-0f06-4449-9e91-85d1155a5f6c tempest-AttachVolumeNegativeTest-754998453 tempest-AttachVolumeNegativeTest-754998453-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102992) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:42:39.520629 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-186dc647-5b33-4f75-a483-b84f43939073 req-01420bd6-0f06-4449-9e91-85d1155a5f6c tempest-AttachVolumeNegativeTest-754998453 tempest-AttachVolumeNegativeTest-754998453-project] 10.222.0.62 "GET /v2.0/ports?device_id=b63ec72c-0e94-420e-a7b6-cb4ba7fe3c33 HTTP/1.1" status: 200 len: 931 time: 0.0496397 Nov 23 19:42:39.523536 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [None req-91d8fb46-428d-4ad3-92af-611264e34916 admin admin] 10.222.0.62 "PUT /v2.0/routers/3524bcbc-06d6-4343-84f5-54d756e6dd80/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 2.0584247 Nov 23 19:42:39.526198 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.wsgi [-] (102993) accepted ('10.222.0.62', 51010) {{(pid=102993) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 23 19:42:39.531261 dv-cinder-819011-1-iscsi neutron-server[102995]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-f0aab04c-cce0-432a-9dcf-db2d28d224ad None None] Sync routers for ids ['3524bcbc-06d6-4343-84f5-54d756e6dd80'] in dv-cinder-819011-1-iscsi {{(pid=102995) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 23 19:42:39.537764 dv-cinder-819011-1-iscsi neutron-server[102995]: DEBUG neutron.db.l3_dvrscheduler_db [None req-f0aab04c-cce0-432a-9dcf-db2d28d224ad None None] Routers {'3524bcbc-06d6-4343-84f5-54d756e6dd80'} bound to L3 agent in host dv-cinder-819011-1-iscsi {{(pid=102995) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 23 19:42:39.538338 dv-cinder-819011-1-iscsi neutron-server[102995]: DEBUG neutron.db.l3_hamode_db [None req-f0aab04c-cce0-432a-9dcf-db2d28d224ad None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-819011-1-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 6, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 6},created_at=2021-11-23T19:25:14Z,description=,heartbeat_timestamp=2021-11-23T19:42:14Z,host='dv-cinder-819011-1-iscsi',id=1b20f2c4-70b6-43c3-b9bd-0062cc9e57ac,load=0,resource_versions=,resources_synced=,started_at=2021-11-23T19:25:15Z,topic='l3_agent')) {'router_ids': ['3524bcbc-06d6-4343-84f5-54d756e6dd80'], 'active': True} {{(pid=102995) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 23 19:42:39.579955 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-186dc647-5b33-4f75-a483-b84f43939073 req-4629d377-6e09-4160-b73c-f358ea5349f6 tempest-AttachVolumeNegativeTest-754998453 tempest-AttachVolumeNegativeTest-754998453-project] 10.222.0.62 "GET /v2.0/security-groups?id=78a07d59-fd8e-4f94-9dfc-099d7d04efec&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0485716 Nov 23 19:42:39.646864 dv-cinder-819011-1-iscsi neutron-server[102995]: DEBUG neutron.db.l3_dvr_db [None req-f0aab04c-cce0-432a-9dcf-db2d28d224ad None None] Set router 3524bcbc-06d6-4343-84f5-54d756e6dd80 gateway port host: dv-cinder-819011-1-iscsi {{(pid=102995) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 23 19:42:39.724741 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-aa09f910-73cc-465b-92c7-c8603b2c7454 admin admin] Publish callbacks [] for router, before_delete {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:42:39.920038 dv-cinder-819011-1-iscsi neutron-server[102995]: DEBUG neutron.db.l3_hamode_db [None req-f0aab04c-cce0-432a-9dcf-db2d28d224ad None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '3524bcbc-06d6-4343-84f5-54d756e6dd80', 'name': 'tempest-TestShelveInstance-670557749-router', 'tenant_id': '35f8a5017a27449084aabd12f27f5a8a', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'a93e254e-aac9-4233-9e4d-4290fd0458e4', 'external_fixed_ips': [{'subnet_id': 'e0b32f3d-83d6-439a-bbed-01df7cf01051', 'ip_address': '172.27.1.194'}], 'enable_snat': True}, 'gw_port_id': 'abd59c5e-8249-4aba-855f-bf3ed33724b6', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-23T19:37:15Z', 'updated_at': '2021-11-23T19:42:38Z', 'revision_number': 5, 'project_id': '35f8a5017a27449084aabd12f27f5a8a', 'gw_port': {'id': 'abd59c5e-8249-4aba-855f-bf3ed33724b6', 'name': '', 'network_id': 'a93e254e-aac9-4233-9e4d-4290fd0458e4', 'tenant_id': '', 'mac_address': 'fa:16:3e:d7:89:48', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '3524bcbc-06d6-4343-84f5-54d756e6dd80', 'device_owner': 'network:router_gateway', 'standard_attr_id': 515, 'fixed_ips': [{'subnet_id': 'e0b32f3d-83d6-439a-bbed-01df7cf01051', 'ip_address': '172.27.1.194', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-819011-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-23T19:37:16Z', 'updated_at': '2021-11-23T19:37:22Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'e0b32f3d-83d6-439a-bbed-01df7cf01051', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-819011-1-iscsi'}], 'dv-cinder-819011-1-iscsi', False) {} {{(pid=102995) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 23 19:42:39.951260 dv-cinder-819011-1-iscsi neutron-server[102995]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-f0aab04c-cce0-432a-9dcf-db2d28d224ad None None] Checking router: 3524bcbc-06d6-4343-84f5-54d756e6dd80 for host: dv-cinder-819011-1-iscsi {{(pid=102995) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 23 19:42:39.960005 dv-cinder-819011-1-iscsi neutron-server[102995]: DEBUG neutron.db.l3_dvrscheduler_db [None req-f0aab04c-cce0-432a-9dcf-db2d28d224ad None None] Routers {'3524bcbc-06d6-4343-84f5-54d756e6dd80'} bound to L3 agent in host dv-cinder-819011-1-iscsi {{(pid=102995) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 23 19:42:39.960640 dv-cinder-819011-1-iscsi neutron-server[102995]: DEBUG neutron.db.l3_hamode_db [None req-f0aab04c-cce0-432a-9dcf-db2d28d224ad None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-819011-1-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 6, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 6},created_at=2021-11-23T19:25:14Z,description=,heartbeat_timestamp=2021-11-23T19:42:14Z,host='dv-cinder-819011-1-iscsi',id=1b20f2c4-70b6-43c3-b9bd-0062cc9e57ac,load=0,resource_versions=,resources_synced=,started_at=2021-11-23T19:25:15Z,topic='l3_agent')) {'router_ids': ['3524bcbc-06d6-4343-84f5-54d756e6dd80'], 'active': True} {{(pid=102995) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 23 19:42:40.066926 dv-cinder-819011-1-iscsi neutron-server[102995]: DEBUG neutron.db.l3_dvr_db [None req-f0aab04c-cce0-432a-9dcf-db2d28d224ad None None] Set router 3524bcbc-06d6-4343-84f5-54d756e6dd80 gateway port host: dv-cinder-819011-1-iscsi {{(pid=102995) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 23 19:42:40.181739 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-aa09f910-73cc-465b-92c7-c8603b2c7454 admin admin] Publish callbacks [] for router_gateway, before_delete {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:42:40.247072 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.notifiers.nova [req-94a27c1c-ade1-4cc9-956b-4d009bc121da req-7893f31d-bcbb-4012-95ac-67aaffff7267 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id b1a5b461-ffce-430d-9e3a-f6255af48107 {{(pid=102993) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 23 19:42:40.251515 dv-cinder-819011-1-iscsi neutron-server[102995]: DEBUG neutron.db.l3_hamode_db [None req-f0aab04c-cce0-432a-9dcf-db2d28d224ad None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '3524bcbc-06d6-4343-84f5-54d756e6dd80', 'name': 'tempest-TestShelveInstance-670557749-router', 'tenant_id': '35f8a5017a27449084aabd12f27f5a8a', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'a93e254e-aac9-4233-9e4d-4290fd0458e4', 'external_fixed_ips': [{'subnet_id': 'e0b32f3d-83d6-439a-bbed-01df7cf01051', 'ip_address': '172.27.1.194'}], 'enable_snat': True}, 'gw_port_id': 'abd59c5e-8249-4aba-855f-bf3ed33724b6', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-23T19:37:15Z', 'updated_at': '2021-11-23T19:42:38Z', 'revision_number': 5, 'project_id': '35f8a5017a27449084aabd12f27f5a8a', 'gw_port': {'id': 'abd59c5e-8249-4aba-855f-bf3ed33724b6', 'name': '', 'network_id': 'a93e254e-aac9-4233-9e4d-4290fd0458e4', 'tenant_id': '', 'mac_address': 'fa:16:3e:d7:89:48', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '3524bcbc-06d6-4343-84f5-54d756e6dd80', 'device_owner': 'network:router_gateway', 'standard_attr_id': 515, 'fixed_ips': [{'subnet_id': 'e0b32f3d-83d6-439a-bbed-01df7cf01051', 'ip_address': '172.27.1.194', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-819011-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-23T19:37:16Z', 'updated_at': '2021-11-23T19:37:22Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'e0b32f3d-83d6-439a-bbed-01df7cf01051', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-819011-1-iscsi'}], 'dv-cinder-819011-1-iscsi', False) {} {{(pid=102995) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 23 19:42:40.255936 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [req-94a27c1c-ade1-4cc9-956b-4d009bc121da req-7893f31d-bcbb-4012-95ac-67aaffff7267 service neutron] Publish callbacks [] for port, precommit_update {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:42:40.269665 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.db.provisioning_blocks [req-94a27c1c-ade1-4cc9-956b-4d009bc121da req-7893f31d-bcbb-4012-95ac-67aaffff7267 service neutron] Transition to ACTIVE for port object b1a5b461-ffce-430d-9e3a-f6255af48107 will not be triggered until provisioned by entity L2. {{(pid=102993) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 23 19:42:40.278073 dv-cinder-819011-1-iscsi neutron-server[102995]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-f0aab04c-cce0-432a-9dcf-db2d28d224ad None None] The sync data for ids ['3524bcbc-06d6-4343-84f5-54d756e6dd80'] in dv-cinder-819011-1-iscsi is: [{'id': '3524bcbc-06d6-4343-84f5-54d756e6dd80', 'name': 'tempest-TestShelveInstance-670557749-router', 'tenant_id': '35f8a5017a27449084aabd12f27f5a8a', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'a93e254e-aac9-4233-9e4d-4290fd0458e4', 'external_fixed_ips': [{'subnet_id': 'e0b32f3d-83d6-439a-bbed-01df7cf01051', 'ip_address': '172.27.1.194'}], 'enable_snat': True}, 'gw_port_id': 'abd59c5e-8249-4aba-855f-bf3ed33724b6', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-23T19:37:15Z', 'updated_at': '2021-11-23T19:42:38Z', 'revision_number': 5, 'project_id': '35f8a5017a27449084aabd12f27f5a8a', 'gw_port': {'id': 'abd59c5e-8249-4aba-855f-bf3ed33724b6', 'name': '', 'network_id': 'a93e254e-aac9-4233-9e4d-4290fd0458e4', 'tenant_id': '', 'mac_address': 'fa:16:3e:d7:89:48', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '3524bcbc-06d6-4343-84f5-54d756e6dd80', 'device_owner': 'network:router_gateway', 'standard_attr_id': 515, 'fixed_ips': [{'subnet_id': 'e0b32f3d-83d6-439a-bbed-01df7cf01051', 'ip_address': '172.27.1.194', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-819011-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-23T19:37:16Z', 'updated_at': '2021-11-23T19:37:22Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'e0b32f3d-83d6-439a-bbed-01df7cf01051', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-819011-1-iscsi'}] {{(pid=102995) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 23 19:42:40.314924 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.plugins.ml2.plugin [None req-aa09f910-73cc-465b-92c7-c8603b2c7454 admin admin] Deleting port abd59c5e-8249-4aba-855f-bf3ed33724b6 {{(pid=102993) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 23 19:42:40.315267 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-aa09f910-73cc-465b-92c7-c8603b2c7454 admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8783631423070'] for port, before_delete {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:42:40.366868 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [req-94a27c1c-ade1-4cc9-956b-4d009bc121da req-7893f31d-bcbb-4012-95ac-67aaffff7267 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7918660', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-15067', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560168', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8783631423946', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8783631008732', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8783631008750', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-17257505'] for port, after_update {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:42:40.429989 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7893f31d-bcbb-4012-95ac-67aaffff7267 service neutron] Pushing event updated for resources: {'Port': ['ID=b1a5b461-ffce-430d-9e3a-f6255af48107,revision_number=2']} {{(pid=102993) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 23 19:42:40.488897 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.plugins.ml2.db [None req-aa09f910-73cc-465b-92c7-c8603b2c7454 admin admin] For port abd59c5e-8249-4aba-855f-bf3ed33724b6, host dv-cinder-819011-1-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-819011-1-iscsi',level=0,port_id=abd59c5e-8249-4aba-855f-bf3ed33724b6,segment=NetworkSegment(3cb5e60b-103a-47d0-a28b-d68e3159d032),segment_id=3cb5e60b-103a-47d0-a28b-d68e3159d032)] {{(pid=102993) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 23 19:42:40.489287 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-aa09f910-73cc-465b-92c7-c8603b2c7454 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-927332'] for port, precommit_delete {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:42:40.508609 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.plugins.ml2.plugin [None req-aa09f910-73cc-465b-92c7-c8603b2c7454 admin admin] Calling delete_port for abd59c5e-8249-4aba-855f-bf3ed33724b6 owned by network:router_gateway {{(pid=102993) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 23 19:42:40.563485 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.plugins.ml2.managers [req-94a27c1c-ade1-4cc9-956b-4d009bc121da req-7893f31d-bcbb-4012-95ac-67aaffff7267 service neutron] Attempting to bind port b1a5b461-ffce-430d-9e3a-f6255af48107 on host hv-cinder-81901 for vnic_type normal with profile {{(pid=102993) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 23 19:42:40.563752 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.plugins.ml2.managers [req-94a27c1c-ade1-4cc9-956b-4d009bc121da req-7893f31d-bcbb-4012-95ac-67aaffff7267 service neutron] Attempting to bind port b1a5b461-ffce-430d-9e3a-f6255af48107 by drivers openvswitch,hyperv on host hv-cinder-81901 at level 0 using segments [{'id': 'a14a7aae-c481-4c86-92ee-f7808a54fd04', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 832, 'network_id': '5f438c34-aac6-400d-bc7e-2e0506f124a9'}] {{(pid=102993) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 23 19:42:40.564084 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-94a27c1c-ade1-4cc9-956b-4d009bc121da req-7893f31d-bcbb-4012-95ac-67aaffff7267 service neutron] Attempting to bind port b1a5b461-ffce-430d-9e3a-f6255af48107 on network 5f438c34-aac6-400d-bc7e-2e0506f124a9 {{(pid=102993) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 23 19:42:40.573826 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-94a27c1c-ade1-4cc9-956b-4d009bc121da req-7893f31d-bcbb-4012-95ac-67aaffff7267 service neutron] Port b1a5b461-ffce-430d-9e3a-f6255af48107 on network 5f438c34-aac6-400d-bc7e-2e0506f124a9 not bound, no agent of type Open vSwitch agent registered on host hv-cinder-81901 {{(pid=102993) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Nov 23 19:42:40.574148 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-94a27c1c-ade1-4cc9-956b-4d009bc121da req-7893f31d-bcbb-4012-95ac-67aaffff7267 service neutron] Attempting to bind port b1a5b461-ffce-430d-9e3a-f6255af48107 on network 5f438c34-aac6-400d-bc7e-2e0506f124a9 {{(pid=102993) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 23 19:42:40.587885 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-94a27c1c-ade1-4cc9-956b-4d009bc121da req-7893f31d-bcbb-4012-95ac-67aaffff7267 service neutron] Checking agent: {'id': '14e5d049-431d-466a-8d1c-264e5129d376', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-81901', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 23, 19, 31, 29), 'started_at': datetime.datetime(2021, 11, 23, 19, 31, 29), 'heartbeat_timestamp': datetime.datetime(2021, 11, 23, 19, 42, 30), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=102993) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 23 19:42:40.588224 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-94a27c1c-ade1-4cc9-956b-4d009bc121da req-7893f31d-bcbb-4012-95ac-67aaffff7267 service neutron] Checking segment: {'id': 'a14a7aae-c481-4c86-92ee-f7808a54fd04', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 832, 'network_id': '5f438c34-aac6-400d-bc7e-2e0506f124a9'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102993) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 23 19:42:40.588612 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-94a27c1c-ade1-4cc9-956b-4d009bc121da req-7893f31d-bcbb-4012-95ac-67aaffff7267 service neutron] Bound using segment: {'id': 'a14a7aae-c481-4c86-92ee-f7808a54fd04', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 832, 'network_id': '5f438c34-aac6-400d-bc7e-2e0506f124a9'} {{(pid=102993) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 23 19:42:40.589038 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.plugins.ml2.managers [req-94a27c1c-ade1-4cc9-956b-4d009bc121da req-7893f31d-bcbb-4012-95ac-67aaffff7267 service neutron] Bound port: b1a5b461-ffce-430d-9e3a-f6255af48107, host: hv-cinder-81901, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': 'a14a7aae-c481-4c86-92ee-f7808a54fd04', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 832, 'network_id': '5f438c34-aac6-400d-bc7e-2e0506f124a9'}}] {{(pid=102993) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 23 19:42:40.589400 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [req-94a27c1c-ade1-4cc9-956b-4d009bc121da req-7893f31d-bcbb-4012-95ac-67aaffff7267 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7921281'] for port, before_update {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:42:40.736665 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.plugins.ml2.db [req-94a27c1c-ade1-4cc9-956b-4d009bc121da req-7893f31d-bcbb-4012-95ac-67aaffff7267 service neutron] For port b1a5b461-ffce-430d-9e3a-f6255af48107, host hv-cinder-81901, cleared binding levels {{(pid=102993) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 23 19:42:40.742132 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.plugins.ml2.db [req-94a27c1c-ade1-4cc9-956b-4d009bc121da req-7893f31d-bcbb-4012-95ac-67aaffff7267 service neutron] For port b1a5b461-ffce-430d-9e3a-f6255af48107, host hv-cinder-81901, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81901',level=0,port_id=b1a5b461-ffce-430d-9e3a-f6255af48107,segment=NetworkSegment(a14a7aae-c481-4c86-92ee-f7808a54fd04),segment_id=a14a7aae-c481-4c86-92ee-f7808a54fd04)] {{(pid=102993) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 23 19:42:40.775409 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c4d64371-e713-479c-908a-2ced92d01f20 req-d42bcc2b-1b06-4b01-ad6b-e14eb6128265 tempest-AttachVolumeNegativeTest-754998453 tempest-AttachVolumeNegativeTest-754998453-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102993) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:42:40.776893 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-c4d64371-e713-479c-908a-2ced92d01f20 req-d42bcc2b-1b06-4b01-ad6b-e14eb6128265 tempest-AttachVolumeNegativeTest-754998453 tempest-AttachVolumeNegativeTest-754998453-project] 10.222.0.62 "GET /v2.0/ports?device_id=b63ec72c-0e94-420e-a7b6-cb4ba7fe3c33 HTTP/1.1" status: 200 len: 943 time: 0.1165946 Nov 23 19:42:40.822803 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [req-94a27c1c-ade1-4cc9-956b-4d009bc121da req-7893f31d-bcbb-4012-95ac-67aaffff7267 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7918660', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-15067', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560168', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8783631423946', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8783631008732', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8783631008750', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-17257505'] for port, after_update {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:42:40.872707 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-c4d64371-e713-479c-908a-2ced92d01f20 req-6d14eba1-8f4d-4d3a-91fd-a1f12f5cb25e tempest-AttachVolumeNegativeTest-754998453 tempest-AttachVolumeNegativeTest-754998453-project] 10.222.0.62 "GET /v2.0/security-groups?id=78a07d59-fd8e-4f94-9dfc-099d7d04efec&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0880301 Nov 23 19:42:40.876024 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-94a27c1c-ade1-4cc9-956b-4d009bc121da req-7893f31d-bcbb-4012-95ac-67aaffff7267 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102993) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:42:40.876529 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [req-94a27c1c-ade1-4cc9-956b-4d009bc121da req-7893f31d-bcbb-4012-95ac-67aaffff7267 service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-514902'] for port, before_response {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:42:40.877940 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-94a27c1c-ade1-4cc9-956b-4d009bc121da req-7893f31d-bcbb-4012-95ac-67aaffff7267 service neutron] 10.222.0.41 "PUT /v2.0/ports/b1a5b461-ffce-430d-9e3a-f6255af48107 HTTP/1.1" status: 200 len: 1093 time: 1.4659100 Nov 23 19:42:40.878385 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'b63ec72c-0e94-420e-a7b6-cb4ba7fe3c33', 'tag': 'b1a5b461-ffce-430d-9e3a-f6255af48107'}] {{(pid=102993) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 23 19:42:40.880654 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.62/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}9b10b92acbee16fb695be1efeed0b68f7c36a5b215ec004a8d9d707fa3d35b2c" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-fdb61e03-3b38-4100-bfd3-df74588c9b24" -d '{"events": [{"name": "network-changed", "server_uuid": "b63ec72c-0e94-420e-a7b6-cb4ba7fe3c33", "tag": "b1a5b461-ffce-430d-9e3a-f6255af48107"}]}' {{(pid=102993) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 23 19:42:40.894654 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-aa09f910-73cc-465b-92c7-c8603b2c7454 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7918660', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-15067', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560168', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8783631424624', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8783631008723', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-17257496'] for port, after_delete {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:42:40.914394 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7893f31d-bcbb-4012-95ac-67aaffff7267 service neutron] Pushing event updated for resources: {'Port': ['ID=b1a5b461-ffce-430d-9e3a-f6255af48107,revision_number=3']} {{(pid=102993) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 23 19:42:40.935032 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Tue, 23 Nov 2021 19:42:40 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-5dfefbc7-652b-480b-a322-e26bcf386e15 x-openstack-request-id: req-5dfefbc7-652b-480b-a322-e26bcf386e15 {{(pid=102993) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 23 19:42:40.935327 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "b63ec72c-0e94-420e-a7b6-cb4ba7fe3c33", "tag": "b1a5b461-ffce-430d-9e3a-f6255af48107", "status": "completed", "code": 200}]} {{(pid=102993) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 23 19:42:40.935589 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.62/compute/v2.1/os-server-external-events used request id req-5dfefbc7-652b-480b-a322-e26bcf386e15 {{(pid=102993) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 23 19:42:40.936253 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'b63ec72c-0e94-420e-a7b6-cb4ba7fe3c33', 'tag': 'b1a5b461-ffce-430d-9e3a-f6255af48107', 'status': 'completed', 'code': 200} Nov 23 19:42:40.956531 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-aa09f910-73cc-465b-92c7-c8603b2c7454 admin admin] Pushing event deleted for resources: {'Port': ['ID=abd59c5e-8249-4aba-855f-bf3ed33724b6,revision_number=None']} {{(pid=102993) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 23 19:42:41.018757 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-aa09f910-73cc-465b-92c7-c8603b2c7454 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-926585'] for router_gateway, after_delete {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:42:41.083691 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fdb61e03-3b38-4100-bfd3-df74588c9b24 req-b7e2d55c-01ac-4993-a462-09d2fba8f524 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102993) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:42:41.085899 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-fdb61e03-3b38-4100-bfd3-df74588c9b24 req-b7e2d55c-01ac-4993-a462-09d2fba8f524 service neutron] 10.222.0.41 "GET /v2.0/ports?tenant_id=e738acf03acd4f9d90b4dc46fb48bb06&device_id=b63ec72c-0e94-420e-a7b6-cb4ba7fe3c33 HTTP/1.1" status: 200 len: 1096 time: 0.1099851 Nov 23 19:42:41.139285 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-aa09f910-73cc-465b-92c7-c8603b2c7454 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-932919', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-13457'] for router, precommit_delete {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:42:41.146444 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-aa09f910-73cc-465b-92c7-c8603b2c7454 admin admin] Publish callbacks [] for router_controller, precommit_delete_associations {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:42:41.239896 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fdb61e03-3b38-4100-bfd3-df74588c9b24 req-0fe3fc71-bcc1-4d8a-bbfd-2340f4603d72 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102993) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:42:41.241698 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-fdb61e03-3b38-4100-bfd3-df74588c9b24 req-0fe3fc71-bcc1-4d8a-bbfd-2340f4603d72 service neutron] 10.222.0.41 "GET /v2.0/networks?tenant_id=e738acf03acd4f9d90b4dc46fb48bb06&shared=False HTTP/1.1" status: 200 len: 916 time: 0.1312954 Nov 23 19:42:41.260240 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-aa09f910-73cc-465b-92c7-c8603b2c7454 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-926715'] for router, after_delete {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:42:41.260748 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-aa09f910-73cc-465b-92c7-c8603b2c7454 admin admin] Fanout notify agent at l3_agent the message router_deleted on router 3524bcbc-06d6-4343-84f5-54d756e6dd80 {{(pid=102993) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Nov 23 19:42:41.278730 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-aa09f910-73cc-465b-92c7-c8603b2c7454 admin admin] Publish callbacks [] for router, before_response {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:42:41.279868 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [None req-aa09f910-73cc-465b-92c7-c8603b2c7454 admin admin] 10.222.0.62 "DELETE /v2.0/routers/3524bcbc-06d6-4343-84f5-54d756e6dd80 HTTP/1.1" status: 204 len: 168 time: 1.7527497 Nov 23 19:42:41.282564 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.wsgi [-] (102992) accepted ('10.222.0.62', 51022) {{(pid=102992) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 23 19:42:41.342370 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.db.db_base_plugin_v2 [None req-d5354f23-b945-424f-8877-66fba284fece admin admin] Deleting subnet afa5bc59-f70c-409d-8c15-be2dcdce66a3 {{(pid=102992) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Nov 23 19:42:41.346312 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [None req-d5354f23-b945-424f-8877-66fba284fece admin admin] Publish callbacks [] for subnet, before_delete {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:42:41.362347 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fdb61e03-3b38-4100-bfd3-df74588c9b24 req-7fd75947-0a0c-4e89-b549-1f309e099da6 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102993) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:42:41.363827 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-fdb61e03-3b38-4100-bfd3-df74588c9b24 req-7fd75947-0a0c-4e89-b549-1f309e099da6 service neutron] 10.222.0.41 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 870 time: 0.1124544 Nov 23 19:42:41.384057 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [None req-d5354f23-b945-424f-8877-66fba284fece admin admin] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-25272549'] for subnet, precommit_delete_associations {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:42:41.456606 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-94a27c1c-ade1-4cc9-956b-4d009bc121da req-470d2c17-b694-456f-8b62-17284d5354af service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102993) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:42:41.458150 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-94a27c1c-ade1-4cc9-956b-4d009bc121da req-470d2c17-b694-456f-8b62-17284d5354af service neutron] 10.222.0.41 "GET /v2.0/ports?tenant_id=e738acf03acd4f9d90b4dc46fb48bb06&device_id=b63ec72c-0e94-420e-a7b6-cb4ba7fe3c33 HTTP/1.1" status: 200 len: 1096 time: 0.0414662 Nov 23 19:42:41.466758 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [None req-d5354f23-b945-424f-8877-66fba284fece admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-7975863'] for subnet, precommit_delete {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:42:41.510242 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-94a27c1c-ade1-4cc9-956b-4d009bc121da req-684aaa62-4f51-4393-a862-5d062a2e19f8 service neutron] 10.222.0.41 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.4&port_id=b1a5b461-ffce-430d-9e3a-f6255af48107 HTTP/1.1" status: 200 len: 217 time: 0.0392747 Nov 23 19:42:41.575985 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [None req-d5354f23-b945-424f-8877-66fba284fece admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-7982148', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-554858', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560168', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-25199822', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-25999729'] for subnet, after_delete {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:42:41.601666 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d5354f23-b945-424f-8877-66fba284fece admin admin] Pushing event deleted for resources: {'Subnet': ['ID=afa5bc59-f70c-409d-8c15-be2dcdce66a3,revision_number=None']} {{(pid=102992) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 23 19:42:41.605473 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [None req-d5354f23-b945-424f-8877-66fba284fece admin admin] Publish callbacks [] for subnet, before_response {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:42:41.608756 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [None req-d5354f23-b945-424f-8877-66fba284fece admin admin] 10.222.0.62 "DELETE /v2.0/subnets/afa5bc59-f70c-409d-8c15-be2dcdce66a3 HTTP/1.1" status: 204 len: 168 time: 0.3244426 Nov 23 19:42:41.612452 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.wsgi [-] (102992) accepted ('10.222.0.62', 51024) {{(pid=102992) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 23 19:42:41.615477 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-885bc388-65da-4f6a-865e-c67a346bd728 None None] Network 87e46ab6-0f90-430f-930f-9ea1580c04c3 requested from dv-cinder-819011-1-iscsi {{(pid=102994) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 23 19:42:41.624292 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-94a27c1c-ade1-4cc9-956b-4d009bc121da req-3b8d0f3a-9ff6-45ae-937b-24f4d2b0d3bc service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102993) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:42:41.625942 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-94a27c1c-ade1-4cc9-956b-4d009bc121da req-3b8d0f3a-9ff6-45ae-937b-24f4d2b0d3bc service neutron] 10.222.0.41 "GET /v2.0/subnets?id=ffd14982-fec3-42b1-9d92-f2ed87a640f4 HTTP/1.1" status: 200 len: 855 time: 0.1059802 Nov 23 19:42:41.674150 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-94a27c1c-ade1-4cc9-956b-4d009bc121da req-f980bdce-1033-45db-9f8d-ebebe738679f service neutron] 10.222.0.41 "GET /v2.0/ports?network_id=5f438c34-aac6-400d-bc7e-2e0506f124a9&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0290208 Nov 23 19:42:41.682901 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [None req-0a1a7548-6377-4dc1-b22a-135696a1ae95 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-8133038'] for network, before_delete {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:42:41.763096 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.plugins.ml2.plugin [None req-0a1a7548-6377-4dc1-b22a-135696a1ae95 admin admin] Deleting port be8d3464-418e-47d4-85c9-a0e4ae74df89 {{(pid=102992) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 23 19:42:41.763528 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [None req-0a1a7548-6377-4dc1-b22a-135696a1ae95 admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8783631423070'] for port, before_delete {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:42:41.775543 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron_lib.callbacks.manager [None req-7102e20c-dd4e-44c5-b897-b49fdad45772 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8783631323329', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7978582'] for agent, after_update {{(pid=102994) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:42:41.811680 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-94a27c1c-ade1-4cc9-956b-4d009bc121da req-deac09f8-1b8b-4130-8e72-82278f4e39a9 service neutron] 10.222.0.41 "GET /v2.0/networks/5f438c34-aac6-400d-bc7e-2e0506f124a9?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1266835 Nov 23 19:42:41.832831 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.plugins.ml2.db [None req-0a1a7548-6377-4dc1-b22a-135696a1ae95 admin admin] For port be8d3464-418e-47d4-85c9-a0e4ae74df89, host dv-cinder-819011-1-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-819011-1-iscsi',level=0,port_id=be8d3464-418e-47d4-85c9-a0e4ae74df89,segment=NetworkSegment(5c30b9a1-7b41-4664-aa24-084baf66a2d5),segment_id=5c30b9a1-7b41-4664-aa24-084baf66a2d5)] {{(pid=102992) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 23 19:42:41.833215 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [None req-0a1a7548-6377-4dc1-b22a-135696a1ae95 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-927332'] for port, precommit_delete {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:42:41.833776 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-f5c64e82-7812-4672-80cb-b9f02185f51d None None] DHCP port deletion for 87e46ab6-0f90-430f-930f-9ea1580c04c3 request from dv-cinder-819011-1-iscsi {{(pid=102994) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:266}} Nov 23 19:42:41.848866 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.plugins.ml2.plugin [None req-0a1a7548-6377-4dc1-b22a-135696a1ae95 admin admin] Calling delete_port for be8d3464-418e-47d4-85c9-a0e4ae74df89 owned by network:dhcp {{(pid=102992) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 23 19:42:41.885828 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.plugins.ml2.plugin [None req-f5c64e82-7812-4672-80cb-b9f02185f51d None None] Deleting port be8d3464-418e-47d4-85c9-a0e4ae74df89 {{(pid=102994) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 23 19:42:41.886211 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron_lib.callbacks.manager [None req-f5c64e82-7812-4672-80cb-b9f02185f51d None None] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8783631423070'] for port, before_delete {{(pid=102994) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:42:41.926698 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-94a27c1c-ade1-4cc9-956b-4d009bc121da req-1b30fda5-9549-45ff-a985-8da6ce924fe7 service neutron] 10.222.0.41 "GET /v2.0/networks/5f438c34-aac6-400d-bc7e-2e0506f124a9?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1051395 Nov 23 19:42:41.952009 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.plugins.ml2.db [None req-f5c64e82-7812-4672-80cb-b9f02185f51d None None] For port be8d3464-418e-47d4-85c9-a0e4ae74df89, host dv-cinder-819011-1-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-819011-1-iscsi',level=0,port_id=be8d3464-418e-47d4-85c9-a0e4ae74df89,segment=NetworkSegment(5c30b9a1-7b41-4664-aa24-084baf66a2d5),segment_id=5c30b9a1-7b41-4664-aa24-084baf66a2d5)] {{(pid=102994) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 23 19:42:41.952465 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron_lib.callbacks.manager [None req-f5c64e82-7812-4672-80cb-b9f02185f51d None None] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-927332'] for port, precommit_delete {{(pid=102994) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:42:41.966478 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.plugins.ml2.plugin [None req-f5c64e82-7812-4672-80cb-b9f02185f51d None None] Calling delete_port for be8d3464-418e-47d4-85c9-a0e4ae74df89 owned by network:dhcp {{(pid=102994) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 23 19:42:42.009269 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-07a042fe-9245-4001-9da2-f995537883ab req-2224278e-baf6-4b29-8afb-aaa2247ac1ac tempest-AttachVolumeNegativeTest-754998453 tempest-AttachVolumeNegativeTest-754998453-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102993) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:42:42.010747 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-07a042fe-9245-4001-9da2-f995537883ab req-2224278e-baf6-4b29-8afb-aaa2247ac1ac tempest-AttachVolumeNegativeTest-754998453 tempest-AttachVolumeNegativeTest-754998453-project] 10.222.0.62 "GET /v2.0/ports?device_id=b63ec72c-0e94-420e-a7b6-cb4ba7fe3c33 HTTP/1.1" status: 200 len: 943 time: 0.0498848 Nov 23 19:42:42.050370 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [None req-0a1a7548-6377-4dc1-b22a-135696a1ae95 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7918660', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-15067', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560168', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8783631424624', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8783631008723', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-25199805'] for port, after_delete {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:42:42.056676 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron_lib.callbacks.manager [None req-f5c64e82-7812-4672-80cb-b9f02185f51d None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7918660', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-15067', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560168', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8783631424624', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8783631008723'] for port, after_delete {{(pid=102994) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:42:42.067100 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-07a042fe-9245-4001-9da2-f995537883ab req-419ad967-b617-4926-ac15-4851ea0486d0 tempest-AttachVolumeNegativeTest-754998453 tempest-AttachVolumeNegativeTest-754998453-project] 10.222.0.62 "GET /v2.0/security-groups?id=78a07d59-fd8e-4f94-9dfc-099d7d04efec&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0501685 Nov 23 19:42:42.080455 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0a1a7548-6377-4dc1-b22a-135696a1ae95 admin admin] Pushing event deleted for resources: {'Port': ['ID=be8d3464-418e-47d4-85c9-a0e4ae74df89,revision_number=None']} {{(pid=102992) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 23 19:42:42.086550 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.db.l3_dvrscheduler_db [None req-0a1a7548-6377-4dc1-b22a-135696a1ae95 admin admin] No DVR routers for this DVR port be8d3464-418e-47d4-85c9-a0e4ae74df89 on host dv-cinder-819011-1-iscsi {{(pid=102992) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 23 19:42:42.092116 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f5c64e82-7812-4672-80cb-b9f02185f51d None None] Pushing event deleted for resources: {'Port': ['ID=be8d3464-418e-47d4-85c9-a0e4ae74df89,revision_number=None']} {{(pid=102994) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 23 19:42:42.094218 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.db.l3_dvrscheduler_db [None req-f5c64e82-7812-4672-80cb-b9f02185f51d None None] No DVR routers for this DVR port be8d3464-418e-47d4-85c9-a0e4ae74df89 on host dv-cinder-819011-1-iscsi {{(pid=102994) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 23 19:42:42.160600 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [None req-0a1a7548-6377-4dc1-b22a-135696a1ae95 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-7977576', 'neutron.services.segments.db._delete_segments_for_network-8783631323320'] for network, precommit_delete {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:42:42.180836 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.services.segments.db [None req-0a1a7548-6377-4dc1-b22a-135696a1ae95 admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['87e46ab6-0f90-430f-930f-9ea1580c04c3']}} {{(pid=102992) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 23 19:42:42.190320 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.services.segments.db [None req-0a1a7548-6377-4dc1-b22a-135696a1ae95 admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '5c30b9a1-7b41-4664-aa24-084baf66a2d5') {'for_net_delete': True} {{(pid=102992) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 23 19:42:42.190655 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.services.segments.db [None req-0a1a7548-6377-4dc1-b22a-135696a1ae95 admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '5c30b9a1-7b41-4664-aa24-084baf66a2d5') {} {{(pid=102992) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 23 19:42:42.200879 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [None req-0a1a7548-6377-4dc1-b22a-135696a1ae95 admin admin] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8783631432524', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-25272530'] for segment, before_delete {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:42:42.214784 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [None req-0a1a7548-6377-4dc1-b22a-135696a1ae95 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7982218'] for segment, precommit_delete {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:42:42.221058 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-0a1a7548-6377-4dc1-b22a-135696a1ae95 admin admin] Releasing vlan 817 on physical network physnet1 to pool {{(pid=102992) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Nov 23 19:42:42.221480 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [None req-0a1a7548-6377-4dc1-b22a-135696a1ae95 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7982218', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-25200492'] for segment, after_delete {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:42:42.223098 dv-cinder-819011-1-iscsi neutron-server[102992]: Traceback (most recent call last): Nov 23 19:42:42.223098 dv-cinder-819011-1-iscsi neutron-server[102992]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Nov 23 19:42:42.223098 dv-cinder-819011-1-iscsi neutron-server[102992]: timer() Nov 23 19:42:42.223098 dv-cinder-819011-1-iscsi neutron-server[102992]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 23 19:42:42.223098 dv-cinder-819011-1-iscsi neutron-server[102992]: cb(*args, **kw) Nov 23 19:42:42.223098 dv-cinder-819011-1-iscsi neutron-server[102992]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Nov 23 19:42:42.223098 dv-cinder-819011-1-iscsi neutron-server[102992]: return func(*args, **kwargs) Nov 23 19:42:42.223098 dv-cinder-819011-1-iscsi neutron-server[102992]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 23 19:42:42.223098 dv-cinder-819011-1-iscsi neutron-server[102992]: self._notify() Nov 23 19:42:42.223098 dv-cinder-819011-1-iscsi neutron-server[102992]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 23 19:42:42.223098 dv-cinder-819011-1-iscsi neutron-server[102992]: self.callback(batched_events) Nov 23 19:42:42.223098 dv-cinder-819011-1-iscsi neutron-server[102992]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 23 19:42:42.223098 dv-cinder-819011-1-iscsi neutron-server[102992]: event.method(event) Nov 23 19:42:42.223098 dv-cinder-819011-1-iscsi neutron-server[102992]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Nov 23 19:42:42.223098 dv-cinder-819011-1-iscsi neutron-server[102992]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 23 19:42:42.223098 dv-cinder-819011-1-iscsi neutron-server[102992]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Nov 23 19:42:42.223098 dv-cinder-819011-1-iscsi neutron-server[102992]: aggregate_uuid = self.p_client.list_aggregates( Nov 23 19:42:42.223098 dv-cinder-819011-1-iscsi neutron-server[102992]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Nov 23 19:42:42.223098 dv-cinder-819011-1-iscsi neutron-server[102992]: return f(self, *a, **k) Nov 23 19:42:42.223098 dv-cinder-819011-1-iscsi neutron-server[102992]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 23 19:42:42.223098 dv-cinder-819011-1-iscsi neutron-server[102992]: return self._get(url).json() Nov 23 19:42:42.223098 dv-cinder-819011-1-iscsi neutron-server[102992]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 23 19:42:42.223098 dv-cinder-819011-1-iscsi neutron-server[102992]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 23 19:42:42.223098 dv-cinder-819011-1-iscsi neutron-server[102992]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Nov 23 19:42:42.223098 dv-cinder-819011-1-iscsi neutron-server[102992]: return self.request(url, 'GET', **kwargs) Nov 23 19:42:42.223098 dv-cinder-819011-1-iscsi neutron-server[102992]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Nov 23 19:42:42.223098 dv-cinder-819011-1-iscsi neutron-server[102992]: base_url = self.get_endpoint(auth, allow=allow, Nov 23 19:42:42.223098 dv-cinder-819011-1-iscsi neutron-server[102992]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Nov 23 19:42:42.223098 dv-cinder-819011-1-iscsi neutron-server[102992]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 23 19:42:42.223098 dv-cinder-819011-1-iscsi neutron-server[102992]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Nov 23 19:42:42.223098 dv-cinder-819011-1-iscsi neutron-server[102992]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 23 19:42:42.223098 dv-cinder-819011-1-iscsi neutron-server[102992]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 23 19:42:42.238747 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.plugins.ml2.rpc [None req-eb87b2c3-3339-4249-8b85-e695b5b4e1f9 None None] Device abd59c5e-8249-4aba-855f-bf3ed33724b6 no longer exists at agent ovs-agent-dv-cinder-819011-1-iscsi {{(pid=102994) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 23 19:42:42.259572 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.plugins.ml2.plugin [None req-eb87b2c3-3339-4249-8b85-e695b5b4e1f9 None None] No Port match for: abd59c5e-8249-4aba-855f-bf3ed33724b6 {{(pid=102994) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 23 19:42:42.259917 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.plugins.ml2.rpc [None req-eb87b2c3-3339-4249-8b85-e695b5b4e1f9 None None] Device abd59c5e-8249-4aba-855f-bf3ed33724b6 not bound to the agent host dv-cinder-819011-1-iscsi {{(pid=102994) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 23 19:42:42.260418 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.plugins.ml2.rpc [None req-eb87b2c3-3339-4249-8b85-e695b5b4e1f9 None None] Device e277d91a-2f3d-4a95-80af-b6e6c458ebab no longer exists at agent ovs-agent-dv-cinder-819011-1-iscsi {{(pid=102994) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 23 19:42:42.283539 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.plugins.ml2.plugin [None req-eb87b2c3-3339-4249-8b85-e695b5b4e1f9 None None] No Port match for: e277d91a-2f3d-4a95-80af-b6e6c458ebab {{(pid=102994) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 23 19:42:42.292039 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.plugins.ml2.rpc [None req-eb87b2c3-3339-4249-8b85-e695b5b4e1f9 None None] Device e277d91a-2f3d-4a95-80af-b6e6c458ebab not bound to the agent host dv-cinder-819011-1-iscsi {{(pid=102994) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 23 19:42:42.292039 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.plugins.ml2.rpc [None req-eb87b2c3-3339-4249-8b85-e695b5b4e1f9 None None] Device be8d3464-418e-47d4-85c9-a0e4ae74df89 no longer exists at agent ovs-agent-dv-cinder-819011-1-iscsi {{(pid=102994) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 23 19:42:42.303358 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.plugins.ml2.plugin [None req-eb87b2c3-3339-4249-8b85-e695b5b4e1f9 None None] No Port match for: be8d3464-418e-47d4-85c9-a0e4ae74df89 {{(pid=102994) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 23 19:42:42.303864 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.plugins.ml2.rpc [None req-eb87b2c3-3339-4249-8b85-e695b5b4e1f9 None None] Device be8d3464-418e-47d4-85c9-a0e4ae74df89 not bound to the agent host dv-cinder-819011-1-iscsi {{(pid=102994) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 23 19:42:42.318512 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [None req-0a1a7548-6377-4dc1-b22a-135696a1ae95 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-7977567', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-554949', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560168', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-926557'] for network, after_delete {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:42:42.324564 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [None req-0a1a7548-6377-4dc1-b22a-135696a1ae95 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-560186'] for network, before_response {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:42:42.329267 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [None req-0a1a7548-6377-4dc1-b22a-135696a1ae95 admin admin] 10.222.0.62 "DELETE /v2.0/networks/87e46ab6-0f90-430f-930f-9ea1580c04c3 HTTP/1.1" status: 204 len: 168 time: 0.7144976 Nov 23 19:42:42.331170 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.wsgi [-] (102993) accepted ('10.222.0.62', 51030) {{(pid=102993) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 23 19:42:42.339557 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0a1a7548-6377-4dc1-b22a-135696a1ae95 admin admin] Pushing event deleted for resources: {'Network': ['ID=87e46ab6-0f90-430f-930f-9ea1580c04c3,revision_number=None']} {{(pid=102992) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 23 19:42:42.673210 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-5a7ea939-ee29-48b9-bd1f-aa69fe9a9000 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-932931'] for router_interface, before_delete {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:42:42.919023 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.plugins.ml2.plugin [None req-5a7ea939-ee29-48b9-bd1f-aa69fe9a9000 admin admin] Deleting port 6316de48-e729-4e1a-8557-06a3ec7c6a4a {{(pid=102993) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 23 19:42:42.919360 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-5a7ea939-ee29-48b9-bd1f-aa69fe9a9000 admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8783631423070'] for port, before_delete {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:42:42.996897 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.plugins.ml2.db [None req-5a7ea939-ee29-48b9-bd1f-aa69fe9a9000 admin admin] For port 6316de48-e729-4e1a-8557-06a3ec7c6a4a, host dv-cinder-819011-1-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-819011-1-iscsi',level=0,port_id=6316de48-e729-4e1a-8557-06a3ec7c6a4a,segment=NetworkSegment(a6451c29-fea7-487e-9bb2-6a8e36a6bb38),segment_id=a6451c29-fea7-487e-9bb2-6a8e36a6bb38)] {{(pid=102993) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 23 19:42:42.997253 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-5a7ea939-ee29-48b9-bd1f-aa69fe9a9000 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-927332'] for port, precommit_delete {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:42:43.013085 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.plugins.ml2.plugin [None req-5a7ea939-ee29-48b9-bd1f-aa69fe9a9000 admin admin] Calling delete_port for 6316de48-e729-4e1a-8557-06a3ec7c6a4a owned by network:router_interface {{(pid=102993) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 23 19:42:43.191607 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-083fab0d-0fd5-433f-b7ca-eb8acaab0ab9 req-d171fad9-82e1-4f2e-a55c-dd0e5ae9ecbd tempest-AttachVolumeNegativeTest-754998453 tempest-AttachVolumeNegativeTest-754998453-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102992) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:42:43.193133 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-083fab0d-0fd5-433f-b7ca-eb8acaab0ab9 req-d171fad9-82e1-4f2e-a55c-dd0e5ae9ecbd tempest-AttachVolumeNegativeTest-754998453 tempest-AttachVolumeNegativeTest-754998453-project] 10.222.0.62 "GET /v2.0/ports?device_id=b63ec72c-0e94-420e-a7b6-cb4ba7fe3c33 HTTP/1.1" status: 200 len: 943 time: 0.0543721 Nov 23 19:42:43.238738 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-5a7ea939-ee29-48b9-bd1f-aa69fe9a9000 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7918660', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-15067', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560168', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8783631424624', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8783631008723', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-17257496'] for port, after_delete {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:42:43.242753 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-083fab0d-0fd5-433f-b7ca-eb8acaab0ab9 req-911bfb73-6136-468a-b7be-16e66f37acef tempest-AttachVolumeNegativeTest-754998453 tempest-AttachVolumeNegativeTest-754998453-project] 10.222.0.62 "GET /v2.0/security-groups?id=78a07d59-fd8e-4f94-9dfc-099d7d04efec&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0424502 Nov 23 19:42:43.270900 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5a7ea939-ee29-48b9-bd1f-aa69fe9a9000 admin admin] Pushing event deleted for resources: {'Port': ['ID=6316de48-e729-4e1a-8557-06a3ec7c6a4a,revision_number=None']} {{(pid=102993) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 23 19:42:43.459932 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-5a7ea939-ee29-48b9-bd1f-aa69fe9a9000 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-560161', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-933087'] for router_interface, after_delete {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:42:43.688327 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-5a7ea939-ee29-48b9-bd1f-aa69fe9a9000 admin admin] Router 7d0a2886-ab9d-4826-872e-c085fa7372ce has already been hosted by L3 agent 1b20f2c4-70b6-43c3-b9bd-0062cc9e57ac {{(pid=102993) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 23 19:42:43.793849 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-5a7ea939-ee29-48b9-bd1f-aa69fe9a9000 admin admin] Notify agent at l3_agent.dv-cinder-819011-1-iscsi the message routers_updated {{(pid=102993) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 23 19:42:43.798945 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [None req-5a7ea939-ee29-48b9-bd1f-aa69fe9a9000 admin admin] 10.222.0.62 "PUT /v2.0/routers/7d0a2886-ab9d-4826-872e-c085fa7372ce/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 1.4665139 Nov 23 19:42:43.801801 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.wsgi [-] (102993) accepted ('10.222.0.62', 51044) {{(pid=102993) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 23 19:42:43.804311 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-239ed096-a9bc-48ce-aab4-7ff32b555d39 None None] Sync routers for ids ['7d0a2886-ab9d-4826-872e-c085fa7372ce'] in dv-cinder-819011-1-iscsi {{(pid=102994) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 23 19:42:43.816782 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.db.l3_dvrscheduler_db [None req-239ed096-a9bc-48ce-aab4-7ff32b555d39 None None] Routers {'7d0a2886-ab9d-4826-872e-c085fa7372ce'} bound to L3 agent in host dv-cinder-819011-1-iscsi {{(pid=102994) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 23 19:42:43.817437 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.db.l3_hamode_db [None req-239ed096-a9bc-48ce-aab4-7ff32b555d39 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-819011-1-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 6, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 6},created_at=2021-11-23T19:25:14Z,description=,heartbeat_timestamp=2021-11-23T19:42:14Z,host='dv-cinder-819011-1-iscsi',id=1b20f2c4-70b6-43c3-b9bd-0062cc9e57ac,load=0,resource_versions=,resources_synced=,started_at=2021-11-23T19:25:15Z,topic='l3_agent')) {'router_ids': ['7d0a2886-ab9d-4826-872e-c085fa7372ce'], 'active': True} {{(pid=102994) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 23 19:42:43.906090 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-25956835-80d3-4c18-a50b-8a2ab36d2864 admin admin] Publish callbacks [] for router, before_delete {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:42:43.924369 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.db.l3_dvr_db [None req-239ed096-a9bc-48ce-aab4-7ff32b555d39 None None] Set router 7d0a2886-ab9d-4826-872e-c085fa7372ce gateway port host: dv-cinder-819011-1-iscsi {{(pid=102994) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 23 19:42:44.125793 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.db.l3_hamode_db [None req-239ed096-a9bc-48ce-aab4-7ff32b555d39 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '7d0a2886-ab9d-4826-872e-c085fa7372ce', 'name': 'tempest-TestShelveInstance-1814897973-router', 'tenant_id': '2782edd0ce0e455b825d4fa9efd24221', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'a93e254e-aac9-4233-9e4d-4290fd0458e4', 'external_fixed_ips': [{'subnet_id': 'e0b32f3d-83d6-439a-bbed-01df7cf01051', 'ip_address': '172.27.1.217'}], 'enable_snat': True}, 'gw_port_id': '6f678090-b3f3-474e-8c77-32f412c39e45', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-23T19:37:21Z', 'updated_at': '2021-11-23T19:42:43Z', 'revision_number': 5, 'project_id': '2782edd0ce0e455b825d4fa9efd24221', 'gw_port': {'id': '6f678090-b3f3-474e-8c77-32f412c39e45', 'name': '', 'network_id': 'a93e254e-aac9-4233-9e4d-4290fd0458e4', 'tenant_id': '', 'mac_address': 'fa:16:3e:bd:9a:bb', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '7d0a2886-ab9d-4826-872e-c085fa7372ce', 'device_owner': 'network:router_gateway', 'standard_attr_id': 528, 'fixed_ips': [{'subnet_id': 'e0b32f3d-83d6-439a-bbed-01df7cf01051', 'ip_address': '172.27.1.217', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-819011-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-23T19:37:22Z', 'updated_at': '2021-11-23T19:37:28Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'e0b32f3d-83d6-439a-bbed-01df7cf01051', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-819011-1-iscsi'}], 'dv-cinder-819011-1-iscsi', False) {} {{(pid=102994) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 23 19:42:44.167000 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-239ed096-a9bc-48ce-aab4-7ff32b555d39 None None] Checking router: 7d0a2886-ab9d-4826-872e-c085fa7372ce for host: dv-cinder-819011-1-iscsi {{(pid=102994) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 23 19:42:44.182008 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.db.l3_dvrscheduler_db [None req-239ed096-a9bc-48ce-aab4-7ff32b555d39 None None] Routers {'7d0a2886-ab9d-4826-872e-c085fa7372ce'} bound to L3 agent in host dv-cinder-819011-1-iscsi {{(pid=102994) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 23 19:42:44.182722 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.db.l3_hamode_db [None req-239ed096-a9bc-48ce-aab4-7ff32b555d39 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-819011-1-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 6, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 6},created_at=2021-11-23T19:25:14Z,description=,heartbeat_timestamp=2021-11-23T19:42:14Z,host='dv-cinder-819011-1-iscsi',id=1b20f2c4-70b6-43c3-b9bd-0062cc9e57ac,load=0,resource_versions=,resources_synced=,started_at=2021-11-23T19:25:15Z,topic='l3_agent')) {'router_ids': ['7d0a2886-ab9d-4826-872e-c085fa7372ce'], 'active': True} {{(pid=102994) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 23 19:42:44.265929 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron_lib.callbacks.manager [None req-36947a13-7b47-4bbc-bc70-6ab7c3c6acf0 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8783631323329', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7978582'] for agent, after_update {{(pid=102994) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:42:44.300054 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-25956835-80d3-4c18-a50b-8a2ab36d2864 admin admin] Publish callbacks [] for router_gateway, before_delete {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:42:44.311461 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.db.l3_dvr_db [None req-239ed096-a9bc-48ce-aab4-7ff32b555d39 None None] Set router 7d0a2886-ab9d-4826-872e-c085fa7372ce gateway port host: dv-cinder-819011-1-iscsi {{(pid=102994) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 23 19:42:44.384180 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f76bd764-27a7-4ba7-9526-3ac86505c6d4 req-65b98f6d-b7a9-494c-a30d-3b0d0dea1b5f tempest-AttachVolumeNegativeTest-754998453 tempest-AttachVolumeNegativeTest-754998453-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102993) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:42:44.385743 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-f76bd764-27a7-4ba7-9526-3ac86505c6d4 req-65b98f6d-b7a9-494c-a30d-3b0d0dea1b5f tempest-AttachVolumeNegativeTest-754998453 tempest-AttachVolumeNegativeTest-754998453-project] 10.222.0.62 "GET /v2.0/ports?device_id=b63ec72c-0e94-420e-a7b6-cb4ba7fe3c33 HTTP/1.1" status: 200 len: 943 time: 0.0706542 Nov 23 19:42:44.441037 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.plugins.ml2.plugin [None req-25956835-80d3-4c18-a50b-8a2ab36d2864 admin admin] Deleting port 6f678090-b3f3-474e-8c77-32f412c39e45 {{(pid=102993) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 23 19:42:44.441366 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-25956835-80d3-4c18-a50b-8a2ab36d2864 admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8783631423070'] for port, before_delete {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:42:44.459192 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-f76bd764-27a7-4ba7-9526-3ac86505c6d4 req-ce6820fb-8c63-483e-beac-f9558a731fd1 tempest-AttachVolumeNegativeTest-754998453 tempest-AttachVolumeNegativeTest-754998453-project] 10.222.0.62 "GET /v2.0/security-groups?id=78a07d59-fd8e-4f94-9dfc-099d7d04efec&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0660524 Nov 23 19:42:44.540235 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.plugins.ml2.db [None req-25956835-80d3-4c18-a50b-8a2ab36d2864 admin admin] For port 6f678090-b3f3-474e-8c77-32f412c39e45, host dv-cinder-819011-1-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-819011-1-iscsi',level=0,port_id=6f678090-b3f3-474e-8c77-32f412c39e45,segment=NetworkSegment(3cb5e60b-103a-47d0-a28b-d68e3159d032),segment_id=3cb5e60b-103a-47d0-a28b-d68e3159d032)] {{(pid=102993) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 23 19:42:44.540657 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-25956835-80d3-4c18-a50b-8a2ab36d2864 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-927332'] for port, precommit_delete {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:42:44.552466 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.plugins.ml2.plugin [None req-25956835-80d3-4c18-a50b-8a2ab36d2864 admin admin] Calling delete_port for 6f678090-b3f3-474e-8c77-32f412c39e45 owned by network:router_gateway {{(pid=102993) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 23 19:42:44.618308 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.db.l3_hamode_db [None req-239ed096-a9bc-48ce-aab4-7ff32b555d39 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '7d0a2886-ab9d-4826-872e-c085fa7372ce', 'name': 'tempest-TestShelveInstance-1814897973-router', 'tenant_id': '2782edd0ce0e455b825d4fa9efd24221', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'a93e254e-aac9-4233-9e4d-4290fd0458e4', 'external_fixed_ips': [{'subnet_id': 'e0b32f3d-83d6-439a-bbed-01df7cf01051', 'ip_address': '172.27.1.217'}], 'enable_snat': True}, 'gw_port_id': '6f678090-b3f3-474e-8c77-32f412c39e45', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-23T19:37:21Z', 'updated_at': '2021-11-23T19:42:43Z', 'revision_number': 5, 'project_id': '2782edd0ce0e455b825d4fa9efd24221', 'gw_port': {'id': '6f678090-b3f3-474e-8c77-32f412c39e45', 'name': '', 'network_id': 'a93e254e-aac9-4233-9e4d-4290fd0458e4', 'tenant_id': '', 'mac_address': 'fa:16:3e:bd:9a:bb', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '7d0a2886-ab9d-4826-872e-c085fa7372ce', 'device_owner': 'network:router_gateway', 'standard_attr_id': 528, 'fixed_ips': [{'subnet_id': 'e0b32f3d-83d6-439a-bbed-01df7cf01051', 'ip_address': '172.27.1.217', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-819011-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-23T19:37:22Z', 'updated_at': '2021-11-23T19:37:28Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'e0b32f3d-83d6-439a-bbed-01df7cf01051', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-819011-1-iscsi'}], 'dv-cinder-819011-1-iscsi', False) {} {{(pid=102994) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 23 19:42:44.644283 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-239ed096-a9bc-48ce-aab4-7ff32b555d39 None None] The sync data for ids ['7d0a2886-ab9d-4826-872e-c085fa7372ce'] in dv-cinder-819011-1-iscsi is: [{'id': '7d0a2886-ab9d-4826-872e-c085fa7372ce', 'name': 'tempest-TestShelveInstance-1814897973-router', 'tenant_id': '2782edd0ce0e455b825d4fa9efd24221', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'a93e254e-aac9-4233-9e4d-4290fd0458e4', 'external_fixed_ips': [{'subnet_id': 'e0b32f3d-83d6-439a-bbed-01df7cf01051', 'ip_address': '172.27.1.217'}], 'enable_snat': True}, 'gw_port_id': '6f678090-b3f3-474e-8c77-32f412c39e45', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-23T19:37:21Z', 'updated_at': '2021-11-23T19:42:43Z', 'revision_number': 5, 'project_id': '2782edd0ce0e455b825d4fa9efd24221', 'gw_port': {'id': '6f678090-b3f3-474e-8c77-32f412c39e45', 'name': '', 'network_id': 'a93e254e-aac9-4233-9e4d-4290fd0458e4', 'tenant_id': '', 'mac_address': 'fa:16:3e:bd:9a:bb', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '7d0a2886-ab9d-4826-872e-c085fa7372ce', 'device_owner': 'network:router_gateway', 'standard_attr_id': 528, 'fixed_ips': [{'subnet_id': 'e0b32f3d-83d6-439a-bbed-01df7cf01051', 'ip_address': '172.27.1.217', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-819011-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-23T19:37:22Z', 'updated_at': '2021-11-23T19:37:28Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'e0b32f3d-83d6-439a-bbed-01df7cf01051', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-819011-1-iscsi'}] {{(pid=102994) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 23 19:42:44.769932 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-25956835-80d3-4c18-a50b-8a2ab36d2864 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7918660', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-15067', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560168', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8783631424624', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8783631008723', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-17257496'] for port, after_delete {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:42:44.796022 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-25956835-80d3-4c18-a50b-8a2ab36d2864 admin admin] Pushing event deleted for resources: {'Port': ['ID=6f678090-b3f3-474e-8c77-32f412c39e45,revision_number=None']} {{(pid=102993) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 23 19:42:44.859904 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-25956835-80d3-4c18-a50b-8a2ab36d2864 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-926585'] for router_gateway, after_delete {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:42:44.947286 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-25956835-80d3-4c18-a50b-8a2ab36d2864 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-932919', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-13457'] for router, precommit_delete {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:42:44.949360 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-25956835-80d3-4c18-a50b-8a2ab36d2864 admin admin] Publish callbacks [] for router_controller, precommit_delete_associations {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:42:45.050160 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-25956835-80d3-4c18-a50b-8a2ab36d2864 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-926715'] for router, after_delete {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:42:45.050835 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-25956835-80d3-4c18-a50b-8a2ab36d2864 admin admin] Fanout notify agent at l3_agent the message router_deleted on router 7d0a2886-ab9d-4826-872e-c085fa7372ce {{(pid=102993) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Nov 23 19:42:45.058119 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-25956835-80d3-4c18-a50b-8a2ab36d2864 admin admin] Publish callbacks [] for router, before_response {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:42:45.061954 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [None req-25956835-80d3-4c18-a50b-8a2ab36d2864 admin admin] 10.222.0.62 "DELETE /v2.0/routers/7d0a2886-ab9d-4826-872e-c085fa7372ce HTTP/1.1" status: 204 len: 168 time: 1.2569792 Nov 23 19:42:45.062375 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.wsgi [-] (102993) accepted ('10.222.0.62', 51052) {{(pid=102993) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 23 19:42:45.095927 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron_lib.callbacks.manager [None req-8346ef05-f685-4c3d-af3d-a159b683bec2 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8783631323329', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7978582'] for agent, after_update {{(pid=102994) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:42:45.114746 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.db.db_base_plugin_v2 [None req-8d913fd8-6cdd-417e-97fb-9ad99d57143c admin admin] Deleting subnet baa3c93e-8af6-411c-80fd-fd8f5df6bde9 {{(pid=102993) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Nov 23 19:42:45.117570 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-8d913fd8-6cdd-417e-97fb-9ad99d57143c admin admin] Publish callbacks [] for subnet, before_delete {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:42:45.160109 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-8d913fd8-6cdd-417e-97fb-9ad99d57143c admin admin] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-16914634'] for subnet, precommit_delete_associations {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:42:45.240261 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-8d913fd8-6cdd-417e-97fb-9ad99d57143c admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-7975863'] for subnet, precommit_delete {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:42:45.376342 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-8d913fd8-6cdd-417e-97fb-9ad99d57143c admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-7982148', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-554858', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560168', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-17257579', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-17772973'] for subnet, after_delete {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:42:45.407569 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8d913fd8-6cdd-417e-97fb-9ad99d57143c admin admin] Pushing event deleted for resources: {'Subnet': ['ID=baa3c93e-8af6-411c-80fd-fd8f5df6bde9,revision_number=None']} {{(pid=102993) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 23 19:42:45.409790 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-8d913fd8-6cdd-417e-97fb-9ad99d57143c admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-560186'] for subnet, before_response {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:42:45.413297 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [None req-8d913fd8-6cdd-417e-97fb-9ad99d57143c admin admin] 10.222.0.62 "DELETE /v2.0/subnets/baa3c93e-8af6-411c-80fd-fd8f5df6bde9 HTTP/1.1" status: 204 len: 168 time: 0.3498185 Nov 23 19:42:45.413645 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-ece0136a-a490-4c9d-ba47-107e421080c1 None None] Network f85fa999-4237-44ad-8898-e5b57905b92f requested from dv-cinder-819011-1-iscsi {{(pid=102994) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 23 19:42:45.415736 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.wsgi [-] (102993) accepted ('10.222.0.62', 51060) {{(pid=102993) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 23 19:42:45.494441 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-4c449f12-11ec-442a-b09a-52fbc547562f admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-8133038'] for network, before_delete {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:42:45.571204 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.plugins.ml2.plugin [None req-4c449f12-11ec-442a-b09a-52fbc547562f admin admin] Deleting port 3b694ca8-b637-46fe-addf-211dc47247ae {{(pid=102993) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 23 19:42:45.571546 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-4c449f12-11ec-442a-b09a-52fbc547562f admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8783631423070'] for port, before_delete {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:42:45.651597 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-be9f7bc8-508b-4e05-ab22-ed574ae7b1b3 req-ad61b2ee-4554-4f30-acb0-77e532b82a91 tempest-AttachVolumeNegativeTest-754998453 tempest-AttachVolumeNegativeTest-754998453-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102993) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:42:45.653103 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-be9f7bc8-508b-4e05-ab22-ed574ae7b1b3 req-ad61b2ee-4554-4f30-acb0-77e532b82a91 tempest-AttachVolumeNegativeTest-754998453 tempest-AttachVolumeNegativeTest-754998453-project] 10.222.0.62 "GET /v2.0/ports?device_id=b63ec72c-0e94-420e-a7b6-cb4ba7fe3c33 HTTP/1.1" status: 200 len: 943 time: 0.1127772 Nov 23 19:42:45.663606 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.plugins.ml2.db [None req-4c449f12-11ec-442a-b09a-52fbc547562f admin admin] For port 3b694ca8-b637-46fe-addf-211dc47247ae, host dv-cinder-819011-1-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-819011-1-iscsi',level=0,port_id=3b694ca8-b637-46fe-addf-211dc47247ae,segment=NetworkSegment(a6451c29-fea7-487e-9bb2-6a8e36a6bb38),segment_id=a6451c29-fea7-487e-9bb2-6a8e36a6bb38)] {{(pid=102993) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 23 19:42:45.663606 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-4c449f12-11ec-442a-b09a-52fbc547562f admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-927332'] for port, precommit_delete {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:42:45.672443 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-26a5d8e0-92d5-4297-9873-510625714276 None None] DHCP port deletion for f85fa999-4237-44ad-8898-e5b57905b92f request from dv-cinder-819011-1-iscsi {{(pid=102994) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:266}} Nov 23 19:42:45.679819 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.plugins.ml2.plugin [None req-4c449f12-11ec-442a-b09a-52fbc547562f admin admin] Calling delete_port for 3b694ca8-b637-46fe-addf-211dc47247ae owned by network:dhcp {{(pid=102993) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 23 19:42:45.729690 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.plugins.ml2.plugin [None req-26a5d8e0-92d5-4297-9873-510625714276 None None] Deleting port 3b694ca8-b637-46fe-addf-211dc47247ae {{(pid=102994) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 23 19:42:45.730065 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron_lib.callbacks.manager [None req-26a5d8e0-92d5-4297-9873-510625714276 None None] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8783631423070'] for port, before_delete {{(pid=102994) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:42:45.754284 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-be9f7bc8-508b-4e05-ab22-ed574ae7b1b3 req-caf8293e-c873-4026-a253-fd882c041336 tempest-AttachVolumeNegativeTest-754998453 tempest-AttachVolumeNegativeTest-754998453-project] 10.222.0.62 "GET /v2.0/security-groups?id=78a07d59-fd8e-4f94-9dfc-099d7d04efec&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0922434 Nov 23 19:42:45.795000 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.plugins.ml2.db [None req-26a5d8e0-92d5-4297-9873-510625714276 None None] For port 3b694ca8-b637-46fe-addf-211dc47247ae, host dv-cinder-819011-1-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-819011-1-iscsi',level=0,port_id=3b694ca8-b637-46fe-addf-211dc47247ae,segment=NetworkSegment(a6451c29-fea7-487e-9bb2-6a8e36a6bb38),segment_id=a6451c29-fea7-487e-9bb2-6a8e36a6bb38)] {{(pid=102994) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 23 19:42:45.795394 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron_lib.callbacks.manager [None req-26a5d8e0-92d5-4297-9873-510625714276 None None] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-927332'] for port, precommit_delete {{(pid=102994) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:42:45.808983 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.plugins.ml2.plugin [None req-26a5d8e0-92d5-4297-9873-510625714276 None None] Calling delete_port for 3b694ca8-b637-46fe-addf-211dc47247ae owned by network:dhcp {{(pid=102994) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 23 19:42:45.872989 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-4c449f12-11ec-442a-b09a-52fbc547562f admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7918660', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-15067', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560168', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8783631424624', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8783631008723', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-17257496'] for port, after_delete {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:42:45.887838 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron_lib.callbacks.manager [None req-26a5d8e0-92d5-4297-9873-510625714276 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7918660', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-15067', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560168', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8783631424624', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8783631008723'] for port, after_delete {{(pid=102994) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:42:45.902976 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4c449f12-11ec-442a-b09a-52fbc547562f admin admin] Pushing event deleted for resources: {'Port': ['ID=3b694ca8-b637-46fe-addf-211dc47247ae,revision_number=None']} {{(pid=102993) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 23 19:42:45.906574 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.db.l3_dvrscheduler_db [None req-4c449f12-11ec-442a-b09a-52fbc547562f admin admin] No DVR routers for this DVR port 3b694ca8-b637-46fe-addf-211dc47247ae on host dv-cinder-819011-1-iscsi {{(pid=102993) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 23 19:42:45.922349 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-26a5d8e0-92d5-4297-9873-510625714276 None None] Pushing event deleted for resources: {'Port': ['ID=3b694ca8-b637-46fe-addf-211dc47247ae,revision_number=None']} {{(pid=102994) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 23 19:42:45.927430 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.db.l3_dvrscheduler_db [None req-26a5d8e0-92d5-4297-9873-510625714276 None None] No DVR routers for this DVR port 3b694ca8-b637-46fe-addf-211dc47247ae on host dv-cinder-819011-1-iscsi {{(pid=102994) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 23 19:42:45.988682 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-4c449f12-11ec-442a-b09a-52fbc547562f admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-7977576', 'neutron.services.segments.db._delete_segments_for_network-8783631323320'] for network, precommit_delete {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:42:46.010204 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.services.segments.db [None req-4c449f12-11ec-442a-b09a-52fbc547562f admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['f85fa999-4237-44ad-8898-e5b57905b92f']}} {{(pid=102993) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 23 19:42:46.019471 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.services.segments.db [None req-4c449f12-11ec-442a-b09a-52fbc547562f admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, 'a6451c29-fea7-487e-9bb2-6a8e36a6bb38') {'for_net_delete': True} {{(pid=102993) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 23 19:42:46.019767 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.services.segments.db [None req-4c449f12-11ec-442a-b09a-52fbc547562f admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, 'a6451c29-fea7-487e-9bb2-6a8e36a6bb38') {} {{(pid=102993) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 23 19:42:46.033828 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-4c449f12-11ec-442a-b09a-52fbc547562f admin admin] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8783631432524', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-16914685'] for segment, before_delete {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:42:46.047248 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-4c449f12-11ec-442a-b09a-52fbc547562f admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7982218'] for segment, precommit_delete {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:42:46.056037 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-4c449f12-11ec-442a-b09a-52fbc547562f admin admin] Releasing vlan 831 on physical network physnet1 to pool {{(pid=102993) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Nov 23 19:42:46.056037 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-4c449f12-11ec-442a-b09a-52fbc547562f admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7982218', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-17258441'] for segment, after_delete {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:42:46.056037 dv-cinder-819011-1-iscsi neutron-server[102993]: Traceback (most recent call last): Nov 23 19:42:46.056037 dv-cinder-819011-1-iscsi neutron-server[102993]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Nov 23 19:42:46.056037 dv-cinder-819011-1-iscsi neutron-server[102993]: timer() Nov 23 19:42:46.056037 dv-cinder-819011-1-iscsi neutron-server[102993]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 23 19:42:46.056037 dv-cinder-819011-1-iscsi neutron-server[102993]: cb(*args, **kw) Nov 23 19:42:46.056037 dv-cinder-819011-1-iscsi neutron-server[102993]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Nov 23 19:42:46.056037 dv-cinder-819011-1-iscsi neutron-server[102993]: return func(*args, **kwargs) Nov 23 19:42:46.056037 dv-cinder-819011-1-iscsi neutron-server[102993]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 23 19:42:46.056037 dv-cinder-819011-1-iscsi neutron-server[102993]: self._notify() Nov 23 19:42:46.056037 dv-cinder-819011-1-iscsi neutron-server[102993]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 23 19:42:46.056037 dv-cinder-819011-1-iscsi neutron-server[102993]: self.callback(batched_events) Nov 23 19:42:46.056037 dv-cinder-819011-1-iscsi neutron-server[102993]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 23 19:42:46.056037 dv-cinder-819011-1-iscsi neutron-server[102993]: event.method(event) Nov 23 19:42:46.056037 dv-cinder-819011-1-iscsi neutron-server[102993]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Nov 23 19:42:46.056037 dv-cinder-819011-1-iscsi neutron-server[102993]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 23 19:42:46.056037 dv-cinder-819011-1-iscsi neutron-server[102993]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Nov 23 19:42:46.056037 dv-cinder-819011-1-iscsi neutron-server[102993]: aggregate_uuid = self.p_client.list_aggregates( Nov 23 19:42:46.056037 dv-cinder-819011-1-iscsi neutron-server[102993]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Nov 23 19:42:46.056037 dv-cinder-819011-1-iscsi neutron-server[102993]: return f(self, *a, **k) Nov 23 19:42:46.056037 dv-cinder-819011-1-iscsi neutron-server[102993]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 23 19:42:46.056037 dv-cinder-819011-1-iscsi neutron-server[102993]: return self._get(url).json() Nov 23 19:42:46.056037 dv-cinder-819011-1-iscsi neutron-server[102993]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 23 19:42:46.056037 dv-cinder-819011-1-iscsi neutron-server[102993]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 23 19:42:46.056037 dv-cinder-819011-1-iscsi neutron-server[102993]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Nov 23 19:42:46.056037 dv-cinder-819011-1-iscsi neutron-server[102993]: return self.request(url, 'GET', **kwargs) Nov 23 19:42:46.056037 dv-cinder-819011-1-iscsi neutron-server[102993]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Nov 23 19:42:46.056037 dv-cinder-819011-1-iscsi neutron-server[102993]: base_url = self.get_endpoint(auth, allow=allow, Nov 23 19:42:46.056037 dv-cinder-819011-1-iscsi neutron-server[102993]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Nov 23 19:42:46.056037 dv-cinder-819011-1-iscsi neutron-server[102993]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 23 19:42:46.056037 dv-cinder-819011-1-iscsi neutron-server[102993]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Nov 23 19:42:46.056037 dv-cinder-819011-1-iscsi neutron-server[102993]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 23 19:42:46.056037 dv-cinder-819011-1-iscsi neutron-server[102993]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 23 19:42:46.085274 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.plugins.ml2.rpc [None req-4bf48ff4-ecfb-4168-8b63-249b8c6e9f04 None None] Device b1a5b461-ffce-430d-9e3a-f6255af48107 details requested by agent hyperv_hv-cinder-81901 with host hv-cinder-81901 {{(pid=102994) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Nov 23 19:42:46.175589 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-4c449f12-11ec-442a-b09a-52fbc547562f admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-7977567', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-554949', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560168', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-926557'] for network, after_delete {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:42:46.184411 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-4c449f12-11ec-442a-b09a-52fbc547562f admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-560186'] for network, before_response {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:42:46.190874 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.plugins.ml2.db [None req-4bf48ff4-ecfb-4168-8b63-249b8c6e9f04 None None] For port b1a5b461-ffce-430d-9e3a-f6255af48107, host hv-cinder-81901, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81901',level=0,port_id=b1a5b461-ffce-430d-9e3a-f6255af48107,segment=NetworkSegment(a14a7aae-c481-4c86-92ee-f7808a54fd04),segment_id=a14a7aae-c481-4c86-92ee-f7808a54fd04)] {{(pid=102994) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 23 19:42:46.191464 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [None req-4c449f12-11ec-442a-b09a-52fbc547562f admin admin] 10.222.0.62 "DELETE /v2.0/networks/f85fa999-4237-44ad-8898-e5b57905b92f HTTP/1.1" status: 204 len: 168 time: 0.7708540 Nov 23 19:42:46.198665 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4c449f12-11ec-442a-b09a-52fbc547562f admin admin] Pushing event deleted for resources: {'Network': ['ID=f85fa999-4237-44ad-8898-e5b57905b92f,revision_number=None']} {{(pid=102993) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 23 19:42:46.204458 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.plugins.ml2.rpc [None req-4bf48ff4-ecfb-4168-8b63-249b8c6e9f04 None None] Returning: {'device': 'b1a5b461-ffce-430d-9e3a-f6255af48107', 'network_id': '5f438c34-aac6-400d-bc7e-2e0506f124a9', 'port_id': 'b1a5b461-ffce-430d-9e3a-f6255af48107', 'mac_address': 'fa:16:3e:27:94:61', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 832, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'ffd14982-fec3-42b1-9d92-f2ed87a640f4', 'ip_address': '172.20.0.4'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=102994) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Nov 23 19:42:46.246372 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron_lib.callbacks.manager [None req-4bf48ff4-ecfb-4168-8b63-249b8c6e9f04 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7921281'] for port, before_update {{(pid=102994) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:42:46.260076 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.notifiers.nova [None req-4bf48ff4-ecfb-4168-8b63-249b8c6e9f04 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id b1a5b461-ffce-430d-9e3a-f6255af48107 {{(pid=102994) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 23 19:42:46.265511 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.plugins.ml2.rpc [None req-eb87b2c3-3339-4249-8b85-e695b5b4e1f9 None None] Device 6316de48-e729-4e1a-8557-06a3ec7c6a4a no longer exists at agent ovs-agent-dv-cinder-819011-1-iscsi {{(pid=102994) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 23 19:42:46.290952 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.plugins.ml2.plugin [None req-eb87b2c3-3339-4249-8b85-e695b5b4e1f9 None None] No Port match for: 6316de48-e729-4e1a-8557-06a3ec7c6a4a {{(pid=102994) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 23 19:42:46.291300 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.plugins.ml2.rpc [None req-eb87b2c3-3339-4249-8b85-e695b5b4e1f9 None None] Device 6316de48-e729-4e1a-8557-06a3ec7c6a4a not bound to the agent host dv-cinder-819011-1-iscsi {{(pid=102994) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 23 19:42:46.291716 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.plugins.ml2.rpc [None req-eb87b2c3-3339-4249-8b85-e695b5b4e1f9 None None] Device 3b694ca8-b637-46fe-addf-211dc47247ae no longer exists at agent ovs-agent-dv-cinder-819011-1-iscsi {{(pid=102994) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 23 19:42:46.301278 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.plugins.ml2.db [None req-4bf48ff4-ecfb-4168-8b63-249b8c6e9f04 None None] For port b1a5b461-ffce-430d-9e3a-f6255af48107, host hv-cinder-81901, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81901',level=0,port_id=b1a5b461-ffce-430d-9e3a-f6255af48107,segment=NetworkSegment(a14a7aae-c481-4c86-92ee-f7808a54fd04),segment_id=a14a7aae-c481-4c86-92ee-f7808a54fd04)] {{(pid=102994) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 23 19:42:46.321278 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.plugins.ml2.plugin [None req-eb87b2c3-3339-4249-8b85-e695b5b4e1f9 None None] No Port match for: 3b694ca8-b637-46fe-addf-211dc47247ae {{(pid=102994) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 23 19:42:46.321648 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.plugins.ml2.rpc [None req-eb87b2c3-3339-4249-8b85-e695b5b4e1f9 None None] Device 3b694ca8-b637-46fe-addf-211dc47247ae not bound to the agent host dv-cinder-819011-1-iscsi {{(pid=102994) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 23 19:42:46.322061 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.plugins.ml2.rpc [None req-eb87b2c3-3339-4249-8b85-e695b5b4e1f9 None None] Device 6f678090-b3f3-474e-8c77-32f412c39e45 no longer exists at agent ovs-agent-dv-cinder-819011-1-iscsi {{(pid=102994) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 23 19:42:46.339924 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.plugins.ml2.plugin [None req-eb87b2c3-3339-4249-8b85-e695b5b4e1f9 None None] No Port match for: 6f678090-b3f3-474e-8c77-32f412c39e45 {{(pid=102994) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 23 19:42:46.340291 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.plugins.ml2.rpc [None req-eb87b2c3-3339-4249-8b85-e695b5b4e1f9 None None] Device 6f678090-b3f3-474e-8c77-32f412c39e45 not bound to the agent host dv-cinder-819011-1-iscsi {{(pid=102994) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 23 19:42:46.352559 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron_lib.callbacks.manager [None req-4bf48ff4-ecfb-4168-8b63-249b8c6e9f04 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7918660', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-15067', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560168', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8783631423946', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8783631008732', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8783631008750'] for port, after_update {{(pid=102994) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:42:46.399366 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4bf48ff4-ecfb-4168-8b63-249b8c6e9f04 None None] Pushing event updated for resources: {'Port': ['ID=b1a5b461-ffce-430d-9e3a-f6255af48107,revision_number=4']} {{(pid=102994) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 23 19:42:46.527935 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.wsgi [-] (102993) accepted ('10.222.0.62', 51072) {{(pid=102993) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 23 19:42:46.568049 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [None req-abc97f59-12b2-41be-b987-b8ecd2248007 admin admin] 10.222.0.62 "GET /v2.0/security-groups?tenant_id=35f8a5017a27449084aabd12f27f5a8a&name=default HTTP/1.1" status: 200 len: 2996 time: 0.0386894 Nov 23 19:42:46.571169 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.wsgi [-] (102993) accepted ('10.222.0.62', 51074) {{(pid=102993) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 23 19:42:46.620515 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-81d6d0bf-1e4c-4122-a893-f6552b121d35 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:42:46.633020 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron_lib.callbacks.manager [None req-785c1d26-11ba-42d8-b5a6-51a8b3daeef0 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8783631323329', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7978582'] for agent, after_update {{(pid=102994) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:42:46.646426 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-81d6d0bf-1e4c-4122-a893-f6552b121d35 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:42:46.760958 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.plugins.ml2.db [None req-4bf48ff4-ecfb-4168-8b63-249b8c6e9f04 None None] get_ports_and_sgs() called for port_ids ['b1a5b461-ffce-430d-9e3a-f6255af48107'] {{(pid=102994) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 23 19:42:46.764714 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-81d6d0bf-1e4c-4122-a893-f6552b121d35 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-623933'] for security_group, after_delete {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:42:46.767429 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-81d6d0bf-1e4c-4122-a893-f6552b121d35 admin admin] Publish callbacks [] for security_group, before_response {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:42:46.768602 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [None req-81d6d0bf-1e4c-4122-a893-f6552b121d35 admin admin] 10.222.0.62 "DELETE /v2.0/security-groups/8bd676d5-ea27-4894-87a8-c1188d878c74 HTTP/1.1" status: 204 len: 168 time: 0.1965251 Nov 23 19:42:46.776700 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-81d6d0bf-1e4c-4122-a893-f6552b121d35 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=8bd676d5-ea27-4894-87a8-c1188d878c74,revision_number=None']} {{(pid=102993) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 23 19:42:46.884199 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-301e0d22-b0a6-4bd9-9a25-5d883eadf9f2 req-f8b9886c-6db8-4be4-aeb8-16f57113b4c4 tempest-AttachVolumeNegativeTest-754998453 tempest-AttachVolumeNegativeTest-754998453-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102993) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:42:46.885820 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-301e0d22-b0a6-4bd9-9a25-5d883eadf9f2 req-f8b9886c-6db8-4be4-aeb8-16f57113b4c4 tempest-AttachVolumeNegativeTest-754998453 tempest-AttachVolumeNegativeTest-754998453-project] 10.222.0.62 "GET /v2.0/ports?device_id=b63ec72c-0e94-420e-a7b6-cb4ba7fe3c33 HTTP/1.1" status: 200 len: 944 time: 0.0546389 Nov 23 19:42:46.935346 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-301e0d22-b0a6-4bd9-9a25-5d883eadf9f2 req-e8628ee4-5842-4d9a-881b-de9fd8b37631 tempest-AttachVolumeNegativeTest-754998453 tempest-AttachVolumeNegativeTest-754998453-project] 10.222.0.62 "GET /v2.0/security-groups?id=78a07d59-fd8e-4f94-9dfc-099d7d04efec&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0435922 Nov 23 19:42:47.307082 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron_lib.callbacks.manager [None req-eb87b2c3-3339-4249-8b85-e695b5b4e1f9 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8783631323329', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7978582'] for agent, after_update {{(pid=102994) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:42:47.373674 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.wsgi [-] (102992) accepted ('10.222.0.62', 51084) {{(pid=102992) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 23 19:42:47.413345 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [None req-da3f9db8-c852-4af4-891a-13e5e11385f0 admin admin] 10.222.0.62 "GET /v2.0/security-groups?tenant_id=2782edd0ce0e455b825d4fa9efd24221&name=default HTTP/1.1" status: 200 len: 2996 time: 0.0383618 Nov 23 19:42:47.416330 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.wsgi [-] (102993) accepted ('10.222.0.62', 51086) {{(pid=102993) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 23 19:42:47.463254 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-330b5653-0c87-4d47-81e7-8764c0590774 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:42:47.483960 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-330b5653-0c87-4d47-81e7-8764c0590774 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:42:47.598210 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-330b5653-0c87-4d47-81e7-8764c0590774 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-623933'] for security_group, after_delete {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:42:47.601821 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-330b5653-0c87-4d47-81e7-8764c0590774 admin admin] Publish callbacks [] for security_group, before_response {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:42:47.602969 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [None req-330b5653-0c87-4d47-81e7-8764c0590774 admin admin] 10.222.0.62 "DELETE /v2.0/security-groups/52ef8f21-5900-4c6a-a4cb-d749c75ddf46 HTTP/1.1" status: 204 len: 168 time: 0.1856430 Nov 23 19:42:47.612740 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-330b5653-0c87-4d47-81e7-8764c0590774 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=52ef8f21-5900-4c6a-a4cb-d749c75ddf46,revision_number=None']} {{(pid=102993) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 23 19:42:48.057825 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-72d7e041-1489-411c-bb46-1328bda16caf req-5a161ff5-79fd-4976-a6ba-8cda0988b313 tempest-AttachVolumeNegativeTest-754998453 tempest-AttachVolumeNegativeTest-754998453-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102992) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:42:48.059407 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-72d7e041-1489-411c-bb46-1328bda16caf req-5a161ff5-79fd-4976-a6ba-8cda0988b313 tempest-AttachVolumeNegativeTest-754998453 tempest-AttachVolumeNegativeTest-754998453-project] 10.222.0.62 "GET /v2.0/ports?device_id=b63ec72c-0e94-420e-a7b6-cb4ba7fe3c33 HTTP/1.1" status: 200 len: 944 time: 0.0514758 Nov 23 19:42:48.094639 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.plugins.ml2.rpc [None req-4bf48ff4-ecfb-4168-8b63-249b8c6e9f04 None None] Device b1a5b461-ffce-430d-9e3a-f6255af48107 up at agent hyperv_hv-cinder-81901 {{(pid=102994) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 23 19:42:48.107584 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-72d7e041-1489-411c-bb46-1328bda16caf req-523d4584-80f9-45e4-9734-18eaebe2fca2 tempest-AttachVolumeNegativeTest-754998453 tempest-AttachVolumeNegativeTest-754998453-project] 10.222.0.62 "GET /v2.0/security-groups?id=78a07d59-fd8e-4f94-9dfc-099d7d04efec&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0419531 Nov 23 19:42:48.175215 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.db.provisioning_blocks [None req-4bf48ff4-ecfb-4168-8b63-249b8c6e9f04 None None] Provisioning for port b1a5b461-ffce-430d-9e3a-f6255af48107 completed by entity L2. {{(pid=102994) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 23 19:42:48.179428 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.db.provisioning_blocks [None req-4bf48ff4-ecfb-4168-8b63-249b8c6e9f04 None None] Provisioning complete for port b1a5b461-ffce-430d-9e3a-f6255af48107 triggered by entity L2. {{(pid=102994) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 23 19:42:48.179806 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron_lib.callbacks.manager [None req-4bf48ff4-ecfb-4168-8b63-249b8c6e9f04 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-8355713'] for port, provisioning_complete {{(pid=102994) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:42:48.262485 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron_lib.callbacks.manager [None req-4bf48ff4-ecfb-4168-8b63-249b8c6e9f04 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7921281'] for port, before_update {{(pid=102994) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:42:48.281321 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'b63ec72c-0e94-420e-a7b6-cb4ba7fe3c33', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'b1a5b461-ffce-430d-9e3a-f6255af48107'}] {{(pid=102994) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 23 19:42:48.283561 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.62/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}09a7511da0d2ba1d728b27e36a8467ec5289399952f0059588048a7cb66d3a43" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-bf4fd56f-7ebe-4ef0-bd03-0c2c76f2ce60" -d '{"events": [{"server_uuid": "b63ec72c-0e94-420e-a7b6-cb4ba7fe3c33", "name": "network-vif-plugged", "status": "completed", "tag": "b1a5b461-ffce-430d-9e3a-f6255af48107"}]}' {{(pid=102994) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 23 19:42:48.297193 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.plugins.ml2.db [None req-4bf48ff4-ecfb-4168-8b63-249b8c6e9f04 None None] For port b1a5b461-ffce-430d-9e3a-f6255af48107, host hv-cinder-81901, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81901',level=0,port_id=b1a5b461-ffce-430d-9e3a-f6255af48107,segment=NetworkSegment(a14a7aae-c481-4c86-92ee-f7808a54fd04),segment_id=a14a7aae-c481-4c86-92ee-f7808a54fd04)] {{(pid=102994) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 23 19:42:48.327764 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 23 Nov 2021 19:42:48 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-becfb465-7fb2-4444-951f-bee1d856116a x-openstack-request-id: req-becfb465-7fb2-4444-951f-bee1d856116a {{(pid=102994) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 23 19:42:48.327764 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "b63ec72c-0e94-420e-a7b6-cb4ba7fe3c33", "name": "network-vif-plugged", "status": "completed", "tag": "b1a5b461-ffce-430d-9e3a-f6255af48107", "code": 200}]} {{(pid=102994) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 23 19:42:48.327764 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.62/compute/v2.1/os-server-external-events used request id req-becfb465-7fb2-4444-951f-bee1d856116a {{(pid=102994) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 23 19:42:48.327764 dv-cinder-819011-1-iscsi neutron-server[102994]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'b63ec72c-0e94-420e-a7b6-cb4ba7fe3c33', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'b1a5b461-ffce-430d-9e3a-f6255af48107', 'code': 200} Nov 23 19:42:48.381981 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron_lib.callbacks.manager [None req-4bf48ff4-ecfb-4168-8b63-249b8c6e9f04 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7918660', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-15067', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560168', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8783631423946', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8783631008732', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8783631008750'] for port, after_update {{(pid=102994) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:42:48.428324 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4bf48ff4-ecfb-4168-8b63-249b8c6e9f04 None None] Pushing event updated for resources: {'Port': ['ID=b1a5b461-ffce-430d-9e3a-f6255af48107,revision_number=5']} {{(pid=102994) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 23 19:42:48.620634 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-46a9eabf-7e73-4902-b855-49a4b09d93be req-2537aec1-3e81-4896-80ab-acccff7b8800 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102993) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:42:48.622041 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-46a9eabf-7e73-4902-b855-49a4b09d93be req-2537aec1-3e81-4896-80ab-acccff7b8800 service neutron] 10.222.0.41 "GET /v2.0/ports?device_id=b63ec72c-0e94-420e-a7b6-cb4ba7fe3c33 HTTP/1.1" status: 200 len: 1098 time: 0.0397284 Nov 23 19:42:48.674261 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-46a9eabf-7e73-4902-b855-49a4b09d93be req-375dd2c7-70dd-49ee-a1ea-62bf803ede38 service neutron] 10.222.0.41 "GET /v2.0/security-groups?id=78a07d59-fd8e-4f94-9dfc-099d7d04efec&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0365314 Nov 23 19:42:49.222874 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8aca61bc-a9b1-42b7-afd7-c306e080dcbd req-b9fd0835-224b-457d-8bb9-c15d824a22d0 tempest-AttachVolumeNegativeTest-754998453 tempest-AttachVolumeNegativeTest-754998453-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102992) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:42:49.224339 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-8aca61bc-a9b1-42b7-afd7-c306e080dcbd req-b9fd0835-224b-457d-8bb9-c15d824a22d0 tempest-AttachVolumeNegativeTest-754998453 tempest-AttachVolumeNegativeTest-754998453-project] 10.222.0.62 "GET /v2.0/ports?device_id=b63ec72c-0e94-420e-a7b6-cb4ba7fe3c33 HTTP/1.1" status: 200 len: 945 time: 0.0517840 Nov 23 19:42:49.270500 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-8aca61bc-a9b1-42b7-afd7-c306e080dcbd req-f4a10133-4a10-424d-ae46-ad71373aa53e tempest-AttachVolumeNegativeTest-754998453 tempest-AttachVolumeNegativeTest-754998453-project] 10.222.0.62 "GET /v2.0/security-groups?id=78a07d59-fd8e-4f94-9dfc-099d7d04efec&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0396707 Nov 23 19:42:50.388696 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a00e7e5d-9eb2-4c2b-b22a-7d02a1163f88 req-3e58a878-872f-41c8-9649-f5785751806b tempest-AttachVolumeNegativeTest-754998453 tempest-AttachVolumeNegativeTest-754998453-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102993) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:42:50.390213 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-a00e7e5d-9eb2-4c2b-b22a-7d02a1163f88 req-3e58a878-872f-41c8-9649-f5785751806b tempest-AttachVolumeNegativeTest-754998453 tempest-AttachVolumeNegativeTest-754998453-project] 10.222.0.62 "GET /v2.0/ports?device_id=b63ec72c-0e94-420e-a7b6-cb4ba7fe3c33 HTTP/1.1" status: 200 len: 945 time: 0.0503833 Nov 23 19:42:50.438793 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-a00e7e5d-9eb2-4c2b-b22a-7d02a1163f88 req-ce3f62ae-3495-4fab-a4f0-a8127af6e980 tempest-AttachVolumeNegativeTest-754998453 tempest-AttachVolumeNegativeTest-754998453-project] 10.222.0.62 "GET /v2.0/security-groups?id=78a07d59-fd8e-4f94-9dfc-099d7d04efec&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0426841 Nov 23 19:42:59.849425 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron_lib.callbacks.manager [None req-4bf48ff4-ecfb-4168-8b63-249b8c6e9f04 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8783631323329', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7978582'] for agent, after_update {{(pid=102994) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:43:04.451365 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d3355ad6-00bf-4871-b35b-e95e5413c50d req-daf831e0-6640-456f-8b59-dae800ff724a tempest-AttachVolumeNegativeTest-754998453 tempest-AttachVolumeNegativeTest-754998453-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102992) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:43:04.452834 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-d3355ad6-00bf-4871-b35b-e95e5413c50d req-daf831e0-6640-456f-8b59-dae800ff724a tempest-AttachVolumeNegativeTest-754998453 tempest-AttachVolumeNegativeTest-754998453-project] 10.222.0.62 "GET /v2.0/ports?device_id=b63ec72c-0e94-420e-a7b6-cb4ba7fe3c33 HTTP/1.1" status: 200 len: 945 time: 0.0484600 Nov 23 19:43:04.500445 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-d3355ad6-00bf-4871-b35b-e95e5413c50d req-379248f0-82fc-426c-85cc-59809b446108 tempest-AttachVolumeNegativeTest-754998453 tempest-AttachVolumeNegativeTest-754998453-project] 10.222.0.62 "GET /v2.0/security-groups?id=78a07d59-fd8e-4f94-9dfc-099d7d04efec&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0416565 Nov 23 19:43:05.621879 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d3a59511-caba-496d-ac47-d40803902f66 req-1c97fd76-c83b-4c96-8c8f-a2d702a385ec tempest-AttachVolumeNegativeTest-754998453 tempest-AttachVolumeNegativeTest-754998453-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102993) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:43:05.623348 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-d3a59511-caba-496d-ac47-d40803902f66 req-1c97fd76-c83b-4c96-8c8f-a2d702a385ec tempest-AttachVolumeNegativeTest-754998453 tempest-AttachVolumeNegativeTest-754998453-project] 10.222.0.62 "GET /v2.0/ports?device_id=b63ec72c-0e94-420e-a7b6-cb4ba7fe3c33 HTTP/1.1" status: 200 len: 945 time: 0.0537505 Nov 23 19:43:05.670128 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-d3a59511-caba-496d-ac47-d40803902f66 req-c67e3571-1b95-4e66-9737-d5ba4b5507ed tempest-AttachVolumeNegativeTest-754998453 tempest-AttachVolumeNegativeTest-754998453-project] 10.222.0.62 "GET /v2.0/security-groups?id=78a07d59-fd8e-4f94-9dfc-099d7d04efec&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0407729 Nov 23 19:43:06.003430 dv-cinder-819011-1-iscsi neutron-server[102995]: DEBUG neutron.db.agents_db [None req-84bdc9b2-57ea-4bdb-a245-07c78d37cea8 None None] Agent healthcheck: found 6 active agents {{(pid=102995) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 23 19:43:06.317188 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-596d9bd6-76a5-4ce5-82f7-1f8bb50f0a03 req-434988ac-a033-4ed8-84fa-179fb64e44be tempest-AttachVolumeNegativeTest-754998453 tempest-AttachVolumeNegativeTest-754998453-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102993) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:43:06.318639 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-596d9bd6-76a5-4ce5-82f7-1f8bb50f0a03 req-434988ac-a033-4ed8-84fa-179fb64e44be tempest-AttachVolumeNegativeTest-754998453 tempest-AttachVolumeNegativeTest-754998453-project] 10.222.0.41 "GET /v2.0/ports?device_id=b63ec72c-0e94-420e-a7b6-cb4ba7fe3c33 HTTP/1.1" status: 200 len: 945 time: 0.0478399 Nov 23 19:43:06.412173 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.plugins.ml2.plugin [req-596d9bd6-76a5-4ce5-82f7-1f8bb50f0a03 req-bf1ac9b2-917b-4b32-8bdd-1cde35f67a15 tempest-AttachVolumeNegativeTest-754998453 tempest-AttachVolumeNegativeTest-754998453-project] Deleting port b1a5b461-ffce-430d-9e3a-f6255af48107 {{(pid=102993) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 23 19:43:06.412510 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [req-596d9bd6-76a5-4ce5-82f7-1f8bb50f0a03 req-bf1ac9b2-917b-4b32-8bdd-1cde35f67a15 tempest-AttachVolumeNegativeTest-754998453 tempest-AttachVolumeNegativeTest-754998453-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8783631423070'] for port, before_delete {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:43:06.499141 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.plugins.ml2.db [req-596d9bd6-76a5-4ce5-82f7-1f8bb50f0a03 req-bf1ac9b2-917b-4b32-8bdd-1cde35f67a15 tempest-AttachVolumeNegativeTest-754998453 tempest-AttachVolumeNegativeTest-754998453-project] For port b1a5b461-ffce-430d-9e3a-f6255af48107, host hv-cinder-81901, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81901',level=0,port_id=b1a5b461-ffce-430d-9e3a-f6255af48107,segment=NetworkSegment(a14a7aae-c481-4c86-92ee-f7808a54fd04),segment_id=a14a7aae-c481-4c86-92ee-f7808a54fd04)] {{(pid=102993) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 23 19:43:06.506529 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [req-596d9bd6-76a5-4ce5-82f7-1f8bb50f0a03 req-bf1ac9b2-917b-4b32-8bdd-1cde35f67a15 tempest-AttachVolumeNegativeTest-754998453 tempest-AttachVolumeNegativeTest-754998453-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-927332'] for port, precommit_delete {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:43:06.512373 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.plugins.ml2.plugin [req-596d9bd6-76a5-4ce5-82f7-1f8bb50f0a03 req-bf1ac9b2-917b-4b32-8bdd-1cde35f67a15 tempest-AttachVolumeNegativeTest-754998453 tempest-AttachVolumeNegativeTest-754998453-project] Calling delete_port for b1a5b461-ffce-430d-9e3a-f6255af48107 owned by compute:nova {{(pid=102993) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 23 19:43:06.683585 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [req-596d9bd6-76a5-4ce5-82f7-1f8bb50f0a03 req-bf1ac9b2-917b-4b32-8bdd-1cde35f67a15 tempest-AttachVolumeNegativeTest-754998453 tempest-AttachVolumeNegativeTest-754998453-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7918660', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-15067', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560168', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8783631424624', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8783631008723', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-17257496'] for port, after_delete {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:43:06.702225 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.plugins.ml2.db [None req-4bf48ff4-ecfb-4168-8b63-249b8c6e9f04 None None] get_ports_and_sgs() called for port_ids ['e8dc7322-0b92-4637-a298-0a114bf01c42', 'a2ad1558-284e-4085-92ca-d32f3052846b', '56425014-3b47-41cc-b7b9-4b72d31ef8c6', 'b1a5b461-ffce-430d-9e3a-f6255af48107'] {{(pid=102994) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 23 19:43:06.714287 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bf1ac9b2-917b-4b32-8bdd-1cde35f67a15 tempest-AttachVolumeNegativeTest-754998453 tempest-AttachVolumeNegativeTest-754998453-project] Pushing event deleted for resources: {'Port': ['ID=b1a5b461-ffce-430d-9e3a-f6255af48107,revision_number=None']} {{(pid=102993) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 23 19:43:06.760527 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.db.l3_dvrscheduler_db [req-596d9bd6-76a5-4ce5-82f7-1f8bb50f0a03 req-bf1ac9b2-917b-4b32-8bdd-1cde35f67a15 tempest-AttachVolumeNegativeTest-754998453 tempest-AttachVolumeNegativeTest-754998453-project] No DVR routers for this DVR port b1a5b461-ffce-430d-9e3a-f6255af48107 on host hv-cinder-81901 {{(pid=102993) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 23 19:43:06.763241 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [req-596d9bd6-76a5-4ce5-82f7-1f8bb50f0a03 req-bf1ac9b2-917b-4b32-8bdd-1cde35f67a15 tempest-AttachVolumeNegativeTest-754998453 tempest-AttachVolumeNegativeTest-754998453-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-514902'] for port, before_response {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:43:06.767218 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-596d9bd6-76a5-4ce5-82f7-1f8bb50f0a03 req-bf1ac9b2-917b-4b32-8bdd-1cde35f67a15 tempest-AttachVolumeNegativeTest-754998453 tempest-AttachVolumeNegativeTest-754998453-project] 10.222.0.41 "DELETE /v2.0/ports/b1a5b461-ffce-430d-9e3a-f6255af48107 HTTP/1.1" status: 204 len: 173 time: 0.4410751 Nov 23 19:43:06.767740 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'b63ec72c-0e94-420e-a7b6-cb4ba7fe3c33', 'name': 'network-vif-deleted', 'tag': 'b1a5b461-ffce-430d-9e3a-f6255af48107'}] {{(pid=102993) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 23 19:43:06.770151 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.62/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}9b10b92acbee16fb695be1efeed0b68f7c36a5b215ec004a8d9d707fa3d35b2c" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-ddd40e97-9e80-4a91-8b50-7344c163dfe1" -d '{"events": [{"server_uuid": "b63ec72c-0e94-420e-a7b6-cb4ba7fe3c33", "name": "network-vif-deleted", "tag": "b1a5b461-ffce-430d-9e3a-f6255af48107"}]}' {{(pid=102993) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 23 19:43:06.822129 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 23 Nov 2021 19:43:06 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-37069681-1f72-450a-8a1c-22bcad0c73b8 x-openstack-request-id: req-37069681-1f72-450a-8a1c-22bcad0c73b8 {{(pid=102993) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 23 19:43:06.824537 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "b63ec72c-0e94-420e-a7b6-cb4ba7fe3c33", "name": "network-vif-deleted", "tag": "b1a5b461-ffce-430d-9e3a-f6255af48107", "status": "completed", "code": 200}]} {{(pid=102993) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 23 19:43:06.824537 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.62/compute/v2.1/os-server-external-events used request id req-37069681-1f72-450a-8a1c-22bcad0c73b8 {{(pid=102993) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 23 19:43:06.824537 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'b63ec72c-0e94-420e-a7b6-cb4ba7fe3c33', 'name': 'network-vif-deleted', 'tag': 'b1a5b461-ffce-430d-9e3a-f6255af48107', 'status': 'completed', 'code': 200} Nov 23 19:43:06.930899 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-b7030bc0-53d9-4e54-9aed-76bdb8df2003 req-b996d21c-b598-4ec6-9998-b6793f26f077 tempest-AttachVolumeNegativeTest-754998453 tempest-AttachVolumeNegativeTest-754998453-project] 10.222.0.62 "GET /v2.0/ports?device_id=b63ec72c-0e94-420e-a7b6-cb4ba7fe3c33 HTTP/1.1" status: 200 len: 210 time: 0.0308304 Nov 23 19:43:09.689639 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b253be70-c9d9-4a4a-952f-8213e1c2dc04 req-edcfdbc5-37e4-4694-8f8f-aeae87ccde38 tempest-AttachVolumeNegativeTest-754998453 tempest-AttachVolumeNegativeTest-754998453-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102993) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:43:09.691110 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-b253be70-c9d9-4a4a-952f-8213e1c2dc04 req-edcfdbc5-37e4-4694-8f8f-aeae87ccde38 tempest-AttachVolumeNegativeTest-754998453 tempest-AttachVolumeNegativeTest-754998453-project] 10.222.0.62 "GET /v2.0/ports?device_id=4f9e5b06-00b6-4635-881c-06359237f669 HTTP/1.1" status: 200 len: 945 time: 0.0522535 Nov 23 19:43:09.737803 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-b253be70-c9d9-4a4a-952f-8213e1c2dc04 req-6db7cdaa-9b2d-4cb9-9319-a0ad03124195 tempest-AttachVolumeNegativeTest-754998453 tempest-AttachVolumeNegativeTest-754998453-project] 10.222.0.62 "GET /v2.0/security-groups?id=78a07d59-fd8e-4f94-9dfc-099d7d04efec&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0404108 Nov 23 19:43:10.210157 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.plugins.ml2.rpc [None req-4bf48ff4-ecfb-4168-8b63-249b8c6e9f04 None None] Device b1a5b461-ffce-430d-9e3a-f6255af48107 no longer exists at agent hyperv_hv-cinder-81901 {{(pid=102994) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 23 19:43:10.234080 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.plugins.ml2.plugin [None req-4bf48ff4-ecfb-4168-8b63-249b8c6e9f04 None None] No Port match for: b1a5b461-ffce-430d-9e3a-f6255af48107 {{(pid=102994) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 23 19:43:10.234435 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.plugins.ml2.rpc [None req-4bf48ff4-ecfb-4168-8b63-249b8c6e9f04 None None] Device b1a5b461-ffce-430d-9e3a-f6255af48107 not bound to the agent host hv-cinder-81901 {{(pid=102994) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 23 19:43:10.856209 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-39304a55-86e5-46bc-a8e6-4bf23da59a7c req-acecd013-9115-4b3e-bc61-0690f20eab1d tempest-AttachVolumeNegativeTest-754998453 tempest-AttachVolumeNegativeTest-754998453-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102992) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:43:10.857725 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-39304a55-86e5-46bc-a8e6-4bf23da59a7c req-acecd013-9115-4b3e-bc61-0690f20eab1d tempest-AttachVolumeNegativeTest-754998453 tempest-AttachVolumeNegativeTest-754998453-project] 10.222.0.62 "GET /v2.0/ports?device_id=4f9e5b06-00b6-4635-881c-06359237f669 HTTP/1.1" status: 200 len: 945 time: 0.0537155 Nov 23 19:43:10.904690 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-39304a55-86e5-46bc-a8e6-4bf23da59a7c req-d43d4acd-842f-4898-a8c8-ca596a9dbbb1 tempest-AttachVolumeNegativeTest-754998453 tempest-AttachVolumeNegativeTest-754998453-project] 10.222.0.62 "GET /v2.0/security-groups?id=78a07d59-fd8e-4f94-9dfc-099d7d04efec&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0409856 Nov 23 19:43:11.592393 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-02803ec7-f7de-45db-9999-bb865cba3de7 req-f9fa25da-1f4b-4d1b-be28-f1bc6f5babcd tempest-AttachVolumeNegativeTest-754998453 tempest-AttachVolumeNegativeTest-754998453-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102993) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:43:11.593877 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-02803ec7-f7de-45db-9999-bb865cba3de7 req-f9fa25da-1f4b-4d1b-be28-f1bc6f5babcd tempest-AttachVolumeNegativeTest-754998453 tempest-AttachVolumeNegativeTest-754998453-project] 10.222.0.41 "GET /v2.0/ports?device_id=4f9e5b06-00b6-4635-881c-06359237f669 HTTP/1.1" status: 200 len: 945 time: 0.0492730 Nov 23 19:43:11.691192 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.plugins.ml2.plugin [req-02803ec7-f7de-45db-9999-bb865cba3de7 req-6716cc71-2e30-41fc-9b3f-63cf9e8a4be4 tempest-AttachVolumeNegativeTest-754998453 tempest-AttachVolumeNegativeTest-754998453-project] Deleting port 56425014-3b47-41cc-b7b9-4b72d31ef8c6 {{(pid=102993) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 23 19:43:11.691526 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [req-02803ec7-f7de-45db-9999-bb865cba3de7 req-6716cc71-2e30-41fc-9b3f-63cf9e8a4be4 tempest-AttachVolumeNegativeTest-754998453 tempest-AttachVolumeNegativeTest-754998453-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8783631423070'] for port, before_delete {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:43:11.740617 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron_lib.callbacks.manager [None req-5bc02dcb-b35e-4d69-9d20-86d9c56e2c1b None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8783631323329', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7978582'] for agent, after_update {{(pid=102994) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:43:11.782119 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.plugins.ml2.db [req-02803ec7-f7de-45db-9999-bb865cba3de7 req-6716cc71-2e30-41fc-9b3f-63cf9e8a4be4 tempest-AttachVolumeNegativeTest-754998453 tempest-AttachVolumeNegativeTest-754998453-project] For port 56425014-3b47-41cc-b7b9-4b72d31ef8c6, host hv-cinder-81901, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81901',level=0,port_id=56425014-3b47-41cc-b7b9-4b72d31ef8c6,segment=NetworkSegment(a14a7aae-c481-4c86-92ee-f7808a54fd04),segment_id=a14a7aae-c481-4c86-92ee-f7808a54fd04)] {{(pid=102993) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 23 19:43:11.782480 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [req-02803ec7-f7de-45db-9999-bb865cba3de7 req-6716cc71-2e30-41fc-9b3f-63cf9e8a4be4 tempest-AttachVolumeNegativeTest-754998453 tempest-AttachVolumeNegativeTest-754998453-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-927332'] for port, precommit_delete {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:43:11.796222 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.plugins.ml2.plugin [req-02803ec7-f7de-45db-9999-bb865cba3de7 req-6716cc71-2e30-41fc-9b3f-63cf9e8a4be4 tempest-AttachVolumeNegativeTest-754998453 tempest-AttachVolumeNegativeTest-754998453-project] Calling delete_port for 56425014-3b47-41cc-b7b9-4b72d31ef8c6 owned by compute:nova {{(pid=102993) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 23 19:43:11.983959 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [req-02803ec7-f7de-45db-9999-bb865cba3de7 req-6716cc71-2e30-41fc-9b3f-63cf9e8a4be4 tempest-AttachVolumeNegativeTest-754998453 tempest-AttachVolumeNegativeTest-754998453-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7918660', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-15067', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560168', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8783631424624', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8783631008723', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-17257496'] for port, after_delete {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:43:11.996287 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.plugins.ml2.db [None req-4bf48ff4-ecfb-4168-8b63-249b8c6e9f04 None None] get_ports_and_sgs() called for port_ids ['e8dc7322-0b92-4637-a298-0a114bf01c42', 'a2ad1558-284e-4085-92ca-d32f3052846b', '56425014-3b47-41cc-b7b9-4b72d31ef8c6'] {{(pid=102994) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 23 19:43:12.013064 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-b7cd21d3-7e58-4e09-9e38-d543aeea1d9a req-9ab82526-e94b-4f1f-be9f-708a6b922cb4 tempest-AttachVolumeNegativeTest-754998453 tempest-AttachVolumeNegativeTest-754998453-project] 10.222.0.62 "GET /v2.0/ports?device_id=4f9e5b06-00b6-4635-881c-06359237f669 HTTP/1.1" status: 200 len: 210 time: 0.0395932 Nov 23 19:43:12.036262 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6716cc71-2e30-41fc-9b3f-63cf9e8a4be4 tempest-AttachVolumeNegativeTest-754998453 tempest-AttachVolumeNegativeTest-754998453-project] Pushing event deleted for resources: {'Port': ['ID=56425014-3b47-41cc-b7b9-4b72d31ef8c6,revision_number=None']} {{(pid=102993) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 23 19:43:12.074767 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.db.l3_dvrscheduler_db [req-02803ec7-f7de-45db-9999-bb865cba3de7 req-6716cc71-2e30-41fc-9b3f-63cf9e8a4be4 tempest-AttachVolumeNegativeTest-754998453 tempest-AttachVolumeNegativeTest-754998453-project] No DVR routers for this DVR port 56425014-3b47-41cc-b7b9-4b72d31ef8c6 on host hv-cinder-81901 {{(pid=102993) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 23 19:43:12.077313 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [req-02803ec7-f7de-45db-9999-bb865cba3de7 req-6716cc71-2e30-41fc-9b3f-63cf9e8a4be4 tempest-AttachVolumeNegativeTest-754998453 tempest-AttachVolumeNegativeTest-754998453-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-514902'] for port, before_response {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:43:12.081076 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-02803ec7-f7de-45db-9999-bb865cba3de7 req-6716cc71-2e30-41fc-9b3f-63cf9e8a4be4 tempest-AttachVolumeNegativeTest-754998453 tempest-AttachVolumeNegativeTest-754998453-project] 10.222.0.41 "DELETE /v2.0/ports/56425014-3b47-41cc-b7b9-4b72d31ef8c6 HTTP/1.1" status: 204 len: 173 time: 0.4801633 Nov 23 19:43:12.081599 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '4f9e5b06-00b6-4635-881c-06359237f669', 'name': 'network-vif-deleted', 'tag': '56425014-3b47-41cc-b7b9-4b72d31ef8c6'}] {{(pid=102993) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 23 19:43:12.083969 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.62/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}9b10b92acbee16fb695be1efeed0b68f7c36a5b215ec004a8d9d707fa3d35b2c" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-935d1863-7912-4e26-9517-d6b98528303b" -d '{"events": [{"server_uuid": "4f9e5b06-00b6-4635-881c-06359237f669", "name": "network-vif-deleted", "tag": "56425014-3b47-41cc-b7b9-4b72d31ef8c6"}]}' {{(pid=102993) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 23 19:43:12.122904 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 23 Nov 2021 19:43:12 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-302935f2-e314-4a13-abb2-a49d993b6e90 x-openstack-request-id: req-302935f2-e314-4a13-abb2-a49d993b6e90 {{(pid=102993) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 23 19:43:12.123205 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "4f9e5b06-00b6-4635-881c-06359237f669", "name": "network-vif-deleted", "tag": "56425014-3b47-41cc-b7b9-4b72d31ef8c6", "status": "completed", "code": 200}]} {{(pid=102993) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 23 19:43:12.123464 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.62/compute/v2.1/os-server-external-events used request id req-302935f2-e314-4a13-abb2-a49d993b6e90 {{(pid=102993) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 23 19:43:12.123861 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '4f9e5b06-00b6-4635-881c-06359237f669', 'name': 'network-vif-deleted', 'tag': '56425014-3b47-41cc-b7b9-4b72d31ef8c6', 'status': 'completed', 'code': 200} Nov 23 19:43:13.459748 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-08c17501-6985-44a4-81b2-628993068be6 req-a7cf1dcf-70c5-443b-8870-90fcafd5db5e tempest-AttachVolumeNegativeTest-754998453 tempest-AttachVolumeNegativeTest-754998453-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102992) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:43:13.461497 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-08c17501-6985-44a4-81b2-628993068be6 req-a7cf1dcf-70c5-443b-8870-90fcafd5db5e tempest-AttachVolumeNegativeTest-754998453 tempest-AttachVolumeNegativeTest-754998453-project] 10.222.0.62 "GET /v2.0/ports?device_id=063b0eee-501d-4da3-84b3-fa0731492f5f HTTP/1.1" status: 200 len: 945 time: 0.0511792 Nov 23 19:43:13.508419 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-08c17501-6985-44a4-81b2-628993068be6 req-fc1b6ee3-52a5-482c-a273-251457cb5100 tempest-AttachVolumeNegativeTest-754998453 tempest-AttachVolumeNegativeTest-754998453-project] 10.222.0.62 "GET /v2.0/security-groups?id=78a07d59-fd8e-4f94-9dfc-099d7d04efec&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0402806 Nov 23 19:43:14.186638 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron_lib.callbacks.manager [None req-2b211e89-cb3c-4710-9d87-1b5f634a7db0 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8783631323329', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7978582'] for agent, after_update {{(pid=102994) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:43:14.628173 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-81126536-3c5f-488b-9409-04c86731b4b3 req-43ba171e-9899-4637-b3af-4413e17ac3ca tempest-AttachVolumeNegativeTest-754998453 tempest-AttachVolumeNegativeTest-754998453-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102992) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:43:14.629661 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-81126536-3c5f-488b-9409-04c86731b4b3 req-43ba171e-9899-4637-b3af-4413e17ac3ca tempest-AttachVolumeNegativeTest-754998453 tempest-AttachVolumeNegativeTest-754998453-project] 10.222.0.62 "GET /v2.0/ports?device_id=063b0eee-501d-4da3-84b3-fa0731492f5f HTTP/1.1" status: 200 len: 945 time: 0.0484126 Nov 23 19:43:14.681801 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-81126536-3c5f-488b-9409-04c86731b4b3 req-d8792f4c-ec34-4111-bc3d-0212ddfd0c16 tempest-AttachVolumeNegativeTest-754998453 tempest-AttachVolumeNegativeTest-754998453-project] 10.222.0.62 "GET /v2.0/security-groups?id=78a07d59-fd8e-4f94-9dfc-099d7d04efec&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0458286 Nov 23 19:43:14.873541 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c489c081-660f-475a-ad4b-7b8c36f4ee86 req-b7829fab-c102-4fcb-b93b-4a34093300d5 tempest-AttachVolumeTestJSON-1120920040 tempest-AttachVolumeTestJSON-1120920040-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102992) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:43:14.875000 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-c489c081-660f-475a-ad4b-7b8c36f4ee86 req-b7829fab-c102-4fcb-b93b-4a34093300d5 tempest-AttachVolumeTestJSON-1120920040 tempest-AttachVolumeTestJSON-1120920040-project] 10.222.0.62 "GET /v2.0/ports?device_id=9e87242f-98ef-4e64-9f5f-1371a11fc350 HTTP/1.1" status: 200 len: 945 time: 0.0502450 Nov 23 19:43:14.923612 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-c489c081-660f-475a-ad4b-7b8c36f4ee86 req-a08af730-1eaf-4aea-8500-46377cea1e77 tempest-AttachVolumeTestJSON-1120920040 tempest-AttachVolumeTestJSON-1120920040-project] 10.222.0.62 "GET /v2.0/security-groups?id=72babeb5-3fe0-4e83-bab0-53665ab366a2&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0427604 Nov 23 19:43:15.064664 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a9933a52-4442-4de5-891a-8db7f60ebf35 req-9326475b-3f6e-4e77-9db5-41a65d671c62 tempest-AttachVolumeNegativeTest-754998453 tempest-AttachVolumeNegativeTest-754998453-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102993) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:43:15.066271 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-a9933a52-4442-4de5-891a-8db7f60ebf35 req-9326475b-3f6e-4e77-9db5-41a65d671c62 tempest-AttachVolumeNegativeTest-754998453 tempest-AttachVolumeNegativeTest-754998453-project] 10.222.0.41 "GET /v2.0/ports?device_id=063b0eee-501d-4da3-84b3-fa0731492f5f HTTP/1.1" status: 200 len: 945 time: 0.0491881 Nov 23 19:43:15.100470 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron_lib.callbacks.manager [None req-8346ef05-f685-4c3d-af3d-a159b683bec2 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8783631323329', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7978582'] for agent, after_update {{(pid=102994) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:43:15.158108 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.plugins.ml2.plugin [req-a9933a52-4442-4de5-891a-8db7f60ebf35 req-e4a8efca-a642-41f5-99bf-1c5e6c2ccdaa tempest-AttachVolumeNegativeTest-754998453 tempest-AttachVolumeNegativeTest-754998453-project] Deleting port a2ad1558-284e-4085-92ca-d32f3052846b {{(pid=102993) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 23 19:43:15.158442 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [req-a9933a52-4442-4de5-891a-8db7f60ebf35 req-e4a8efca-a642-41f5-99bf-1c5e6c2ccdaa tempest-AttachVolumeNegativeTest-754998453 tempest-AttachVolumeNegativeTest-754998453-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8783631423070'] for port, before_delete {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:43:15.246287 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.plugins.ml2.db [req-a9933a52-4442-4de5-891a-8db7f60ebf35 req-e4a8efca-a642-41f5-99bf-1c5e6c2ccdaa tempest-AttachVolumeNegativeTest-754998453 tempest-AttachVolumeNegativeTest-754998453-project] For port a2ad1558-284e-4085-92ca-d32f3052846b, host hv-cinder-81901, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81901',level=0,port_id=a2ad1558-284e-4085-92ca-d32f3052846b,segment=NetworkSegment(a14a7aae-c481-4c86-92ee-f7808a54fd04),segment_id=a14a7aae-c481-4c86-92ee-f7808a54fd04)] {{(pid=102993) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 23 19:43:15.246639 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [req-a9933a52-4442-4de5-891a-8db7f60ebf35 req-e4a8efca-a642-41f5-99bf-1c5e6c2ccdaa tempest-AttachVolumeNegativeTest-754998453 tempest-AttachVolumeNegativeTest-754998453-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-927332'] for port, precommit_delete {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:43:15.258601 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.plugins.ml2.plugin [req-a9933a52-4442-4de5-891a-8db7f60ebf35 req-e4a8efca-a642-41f5-99bf-1c5e6c2ccdaa tempest-AttachVolumeNegativeTest-754998453 tempest-AttachVolumeNegativeTest-754998453-project] Calling delete_port for a2ad1558-284e-4085-92ca-d32f3052846b owned by compute:nova {{(pid=102993) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 23 19:43:15.449155 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [req-a9933a52-4442-4de5-891a-8db7f60ebf35 req-e4a8efca-a642-41f5-99bf-1c5e6c2ccdaa tempest-AttachVolumeNegativeTest-754998453 tempest-AttachVolumeNegativeTest-754998453-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7918660', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-15067', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560168', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8783631424624', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8783631008723', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-17257496'] for port, after_delete {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:43:15.460547 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.plugins.ml2.db [None req-4bf48ff4-ecfb-4168-8b63-249b8c6e9f04 None None] get_ports_and_sgs() called for port_ids ['e8dc7322-0b92-4637-a298-0a114bf01c42', 'a2ad1558-284e-4085-92ca-d32f3052846b'] {{(pid=102994) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 23 19:43:15.479073 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e4a8efca-a642-41f5-99bf-1c5e6c2ccdaa tempest-AttachVolumeNegativeTest-754998453 tempest-AttachVolumeNegativeTest-754998453-project] Pushing event deleted for resources: {'Port': ['ID=a2ad1558-284e-4085-92ca-d32f3052846b,revision_number=None']} {{(pid=102993) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 23 19:43:15.517988 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.db.l3_dvrscheduler_db [req-a9933a52-4442-4de5-891a-8db7f60ebf35 req-e4a8efca-a642-41f5-99bf-1c5e6c2ccdaa tempest-AttachVolumeNegativeTest-754998453 tempest-AttachVolumeNegativeTest-754998453-project] No DVR routers for this DVR port a2ad1558-284e-4085-92ca-d32f3052846b on host hv-cinder-81901 {{(pid=102993) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 23 19:43:15.520382 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [req-a9933a52-4442-4de5-891a-8db7f60ebf35 req-e4a8efca-a642-41f5-99bf-1c5e6c2ccdaa tempest-AttachVolumeNegativeTest-754998453 tempest-AttachVolumeNegativeTest-754998453-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-514902'] for port, before_response {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:43:15.523890 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-a9933a52-4442-4de5-891a-8db7f60ebf35 req-e4a8efca-a642-41f5-99bf-1c5e6c2ccdaa tempest-AttachVolumeNegativeTest-754998453 tempest-AttachVolumeNegativeTest-754998453-project] 10.222.0.41 "DELETE /v2.0/ports/a2ad1558-284e-4085-92ca-d32f3052846b HTTP/1.1" status: 204 len: 173 time: 0.4484177 Nov 23 19:43:15.524184 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '063b0eee-501d-4da3-84b3-fa0731492f5f', 'name': 'network-vif-deleted', 'tag': 'a2ad1558-284e-4085-92ca-d32f3052846b'}] {{(pid=102993) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 23 19:43:15.526458 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.62/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}9b10b92acbee16fb695be1efeed0b68f7c36a5b215ec004a8d9d707fa3d35b2c" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-c3662c23-e6ec-4a54-b49b-793c5f9ecc9e" -d '{"events": [{"server_uuid": "063b0eee-501d-4da3-84b3-fa0731492f5f", "name": "network-vif-deleted", "tag": "a2ad1558-284e-4085-92ca-d32f3052846b"}]}' {{(pid=102993) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 23 19:43:15.563044 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 23 Nov 2021 19:43:15 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-f1456fcd-b887-4260-9e6d-d85681e6bfb1 x-openstack-request-id: req-f1456fcd-b887-4260-9e6d-d85681e6bfb1 {{(pid=102993) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 23 19:43:15.563344 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "063b0eee-501d-4da3-84b3-fa0731492f5f", "name": "network-vif-deleted", "tag": "a2ad1558-284e-4085-92ca-d32f3052846b", "status": "completed", "code": 200}]} {{(pid=102993) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 23 19:43:15.563603 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.62/compute/v2.1/os-server-external-events used request id req-f1456fcd-b887-4260-9e6d-d85681e6bfb1 {{(pid=102993) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 23 19:43:15.564003 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '063b0eee-501d-4da3-84b3-fa0731492f5f', 'name': 'network-vif-deleted', 'tag': 'a2ad1558-284e-4085-92ca-d32f3052846b', 'status': 'completed', 'code': 200} Nov 23 19:43:15.775640 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-18d28476-0692-476b-87a0-2f86ced92884 req-8a7d04bd-b63f-47d9-a81f-5c65f32f786b tempest-AttachVolumeNegativeTest-754998453 tempest-AttachVolumeNegativeTest-754998453-project] 10.222.0.62 "GET /v2.0/ports?device_id=063b0eee-501d-4da3-84b3-fa0731492f5f HTTP/1.1" status: 200 len: 210 time: 0.0265558 Nov 23 19:43:16.043433 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-eb2165de-25ea-44be-9f61-11581e84664e req-8ff36d52-5f53-405a-87f7-ac176d8c3537 tempest-AttachVolumeTestJSON-1120920040 tempest-AttachVolumeTestJSON-1120920040-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102993) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:43:16.044830 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-eb2165de-25ea-44be-9f61-11581e84664e req-8ff36d52-5f53-405a-87f7-ac176d8c3537 tempest-AttachVolumeTestJSON-1120920040 tempest-AttachVolumeTestJSON-1120920040-project] 10.222.0.62 "GET /v2.0/ports?device_id=9e87242f-98ef-4e64-9f5f-1371a11fc350 HTTP/1.1" status: 200 len: 945 time: 0.0535524 Nov 23 19:43:16.091961 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-eb2165de-25ea-44be-9f61-11581e84664e req-9169ba5c-0c75-48be-add9-9611c48f38f5 tempest-AttachVolumeTestJSON-1120920040 tempest-AttachVolumeTestJSON-1120920040-project] 10.222.0.62 "GET /v2.0/security-groups?id=72babeb5-3fe0-4e83-bab0-53665ab366a2&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0412169 Nov 23 19:43:16.231280 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.plugins.ml2.rpc [None req-4bf48ff4-ecfb-4168-8b63-249b8c6e9f04 None None] Device 56425014-3b47-41cc-b7b9-4b72d31ef8c6 no longer exists at agent hyperv_hv-cinder-81901 {{(pid=102994) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 23 19:43:16.252093 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.plugins.ml2.plugin [None req-4bf48ff4-ecfb-4168-8b63-249b8c6e9f04 None None] No Port match for: 56425014-3b47-41cc-b7b9-4b72d31ef8c6 {{(pid=102994) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 23 19:43:16.252460 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.plugins.ml2.rpc [None req-4bf48ff4-ecfb-4168-8b63-249b8c6e9f04 None None] Device 56425014-3b47-41cc-b7b9-4b72d31ef8c6 not bound to the agent host hv-cinder-81901 {{(pid=102994) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 23 19:43:16.651596 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron_lib.callbacks.manager [None req-785c1d26-11ba-42d8-b5a6-51a8b3daeef0 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8783631323329', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7978582'] for agent, after_update {{(pid=102994) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:43:16.954875 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b515340a-7134-4952-b9a5-9514b22ca06f req-3035c520-8241-4cca-8cc6-1e67812466d2 tempest-AttachVolumeTestJSON-1120920040 tempest-AttachVolumeTestJSON-1120920040-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102993) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:43:16.956318 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-b515340a-7134-4952-b9a5-9514b22ca06f req-3035c520-8241-4cca-8cc6-1e67812466d2 tempest-AttachVolumeTestJSON-1120920040 tempest-AttachVolumeTestJSON-1120920040-project] 10.222.0.41 "GET /v2.0/ports?device_id=9e87242f-98ef-4e64-9f5f-1371a11fc350 HTTP/1.1" status: 200 len: 945 time: 0.0479300 Nov 23 19:43:17.055254 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.plugins.ml2.plugin [req-b515340a-7134-4952-b9a5-9514b22ca06f req-3fcfe6e6-422d-4e69-bf25-ddf03ac17196 tempest-AttachVolumeTestJSON-1120920040 tempest-AttachVolumeTestJSON-1120920040-project] Deleting port a289ac30-8b2a-4448-8e4b-53dbabc0c2e7 {{(pid=102993) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 23 19:43:17.055254 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [req-b515340a-7134-4952-b9a5-9514b22ca06f req-3fcfe6e6-422d-4e69-bf25-ddf03ac17196 tempest-AttachVolumeTestJSON-1120920040 tempest-AttachVolumeTestJSON-1120920040-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8783631423070'] for port, before_delete {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:43:17.144991 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.plugins.ml2.db [req-b515340a-7134-4952-b9a5-9514b22ca06f req-3fcfe6e6-422d-4e69-bf25-ddf03ac17196 tempest-AttachVolumeTestJSON-1120920040 tempest-AttachVolumeTestJSON-1120920040-project] For port a289ac30-8b2a-4448-8e4b-53dbabc0c2e7, host hv-cinder-81901, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81901',level=0,port_id=a289ac30-8b2a-4448-8e4b-53dbabc0c2e7,segment=NetworkSegment(1a7bcd69-381b-4068-88df-df74b53e9d61),segment_id=1a7bcd69-381b-4068-88df-df74b53e9d61)] {{(pid=102993) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 23 19:43:17.145705 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [req-b515340a-7134-4952-b9a5-9514b22ca06f req-3fcfe6e6-422d-4e69-bf25-ddf03ac17196 tempest-AttachVolumeTestJSON-1120920040 tempest-AttachVolumeTestJSON-1120920040-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-927332'] for port, precommit_delete {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:43:17.280209 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a99d1746-eb61-4de9-bb9d-19a209ae38a1 req-dcbf9b72-909c-4a39-ba92-5702eb8b2e57 tempest-AttachVolumeTestJSON-1120920040 tempest-AttachVolumeTestJSON-1120920040-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102993) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:43:17.281843 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-a99d1746-eb61-4de9-bb9d-19a209ae38a1 req-dcbf9b72-909c-4a39-ba92-5702eb8b2e57 tempest-AttachVolumeTestJSON-1120920040 tempest-AttachVolumeTestJSON-1120920040-project] 10.222.0.62 "GET /v2.0/ports?device_id=9e87242f-98ef-4e64-9f5f-1371a11fc350 HTTP/1.1" status: 200 len: 945 time: 0.1221089 Nov 23 19:43:17.329220 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron_lib.callbacks.manager [None req-eb87b2c3-3339-4249-8b85-e695b5b4e1f9 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8783631323329', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7978582'] for agent, after_update {{(pid=102994) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:43:17.387268 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-a99d1746-eb61-4de9-bb9d-19a209ae38a1 req-21d66941-88e7-4cd3-8a2c-6e07fdebc100 tempest-AttachVolumeTestJSON-1120920040 tempest-AttachVolumeTestJSON-1120920040-project] 10.222.0.62 "GET /v2.0/security-groups?id=72babeb5-3fe0-4e83-bab0-53665ab366a2&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0988936 Nov 23 19:43:17.389111 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [req-b515340a-7134-4952-b9a5-9514b22ca06f req-3fcfe6e6-422d-4e69-bf25-ddf03ac17196 tempest-AttachVolumeTestJSON-1120920040 tempest-AttachVolumeTestJSON-1120920040-project] Publish callbacks [] for floatingip, precommit_update {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:43:17.389503 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [req-b515340a-7134-4952-b9a5-9514b22ca06f req-3fcfe6e6-422d-4e69-bf25-ddf03ac17196 tempest-AttachVolumeTestJSON-1120920040 tempest-AttachVolumeTestJSON-1120920040-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-926531'] for floatingip, after_update {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:43:17.389817 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.db.l3_db [req-b515340a-7134-4952-b9a5-9514b22ca06f req-3fcfe6e6-422d-4e69-bf25-ddf03ac17196 tempest-AttachVolumeTestJSON-1120920040 tempest-AttachVolumeTestJSON-1120920040-project] Floating IP ef077627-e9bd-4654-9bca-52037bf76a41 disassociated. External IP: 172.27.1.48, port: a289ac30-8b2a-4448-8e4b-53dbabc0c2e7. Nov 23 19:43:17.390159 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.plugins.ml2.plugin [req-b515340a-7134-4952-b9a5-9514b22ca06f req-3fcfe6e6-422d-4e69-bf25-ddf03ac17196 tempest-AttachVolumeTestJSON-1120920040 tempest-AttachVolumeTestJSON-1120920040-project] Calling delete_port for a289ac30-8b2a-4448-8e4b-53dbabc0c2e7 owned by compute:nova {{(pid=102993) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 23 19:43:17.568863 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [req-b515340a-7134-4952-b9a5-9514b22ca06f req-3fcfe6e6-422d-4e69-bf25-ddf03ac17196 tempest-AttachVolumeTestJSON-1120920040 tempest-AttachVolumeTestJSON-1120920040-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7918660', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-15067', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560168', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8783631424624', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8783631008723', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-17257496'] for port, after_delete {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:43:17.597211 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3fcfe6e6-422d-4e69-bf25-ddf03ac17196 tempest-AttachVolumeTestJSON-1120920040 tempest-AttachVolumeTestJSON-1120920040-project] Pushing event deleted for resources: {'Port': ['ID=a289ac30-8b2a-4448-8e4b-53dbabc0c2e7,revision_number=None']} {{(pid=102993) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 23 19:43:17.707598 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.scheduler.l3_agent_scheduler [req-b515340a-7134-4952-b9a5-9514b22ca06f req-3fcfe6e6-422d-4e69-bf25-ddf03ac17196 tempest-AttachVolumeTestJSON-1120920040 tempest-AttachVolumeTestJSON-1120920040-project] Router c925adea-d520-48c2-a2b3-fdb5661aaf95 has already been hosted by L3 agent 1b20f2c4-70b6-43c3-b9bd-0062cc9e57ac {{(pid=102993) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 23 19:43:17.812985 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [req-b515340a-7134-4952-b9a5-9514b22ca06f req-3fcfe6e6-422d-4e69-bf25-ddf03ac17196 tempest-AttachVolumeTestJSON-1120920040 tempest-AttachVolumeTestJSON-1120920040-project] Notify agent at l3_agent.dv-cinder-819011-1-iscsi the message routers_updated {{(pid=102993) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 23 19:43:17.822670 dv-cinder-819011-1-iscsi neutron-server[102995]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-dfa9c131-7fd1-438c-9eb3-0b0a0c478172 None None] Sync routers for ids ['c925adea-d520-48c2-a2b3-fdb5661aaf95'] in dv-cinder-819011-1-iscsi {{(pid=102995) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 23 19:43:17.833197 dv-cinder-819011-1-iscsi neutron-server[102995]: DEBUG neutron.db.l3_dvrscheduler_db [None req-dfa9c131-7fd1-438c-9eb3-0b0a0c478172 None None] Routers {'c925adea-d520-48c2-a2b3-fdb5661aaf95'} bound to L3 agent in host dv-cinder-819011-1-iscsi {{(pid=102995) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 23 19:43:17.833838 dv-cinder-819011-1-iscsi neutron-server[102995]: DEBUG neutron.db.l3_hamode_db [None req-dfa9c131-7fd1-438c-9eb3-0b0a0c478172 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-819011-1-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-11-23T19:25:14Z,description=,heartbeat_timestamp=2021-11-23T19:43:14Z,host='dv-cinder-819011-1-iscsi',id=1b20f2c4-70b6-43c3-b9bd-0062cc9e57ac,load=0,resource_versions=,resources_synced=,started_at=2021-11-23T19:25:15Z,topic='l3_agent')) {'router_ids': ['c925adea-d520-48c2-a2b3-fdb5661aaf95'], 'active': True} {{(pid=102995) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 23 19:43:17.851948 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.db.l3_dvrscheduler_db [req-b515340a-7134-4952-b9a5-9514b22ca06f req-3fcfe6e6-422d-4e69-bf25-ddf03ac17196 tempest-AttachVolumeTestJSON-1120920040 tempest-AttachVolumeTestJSON-1120920040-project] No DVR routers for this DVR port a289ac30-8b2a-4448-8e4b-53dbabc0c2e7 on host hv-cinder-81901 {{(pid=102993) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 23 19:43:17.854717 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [req-b515340a-7134-4952-b9a5-9514b22ca06f req-3fcfe6e6-422d-4e69-bf25-ddf03ac17196 tempest-AttachVolumeTestJSON-1120920040 tempest-AttachVolumeTestJSON-1120920040-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-514902'] for port, before_response {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:43:17.858407 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-b515340a-7134-4952-b9a5-9514b22ca06f req-3fcfe6e6-422d-4e69-bf25-ddf03ac17196 tempest-AttachVolumeTestJSON-1120920040 tempest-AttachVolumeTestJSON-1120920040-project] 10.222.0.41 "DELETE /v2.0/ports/a289ac30-8b2a-4448-8e4b-53dbabc0c2e7 HTTP/1.1" status: 204 len: 173 time: 0.8939283 Nov 23 19:43:17.858888 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '9e87242f-98ef-4e64-9f5f-1371a11fc350', 'name': 'network-vif-deleted', 'tag': 'a289ac30-8b2a-4448-8e4b-53dbabc0c2e7'}] {{(pid=102993) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 23 19:43:17.861121 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.62/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}9b10b92acbee16fb695be1efeed0b68f7c36a5b215ec004a8d9d707fa3d35b2c" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-1cd59856-3365-4f71-a2a5-5f7cc4a3927a" -d '{"events": [{"server_uuid": "9e87242f-98ef-4e64-9f5f-1371a11fc350", "name": "network-vif-deleted", "tag": "a289ac30-8b2a-4448-8e4b-53dbabc0c2e7"}]}' {{(pid=102993) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 23 19:43:17.898748 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 23 Nov 2021 19:43:17 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-5b8d2eb9-03f4-4c79-a5d8-f882a2e0aebd x-openstack-request-id: req-5b8d2eb9-03f4-4c79-a5d8-f882a2e0aebd {{(pid=102993) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 23 19:43:17.903682 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "9e87242f-98ef-4e64-9f5f-1371a11fc350", "name": "network-vif-deleted", "tag": "a289ac30-8b2a-4448-8e4b-53dbabc0c2e7", "status": "completed", "code": 200}]} {{(pid=102993) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 23 19:43:17.903682 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.62/compute/v2.1/os-server-external-events used request id req-5b8d2eb9-03f4-4c79-a5d8-f882a2e0aebd {{(pid=102993) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 23 19:43:17.903682 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '9e87242f-98ef-4e64-9f5f-1371a11fc350', 'name': 'network-vif-deleted', 'tag': 'a289ac30-8b2a-4448-8e4b-53dbabc0c2e7', 'status': 'completed', 'code': 200} Nov 23 19:43:17.943027 dv-cinder-819011-1-iscsi neutron-server[102995]: DEBUG neutron.db.l3_dvr_db [None req-dfa9c131-7fd1-438c-9eb3-0b0a0c478172 None None] Set router c925adea-d520-48c2-a2b3-fdb5661aaf95 gateway port host: dv-cinder-819011-1-iscsi {{(pid=102995) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 23 19:43:18.163061 dv-cinder-819011-1-iscsi neutron-server[102995]: DEBUG neutron.db.l3_hamode_db [None req-dfa9c131-7fd1-438c-9eb3-0b0a0c478172 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'c925adea-d520-48c2-a2b3-fdb5661aaf95', 'name': 'tempest-AttachVolumeTestJSON-1672505821-router', 'tenant_id': 'c9d53f0599374b679185cc73383b417c', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'a93e254e-aac9-4233-9e4d-4290fd0458e4', 'external_fixed_ips': [{'subnet_id': 'e0b32f3d-83d6-439a-bbed-01df7cf01051', 'ip_address': '172.27.1.34'}], 'enable_snat': True}, 'gw_port_id': '41109199-34e8-4da6-963c-4a47600cb432', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-23T19:37:05Z', 'updated_at': '2021-11-23T19:37:09Z', 'revision_number': 4, 'project_id': 'c9d53f0599374b679185cc73383b417c', 'gw_port': {'id': '41109199-34e8-4da6-963c-4a47600cb432', 'name': '', 'network_id': 'a93e254e-aac9-4233-9e4d-4290fd0458e4', 'tenant_id': '', 'mac_address': 'fa:16:3e:52:78:cc', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'c925adea-d520-48c2-a2b3-fdb5661aaf95', 'device_owner': 'network:router_gateway', 'standard_attr_id': 486, 'fixed_ips': [{'subnet_id': 'e0b32f3d-83d6-439a-bbed-01df7cf01051', 'ip_address': '172.27.1.34', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-819011-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-23T19:37:06Z', 'updated_at': '2021-11-23T19:37:12Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'e0b32f3d-83d6-439a-bbed-01df7cf01051', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-819011-1-iscsi', '_interfaces': [{'id': '75766f49-5d4b-4c87-b9ea-e4dd672df213', 'name': '', 'network_id': '41fa5020-8aad-49ce-b2a6-39d87c9e6042', 'tenant_id': 'c9d53f0599374b679185cc73383b417c', 'mac_address': 'fa:16:3e:31:a3:fa', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'c925adea-d520-48c2-a2b3-fdb5661aaf95', 'device_owner': 'network:router_interface', 'standard_attr_id': 487, 'fixed_ips': [{'subnet_id': '8f74a1ae-f892-4057-89a5-ca78a259b1bd', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-819011-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-23T19:37:08Z', 'updated_at': '2021-11-23T19:37:14Z', 'revision_number': 5, 'project_id': 'c9d53f0599374b679185cc73383b417c', 'subnets': [{'id': '8f74a1ae-f892-4057-89a5-ca78a259b1bd', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-819011-1-iscsi', False) {} {{(pid=102995) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 23 19:43:18.193803 dv-cinder-819011-1-iscsi neutron-server[102995]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-dfa9c131-7fd1-438c-9eb3-0b0a0c478172 None None] Checking router: c925adea-d520-48c2-a2b3-fdb5661aaf95 for host: dv-cinder-819011-1-iscsi {{(pid=102995) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 23 19:43:18.204135 dv-cinder-819011-1-iscsi neutron-server[102995]: DEBUG neutron.db.l3_dvrscheduler_db [None req-dfa9c131-7fd1-438c-9eb3-0b0a0c478172 None None] Routers {'c925adea-d520-48c2-a2b3-fdb5661aaf95'} bound to L3 agent in host dv-cinder-819011-1-iscsi {{(pid=102995) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 23 19:43:18.204748 dv-cinder-819011-1-iscsi neutron-server[102995]: DEBUG neutron.db.l3_hamode_db [None req-dfa9c131-7fd1-438c-9eb3-0b0a0c478172 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-819011-1-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-11-23T19:25:14Z,description=,heartbeat_timestamp=2021-11-23T19:43:14Z,host='dv-cinder-819011-1-iscsi',id=1b20f2c4-70b6-43c3-b9bd-0062cc9e57ac,load=0,resource_versions=,resources_synced=,started_at=2021-11-23T19:25:15Z,topic='l3_agent')) {'router_ids': ['c925adea-d520-48c2-a2b3-fdb5661aaf95'], 'active': True} {{(pid=102995) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 23 19:43:18.235299 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.plugins.ml2.rpc [None req-4bf48ff4-ecfb-4168-8b63-249b8c6e9f04 None None] Device a2ad1558-284e-4085-92ca-d32f3052846b no longer exists at agent hyperv_hv-cinder-81901 {{(pid=102994) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 23 19:43:18.258749 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.plugins.ml2.plugin [None req-4bf48ff4-ecfb-4168-8b63-249b8c6e9f04 None None] No Port match for: a2ad1558-284e-4085-92ca-d32f3052846b {{(pid=102994) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 23 19:43:18.259138 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.plugins.ml2.rpc [None req-4bf48ff4-ecfb-4168-8b63-249b8c6e9f04 None None] Device a2ad1558-284e-4085-92ca-d32f3052846b not bound to the agent host hv-cinder-81901 {{(pid=102994) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 23 19:43:18.311424 dv-cinder-819011-1-iscsi neutron-server[102995]: DEBUG neutron.db.l3_dvr_db [None req-dfa9c131-7fd1-438c-9eb3-0b0a0c478172 None None] Set router c925adea-d520-48c2-a2b3-fdb5661aaf95 gateway port host: dv-cinder-819011-1-iscsi {{(pid=102995) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 23 19:43:18.500559 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-2e78d192-fd38-463d-916b-82d2f742de80 req-05c2adcb-9508-4c21-b669-241b89812897 tempest-AttachVolumeTestJSON-1120920040 tempest-AttachVolumeTestJSON-1120920040-project] 10.222.0.62 "GET /v2.0/ports?device_id=9e87242f-98ef-4e64-9f5f-1371a11fc350 HTTP/1.1" status: 200 len: 210 time: 0.0293148 Nov 23 19:43:18.530439 dv-cinder-819011-1-iscsi neutron-server[102995]: DEBUG neutron.db.l3_hamode_db [None req-dfa9c131-7fd1-438c-9eb3-0b0a0c478172 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'c925adea-d520-48c2-a2b3-fdb5661aaf95', 'name': 'tempest-AttachVolumeTestJSON-1672505821-router', 'tenant_id': 'c9d53f0599374b679185cc73383b417c', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'a93e254e-aac9-4233-9e4d-4290fd0458e4', 'external_fixed_ips': [{'subnet_id': 'e0b32f3d-83d6-439a-bbed-01df7cf01051', 'ip_address': '172.27.1.34'}], 'enable_snat': True}, 'gw_port_id': '41109199-34e8-4da6-963c-4a47600cb432', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-23T19:37:05Z', 'updated_at': '2021-11-23T19:37:09Z', 'revision_number': 4, 'project_id': 'c9d53f0599374b679185cc73383b417c', 'gw_port': {'id': '41109199-34e8-4da6-963c-4a47600cb432', 'name': '', 'network_id': 'a93e254e-aac9-4233-9e4d-4290fd0458e4', 'tenant_id': '', 'mac_address': 'fa:16:3e:52:78:cc', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'c925adea-d520-48c2-a2b3-fdb5661aaf95', 'device_owner': 'network:router_gateway', 'standard_attr_id': 486, 'fixed_ips': [{'subnet_id': 'e0b32f3d-83d6-439a-bbed-01df7cf01051', 'ip_address': '172.27.1.34', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-819011-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-23T19:37:06Z', 'updated_at': '2021-11-23T19:37:12Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'e0b32f3d-83d6-439a-bbed-01df7cf01051', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-819011-1-iscsi', '_interfaces': [{'id': '75766f49-5d4b-4c87-b9ea-e4dd672df213', 'name': '', 'network_id': '41fa5020-8aad-49ce-b2a6-39d87c9e6042', 'tenant_id': 'c9d53f0599374b679185cc73383b417c', 'mac_address': 'fa:16:3e:31:a3:fa', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'c925adea-d520-48c2-a2b3-fdb5661aaf95', 'device_owner': 'network:router_interface', 'standard_attr_id': 487, 'fixed_ips': [{'subnet_id': '8f74a1ae-f892-4057-89a5-ca78a259b1bd', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-819011-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-23T19:37:08Z', 'updated_at': '2021-11-23T19:37:14Z', 'revision_number': 5, 'project_id': 'c9d53f0599374b679185cc73383b417c', 'subnets': [{'id': '8f74a1ae-f892-4057-89a5-ca78a259b1bd', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-819011-1-iscsi', False) {} {{(pid=102995) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 23 19:43:18.557747 dv-cinder-819011-1-iscsi neutron-server[102995]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-dfa9c131-7fd1-438c-9eb3-0b0a0c478172 None None] The sync data for ids ['c925adea-d520-48c2-a2b3-fdb5661aaf95'] in dv-cinder-819011-1-iscsi is: [{'id': 'c925adea-d520-48c2-a2b3-fdb5661aaf95', 'name': 'tempest-AttachVolumeTestJSON-1672505821-router', 'tenant_id': 'c9d53f0599374b679185cc73383b417c', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'a93e254e-aac9-4233-9e4d-4290fd0458e4', 'external_fixed_ips': [{'subnet_id': 'e0b32f3d-83d6-439a-bbed-01df7cf01051', 'ip_address': '172.27.1.34'}], 'enable_snat': True}, 'gw_port_id': '41109199-34e8-4da6-963c-4a47600cb432', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-23T19:37:05Z', 'updated_at': '2021-11-23T19:37:09Z', 'revision_number': 4, 'project_id': 'c9d53f0599374b679185cc73383b417c', 'gw_port': {'id': '41109199-34e8-4da6-963c-4a47600cb432', 'name': '', 'network_id': 'a93e254e-aac9-4233-9e4d-4290fd0458e4', 'tenant_id': '', 'mac_address': 'fa:16:3e:52:78:cc', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'c925adea-d520-48c2-a2b3-fdb5661aaf95', 'device_owner': 'network:router_gateway', 'standard_attr_id': 486, 'fixed_ips': [{'subnet_id': 'e0b32f3d-83d6-439a-bbed-01df7cf01051', 'ip_address': '172.27.1.34', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-819011-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-23T19:37:06Z', 'updated_at': '2021-11-23T19:37:12Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'e0b32f3d-83d6-439a-bbed-01df7cf01051', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-819011-1-iscsi', '_interfaces': [{'id': '75766f49-5d4b-4c87-b9ea-e4dd672df213', 'name': '', 'network_id': '41fa5020-8aad-49ce-b2a6-39d87c9e6042', 'tenant_id': 'c9d53f0599374b679185cc73383b417c', 'mac_address': 'fa:16:3e:31:a3:fa', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'c925adea-d520-48c2-a2b3-fdb5661aaf95', 'device_owner': 'network:router_interface', 'standard_attr_id': 487, 'fixed_ips': [{'subnet_id': '8f74a1ae-f892-4057-89a5-ca78a259b1bd', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-819011-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-23T19:37:08Z', 'updated_at': '2021-11-23T19:37:14Z', 'revision_number': 5, 'project_id': 'c9d53f0599374b679185cc73383b417c', 'subnets': [{'id': '8f74a1ae-f892-4057-89a5-ca78a259b1bd', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=102995) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 23 19:43:18.569846 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a5a5d8b6-b7ab-4d69-b053-951230e6e459 req-7d10d5a4-e4bf-4e06-8582-e505c22bd265 tempest-AttachVolumeNegativeTest-754998453 tempest-AttachVolumeNegativeTest-754998453-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102993) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:43:18.573690 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-a5a5d8b6-b7ab-4d69-b053-951230e6e459 req-7d10d5a4-e4bf-4e06-8582-e505c22bd265 tempest-AttachVolumeNegativeTest-754998453 tempest-AttachVolumeNegativeTest-754998453-project] 10.222.0.62 "GET /v2.0/ports?device_id=e88dbfaf-c15b-4506-b81e-3abeb760ae36 HTTP/1.1" status: 200 len: 945 time: 0.0585725 Nov 23 19:43:18.624528 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-a5a5d8b6-b7ab-4d69-b053-951230e6e459 req-504f1d0e-b675-48dd-a1e3-b6dd0543994b tempest-AttachVolumeNegativeTest-754998453 tempest-AttachVolumeNegativeTest-754998453-project] 10.222.0.62 "GET /v2.0/security-groups?id=78a07d59-fd8e-4f94-9dfc-099d7d04efec&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0464103 Nov 23 19:43:18.774438 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-21751612-0ad9-42fc-881b-b7d7f928e76a None None] New status for floating IP ef077627-e9bd-4654-9bca-52037bf76a41: DOWN {{(pid=102994) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Nov 23 19:43:19.643484 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.wsgi [-] (102993) accepted ('10.222.0.62', 51288) {{(pid=102993) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 23 19:43:19.702085 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-6f7a3a84-0e6c-48c2-8550-9e7f6a6f2352 tempest-AttachVolumeTestJSON-1120920040 tempest-AttachVolumeTestJSON-1120920040-project] Publish callbacks [] for security_group, before_delete {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:43:19.725243 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-6f7a3a84-0e6c-48c2-8550-9e7f6a6f2352 tempest-AttachVolumeTestJSON-1120920040 tempest-AttachVolumeTestJSON-1120920040-project] Publish callbacks [] for security_group, precommit_delete {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:43:19.748798 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-57a8913f-c5b6-4a92-bce3-3afb552ed65a req-88062b64-3249-415e-809c-8d1b186afc5e tempest-AttachVolumeNegativeTest-754998453 tempest-AttachVolumeNegativeTest-754998453-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102992) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:43:19.751185 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-57a8913f-c5b6-4a92-bce3-3afb552ed65a req-88062b64-3249-415e-809c-8d1b186afc5e tempest-AttachVolumeNegativeTest-754998453 tempest-AttachVolumeNegativeTest-754998453-project] 10.222.0.62 "GET /v2.0/ports?device_id=e88dbfaf-c15b-4506-b81e-3abeb760ae36 HTTP/1.1" status: 200 len: 945 time: 0.0588913 Nov 23 19:43:19.804487 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-57a8913f-c5b6-4a92-bce3-3afb552ed65a req-876ab388-3900-401b-9a19-ff1aa3ace8d4 tempest-AttachVolumeNegativeTest-754998453 tempest-AttachVolumeNegativeTest-754998453-project] 10.222.0.62 "GET /v2.0/security-groups?id=78a07d59-fd8e-4f94-9dfc-099d7d04efec&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0469379 Nov 23 19:43:19.848715 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-6f7a3a84-0e6c-48c2-8550-9e7f6a6f2352 tempest-AttachVolumeTestJSON-1120920040 tempest-AttachVolumeTestJSON-1120920040-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-623933'] for security_group, after_delete {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:43:19.851463 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-6f7a3a84-0e6c-48c2-8550-9e7f6a6f2352 tempest-AttachVolumeTestJSON-1120920040 tempest-AttachVolumeTestJSON-1120920040-project] Publish callbacks [] for security_group, before_response {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:43:19.852607 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [None req-6f7a3a84-0e6c-48c2-8550-9e7f6a6f2352 tempest-AttachVolumeTestJSON-1120920040 tempest-AttachVolumeTestJSON-1120920040-project] 10.222.0.62 "DELETE /v2.0/security-groups/72babeb5-3fe0-4e83-bab0-53665ab366a2 HTTP/1.1" status: 204 len: 168 time: 0.2081254 Nov 23 19:43:19.856013 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.wsgi [-] (102992) accepted ('10.222.0.62', 51292) {{(pid=102992) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 23 19:43:19.862788 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6f7a3a84-0e6c-48c2-8550-9e7f6a6f2352 tempest-AttachVolumeTestJSON-1120920040 tempest-AttachVolumeTestJSON-1120920040-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=72babeb5-3fe0-4e83-bab0-53665ab366a2,revision_number=None']} {{(pid=102993) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 23 19:43:19.868937 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.api.v2.resource [None req-d8e9506c-a418-4326-a9c6-c93b9c1a74b1 tempest-AttachVolumeTestJSON-1120920040 tempest-AttachVolumeTestJSON-1120920040-project] show failed (client error): The resource could not be found. Nov 23 19:43:19.869753 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6f7a3a84-0e6c-48c2-8550-9e7f6a6f2352 tempest-AttachVolumeTestJSON-1120920040 tempest-AttachVolumeTestJSON-1120920040-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-819011-1-iscsi {{(pid=102993) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 23 19:43:19.870228 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [None req-d8e9506c-a418-4326-a9c6-c93b9c1a74b1 tempest-AttachVolumeTestJSON-1120920040 tempest-AttachVolumeTestJSON-1120920040-project] 10.222.0.62 "GET /v2.0/security-groups/72babeb5-3fe0-4e83-bab0-53665ab366a2 HTTP/1.1" status: 404 len: 347 time: 0.0129569 Nov 23 19:43:19.870646 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6f7a3a84-0e6c-48c2-8550-9e7f6a6f2352 tempest-AttachVolumeTestJSON-1120920040 tempest-AttachVolumeTestJSON-1120920040-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-819011-1-iscsi {{(pid=102993) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 23 19:43:19.871000 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6f7a3a84-0e6c-48c2-8550-9e7f6a6f2352 tempest-AttachVolumeTestJSON-1120920040 tempest-AttachVolumeTestJSON-1120920040-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-819011-1-iscsi {{(pid=102993) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 23 19:43:19.871344 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6f7a3a84-0e6c-48c2-8550-9e7f6a6f2352 tempest-AttachVolumeTestJSON-1120920040 tempest-AttachVolumeTestJSON-1120920040-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-819011-1-iscsi {{(pid=102993) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 23 19:43:19.871682 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6f7a3a84-0e6c-48c2-8550-9e7f6a6f2352 tempest-AttachVolumeTestJSON-1120920040 tempest-AttachVolumeTestJSON-1120920040-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-819011-1-iscsi {{(pid=102993) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 23 19:43:19.872019 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6f7a3a84-0e6c-48c2-8550-9e7f6a6f2352 tempest-AttachVolumeTestJSON-1120920040 tempest-AttachVolumeTestJSON-1120920040-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-819011-1-iscsi {{(pid=102993) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 23 19:43:19.872356 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6f7a3a84-0e6c-48c2-8550-9e7f6a6f2352 tempest-AttachVolumeTestJSON-1120920040 tempest-AttachVolumeTestJSON-1120920040-project] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-819011-1-iscsi {{(pid=102993) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 23 19:43:19.872690 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6f7a3a84-0e6c-48c2-8550-9e7f6a6f2352 tempest-AttachVolumeTestJSON-1120920040 tempest-AttachVolumeTestJSON-1120920040-project] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-819011-1-iscsi {{(pid=102993) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 23 19:43:19.872902 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.wsgi [-] (102992) accepted ('10.222.0.62', 51294) {{(pid=102992) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 23 19:43:19.873018 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6f7a3a84-0e6c-48c2-8550-9e7f6a6f2352 tempest-AttachVolumeTestJSON-1120920040 tempest-AttachVolumeTestJSON-1120920040-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-819011-1-iscsi {{(pid=102993) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 23 19:43:19.873343 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6f7a3a84-0e6c-48c2-8550-9e7f6a6f2352 tempest-AttachVolumeTestJSON-1120920040 tempest-AttachVolumeTestJSON-1120920040-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-819011-1-iscsi {{(pid=102993) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 23 19:43:19.873692 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6f7a3a84-0e6c-48c2-8550-9e7f6a6f2352 tempest-AttachVolumeTestJSON-1120920040 tempest-AttachVolumeTestJSON-1120920040-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-819011-1-iscsi {{(pid=102993) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 23 19:43:19.874017 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6f7a3a84-0e6c-48c2-8550-9e7f6a6f2352 tempest-AttachVolumeTestJSON-1120920040 tempest-AttachVolumeTestJSON-1120920040-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-819011-1-iscsi {{(pid=102993) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 23 19:43:19.998962 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.plugins.ml2.plugin [None req-1e74cdcf-4eff-4ea7-94b7-a3015b126011 tempest-AttachVolumeTestJSON-1120920040 tempest-AttachVolumeTestJSON-1120920040-project] Deleting port a1b7e213-0cec-4dad-9556-c0839c43711d {{(pid=102992) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 23 19:43:19.999296 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [None req-1e74cdcf-4eff-4ea7-94b7-a3015b126011 tempest-AttachVolumeTestJSON-1120920040 tempest-AttachVolumeTestJSON-1120920040-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8783631423070'] for port, before_delete {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:43:20.073853 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [None req-1e74cdcf-4eff-4ea7-94b7-a3015b126011 tempest-AttachVolumeTestJSON-1120920040 tempest-AttachVolumeTestJSON-1120920040-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-927332'] for port, precommit_delete {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:43:20.074092 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [None req-1e74cdcf-4eff-4ea7-94b7-a3015b126011 tempest-AttachVolumeTestJSON-1120920040 tempest-AttachVolumeTestJSON-1120920040-project] Publish callbacks [] for floatingip, precommit_delete {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:43:20.085705 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.plugins.ml2.plugin [None req-1e74cdcf-4eff-4ea7-94b7-a3015b126011 tempest-AttachVolumeTestJSON-1120920040 tempest-AttachVolumeTestJSON-1120920040-project] Calling delete_port for a1b7e213-0cec-4dad-9556-c0839c43711d owned by network:floatingip {{(pid=102992) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 23 19:43:20.244256 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.plugins.ml2.rpc [None req-4bf48ff4-ecfb-4168-8b63-249b8c6e9f04 None None] Device a289ac30-8b2a-4448-8e4b-53dbabc0c2e7 no longer exists at agent hyperv_hv-cinder-81901 {{(pid=102994) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 23 19:43:20.261222 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [None req-1e74cdcf-4eff-4ea7-94b7-a3015b126011 tempest-AttachVolumeTestJSON-1120920040 tempest-AttachVolumeTestJSON-1120920040-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7918660', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-15067', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560168', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8783631424624', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8783631008723', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-25199805'] for port, after_delete {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:43:20.264685 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.plugins.ml2.plugin [None req-4bf48ff4-ecfb-4168-8b63-249b8c6e9f04 None None] No Port match for: a289ac30-8b2a-4448-8e4b-53dbabc0c2e7 {{(pid=102994) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 23 19:43:20.265034 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.plugins.ml2.rpc [None req-4bf48ff4-ecfb-4168-8b63-249b8c6e9f04 None None] Device a289ac30-8b2a-4448-8e4b-53dbabc0c2e7 not bound to the agent host hv-cinder-81901 {{(pid=102994) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 23 19:43:20.288431 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1e74cdcf-4eff-4ea7-94b7-a3015b126011 tempest-AttachVolumeTestJSON-1120920040 tempest-AttachVolumeTestJSON-1120920040-project] Pushing event deleted for resources: {'Port': ['ID=a1b7e213-0cec-4dad-9556-c0839c43711d,revision_number=None']} {{(pid=102992) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 23 19:43:20.349191 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [None req-1e74cdcf-4eff-4ea7-94b7-a3015b126011 tempest-AttachVolumeTestJSON-1120920040 tempest-AttachVolumeTestJSON-1120920040-project] Publish callbacks [] for floatingip, after_delete {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:43:20.351768 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [None req-1e74cdcf-4eff-4ea7-94b7-a3015b126011 tempest-AttachVolumeTestJSON-1120920040 tempest-AttachVolumeTestJSON-1120920040-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-514902'] for floatingip, before_response {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:43:20.352923 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [None req-1e74cdcf-4eff-4ea7-94b7-a3015b126011 tempest-AttachVolumeTestJSON-1120920040 tempest-AttachVolumeTestJSON-1120920040-project] 10.222.0.62 "DELETE /v2.0/floatingips/ef077627-e9bd-4654-9bca-52037bf76a41 HTTP/1.1" status: 204 len: 168 time: 0.4790871 Nov 23 19:43:20.515418 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-243fb33a-19c2-4f83-9510-4544a828334f req-f827a2b9-a8d0-4a6b-9a17-2f63511a0d49 tempest-AttachVolumeNegativeTest-754998453 tempest-AttachVolumeNegativeTest-754998453-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102993) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:43:20.516934 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-243fb33a-19c2-4f83-9510-4544a828334f req-f827a2b9-a8d0-4a6b-9a17-2f63511a0d49 tempest-AttachVolumeNegativeTest-754998453 tempest-AttachVolumeNegativeTest-754998453-project] 10.222.0.41 "GET /v2.0/ports?device_id=e88dbfaf-c15b-4506-b81e-3abeb760ae36 HTTP/1.1" status: 200 len: 945 time: 0.0498035 Nov 23 19:43:20.620766 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.plugins.ml2.plugin [req-243fb33a-19c2-4f83-9510-4544a828334f req-54febf90-a7d1-43cf-a441-0684604dcfb4 tempest-AttachVolumeNegativeTest-754998453 tempest-AttachVolumeNegativeTest-754998453-project] Deleting port e8dc7322-0b92-4637-a298-0a114bf01c42 {{(pid=102993) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 23 19:43:20.623403 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [req-243fb33a-19c2-4f83-9510-4544a828334f req-54febf90-a7d1-43cf-a441-0684604dcfb4 tempest-AttachVolumeNegativeTest-754998453 tempest-AttachVolumeNegativeTest-754998453-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8783631423070'] for port, before_delete {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:43:20.709860 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.plugins.ml2.db [req-243fb33a-19c2-4f83-9510-4544a828334f req-54febf90-a7d1-43cf-a441-0684604dcfb4 tempest-AttachVolumeNegativeTest-754998453 tempest-AttachVolumeNegativeTest-754998453-project] For port e8dc7322-0b92-4637-a298-0a114bf01c42, host hv-cinder-81901, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81901',level=0,port_id=e8dc7322-0b92-4637-a298-0a114bf01c42,segment=NetworkSegment(a14a7aae-c481-4c86-92ee-f7808a54fd04),segment_id=a14a7aae-c481-4c86-92ee-f7808a54fd04)] {{(pid=102993) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 23 19:43:20.710562 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [req-243fb33a-19c2-4f83-9510-4544a828334f req-54febf90-a7d1-43cf-a441-0684604dcfb4 tempest-AttachVolumeNegativeTest-754998453 tempest-AttachVolumeNegativeTest-754998453-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-927332'] for port, precommit_delete {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:43:20.722738 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.plugins.ml2.plugin [req-243fb33a-19c2-4f83-9510-4544a828334f req-54febf90-a7d1-43cf-a441-0684604dcfb4 tempest-AttachVolumeNegativeTest-754998453 tempest-AttachVolumeNegativeTest-754998453-project] Calling delete_port for e8dc7322-0b92-4637-a298-0a114bf01c42 owned by compute:nova {{(pid=102993) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 23 19:43:20.929470 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [req-243fb33a-19c2-4f83-9510-4544a828334f req-54febf90-a7d1-43cf-a441-0684604dcfb4 tempest-AttachVolumeNegativeTest-754998453 tempest-AttachVolumeNegativeTest-754998453-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7918660', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-15067', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560168', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8783631424624', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8783631008723', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-17257496'] for port, after_delete {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:43:20.945219 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.plugins.ml2.db [None req-4bf48ff4-ecfb-4168-8b63-249b8c6e9f04 None None] get_ports_and_sgs() called for port_ids ['e8dc7322-0b92-4637-a298-0a114bf01c42'] {{(pid=102994) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 23 19:43:20.968533 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-54febf90-a7d1-43cf-a441-0684604dcfb4 tempest-AttachVolumeNegativeTest-754998453 tempest-AttachVolumeNegativeTest-754998453-project] Pushing event deleted for resources: {'Port': ['ID=e8dc7322-0b92-4637-a298-0a114bf01c42,revision_number=None']} {{(pid=102993) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 23 19:43:21.005261 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.db.l3_dvrscheduler_db [req-243fb33a-19c2-4f83-9510-4544a828334f req-54febf90-a7d1-43cf-a441-0684604dcfb4 tempest-AttachVolumeNegativeTest-754998453 tempest-AttachVolumeNegativeTest-754998453-project] No DVR routers for this DVR port e8dc7322-0b92-4637-a298-0a114bf01c42 on host hv-cinder-81901 {{(pid=102993) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 23 19:43:21.007943 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [req-243fb33a-19c2-4f83-9510-4544a828334f req-54febf90-a7d1-43cf-a441-0684604dcfb4 tempest-AttachVolumeNegativeTest-754998453 tempest-AttachVolumeNegativeTest-754998453-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-514902'] for port, before_response {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:43:21.012719 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-243fb33a-19c2-4f83-9510-4544a828334f req-54febf90-a7d1-43cf-a441-0684604dcfb4 tempest-AttachVolumeNegativeTest-754998453 tempest-AttachVolumeNegativeTest-754998453-project] 10.222.0.41 "DELETE /v2.0/ports/e8dc7322-0b92-4637-a298-0a114bf01c42 HTTP/1.1" status: 204 len: 173 time: 0.4882560 Nov 23 19:43:21.013730 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'e88dbfaf-c15b-4506-b81e-3abeb760ae36', 'name': 'network-vif-deleted', 'tag': 'e8dc7322-0b92-4637-a298-0a114bf01c42'}] {{(pid=102993) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 23 19:43:21.015731 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.62/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}9b10b92acbee16fb695be1efeed0b68f7c36a5b215ec004a8d9d707fa3d35b2c" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-d97f6bcc-f93e-472a-ae87-1d345809af7d" -d '{"events": [{"server_uuid": "e88dbfaf-c15b-4506-b81e-3abeb760ae36", "name": "network-vif-deleted", "tag": "e8dc7322-0b92-4637-a298-0a114bf01c42"}]}' {{(pid=102993) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 23 19:43:21.060209 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 23 Nov 2021 19:43:21 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-fc2798a1-3d8b-4c4e-ac1d-f39e83b3ef2b x-openstack-request-id: req-fc2798a1-3d8b-4c4e-ac1d-f39e83b3ef2b {{(pid=102993) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 23 19:43:21.060209 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "e88dbfaf-c15b-4506-b81e-3abeb760ae36", "name": "network-vif-deleted", "tag": "e8dc7322-0b92-4637-a298-0a114bf01c42", "status": "completed", "code": 200}]} {{(pid=102993) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 23 19:43:21.060476 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.62/compute/v2.1/os-server-external-events used request id req-fc2798a1-3d8b-4c4e-ac1d-f39e83b3ef2b {{(pid=102993) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 23 19:43:21.060840 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'e88dbfaf-c15b-4506-b81e-3abeb760ae36', 'name': 'network-vif-deleted', 'tag': 'e8dc7322-0b92-4637-a298-0a114bf01c42', 'status': 'completed', 'code': 200} Nov 23 19:43:21.140030 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-9d3ac135-cb71-44c9-9bb1-e10b5674746b req-5b9f6807-07e5-4705-9e06-067493e3129e tempest-AttachVolumeNegativeTest-754998453 tempest-AttachVolumeNegativeTest-754998453-project] 10.222.0.62 "GET /v2.0/ports?device_id=e88dbfaf-c15b-4506-b81e-3abeb760ae36 HTTP/1.1" status: 200 len: 210 time: 0.2653422 Nov 23 19:43:22.197665 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.wsgi [-] (102992) accepted ('10.222.0.62', 51316) {{(pid=102992) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 23 19:43:22.242261 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.db.db_base_plugin_v2 [None req-d3bc76c5-3472-42a0-b5b2-f452226f229e admin admin] Deleting subnet ffd14982-fec3-42b1-9d92-f2ed87a640f4 {{(pid=102992) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Nov 23 19:43:22.245483 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [None req-d3bc76c5-3472-42a0-b5b2-f452226f229e admin admin] Publish callbacks [] for subnet, before_delete {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:43:22.279998 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [None req-d3bc76c5-3472-42a0-b5b2-f452226f229e admin admin] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-25272549'] for subnet, precommit_delete_associations {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:43:22.322656 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [None req-d3bc76c5-3472-42a0-b5b2-f452226f229e admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-7975863'] for subnet, precommit_delete {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:43:22.437571 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [None req-d3bc76c5-3472-42a0-b5b2-f452226f229e admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-7982148', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-554858', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560168', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-25199822', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-25999729'] for subnet, after_delete {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:43:22.460390 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d3bc76c5-3472-42a0-b5b2-f452226f229e admin admin] Pushing event deleted for resources: {'Subnet': ['ID=ffd14982-fec3-42b1-9d92-f2ed87a640f4,revision_number=None']} {{(pid=102992) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 23 19:43:22.466382 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [None req-d3bc76c5-3472-42a0-b5b2-f452226f229e admin admin] Publish callbacks [] for subnet, before_response {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:43:22.469670 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [None req-d3bc76c5-3472-42a0-b5b2-f452226f229e admin admin] 10.222.0.62 "DELETE /v2.0/subnets/ffd14982-fec3-42b1-9d92-f2ed87a640f4 HTTP/1.1" status: 204 len: 168 time: 0.2709112 Nov 23 19:43:22.472093 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.wsgi [-] (102992) accepted ('10.222.0.62', 51318) {{(pid=102992) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 23 19:43:22.538716 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [None req-6c4bc14e-262b-482f-9850-f66187fe14ec admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-8133038'] for network, before_delete {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:43:22.618992 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [None req-6c4bc14e-262b-482f-9850-f66187fe14ec admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-7977576', 'neutron.services.segments.db._delete_segments_for_network-8783631323320'] for network, precommit_delete {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:43:22.639194 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.services.segments.db [None req-6c4bc14e-262b-482f-9850-f66187fe14ec admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['5f438c34-aac6-400d-bc7e-2e0506f124a9']}} {{(pid=102992) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 23 19:43:22.648267 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.services.segments.db [None req-6c4bc14e-262b-482f-9850-f66187fe14ec admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, 'a14a7aae-c481-4c86-92ee-f7808a54fd04') {'for_net_delete': True} {{(pid=102992) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 23 19:43:22.648567 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.services.segments.db [None req-6c4bc14e-262b-482f-9850-f66187fe14ec admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, 'a14a7aae-c481-4c86-92ee-f7808a54fd04') {} {{(pid=102992) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 23 19:43:22.657798 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [None req-6c4bc14e-262b-482f-9850-f66187fe14ec admin admin] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8783631432524', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-25272530'] for segment, before_delete {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:43:22.671253 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [None req-6c4bc14e-262b-482f-9850-f66187fe14ec admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7982218'] for segment, precommit_delete {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:43:22.677020 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-6c4bc14e-262b-482f-9850-f66187fe14ec admin admin] Releasing vlan 832 on physical network physnet1 to pool {{(pid=102992) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Nov 23 19:43:22.677417 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [None req-6c4bc14e-262b-482f-9850-f66187fe14ec admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7982218', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-25200492'] for segment, after_delete {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:43:22.679069 dv-cinder-819011-1-iscsi neutron-server[102992]: Traceback (most recent call last): Nov 23 19:43:22.679069 dv-cinder-819011-1-iscsi neutron-server[102992]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Nov 23 19:43:22.679069 dv-cinder-819011-1-iscsi neutron-server[102992]: timer() Nov 23 19:43:22.679069 dv-cinder-819011-1-iscsi neutron-server[102992]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 23 19:43:22.679069 dv-cinder-819011-1-iscsi neutron-server[102992]: cb(*args, **kw) Nov 23 19:43:22.679069 dv-cinder-819011-1-iscsi neutron-server[102992]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Nov 23 19:43:22.679069 dv-cinder-819011-1-iscsi neutron-server[102992]: return func(*args, **kwargs) Nov 23 19:43:22.679069 dv-cinder-819011-1-iscsi neutron-server[102992]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 23 19:43:22.679069 dv-cinder-819011-1-iscsi neutron-server[102992]: self._notify() Nov 23 19:43:22.679069 dv-cinder-819011-1-iscsi neutron-server[102992]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 23 19:43:22.679069 dv-cinder-819011-1-iscsi neutron-server[102992]: self.callback(batched_events) Nov 23 19:43:22.679069 dv-cinder-819011-1-iscsi neutron-server[102992]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 23 19:43:22.679069 dv-cinder-819011-1-iscsi neutron-server[102992]: event.method(event) Nov 23 19:43:22.679069 dv-cinder-819011-1-iscsi neutron-server[102992]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Nov 23 19:43:22.679069 dv-cinder-819011-1-iscsi neutron-server[102992]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 23 19:43:22.679069 dv-cinder-819011-1-iscsi neutron-server[102992]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Nov 23 19:43:22.679069 dv-cinder-819011-1-iscsi neutron-server[102992]: aggregate_uuid = self.p_client.list_aggregates( Nov 23 19:43:22.679069 dv-cinder-819011-1-iscsi neutron-server[102992]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Nov 23 19:43:22.679069 dv-cinder-819011-1-iscsi neutron-server[102992]: return f(self, *a, **k) Nov 23 19:43:22.679069 dv-cinder-819011-1-iscsi neutron-server[102992]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 23 19:43:22.679069 dv-cinder-819011-1-iscsi neutron-server[102992]: return self._get(url).json() Nov 23 19:43:22.679069 dv-cinder-819011-1-iscsi neutron-server[102992]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 23 19:43:22.679069 dv-cinder-819011-1-iscsi neutron-server[102992]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 23 19:43:22.679069 dv-cinder-819011-1-iscsi neutron-server[102992]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Nov 23 19:43:22.679069 dv-cinder-819011-1-iscsi neutron-server[102992]: return self.request(url, 'GET', **kwargs) Nov 23 19:43:22.679069 dv-cinder-819011-1-iscsi neutron-server[102992]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Nov 23 19:43:22.679069 dv-cinder-819011-1-iscsi neutron-server[102992]: base_url = self.get_endpoint(auth, allow=allow, Nov 23 19:43:22.679069 dv-cinder-819011-1-iscsi neutron-server[102992]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Nov 23 19:43:22.679069 dv-cinder-819011-1-iscsi neutron-server[102992]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 23 19:43:22.679069 dv-cinder-819011-1-iscsi neutron-server[102992]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Nov 23 19:43:22.679069 dv-cinder-819011-1-iscsi neutron-server[102992]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 23 19:43:22.679069 dv-cinder-819011-1-iscsi neutron-server[102992]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 23 19:43:22.780511 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [None req-6c4bc14e-262b-482f-9850-f66187fe14ec admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-7977567', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-554949', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560168', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-926557'] for network, after_delete {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:43:22.785268 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [None req-6c4bc14e-262b-482f-9850-f66187fe14ec admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-560186'] for network, before_response {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:43:22.791024 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [None req-6c4bc14e-262b-482f-9850-f66187fe14ec admin admin] 10.222.0.62 "DELETE /v2.0/networks/5f438c34-aac6-400d-bc7e-2e0506f124a9 HTTP/1.1" status: 204 len: 168 time: 0.3152978 Nov 23 19:43:22.802384 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6c4bc14e-262b-482f-9850-f66187fe14ec admin admin] Pushing event deleted for resources: {'Network': ['ID=5f438c34-aac6-400d-bc7e-2e0506f124a9,revision_number=None']} {{(pid=102992) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 23 19:43:23.145995 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.wsgi [-] (102993) accepted ('10.222.0.62', 51332) {{(pid=102993) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 23 19:43:23.186546 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [None req-212e37ab-a264-4f6d-9913-fd01b94d9352 admin admin] 10.222.0.62 "GET /v2.0/security-groups?tenant_id=e738acf03acd4f9d90b4dc46fb48bb06&name=default HTTP/1.1" status: 200 len: 2996 time: 0.0393455 Nov 23 19:43:23.188841 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.wsgi [-] (102993) accepted ('10.222.0.62', 51334) {{(pid=102993) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 23 19:43:23.235992 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-6b87e705-2f64-42ca-bb6c-1f658f2dd297 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:43:23.256248 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-6b87e705-2f64-42ca-bb6c-1f658f2dd297 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:43:23.380073 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-6b87e705-2f64-42ca-bb6c-1f658f2dd297 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-623933'] for security_group, after_delete {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:43:23.382647 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-6b87e705-2f64-42ca-bb6c-1f658f2dd297 admin admin] Publish callbacks [] for security_group, before_response {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:43:23.383923 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [None req-6b87e705-2f64-42ca-bb6c-1f658f2dd297 admin admin] 10.222.0.62 "DELETE /v2.0/security-groups/78a07d59-fd8e-4f94-9dfc-099d7d04efec HTTP/1.1" status: 204 len: 168 time: 0.1940141 Nov 23 19:43:23.393593 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6b87e705-2f64-42ca-bb6c-1f658f2dd297 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=78a07d59-fd8e-4f94-9dfc-099d7d04efec,revision_number=None']} {{(pid=102993) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 23 19:43:24.203608 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.wsgi [-] (102993) accepted ('10.222.0.62', 51360) {{(pid=102993) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 23 19:43:24.269039 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.plugins.ml2.rpc [None req-4bf48ff4-ecfb-4168-8b63-249b8c6e9f04 None None] Device e8dc7322-0b92-4637-a298-0a114bf01c42 no longer exists at agent hyperv_hv-cinder-81901 {{(pid=102994) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 23 19:43:24.289555 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.plugins.ml2.plugin [None req-4bf48ff4-ecfb-4168-8b63-249b8c6e9f04 None None] No Port match for: e8dc7322-0b92-4637-a298-0a114bf01c42 {{(pid=102994) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 23 19:43:24.289906 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.plugins.ml2.rpc [None req-4bf48ff4-ecfb-4168-8b63-249b8c6e9f04 None None] Device e8dc7322-0b92-4637-a298-0a114bf01c42 not bound to the agent host hv-cinder-81901 {{(pid=102994) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 23 19:43:24.747848 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-78775e40-47d3-44a6-8998-6846b2fad027 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-932931'] for router_interface, before_delete {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:43:25.270084 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.plugins.ml2.plugin [None req-78775e40-47d3-44a6-8998-6846b2fad027 admin admin] Deleting port 75766f49-5d4b-4c87-b9ea-e4dd672df213 {{(pid=102993) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 23 19:43:25.270738 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-78775e40-47d3-44a6-8998-6846b2fad027 admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8783631423070'] for port, before_delete {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:43:25.349153 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.plugins.ml2.db [None req-78775e40-47d3-44a6-8998-6846b2fad027 admin admin] For port 75766f49-5d4b-4c87-b9ea-e4dd672df213, host dv-cinder-819011-1-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-819011-1-iscsi',level=0,port_id=75766f49-5d4b-4c87-b9ea-e4dd672df213,segment=NetworkSegment(1a7bcd69-381b-4068-88df-df74b53e9d61),segment_id=1a7bcd69-381b-4068-88df-df74b53e9d61)] {{(pid=102993) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 23 19:43:25.351624 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-78775e40-47d3-44a6-8998-6846b2fad027 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-927332'] for port, precommit_delete {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:43:25.362655 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.plugins.ml2.plugin [None req-78775e40-47d3-44a6-8998-6846b2fad027 admin admin] Calling delete_port for 75766f49-5d4b-4c87-b9ea-e4dd672df213 owned by network:router_interface {{(pid=102993) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 23 19:43:25.597967 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-78775e40-47d3-44a6-8998-6846b2fad027 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7918660', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-15067', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560168', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8783631424624', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8783631008723', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-17257496'] for port, after_delete {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:43:25.625511 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-78775e40-47d3-44a6-8998-6846b2fad027 admin admin] Pushing event deleted for resources: {'Port': ['ID=75766f49-5d4b-4c87-b9ea-e4dd672df213,revision_number=None']} {{(pid=102993) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 23 19:43:25.797341 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-78775e40-47d3-44a6-8998-6846b2fad027 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-560161', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-933087'] for router_interface, after_delete {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:43:26.012157 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-78775e40-47d3-44a6-8998-6846b2fad027 admin admin] Router c925adea-d520-48c2-a2b3-fdb5661aaf95 has already been hosted by L3 agent 1b20f2c4-70b6-43c3-b9bd-0062cc9e57ac {{(pid=102993) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 23 19:43:26.114688 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-78775e40-47d3-44a6-8998-6846b2fad027 admin admin] Notify agent at l3_agent.dv-cinder-819011-1-iscsi the message routers_updated {{(pid=102993) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 23 19:43:26.122653 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [None req-78775e40-47d3-44a6-8998-6846b2fad027 admin admin] 10.222.0.62 "PUT /v2.0/routers/c925adea-d520-48c2-a2b3-fdb5661aaf95/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 1.9149950 Nov 23 19:43:26.122653 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.wsgi [-] (102993) accepted ('10.222.0.62', 51404) {{(pid=102993) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 23 19:43:26.123118 dv-cinder-819011-1-iscsi neutron-server[102995]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-247ef5d6-6528-48aa-b58b-b281ae0bdfc5 None None] Sync routers for ids ['c925adea-d520-48c2-a2b3-fdb5661aaf95'] in dv-cinder-819011-1-iscsi {{(pid=102995) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 23 19:43:26.133269 dv-cinder-819011-1-iscsi neutron-server[102995]: DEBUG neutron.db.l3_dvrscheduler_db [None req-247ef5d6-6528-48aa-b58b-b281ae0bdfc5 None None] Routers {'c925adea-d520-48c2-a2b3-fdb5661aaf95'} bound to L3 agent in host dv-cinder-819011-1-iscsi {{(pid=102995) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 23 19:43:26.133892 dv-cinder-819011-1-iscsi neutron-server[102995]: DEBUG neutron.db.l3_hamode_db [None req-247ef5d6-6528-48aa-b58b-b281ae0bdfc5 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-819011-1-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-11-23T19:25:14Z,description=,heartbeat_timestamp=2021-11-23T19:43:14Z,host='dv-cinder-819011-1-iscsi',id=1b20f2c4-70b6-43c3-b9bd-0062cc9e57ac,load=0,resource_versions=,resources_synced=,started_at=2021-11-23T19:25:15Z,topic='l3_agent')) {'router_ids': ['c925adea-d520-48c2-a2b3-fdb5661aaf95'], 'active': True} {{(pid=102995) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 23 19:43:26.238352 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-2eead6b7-bcf7-43b3-a0e8-61e2a59c0ce3 admin admin] Publish callbacks [] for router, before_delete {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:43:26.247073 dv-cinder-819011-1-iscsi neutron-server[102995]: DEBUG neutron.db.l3_dvr_db [None req-247ef5d6-6528-48aa-b58b-b281ae0bdfc5 None None] Set router c925adea-d520-48c2-a2b3-fdb5661aaf95 gateway port host: dv-cinder-819011-1-iscsi {{(pid=102995) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 23 19:43:26.273469 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.wsgi [-] (102992) accepted ('10.222.0.62', 51408) {{(pid=102992) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 23 19:43:26.359549 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-2eead6b7-bcf7-43b3-a0e8-61e2a59c0ce3 admin admin] Publish callbacks [] for router_gateway, before_delete {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:43:26.394803 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [None req-d27bfb7e-3de8-4d86-91ab-78a91d919302 admin admin] Publish callbacks [] for security_group, before_create {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:43:26.471087 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [None req-d27bfb7e-3de8-4d86-91ab-78a91d919302 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:43:26.500848 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.plugins.ml2.plugin [None req-2eead6b7-bcf7-43b3-a0e8-61e2a59c0ce3 admin admin] Deleting port 41109199-34e8-4da6-963c-4a47600cb432 {{(pid=102993) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 23 19:43:26.501184 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-2eead6b7-bcf7-43b3-a0e8-61e2a59c0ce3 admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8783631423070'] for port, before_delete {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:43:26.518820 dv-cinder-819011-1-iscsi neutron-server[102995]: DEBUG neutron.db.l3_hamode_db [None req-247ef5d6-6528-48aa-b58b-b281ae0bdfc5 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'c925adea-d520-48c2-a2b3-fdb5661aaf95', 'name': 'tempest-AttachVolumeTestJSON-1672505821-router', 'tenant_id': 'c9d53f0599374b679185cc73383b417c', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'a93e254e-aac9-4233-9e4d-4290fd0458e4', 'external_fixed_ips': [{'subnet_id': 'e0b32f3d-83d6-439a-bbed-01df7cf01051', 'ip_address': '172.27.1.34'}], 'enable_snat': True}, 'gw_port_id': '41109199-34e8-4da6-963c-4a47600cb432', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-23T19:37:05Z', 'updated_at': '2021-11-23T19:43:25Z', 'revision_number': 5, 'project_id': 'c9d53f0599374b679185cc73383b417c', 'gw_port': {'id': '41109199-34e8-4da6-963c-4a47600cb432', 'name': '', 'network_id': 'a93e254e-aac9-4233-9e4d-4290fd0458e4', 'tenant_id': '', 'mac_address': 'fa:16:3e:52:78:cc', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'c925adea-d520-48c2-a2b3-fdb5661aaf95', 'device_owner': 'network:router_gateway', 'standard_attr_id': 486, 'fixed_ips': [{'subnet_id': 'e0b32f3d-83d6-439a-bbed-01df7cf01051', 'ip_address': '172.27.1.34', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-819011-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-23T19:37:06Z', 'updated_at': '2021-11-23T19:37:12Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'e0b32f3d-83d6-439a-bbed-01df7cf01051', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-819011-1-iscsi'}], 'dv-cinder-819011-1-iscsi', False) {} {{(pid=102995) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 23 19:43:26.540504 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [None req-d27bfb7e-3de8-4d86-91ab-78a91d919302 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-623933'] for security_group, after_create {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:43:26.545523 dv-cinder-819011-1-iscsi neutron-server[102995]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-247ef5d6-6528-48aa-b58b-b281ae0bdfc5 None None] Checking router: c925adea-d520-48c2-a2b3-fdb5661aaf95 for host: dv-cinder-819011-1-iscsi {{(pid=102995) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 23 19:43:26.553785 dv-cinder-819011-1-iscsi neutron-server[102995]: DEBUG neutron.db.l3_dvrscheduler_db [None req-247ef5d6-6528-48aa-b58b-b281ae0bdfc5 None None] Routers {'c925adea-d520-48c2-a2b3-fdb5661aaf95'} bound to L3 agent in host dv-cinder-819011-1-iscsi {{(pid=102995) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 23 19:43:26.554406 dv-cinder-819011-1-iscsi neutron-server[102995]: DEBUG neutron.db.l3_hamode_db [None req-247ef5d6-6528-48aa-b58b-b281ae0bdfc5 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-819011-1-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-11-23T19:25:14Z,description=,heartbeat_timestamp=2021-11-23T19:43:14Z,host='dv-cinder-819011-1-iscsi',id=1b20f2c4-70b6-43c3-b9bd-0062cc9e57ac,load=0,resource_versions=,resources_synced=,started_at=2021-11-23T19:25:15Z,topic='l3_agent')) {'router_ids': ['c925adea-d520-48c2-a2b3-fdb5661aaf95'], 'active': True} {{(pid=102995) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 23 19:43:26.584692 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [None req-d27bfb7e-3de8-4d86-91ab-78a91d919302 admin admin] 10.222.0.62 "GET /v2.0/security-groups?tenant_id=9862d233407049d384209824b4c4f00e&name=default HTTP/1.1" status: 200 len: 2996 time: 0.3069921 Nov 23 19:43:26.584692 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d27bfb7e-3de8-4d86-91ab-78a91d919302 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=3e1662b9-803a-4e6f-a781-5407e6faf9b4,revision_number=1']} {{(pid=102992) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 23 19:43:26.585103 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.wsgi [-] (102993) accepted ('10.222.0.62', 51412) {{(pid=102993) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 23 19:43:26.597365 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.plugins.ml2.db [None req-2eead6b7-bcf7-43b3-a0e8-61e2a59c0ce3 admin admin] For port 41109199-34e8-4da6-963c-4a47600cb432, host dv-cinder-819011-1-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-819011-1-iscsi',level=0,port_id=41109199-34e8-4da6-963c-4a47600cb432,segment=NetworkSegment(3cb5e60b-103a-47d0-a28b-d68e3159d032),segment_id=3cb5e60b-103a-47d0-a28b-d68e3159d032)] {{(pid=102993) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 23 19:43:26.597756 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-2eead6b7-bcf7-43b3-a0e8-61e2a59c0ce3 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-927332'] for port, precommit_delete {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:43:26.620295 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.plugins.ml2.plugin [None req-2eead6b7-bcf7-43b3-a0e8-61e2a59c0ce3 admin admin] Calling delete_port for 41109199-34e8-4da6-963c-4a47600cb432 owned by network:router_gateway {{(pid=102993) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 23 19:43:26.648239 dv-cinder-819011-1-iscsi neutron-server[102995]: DEBUG neutron.db.l3_dvr_db [None req-247ef5d6-6528-48aa-b58b-b281ae0bdfc5 None None] Set router c925adea-d520-48c2-a2b3-fdb5661aaf95 gateway port host: None {{(pid=102995) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 23 19:43:26.692618 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-bdb1f82b-908c-441f-ac84-268a0200880c admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:43:26.703570 dv-cinder-819011-1-iscsi neutron-server[102995]: DEBUG neutron.db.l3_hamode_db [None req-247ef5d6-6528-48aa-b58b-b281ae0bdfc5 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'c925adea-d520-48c2-a2b3-fdb5661aaf95', 'name': 'tempest-AttachVolumeTestJSON-1672505821-router', 'tenant_id': 'c9d53f0599374b679185cc73383b417c', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-23T19:37:05Z', 'updated_at': '2021-11-23T19:43:26Z', 'revision_number': 6, 'project_id': 'c9d53f0599374b679185cc73383b417c', 'gw_port_host': None}], 'dv-cinder-819011-1-iscsi', False) {} {{(pid=102995) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 23 19:43:26.725663 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-bdb1f82b-908c-441f-ac84-268a0200880c admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:43:26.729541 dv-cinder-819011-1-iscsi neutron-server[102995]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-247ef5d6-6528-48aa-b58b-b281ae0bdfc5 None None] The sync data for ids ['c925adea-d520-48c2-a2b3-fdb5661aaf95'] in dv-cinder-819011-1-iscsi is: [{'id': 'c925adea-d520-48c2-a2b3-fdb5661aaf95', 'name': 'tempest-AttachVolumeTestJSON-1672505821-router', 'tenant_id': 'c9d53f0599374b679185cc73383b417c', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-23T19:37:05Z', 'updated_at': '2021-11-23T19:43:26Z', 'revision_number': 6, 'project_id': 'c9d53f0599374b679185cc73383b417c', 'gw_port_host': None}] {{(pid=102995) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 23 19:43:26.911529 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-bdb1f82b-908c-441f-ac84-268a0200880c admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-623933'] for security_group, after_delete {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:43:26.914171 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-bdb1f82b-908c-441f-ac84-268a0200880c admin admin] Publish callbacks [] for security_group, before_response {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:43:26.915311 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [None req-bdb1f82b-908c-441f-ac84-268a0200880c admin admin] 10.222.0.62 "DELETE /v2.0/security-groups/3e1662b9-803a-4e6f-a781-5407e6faf9b4 HTTP/1.1" status: 204 len: 168 time: 0.3293455 Nov 23 19:43:26.923560 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bdb1f82b-908c-441f-ac84-268a0200880c admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=3e1662b9-803a-4e6f-a781-5407e6faf9b4,revision_number=None']} {{(pid=102993) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 23 19:43:26.935343 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-2eead6b7-bcf7-43b3-a0e8-61e2a59c0ce3 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7918660', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-15067', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560168', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8783631424624', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8783631008723', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-17257496'] for port, after_delete {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:43:26.964653 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2eead6b7-bcf7-43b3-a0e8-61e2a59c0ce3 admin admin] Pushing event deleted for resources: {'Port': ['ID=41109199-34e8-4da6-963c-4a47600cb432,revision_number=None']} {{(pid=102993) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 23 19:43:27.026261 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-2eead6b7-bcf7-43b3-a0e8-61e2a59c0ce3 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-926585'] for router_gateway, after_delete {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:43:27.120415 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-2eead6b7-bcf7-43b3-a0e8-61e2a59c0ce3 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-932919', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-13457'] for router, precommit_delete {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:43:27.123076 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-2eead6b7-bcf7-43b3-a0e8-61e2a59c0ce3 admin admin] Publish callbacks [] for router_controller, precommit_delete_associations {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:43:27.260258 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-2eead6b7-bcf7-43b3-a0e8-61e2a59c0ce3 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-926715'] for router, after_delete {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:43:27.260882 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-2eead6b7-bcf7-43b3-a0e8-61e2a59c0ce3 admin admin] Fanout notify agent at l3_agent the message router_deleted on router c925adea-d520-48c2-a2b3-fdb5661aaf95 {{(pid=102993) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Nov 23 19:43:27.283390 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-2eead6b7-bcf7-43b3-a0e8-61e2a59c0ce3 admin admin] Publish callbacks [] for router, before_response {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:43:27.283390 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [None req-2eead6b7-bcf7-43b3-a0e8-61e2a59c0ce3 admin admin] 10.222.0.62 "DELETE /v2.0/routers/c925adea-d520-48c2-a2b3-fdb5661aaf95 HTTP/1.1" status: 204 len: 168 time: 1.1440723 Nov 23 19:43:27.283390 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.wsgi [-] (102993) accepted ('10.222.0.62', 51418) {{(pid=102993) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 23 19:43:27.316301 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.db.db_base_plugin_v2 [None req-c2afcc39-017f-483e-8397-74465cf24ebc admin admin] Deleting subnet 8f74a1ae-f892-4057-89a5-ca78a259b1bd {{(pid=102993) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Nov 23 19:43:27.319376 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-c2afcc39-017f-483e-8397-74465cf24ebc admin admin] Publish callbacks [] for subnet, before_delete {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:43:27.354321 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-c2afcc39-017f-483e-8397-74465cf24ebc admin admin] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-16914634'] for subnet, precommit_delete_associations {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:43:27.432611 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-c2afcc39-017f-483e-8397-74465cf24ebc admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-7975863'] for subnet, precommit_delete {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:43:27.509626 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.wsgi [-] (102993) accepted ('10.222.0.62', 51420) {{(pid=102993) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 23 19:43:27.524294 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-0e096972-af1c-4827-afa7-5466ca8654e6 admin admin] Publish callbacks [] for security_group, before_create {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:43:27.536961 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-c2afcc39-017f-483e-8397-74465cf24ebc admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-7982148', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-554858', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560168', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-17257579', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-17772973'] for subnet, after_delete {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:43:27.574953 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c2afcc39-017f-483e-8397-74465cf24ebc admin admin] Pushing event deleted for resources: {'Subnet': ['ID=8f74a1ae-f892-4057-89a5-ca78a259b1bd,revision_number=None']} {{(pid=102993) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 23 19:43:27.576953 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-c2afcc39-017f-483e-8397-74465cf24ebc admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-560186'] for subnet, before_response {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:43:27.582643 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [None req-c2afcc39-017f-483e-8397-74465cf24ebc admin admin] 10.222.0.62 "DELETE /v2.0/subnets/8f74a1ae-f892-4057-89a5-ca78a259b1bd HTTP/1.1" status: 204 len: 168 time: 0.3093488 Nov 23 19:43:27.582813 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-dcbe3d36-ec92-4781-8102-bf25ba4cd51b None None] Network 41fa5020-8aad-49ce-b2a6-39d87c9e6042 requested from dv-cinder-819011-1-iscsi {{(pid=102994) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 23 19:43:27.583265 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.wsgi [-] (102992) accepted ('10.222.0.62', 51422) {{(pid=102992) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 23 19:43:27.639156 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-0e096972-af1c-4827-afa7-5466ca8654e6 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:43:27.671741 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [None req-adcfa4c6-b904-4697-aa19-1534090a8134 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-8133038'] for network, before_delete {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:43:27.677071 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-0e096972-af1c-4827-afa7-5466ca8654e6 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-623933'] for security_group, after_create {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:43:27.718046 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [None req-0e096972-af1c-4827-afa7-5466ca8654e6 admin admin] 10.222.0.62 "GET /v2.0/security-groups?tenant_id=16d65bb61b764b09b0d85f652c48f535&name=default HTTP/1.1" status: 200 len: 2996 time: 0.2072408 Nov 23 19:43:27.719634 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0e096972-af1c-4827-afa7-5466ca8654e6 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=aaf9552c-d69d-4cfb-8f33-1ef16d9bef2d,revision_number=1']} {{(pid=102993) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 23 19:43:27.721208 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.wsgi [-] (102992) accepted ('10.222.0.62', 51424) {{(pid=102992) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 23 19:43:27.747598 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.plugins.ml2.plugin [None req-adcfa4c6-b904-4697-aa19-1534090a8134 admin admin] Deleting port bf436721-5360-4dc2-99d4-f32fd359b0fe {{(pid=102992) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 23 19:43:27.747937 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [None req-adcfa4c6-b904-4697-aa19-1534090a8134 admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8783631423070'] for port, before_delete {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:43:27.808301 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-dd541778-e694-4db5-917a-a53b523a4719 None None] DHCP port deletion for 41fa5020-8aad-49ce-b2a6-39d87c9e6042 request from dv-cinder-819011-1-iscsi {{(pid=102994) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:266}} Nov 23 19:43:27.837259 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.plugins.ml2.db [None req-adcfa4c6-b904-4697-aa19-1534090a8134 admin admin] For port bf436721-5360-4dc2-99d4-f32fd359b0fe, host dv-cinder-819011-1-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-819011-1-iscsi',level=0,port_id=bf436721-5360-4dc2-99d4-f32fd359b0fe,segment=NetworkSegment(1a7bcd69-381b-4068-88df-df74b53e9d61),segment_id=1a7bcd69-381b-4068-88df-df74b53e9d61)] {{(pid=102992) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 23 19:43:27.837671 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [None req-adcfa4c6-b904-4697-aa19-1534090a8134 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-927332'] for port, precommit_delete {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:43:27.840811 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [None req-33669e50-46d0-451d-b2bc-604edef9476b admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:43:27.860118 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.plugins.ml2.plugin [None req-adcfa4c6-b904-4697-aa19-1534090a8134 admin admin] Calling delete_port for bf436721-5360-4dc2-99d4-f32fd359b0fe owned by network:dhcp {{(pid=102992) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 23 19:43:27.864608 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.plugins.ml2.plugin [None req-dd541778-e694-4db5-917a-a53b523a4719 None None] Deleting port bf436721-5360-4dc2-99d4-f32fd359b0fe {{(pid=102994) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 23 19:43:27.864992 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron_lib.callbacks.manager [None req-dd541778-e694-4db5-917a-a53b523a4719 None None] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8783631423070'] for port, before_delete {{(pid=102994) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:43:27.877032 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [None req-33669e50-46d0-451d-b2bc-604edef9476b admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:43:27.931528 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.plugins.ml2.db [None req-dd541778-e694-4db5-917a-a53b523a4719 None None] For port bf436721-5360-4dc2-99d4-f32fd359b0fe, host dv-cinder-819011-1-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-819011-1-iscsi',level=0,port_id=bf436721-5360-4dc2-99d4-f32fd359b0fe,segment=NetworkSegment(1a7bcd69-381b-4068-88df-df74b53e9d61),segment_id=1a7bcd69-381b-4068-88df-df74b53e9d61)] {{(pid=102994) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 23 19:43:27.931921 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron_lib.callbacks.manager [None req-dd541778-e694-4db5-917a-a53b523a4719 None None] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-927332'] for port, precommit_delete {{(pid=102994) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:43:27.944474 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.plugins.ml2.plugin [None req-dd541778-e694-4db5-917a-a53b523a4719 None None] Calling delete_port for bf436721-5360-4dc2-99d4-f32fd359b0fe owned by network:dhcp {{(pid=102994) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 23 19:43:28.009062 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [None req-33669e50-46d0-451d-b2bc-604edef9476b admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-623933'] for security_group, after_delete {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:43:28.012422 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [None req-33669e50-46d0-451d-b2bc-604edef9476b admin admin] Publish callbacks [] for security_group, before_response {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:43:28.013675 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [None req-33669e50-46d0-451d-b2bc-604edef9476b admin admin] 10.222.0.62 "DELETE /v2.0/security-groups/aaf9552c-d69d-4cfb-8f33-1ef16d9bef2d HTTP/1.1" status: 204 len: 168 time: 0.2906497 Nov 23 19:43:28.023891 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-33669e50-46d0-451d-b2bc-604edef9476b admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=aaf9552c-d69d-4cfb-8f33-1ef16d9bef2d,revision_number=None']} {{(pid=102992) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 23 19:43:28.045272 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [None req-adcfa4c6-b904-4697-aa19-1534090a8134 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7918660', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-15067', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560168', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8783631424624', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8783631008723', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-25199805'] for port, after_delete {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:43:28.060517 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron_lib.callbacks.manager [None req-dd541778-e694-4db5-917a-a53b523a4719 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7918660', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-15067', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560168', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8783631424624', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8783631008723'] for port, after_delete {{(pid=102994) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:43:28.083230 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.db.l3_dvrscheduler_db [None req-adcfa4c6-b904-4697-aa19-1534090a8134 admin admin] No DVR routers for this DVR port bf436721-5360-4dc2-99d4-f32fd359b0fe on host dv-cinder-819011-1-iscsi {{(pid=102992) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 23 19:43:28.088147 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-dd541778-e694-4db5-917a-a53b523a4719 None None] Pushing event deleted for resources: {'Port': ['ID=bf436721-5360-4dc2-99d4-f32fd359b0fe,revision_number=None']} {{(pid=102994) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 23 19:43:28.090058 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-adcfa4c6-b904-4697-aa19-1534090a8134 admin admin] Pushing event deleted for resources: {'Port': ['ID=bf436721-5360-4dc2-99d4-f32fd359b0fe,revision_number=None']} {{(pid=102992) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 23 19:43:28.090642 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.db.l3_dvrscheduler_db [None req-dd541778-e694-4db5-917a-a53b523a4719 None None] No DVR routers for this DVR port bf436721-5360-4dc2-99d4-f32fd359b0fe on host dv-cinder-819011-1-iscsi {{(pid=102994) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 23 19:43:28.098377 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-dd541778-e694-4db5-917a-a53b523a4719 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-819011-1-iscsi {{(pid=102994) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 23 19:43:28.098799 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-dd541778-e694-4db5-917a-a53b523a4719 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-819011-1-iscsi {{(pid=102994) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 23 19:43:28.099087 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-dd541778-e694-4db5-917a-a53b523a4719 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-819011-1-iscsi {{(pid=102994) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 23 19:43:28.099424 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-dd541778-e694-4db5-917a-a53b523a4719 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-819011-1-iscsi {{(pid=102994) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 23 19:43:28.099759 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-dd541778-e694-4db5-917a-a53b523a4719 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-819011-1-iscsi {{(pid=102994) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 23 19:43:28.100089 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-dd541778-e694-4db5-917a-a53b523a4719 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-819011-1-iscsi {{(pid=102994) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 23 19:43:28.100413 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-dd541778-e694-4db5-917a-a53b523a4719 None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-819011-1-iscsi {{(pid=102994) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 23 19:43:28.100746 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-dd541778-e694-4db5-917a-a53b523a4719 None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-819011-1-iscsi {{(pid=102994) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 23 19:43:28.101073 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-dd541778-e694-4db5-917a-a53b523a4719 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-819011-1-iscsi {{(pid=102994) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 23 19:43:28.101847 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-dd541778-e694-4db5-917a-a53b523a4719 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-819011-1-iscsi {{(pid=102994) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 23 19:43:28.101847 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-dd541778-e694-4db5-917a-a53b523a4719 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-819011-1-iscsi {{(pid=102994) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 23 19:43:28.102044 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-dd541778-e694-4db5-917a-a53b523a4719 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-819011-1-iscsi {{(pid=102994) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 23 19:43:28.168783 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [None req-adcfa4c6-b904-4697-aa19-1534090a8134 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-7977576', 'neutron.services.segments.db._delete_segments_for_network-8783631323320'] for network, precommit_delete {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:43:28.189730 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.services.segments.db [None req-adcfa4c6-b904-4697-aa19-1534090a8134 admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['41fa5020-8aad-49ce-b2a6-39d87c9e6042']}} {{(pid=102992) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 23 19:43:28.198998 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.services.segments.db [None req-adcfa4c6-b904-4697-aa19-1534090a8134 admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '1a7bcd69-381b-4068-88df-df74b53e9d61') {'for_net_delete': True} {{(pid=102992) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 23 19:43:28.199358 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.services.segments.db [None req-adcfa4c6-b904-4697-aa19-1534090a8134 admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '1a7bcd69-381b-4068-88df-df74b53e9d61') {} {{(pid=102992) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 23 19:43:28.214735 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [None req-adcfa4c6-b904-4697-aa19-1534090a8134 admin admin] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8783631432524', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-25272530'] for segment, before_delete {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:43:28.230288 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [None req-adcfa4c6-b904-4697-aa19-1534090a8134 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7982218'] for segment, precommit_delete {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:43:28.236569 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-adcfa4c6-b904-4697-aa19-1534090a8134 admin admin] Releasing vlan 824 on physical network physnet1 to pool {{(pid=102992) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Nov 23 19:43:28.241153 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [None req-adcfa4c6-b904-4697-aa19-1534090a8134 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7982218', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-25200492'] for segment, after_delete {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:43:28.241153 dv-cinder-819011-1-iscsi neutron-server[102992]: Traceback (most recent call last): Nov 23 19:43:28.241153 dv-cinder-819011-1-iscsi neutron-server[102992]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Nov 23 19:43:28.241153 dv-cinder-819011-1-iscsi neutron-server[102992]: timer() Nov 23 19:43:28.241153 dv-cinder-819011-1-iscsi neutron-server[102992]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 23 19:43:28.241153 dv-cinder-819011-1-iscsi neutron-server[102992]: cb(*args, **kw) Nov 23 19:43:28.241153 dv-cinder-819011-1-iscsi neutron-server[102992]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Nov 23 19:43:28.241153 dv-cinder-819011-1-iscsi neutron-server[102992]: return func(*args, **kwargs) Nov 23 19:43:28.241153 dv-cinder-819011-1-iscsi neutron-server[102992]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 23 19:43:28.241153 dv-cinder-819011-1-iscsi neutron-server[102992]: self._notify() Nov 23 19:43:28.241153 dv-cinder-819011-1-iscsi neutron-server[102992]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 23 19:43:28.241153 dv-cinder-819011-1-iscsi neutron-server[102992]: self.callback(batched_events) Nov 23 19:43:28.241153 dv-cinder-819011-1-iscsi neutron-server[102992]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 23 19:43:28.241153 dv-cinder-819011-1-iscsi neutron-server[102992]: event.method(event) Nov 23 19:43:28.241153 dv-cinder-819011-1-iscsi neutron-server[102992]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Nov 23 19:43:28.241153 dv-cinder-819011-1-iscsi neutron-server[102992]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 23 19:43:28.241153 dv-cinder-819011-1-iscsi neutron-server[102992]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Nov 23 19:43:28.241153 dv-cinder-819011-1-iscsi neutron-server[102992]: aggregate_uuid = self.p_client.list_aggregates( Nov 23 19:43:28.241153 dv-cinder-819011-1-iscsi neutron-server[102992]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Nov 23 19:43:28.241153 dv-cinder-819011-1-iscsi neutron-server[102992]: return f(self, *a, **k) Nov 23 19:43:28.241153 dv-cinder-819011-1-iscsi neutron-server[102992]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 23 19:43:28.241153 dv-cinder-819011-1-iscsi neutron-server[102992]: return self._get(url).json() Nov 23 19:43:28.241153 dv-cinder-819011-1-iscsi neutron-server[102992]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 23 19:43:28.241153 dv-cinder-819011-1-iscsi neutron-server[102992]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 23 19:43:28.241153 dv-cinder-819011-1-iscsi neutron-server[102992]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Nov 23 19:43:28.241153 dv-cinder-819011-1-iscsi neutron-server[102992]: return self.request(url, 'GET', **kwargs) Nov 23 19:43:28.241153 dv-cinder-819011-1-iscsi neutron-server[102992]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Nov 23 19:43:28.241153 dv-cinder-819011-1-iscsi neutron-server[102992]: base_url = self.get_endpoint(auth, allow=allow, Nov 23 19:43:28.241153 dv-cinder-819011-1-iscsi neutron-server[102992]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Nov 23 19:43:28.241153 dv-cinder-819011-1-iscsi neutron-server[102992]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 23 19:43:28.241153 dv-cinder-819011-1-iscsi neutron-server[102992]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Nov 23 19:43:28.241153 dv-cinder-819011-1-iscsi neutron-server[102992]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 23 19:43:28.241153 dv-cinder-819011-1-iscsi neutron-server[102992]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 23 19:43:28.277069 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.plugins.ml2.rpc [None req-eb87b2c3-3339-4249-8b85-e695b5b4e1f9 None None] Device bf436721-5360-4dc2-99d4-f32fd359b0fe no longer exists at agent ovs-agent-dv-cinder-819011-1-iscsi {{(pid=102994) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 23 19:43:28.297754 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.plugins.ml2.plugin [None req-eb87b2c3-3339-4249-8b85-e695b5b4e1f9 None None] No Port match for: bf436721-5360-4dc2-99d4-f32fd359b0fe {{(pid=102994) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 23 19:43:28.298180 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.plugins.ml2.rpc [None req-eb87b2c3-3339-4249-8b85-e695b5b4e1f9 None None] Device bf436721-5360-4dc2-99d4-f32fd359b0fe not bound to the agent host dv-cinder-819011-1-iscsi {{(pid=102994) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 23 19:43:28.298671 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.plugins.ml2.rpc [None req-eb87b2c3-3339-4249-8b85-e695b5b4e1f9 None None] Device 41109199-34e8-4da6-963c-4a47600cb432 no longer exists at agent ovs-agent-dv-cinder-819011-1-iscsi {{(pid=102994) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 23 19:43:28.317545 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.plugins.ml2.plugin [None req-eb87b2c3-3339-4249-8b85-e695b5b4e1f9 None None] No Port match for: 41109199-34e8-4da6-963c-4a47600cb432 {{(pid=102994) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 23 19:43:28.325295 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.plugins.ml2.rpc [None req-eb87b2c3-3339-4249-8b85-e695b5b4e1f9 None None] Device 41109199-34e8-4da6-963c-4a47600cb432 not bound to the agent host dv-cinder-819011-1-iscsi {{(pid=102994) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 23 19:43:28.325295 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.plugins.ml2.rpc [None req-eb87b2c3-3339-4249-8b85-e695b5b4e1f9 None None] Device 75766f49-5d4b-4c87-b9ea-e4dd672df213 no longer exists at agent ovs-agent-dv-cinder-819011-1-iscsi {{(pid=102994) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 23 19:43:28.337627 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.plugins.ml2.plugin [None req-eb87b2c3-3339-4249-8b85-e695b5b4e1f9 None None] No Port match for: 75766f49-5d4b-4c87-b9ea-e4dd672df213 {{(pid=102994) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 23 19:43:28.338005 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.plugins.ml2.rpc [None req-eb87b2c3-3339-4249-8b85-e695b5b4e1f9 None None] Device 75766f49-5d4b-4c87-b9ea-e4dd672df213 not bound to the agent host dv-cinder-819011-1-iscsi {{(pid=102994) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 23 19:43:28.357306 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [None req-adcfa4c6-b904-4697-aa19-1534090a8134 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-7977567', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-554949', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560168', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-926557'] for network, after_delete {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:43:28.363633 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [None req-adcfa4c6-b904-4697-aa19-1534090a8134 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-560186'] for network, before_response {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:43:28.366909 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [None req-adcfa4c6-b904-4697-aa19-1534090a8134 admin admin] 10.222.0.62 "DELETE /v2.0/networks/41fa5020-8aad-49ce-b2a6-39d87c9e6042 HTTP/1.1" status: 204 len: 168 time: 0.7829020 Nov 23 19:43:28.377666 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-adcfa4c6-b904-4697-aa19-1534090a8134 admin admin] Pushing event deleted for resources: {'Network': ['ID=41fa5020-8aad-49ce-b2a6-39d87c9e6042,revision_number=None']} {{(pid=102992) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 23 19:43:28.690433 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.wsgi [-] (102992) accepted ('10.222.0.62', 51440) {{(pid=102992) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 23 19:43:28.729154 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [None req-75493bf4-2f6d-439b-a5af-1540e25207d7 admin admin] 10.222.0.62 "GET /v2.0/security-groups?tenant_id=c9d53f0599374b679185cc73383b417c&name=default HTTP/1.1" status: 200 len: 2996 time: 0.0374568 Nov 23 19:43:28.732996 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.wsgi [-] (102993) accepted ('10.222.0.62', 51442) {{(pid=102993) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 23 19:43:28.783101 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-949918bb-0878-4ee4-adfd-42c61c456734 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:43:28.809057 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-949918bb-0878-4ee4-adfd-42c61c456734 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:43:28.957336 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-949918bb-0878-4ee4-adfd-42c61c456734 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-623933'] for security_group, after_delete {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:43:28.960232 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-949918bb-0878-4ee4-adfd-42c61c456734 admin admin] Publish callbacks [] for security_group, before_response {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:43:28.961473 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [None req-949918bb-0878-4ee4-adfd-42c61c456734 admin admin] 10.222.0.62 "DELETE /v2.0/security-groups/3c646d5d-3feb-4f6d-b5a1-38e2b7bb59fa HTTP/1.1" status: 204 len: 168 time: 0.2274361 Nov 23 19:43:28.969295 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-949918bb-0878-4ee4-adfd-42c61c456734 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=3c646d5d-3feb-4f6d-b5a1-38e2b7bb59fa,revision_number=None']} {{(pid=102993) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 23 19:43:29.837203 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron_lib.callbacks.manager [None req-4bf48ff4-ecfb-4168-8b63-249b8c6e9f04 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8783631323329', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7978582'] for agent, after_update {{(pid=102994) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:43:29.896697 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.wsgi [-] (102993) accepted ('10.222.0.62', 51490) {{(pid=102993) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 23 19:43:29.992630 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.api.v2.base [None req-5f3b57be-5fa5-49fc-89d7-7ea535fbcda1 admin admin] Request body: {'network': {'name': 'tempest-EncryptedVolumesExtendAttachedTest-2082993086-network', 'tenant_id': '33aae306238f4dc18446de6c98952b34'}} {{(pid=102993) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 23 19:43:30.054776 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-5f3b57be-5fa5-49fc-89d7-7ea535fbcda1 admin admin] Made reservation on behalf of 33aae306238f4dc18446de6c98952b34 for: {'network': 1} {{(pid=102993) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 23 19:43:30.057149 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-5f3b57be-5fa5-49fc-89d7-7ea535fbcda1 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7921281'] for network, before_create {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:43:30.069096 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-5f3b57be-5fa5-49fc-89d7-7ea535fbcda1 admin admin] Publish callbacks [] for security_group, before_create {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:43:30.155885 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-5f3b57be-5fa5-49fc-89d7-7ea535fbcda1 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:43:30.197528 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-5f3b57be-5fa5-49fc-89d7-7ea535fbcda1 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-623933'] for security_group, after_create {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:43:30.225295 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-5f3b57be-5fa5-49fc-89d7-7ea535fbcda1 admin admin] vlan segment allocate from pool success with {'vlan_id': 840, 'physical_network': 'physnet1'} {{(pid=102993) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 23 19:43:30.232629 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5f3b57be-5fa5-49fc-89d7-7ea535fbcda1 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=59c0e63d-07cd-4e01-984f-295d3aec7347,revision_number=1']} {{(pid=102993) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 23 19:43:30.243556 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-5f3b57be-5fa5-49fc-89d7-7ea535fbcda1 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7982218'] for segment, precommit_create {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:43:30.243556 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.db.segments_db [None req-5f3b57be-5fa5-49fc-89d7-7ea535fbcda1 admin admin] Added segment b0f3f9d8-31c7-4cd9-88eb-c137fafe2781 of type vlan for network 620a2f82-a6b4-4e0c-80ae-5dce2f20e8b2 Nov 23 19:43:30.283947 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-5f3b57be-5fa5-49fc-89d7-7ea535fbcda1 admin admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8783630993713'] for network, precommit_create {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:43:30.363347 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-5f3b57be-5fa5-49fc-89d7-7ea535fbcda1 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-554949', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560168'] for network, after_create {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:43:30.364322 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-5f3b57be-5fa5-49fc-89d7-7ea535fbcda1 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102993) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:43:30.364909 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-5f3b57be-5fa5-49fc-89d7-7ea535fbcda1 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-560186'] for network, before_response {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:43:30.427653 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5f3b57be-5fa5-49fc-89d7-7ea535fbcda1 admin admin] Pushing event updated for resources: {'Network': ['ID=620a2f82-a6b4-4e0c-80ae-5dce2f20e8b2,revision_number=1']} {{(pid=102993) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 23 19:43:30.437876 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.plugins.ml2.rpc [None req-eb87b2c3-3339-4249-8b85-e695b5b4e1f9 None None] Network 620a2f82-a6b4-4e0c-80ae-5dce2f20e8b2 details requested by agent ovs-agent-dv-cinder-819011-1-iscsi with host dv-cinder-819011-1-iscsi {{(pid=102994) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Nov 23 19:43:30.439895 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [None req-5f3b57be-5fa5-49fc-89d7-7ea535fbcda1 admin admin] 10.222.0.62 "POST /v2.0/networks HTTP/1.1" status: 201 len: 898 time: 0.5415080 Nov 23 19:43:30.442767 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.wsgi [-] (102993) accepted ('10.222.0.62', 51500) {{(pid=102993) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 23 19:43:30.447616 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.api.v2.base [None req-94ebc39e-7787-4f67-8cbc-6ba73ce81751 admin admin] Request body: {'subnet': {'network_id': '620a2f82-a6b4-4e0c-80ae-5dce2f20e8b2', 'cidr': '172.20.0.0/28', 'name': 'tempest-EncryptedVolumesExtendAttachedTest-2082993086-subnet', 'tenant_id': '33aae306238f4dc18446de6c98952b34', 'enable_dhcp': False, 'ip_version': 4}} {{(pid=102993) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 23 19:43:30.545881 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-94ebc39e-7787-4f67-8cbc-6ba73ce81751 admin admin] Made reservation on behalf of 33aae306238f4dc18446de6c98952b34 for: {'subnet': 1} {{(pid=102993) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 23 19:43:30.548287 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-94ebc39e-7787-4f67-8cbc-6ba73ce81751 admin admin] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-17772934'] for subnet, before_create {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:43:30.780453 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-94ebc39e-7787-4f67-8cbc-6ba73ce81751 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-554858', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560168', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-17257652', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-17772948'] for subnet, after_create {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:43:30.837014 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-94ebc39e-7787-4f67-8cbc-6ba73ce81751 admin admin] Pushing event updated for resources: {'Subnet': ['ID=181357d0-16c2-4e77-b99b-d68a3be3bc99,revision_number=0']} {{(pid=102993) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 23 19:43:30.846454 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-94ebc39e-7787-4f67-8cbc-6ba73ce81751 admin admin] Checking segment: {'id': 'b0f3f9d8-31c7-4cd9-88eb-c137fafe2781', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 840, 'network_id': '620a2f82-a6b4-4e0c-80ae-5dce2f20e8b2'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102993) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 23 19:43:30.846819 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-94ebc39e-7787-4f67-8cbc-6ba73ce81751 admin admin] Network hostable DHCP agents. Network: 620a2f82-a6b4-4e0c-80ae-5dce2f20e8b2, hostable agents: ['e51c95c7-6a36-4263-ba47-1839054f3e7a'], hosted agents: [] {{(pid=102993) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 23 19:43:30.928372 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-94ebc39e-7787-4f67-8cbc-6ba73ce81751 admin admin] Network 620a2f82-a6b4-4e0c-80ae-5dce2f20e8b2 is scheduled to be hosted by DHCP agent e51c95c7-6a36-4263-ba47-1839054f3e7a with binding_index 1 {{(pid=102993) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 23 19:43:31.037023 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.scheduler.base_scheduler [None req-94ebc39e-7787-4f67-8cbc-6ba73ce81751 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-819011-1-iscsi, 620a2f82-a6b4-4e0c-80ae-5dce2f20e8b2) {{(pid=102993) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 23 19:43:31.041321 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-94ebc39e-7787-4f67-8cbc-6ba73ce81751 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=102993) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:43:31.041979 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-94ebc39e-7787-4f67-8cbc-6ba73ce81751 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-560186'] for subnet, before_response {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:43:31.045950 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-1c891238-f1d3-460c-8b27-72aab573334e None None] Network 620a2f82-a6b4-4e0c-80ae-5dce2f20e8b2 requested from dv-cinder-819011-1-iscsi {{(pid=102994) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 23 19:43:31.131422 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [None req-94ebc39e-7787-4f67-8cbc-6ba73ce81751 admin admin] 10.222.0.62 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 862 time: 0.6875319 Nov 23 19:43:31.172430 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-521cfe15-2c9a-419e-9f60-01cbd201768b None None] Network 620a2f82-a6b4-4e0c-80ae-5dce2f20e8b2 requested from dv-cinder-819011-1-iscsi {{(pid=102994) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 23 19:43:31.632292 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-ec7028c3-7f88-4f90-875c-2ac52d49853e req-addcf2dc-3564-44ed-b418-c862421190ee service neutron] 10.222.0.41 "GET /v2.0/ports?device_id=9e64d320-821f-4313-8dd0-3b327ba75634&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 275 time: 0.0405021 Nov 23 19:43:31.723341 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ec7028c3-7f88-4f90-875c-2ac52d49853e req-6399777a-a4e1-4970-bd47-4f91a7d40a94 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102993) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:43:31.724870 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-ec7028c3-7f88-4f90-875c-2ac52d49853e req-6399777a-a4e1-4970-bd47-4f91a7d40a94 service neutron] 10.222.0.41 "GET /v2.0/ports?tenant_id=257b0b2e531441b4bb745e99cfd799f3&device_id=9e64d320-821f-4313-8dd0-3b327ba75634 HTTP/1.1" status: 200 len: 1099 time: 0.0463920 Nov 23 19:43:31.839058 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ec7028c3-7f88-4f90-875c-2ac52d49853e req-9c1578c8-c683-482e-985c-c8118904db57 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102993) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:43:31.841140 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-ec7028c3-7f88-4f90-875c-2ac52d49853e req-9c1578c8-c683-482e-985c-c8118904db57 service neutron] 10.222.0.41 "GET /v2.0/networks?id=226a519f-5f3e-4d80-bb8a-0e9fc4f64828 HTTP/1.1" status: 200 len: 911 time: 0.0955997 Nov 23 19:43:31.849017 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.wsgi [-] (102993) accepted ('10.222.0.62', 51528) {{(pid=102993) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 23 19:43:31.853748 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.api.v2.base [None req-337b34c0-a257-4659-8ae8-77cd0e62fdfb admin admin] Request body: {'network': {'name': 'tempest-EncryptedVolumesExtendAttachedTest-2027490511-network', 'tenant_id': 'ddba7a4e56954bf0a8c78196f930f63a'}} {{(pid=102993) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 23 19:43:31.929118 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-ec7028c3-7f88-4f90-875c-2ac52d49853e req-120ff74c-1f14-4638-a80c-4361cc65f6e0 service neutron] 10.222.0.41 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.13&port_id=3f7db100-6209-44d3-88c7-906fb1cec5cb HTTP/1.1" status: 200 len: 1002 time: 0.0709991 Nov 23 19:43:31.978956 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ec7028c3-7f88-4f90-875c-2ac52d49853e req-cf6e47c8-9d63-4545-931a-681414186c9a service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102993) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:43:31.980361 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-ec7028c3-7f88-4f90-875c-2ac52d49853e req-cf6e47c8-9d63-4545-931a-681414186c9a service neutron] 10.222.0.41 "GET /v2.0/subnets?id=88de785d-c540-4651-af1e-26f27ccaee3c HTTP/1.1" status: 200 len: 849 time: 0.0438991 Nov 23 19:43:32.025809 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-337b34c0-a257-4659-8ae8-77cd0e62fdfb admin admin] Made reservation on behalf of ddba7a4e56954bf0a8c78196f930f63a for: {'network': 1} {{(pid=102993) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 23 19:43:32.029360 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-337b34c0-a257-4659-8ae8-77cd0e62fdfb admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7921281'] for network, before_create {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:43:32.034110 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ec7028c3-7f88-4f90-875c-2ac52d49853e req-064c0ba5-f786-47cb-8311-b9682728b643 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102993) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:43:32.035570 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-ec7028c3-7f88-4f90-875c-2ac52d49853e req-064c0ba5-f786-47cb-8311-b9682728b643 service neutron] 10.222.0.41 "GET /v2.0/ports?network_id=226a519f-5f3e-4d80-bb8a-0e9fc4f64828&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0466776 Nov 23 19:43:32.040953 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-337b34c0-a257-4659-8ae8-77cd0e62fdfb admin admin] Publish callbacks [] for security_group, before_create {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:43:32.170772 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-ec7028c3-7f88-4f90-875c-2ac52d49853e req-4de30a13-b97a-4284-b5ab-48977c0fbe29 service neutron] 10.222.0.41 "GET /v2.0/networks/226a519f-5f3e-4d80-bb8a-0e9fc4f64828?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1247826 Nov 23 19:43:32.220505 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-337b34c0-a257-4659-8ae8-77cd0e62fdfb admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:43:32.283257 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-ec7028c3-7f88-4f90-875c-2ac52d49853e req-3ac8e489-6543-4af0-8995-bbd95c732681 service neutron] 10.222.0.41 "GET /v2.0/networks/226a519f-5f3e-4d80-bb8a-0e9fc4f64828?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1000059 Nov 23 19:43:32.294566 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-337b34c0-a257-4659-8ae8-77cd0e62fdfb admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-623933'] for security_group, after_create {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:43:32.319286 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-337b34c0-a257-4659-8ae8-77cd0e62fdfb admin admin] vlan segment allocate from pool success with {'vlan_id': 801, 'physical_network': 'physnet1'} {{(pid=102993) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 23 19:43:32.328449 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-337b34c0-a257-4659-8ae8-77cd0e62fdfb admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=f301dc6b-6515-4db4-b49f-741980840d76,revision_number=1']} {{(pid=102993) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 23 19:43:32.334358 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-337b34c0-a257-4659-8ae8-77cd0e62fdfb admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7982218'] for segment, precommit_create {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:43:32.334704 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.db.segments_db [None req-337b34c0-a257-4659-8ae8-77cd0e62fdfb admin admin] Added segment eb335a34-7675-40b1-852e-00147b7c1f71 of type vlan for network bccf0525-7b45-41b3-b0ff-a0f59d295229 Nov 23 19:43:32.375440 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-337b34c0-a257-4659-8ae8-77cd0e62fdfb admin admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8783630993713'] for network, precommit_create {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:43:32.471485 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-337b34c0-a257-4659-8ae8-77cd0e62fdfb admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-554949', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560168'] for network, after_create {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:43:32.472439 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-337b34c0-a257-4659-8ae8-77cd0e62fdfb admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102993) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:43:32.473043 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-337b34c0-a257-4659-8ae8-77cd0e62fdfb admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-560186'] for network, before_response {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:43:32.532056 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-337b34c0-a257-4659-8ae8-77cd0e62fdfb admin admin] Pushing event updated for resources: {'Network': ['ID=bccf0525-7b45-41b3-b0ff-a0f59d295229,revision_number=1']} {{(pid=102993) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 23 19:43:32.542731 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.plugins.ml2.rpc [None req-eb87b2c3-3339-4249-8b85-e695b5b4e1f9 None None] Network bccf0525-7b45-41b3-b0ff-a0f59d295229 details requested by agent ovs-agent-dv-cinder-819011-1-iscsi with host dv-cinder-819011-1-iscsi {{(pid=102994) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Nov 23 19:43:32.600346 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [None req-337b34c0-a257-4659-8ae8-77cd0e62fdfb admin admin] 10.222.0.62 "POST /v2.0/networks HTTP/1.1" status: 201 len: 898 time: 0.7502367 Nov 23 19:43:32.603193 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.wsgi [-] (102993) accepted ('10.222.0.62', 51538) {{(pid=102993) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 23 19:43:32.609091 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.api.v2.base [None req-88aa9935-8d76-408c-9c69-c1c90cd1f3ac admin admin] Request body: {'subnet': {'network_id': 'bccf0525-7b45-41b3-b0ff-a0f59d295229', 'cidr': '172.20.0.0/28', 'name': 'tempest-EncryptedVolumesExtendAttachedTest-2027490511-subnet', 'tenant_id': 'ddba7a4e56954bf0a8c78196f930f63a', 'enable_dhcp': False, 'ip_version': 4}} {{(pid=102993) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 23 19:43:32.700013 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-88aa9935-8d76-408c-9c69-c1c90cd1f3ac admin admin] Made reservation on behalf of ddba7a4e56954bf0a8c78196f930f63a for: {'subnet': 1} {{(pid=102993) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 23 19:43:32.702377 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-88aa9935-8d76-408c-9c69-c1c90cd1f3ac admin admin] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-17772934'] for subnet, before_create {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:43:32.940160 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-88aa9935-8d76-408c-9c69-c1c90cd1f3ac admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-554858', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560168', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-17257652', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-17772948'] for subnet, after_create {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:43:32.999317 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-88aa9935-8d76-408c-9c69-c1c90cd1f3ac admin admin] Pushing event updated for resources: {'Subnet': ['ID=ff198c0e-5a60-475e-bd1d-88271860f07f,revision_number=0']} {{(pid=102993) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 23 19:43:33.007910 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-88aa9935-8d76-408c-9c69-c1c90cd1f3ac admin admin] Checking segment: {'id': 'eb335a34-7675-40b1-852e-00147b7c1f71', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 801, 'network_id': 'bccf0525-7b45-41b3-b0ff-a0f59d295229'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102993) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 23 19:43:33.008269 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-88aa9935-8d76-408c-9c69-c1c90cd1f3ac admin admin] Network hostable DHCP agents. Network: bccf0525-7b45-41b3-b0ff-a0f59d295229, hostable agents: ['e51c95c7-6a36-4263-ba47-1839054f3e7a'], hosted agents: [] {{(pid=102993) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 23 19:43:33.082723 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-88aa9935-8d76-408c-9c69-c1c90cd1f3ac admin admin] Network bccf0525-7b45-41b3-b0ff-a0f59d295229 is scheduled to be hosted by DHCP agent e51c95c7-6a36-4263-ba47-1839054f3e7a with binding_index 1 {{(pid=102993) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 23 19:43:33.162856 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.scheduler.base_scheduler [None req-88aa9935-8d76-408c-9c69-c1c90cd1f3ac admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-819011-1-iscsi, bccf0525-7b45-41b3-b0ff-a0f59d295229) {{(pid=102993) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 23 19:43:33.166889 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-88aa9935-8d76-408c-9c69-c1c90cd1f3ac admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=102993) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:43:33.167497 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-88aa9935-8d76-408c-9c69-c1c90cd1f3ac admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-560186'] for subnet, before_response {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:43:33.172412 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-f6144f49-449f-4e4c-b7ec-beb675fee8f7 None None] Network bccf0525-7b45-41b3-b0ff-a0f59d295229 requested from dv-cinder-819011-1-iscsi {{(pid=102994) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 23 19:43:33.246057 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [None req-88aa9935-8d76-408c-9c69-c1c90cd1f3ac admin admin] 10.222.0.62 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 862 time: 0.6416342 Nov 23 19:43:33.295733 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-ddbd6c52-749a-4bb0-879c-bd69023f8a36 None None] Network bccf0525-7b45-41b3-b0ff-a0f59d295229 requested from dv-cinder-819011-1-iscsi {{(pid=102994) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 23 19:43:33.358344 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.wsgi [-] (102993) accepted ('10.222.0.62', 51544) {{(pid=102993) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 23 19:43:33.403242 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.db.db_base_plugin_v2 [None req-4ada3b72-bc80-4c7c-aa39-9c67b979653c admin admin] Deleting subnet 181357d0-16c2-4e77-b99b-d68a3be3bc99 {{(pid=102993) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Nov 23 19:43:33.406479 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-4ada3b72-bc80-4c7c-aa39-9c67b979653c admin admin] Publish callbacks [] for subnet, before_delete {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:43:33.440841 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-4ada3b72-bc80-4c7c-aa39-9c67b979653c admin admin] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-16914634'] for subnet, precommit_delete_associations {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:43:33.483594 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-4ada3b72-bc80-4c7c-aa39-9c67b979653c admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-7975863'] for subnet, precommit_delete {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:43:33.585962 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-4ada3b72-bc80-4c7c-aa39-9c67b979653c admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-7982148', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-554858', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560168', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-17257579', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-17772973'] for subnet, after_delete {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:43:33.613773 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4ada3b72-bc80-4c7c-aa39-9c67b979653c admin admin] Pushing event deleted for resources: {'Subnet': ['ID=181357d0-16c2-4e77-b99b-d68a3be3bc99,revision_number=None']} {{(pid=102993) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 23 19:43:33.624061 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-4ada3b72-bc80-4c7c-aa39-9c67b979653c admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-560186'] for subnet, before_response {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:43:33.628343 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [None req-4ada3b72-bc80-4c7c-aa39-9c67b979653c admin admin] 10.222.0.62 "DELETE /v2.0/subnets/181357d0-16c2-4e77-b99b-d68a3be3bc99 HTTP/1.1" status: 204 len: 168 time: 0.2687376 Nov 23 19:43:33.629993 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.wsgi [-] (102993) accepted ('10.222.0.62', 51550) {{(pid=102993) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 23 19:43:33.697905 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-92c0be66-79b8-4e5f-96a1-dc1319650a19 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-8133038'] for network, before_delete {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:43:33.779479 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-92c0be66-79b8-4e5f-96a1-dc1319650a19 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-7977576', 'neutron.services.segments.db._delete_segments_for_network-8783631323320'] for network, precommit_delete {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:43:33.799192 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.services.segments.db [None req-92c0be66-79b8-4e5f-96a1-dc1319650a19 admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['620a2f82-a6b4-4e0c-80ae-5dce2f20e8b2']}} {{(pid=102993) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 23 19:43:33.808385 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.services.segments.db [None req-92c0be66-79b8-4e5f-96a1-dc1319650a19 admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, 'b0f3f9d8-31c7-4cd9-88eb-c137fafe2781') {'for_net_delete': True} {{(pid=102993) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 23 19:43:33.808720 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.services.segments.db [None req-92c0be66-79b8-4e5f-96a1-dc1319650a19 admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, 'b0f3f9d8-31c7-4cd9-88eb-c137fafe2781') {} {{(pid=102993) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 23 19:43:33.818208 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-92c0be66-79b8-4e5f-96a1-dc1319650a19 admin admin] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8783631432524', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-16914685'] for segment, before_delete {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:43:33.832581 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-92c0be66-79b8-4e5f-96a1-dc1319650a19 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7982218'] for segment, precommit_delete {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:43:33.837374 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-92c0be66-79b8-4e5f-96a1-dc1319650a19 admin admin] Releasing vlan 840 on physical network physnet1 to pool {{(pid=102993) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Nov 23 19:43:33.837783 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-92c0be66-79b8-4e5f-96a1-dc1319650a19 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7982218', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-17258441'] for segment, after_delete {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:43:33.839383 dv-cinder-819011-1-iscsi neutron-server[102993]: Traceback (most recent call last): Nov 23 19:43:33.839383 dv-cinder-819011-1-iscsi neutron-server[102993]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Nov 23 19:43:33.839383 dv-cinder-819011-1-iscsi neutron-server[102993]: timer() Nov 23 19:43:33.839383 dv-cinder-819011-1-iscsi neutron-server[102993]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 23 19:43:33.839383 dv-cinder-819011-1-iscsi neutron-server[102993]: cb(*args, **kw) Nov 23 19:43:33.839383 dv-cinder-819011-1-iscsi neutron-server[102993]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Nov 23 19:43:33.839383 dv-cinder-819011-1-iscsi neutron-server[102993]: return func(*args, **kwargs) Nov 23 19:43:33.839383 dv-cinder-819011-1-iscsi neutron-server[102993]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 23 19:43:33.839383 dv-cinder-819011-1-iscsi neutron-server[102993]: self._notify() Nov 23 19:43:33.839383 dv-cinder-819011-1-iscsi neutron-server[102993]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 23 19:43:33.839383 dv-cinder-819011-1-iscsi neutron-server[102993]: self.callback(batched_events) Nov 23 19:43:33.839383 dv-cinder-819011-1-iscsi neutron-server[102993]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 23 19:43:33.839383 dv-cinder-819011-1-iscsi neutron-server[102993]: event.method(event) Nov 23 19:43:33.839383 dv-cinder-819011-1-iscsi neutron-server[102993]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Nov 23 19:43:33.839383 dv-cinder-819011-1-iscsi neutron-server[102993]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 23 19:43:33.839383 dv-cinder-819011-1-iscsi neutron-server[102993]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Nov 23 19:43:33.839383 dv-cinder-819011-1-iscsi neutron-server[102993]: aggregate_uuid = self.p_client.list_aggregates( Nov 23 19:43:33.839383 dv-cinder-819011-1-iscsi neutron-server[102993]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Nov 23 19:43:33.839383 dv-cinder-819011-1-iscsi neutron-server[102993]: return f(self, *a, **k) Nov 23 19:43:33.839383 dv-cinder-819011-1-iscsi neutron-server[102993]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 23 19:43:33.839383 dv-cinder-819011-1-iscsi neutron-server[102993]: return self._get(url).json() Nov 23 19:43:33.839383 dv-cinder-819011-1-iscsi neutron-server[102993]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 23 19:43:33.839383 dv-cinder-819011-1-iscsi neutron-server[102993]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 23 19:43:33.839383 dv-cinder-819011-1-iscsi neutron-server[102993]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Nov 23 19:43:33.839383 dv-cinder-819011-1-iscsi neutron-server[102993]: return self.request(url, 'GET', **kwargs) Nov 23 19:43:33.839383 dv-cinder-819011-1-iscsi neutron-server[102993]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Nov 23 19:43:33.839383 dv-cinder-819011-1-iscsi neutron-server[102993]: base_url = self.get_endpoint(auth, allow=allow, Nov 23 19:43:33.839383 dv-cinder-819011-1-iscsi neutron-server[102993]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Nov 23 19:43:33.839383 dv-cinder-819011-1-iscsi neutron-server[102993]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 23 19:43:33.839383 dv-cinder-819011-1-iscsi neutron-server[102993]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Nov 23 19:43:33.839383 dv-cinder-819011-1-iscsi neutron-server[102993]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 23 19:43:33.839383 dv-cinder-819011-1-iscsi neutron-server[102993]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 23 19:43:33.934524 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-92c0be66-79b8-4e5f-96a1-dc1319650a19 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-7977567', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-554949', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560168', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-926557'] for network, after_delete {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:43:33.940582 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-92c0be66-79b8-4e5f-96a1-dc1319650a19 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-560186'] for network, before_response {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:43:33.944245 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [None req-92c0be66-79b8-4e5f-96a1-dc1319650a19 admin admin] 10.222.0.62 "DELETE /v2.0/networks/620a2f82-a6b4-4e0c-80ae-5dce2f20e8b2 HTTP/1.1" status: 204 len: 168 time: 0.3131812 Nov 23 19:43:33.947129 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.wsgi [-] (102992) accepted ('10.222.0.62', 51560) {{(pid=102992) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 23 19:43:33.955604 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-92c0be66-79b8-4e5f-96a1-dc1319650a19 admin admin] Pushing event deleted for resources: {'Network': ['ID=620a2f82-a6b4-4e0c-80ae-5dce2f20e8b2,revision_number=None']} {{(pid=102993) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 23 19:43:33.999835 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.db.db_base_plugin_v2 [None req-805d9730-816e-4baf-a5b8-7d1a16db6d09 admin admin] Deleting subnet ff198c0e-5a60-475e-bd1d-88271860f07f {{(pid=102992) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Nov 23 19:43:34.003147 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [None req-805d9730-816e-4baf-a5b8-7d1a16db6d09 admin admin] Publish callbacks [] for subnet, before_delete {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:43:34.038787 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [None req-805d9730-816e-4baf-a5b8-7d1a16db6d09 admin admin] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-25272549'] for subnet, precommit_delete_associations {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:43:34.077621 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [None req-805d9730-816e-4baf-a5b8-7d1a16db6d09 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-7975863'] for subnet, precommit_delete {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:43:34.186281 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [None req-805d9730-816e-4baf-a5b8-7d1a16db6d09 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-7982148', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-554858', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560168', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-25199822', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-25999729'] for subnet, after_delete {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:43:34.213397 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-805d9730-816e-4baf-a5b8-7d1a16db6d09 admin admin] Pushing event deleted for resources: {'Subnet': ['ID=ff198c0e-5a60-475e-bd1d-88271860f07f,revision_number=None']} {{(pid=102992) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 23 19:43:34.215389 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [None req-805d9730-816e-4baf-a5b8-7d1a16db6d09 admin admin] Publish callbacks [] for subnet, before_response {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:43:34.218863 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [None req-805d9730-816e-4baf-a5b8-7d1a16db6d09 admin admin] 10.222.0.62 "DELETE /v2.0/subnets/ff198c0e-5a60-475e-bd1d-88271860f07f HTTP/1.1" status: 204 len: 168 time: 0.2700300 Nov 23 19:43:34.221164 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.wsgi [-] (102992) accepted ('10.222.0.62', 51570) {{(pid=102992) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 23 19:43:34.294102 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [None req-96c4f150-3180-4934-ba3f-d066220083bf admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-8133038'] for network, before_delete {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:43:34.371708 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [None req-96c4f150-3180-4934-ba3f-d066220083bf admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-7977576', 'neutron.services.segments.db._delete_segments_for_network-8783631323320'] for network, precommit_delete {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:43:34.395744 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.services.segments.db [None req-96c4f150-3180-4934-ba3f-d066220083bf admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['bccf0525-7b45-41b3-b0ff-a0f59d295229']}} {{(pid=102992) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 23 19:43:34.405490 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.services.segments.db [None req-96c4f150-3180-4934-ba3f-d066220083bf admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, 'eb335a34-7675-40b1-852e-00147b7c1f71') {'for_net_delete': True} {{(pid=102992) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 23 19:43:34.405790 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.services.segments.db [None req-96c4f150-3180-4934-ba3f-d066220083bf admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, 'eb335a34-7675-40b1-852e-00147b7c1f71') {} {{(pid=102992) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 23 19:43:34.414870 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [None req-96c4f150-3180-4934-ba3f-d066220083bf admin admin] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8783631432524', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-25272530'] for segment, before_delete {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:43:34.427819 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [None req-96c4f150-3180-4934-ba3f-d066220083bf admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7982218'] for segment, precommit_delete {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:43:34.433789 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-96c4f150-3180-4934-ba3f-d066220083bf admin admin] Releasing vlan 801 on physical network physnet1 to pool {{(pid=102992) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Nov 23 19:43:34.434198 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [None req-96c4f150-3180-4934-ba3f-d066220083bf admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7982218', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-25200492'] for segment, after_delete {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:43:34.436260 dv-cinder-819011-1-iscsi neutron-server[102992]: Traceback (most recent call last): Nov 23 19:43:34.436260 dv-cinder-819011-1-iscsi neutron-server[102992]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Nov 23 19:43:34.436260 dv-cinder-819011-1-iscsi neutron-server[102992]: timer() Nov 23 19:43:34.436260 dv-cinder-819011-1-iscsi neutron-server[102992]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 23 19:43:34.436260 dv-cinder-819011-1-iscsi neutron-server[102992]: cb(*args, **kw) Nov 23 19:43:34.436260 dv-cinder-819011-1-iscsi neutron-server[102992]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Nov 23 19:43:34.436260 dv-cinder-819011-1-iscsi neutron-server[102992]: return func(*args, **kwargs) Nov 23 19:43:34.436260 dv-cinder-819011-1-iscsi neutron-server[102992]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 23 19:43:34.436260 dv-cinder-819011-1-iscsi neutron-server[102992]: self._notify() Nov 23 19:43:34.436260 dv-cinder-819011-1-iscsi neutron-server[102992]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 23 19:43:34.436260 dv-cinder-819011-1-iscsi neutron-server[102992]: self.callback(batched_events) Nov 23 19:43:34.436260 dv-cinder-819011-1-iscsi neutron-server[102992]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 23 19:43:34.436260 dv-cinder-819011-1-iscsi neutron-server[102992]: event.method(event) Nov 23 19:43:34.436260 dv-cinder-819011-1-iscsi neutron-server[102992]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Nov 23 19:43:34.436260 dv-cinder-819011-1-iscsi neutron-server[102992]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 23 19:43:34.436260 dv-cinder-819011-1-iscsi neutron-server[102992]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Nov 23 19:43:34.436260 dv-cinder-819011-1-iscsi neutron-server[102992]: aggregate_uuid = self.p_client.list_aggregates( Nov 23 19:43:34.436260 dv-cinder-819011-1-iscsi neutron-server[102992]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Nov 23 19:43:34.436260 dv-cinder-819011-1-iscsi neutron-server[102992]: return f(self, *a, **k) Nov 23 19:43:34.436260 dv-cinder-819011-1-iscsi neutron-server[102992]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 23 19:43:34.436260 dv-cinder-819011-1-iscsi neutron-server[102992]: return self._get(url).json() Nov 23 19:43:34.436260 dv-cinder-819011-1-iscsi neutron-server[102992]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 23 19:43:34.436260 dv-cinder-819011-1-iscsi neutron-server[102992]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 23 19:43:34.436260 dv-cinder-819011-1-iscsi neutron-server[102992]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Nov 23 19:43:34.436260 dv-cinder-819011-1-iscsi neutron-server[102992]: return self.request(url, 'GET', **kwargs) Nov 23 19:43:34.436260 dv-cinder-819011-1-iscsi neutron-server[102992]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Nov 23 19:43:34.436260 dv-cinder-819011-1-iscsi neutron-server[102992]: base_url = self.get_endpoint(auth, allow=allow, Nov 23 19:43:34.436260 dv-cinder-819011-1-iscsi neutron-server[102992]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Nov 23 19:43:34.436260 dv-cinder-819011-1-iscsi neutron-server[102992]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 23 19:43:34.436260 dv-cinder-819011-1-iscsi neutron-server[102992]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Nov 23 19:43:34.436260 dv-cinder-819011-1-iscsi neutron-server[102992]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 23 19:43:34.436260 dv-cinder-819011-1-iscsi neutron-server[102992]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 23 19:43:34.568879 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [None req-96c4f150-3180-4934-ba3f-d066220083bf admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-7977567', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-554949', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560168', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-926557'] for network, after_delete {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:43:34.574738 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [None req-96c4f150-3180-4934-ba3f-d066220083bf admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-560186'] for network, before_response {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:43:34.578057 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [None req-96c4f150-3180-4934-ba3f-d066220083bf admin admin] 10.222.0.62 "DELETE /v2.0/networks/bccf0525-7b45-41b3-b0ff-a0f59d295229 HTTP/1.1" status: 204 len: 168 time: 0.3559430 Nov 23 19:43:34.588819 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-96c4f150-3180-4934-ba3f-d066220083bf admin admin] Pushing event deleted for resources: {'Network': ['ID=bccf0525-7b45-41b3-b0ff-a0f59d295229,revision_number=None']} {{(pid=102992) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 23 19:43:34.957568 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.wsgi [-] (102992) accepted ('10.222.0.62', 51584) {{(pid=102992) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 23 19:43:34.998206 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [None req-fbeebce3-7296-4676-a7e5-cdc217f67b1d admin admin] 10.222.0.62 "GET /v2.0/security-groups?tenant_id=33aae306238f4dc18446de6c98952b34&name=default HTTP/1.1" status: 200 len: 2996 time: 0.0391164 Nov 23 19:43:34.998416 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.wsgi [-] (102992) accepted ('10.222.0.62', 51586) {{(pid=102992) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 23 19:43:35.003031 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.wsgi [-] (102993) accepted ('10.222.0.62', 51588) {{(pid=102993) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 23 19:43:35.050127 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [None req-5a33e649-8211-4096-abd4-7ccc5c9c38b0 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:43:35.072080 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [None req-5a33e649-8211-4096-abd4-7ccc5c9c38b0 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:43:35.157133 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [None req-5a33e649-8211-4096-abd4-7ccc5c9c38b0 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-623933'] for security_group, after_delete {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:43:35.159942 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [None req-5a33e649-8211-4096-abd4-7ccc5c9c38b0 admin admin] Publish callbacks [] for security_group, before_response {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:43:35.161079 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [None req-5a33e649-8211-4096-abd4-7ccc5c9c38b0 admin admin] 10.222.0.62 "DELETE /v2.0/security-groups/59c0e63d-07cd-4e01-984f-295d3aec7347 HTTP/1.1" status: 204 len: 168 time: 0.1618114 Nov 23 19:43:35.161468 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-80434bdf-588d-48df-bf10-b6e4214b1ce9 admin admin] Publish callbacks [] for security_group, before_create {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:43:35.169154 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5a33e649-8211-4096-abd4-7ccc5c9c38b0 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=59c0e63d-07cd-4e01-984f-295d3aec7347,revision_number=None']} {{(pid=102992) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 23 19:43:35.238752 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-80434bdf-588d-48df-bf10-b6e4214b1ce9 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:43:35.300215 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-80434bdf-588d-48df-bf10-b6e4214b1ce9 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-623933'] for security_group, after_create {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:43:35.342399 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [None req-80434bdf-588d-48df-bf10-b6e4214b1ce9 admin admin] 10.222.0.62 "GET /v2.0/security-groups?tenant_id=0c12ac8a9fb54048904eed8cf7c5ad65&name=default HTTP/1.1" status: 200 len: 2996 time: 0.3382764 Nov 23 19:43:35.343275 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-80434bdf-588d-48df-bf10-b6e4214b1ce9 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=29c19a5e-7ff3-4987-b3e7-7e74a494336a,revision_number=1']} {{(pid=102993) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 23 19:43:35.345247 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.wsgi [-] (102992) accepted ('10.222.0.62', 51594) {{(pid=102992) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 23 19:43:35.396442 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [None req-55304ff4-57fd-4ac9-9333-672a9f0e1719 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:43:35.418924 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [None req-55304ff4-57fd-4ac9-9333-672a9f0e1719 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:43:35.522902 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [None req-55304ff4-57fd-4ac9-9333-672a9f0e1719 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-623933'] for security_group, after_delete {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:43:35.525644 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [None req-55304ff4-57fd-4ac9-9333-672a9f0e1719 admin admin] Publish callbacks [] for security_group, before_response {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:43:35.526823 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [None req-55304ff4-57fd-4ac9-9333-672a9f0e1719 admin admin] 10.222.0.62 "DELETE /v2.0/security-groups/29c19a5e-7ff3-4987-b3e7-7e74a494336a HTTP/1.1" status: 204 len: 168 time: 0.1805320 Nov 23 19:43:35.535745 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-55304ff4-57fd-4ac9-9333-672a9f0e1719 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=29c19a5e-7ff3-4987-b3e7-7e74a494336a,revision_number=None']} {{(pid=102992) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 23 19:43:35.732864 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.wsgi [-] (102992) accepted ('10.222.0.62', 51600) {{(pid=102992) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 23 19:43:35.772250 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [None req-5b7d073c-7320-4336-a898-702f911d548f admin admin] 10.222.0.62 "GET /v2.0/security-groups?tenant_id=ddba7a4e56954bf0a8c78196f930f63a&name=default HTTP/1.1" status: 200 len: 2996 time: 0.0381498 Nov 23 19:43:35.774783 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.wsgi [-] (102992) accepted ('10.222.0.62', 51602) {{(pid=102992) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 23 19:43:35.828079 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [None req-ffeabda5-cf63-48ba-bbd6-1c197539a2cc admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:43:35.849934 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [None req-ffeabda5-cf63-48ba-bbd6-1c197539a2cc admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:43:35.939843 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [None req-ffeabda5-cf63-48ba-bbd6-1c197539a2cc admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-623933'] for security_group, after_delete {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:43:35.942560 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [None req-ffeabda5-cf63-48ba-bbd6-1c197539a2cc admin admin] Publish callbacks [] for security_group, before_response {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:43:35.943770 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [None req-ffeabda5-cf63-48ba-bbd6-1c197539a2cc admin admin] 10.222.0.62 "DELETE /v2.0/security-groups/f301dc6b-6515-4db4-b49f-741980840d76 HTTP/1.1" status: 204 len: 168 time: 0.1680968 Nov 23 19:43:35.952135 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ffeabda5-cf63-48ba-bbd6-1c197539a2cc admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=f301dc6b-6515-4db4-b49f-741980840d76,revision_number=None']} {{(pid=102992) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 23 19:43:36.154984 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.wsgi [-] (102992) accepted ('10.222.0.62', 51608) {{(pid=102992) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 23 19:43:36.168529 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [None req-eab4869f-1db6-4bd0-a245-59851df93bba admin admin] Publish callbacks [] for security_group, before_create {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:43:36.242954 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [None req-eab4869f-1db6-4bd0-a245-59851df93bba admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:43:36.294991 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [None req-eab4869f-1db6-4bd0-a245-59851df93bba admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-623933'] for security_group, after_create {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:43:36.334117 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [None req-eab4869f-1db6-4bd0-a245-59851df93bba admin admin] 10.222.0.62 "GET /v2.0/security-groups?tenant_id=6c2482b3bc7e402e865a1358323f96a8&name=default HTTP/1.1" status: 200 len: 2996 time: 0.1780396 Nov 23 19:43:36.335634 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-eab4869f-1db6-4bd0-a245-59851df93bba admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=cce1f458-84ca-4a7d-b511-147dbebf6485,revision_number=1']} {{(pid=102992) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 23 19:43:36.337482 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.wsgi [-] (102992) accepted ('10.222.0.62', 51614) {{(pid=102992) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 23 19:43:36.387552 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [None req-226cfd84-cb39-4176-a698-752b257cb981 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:43:36.409063 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [None req-226cfd84-cb39-4176-a698-752b257cb981 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:43:36.512300 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [None req-226cfd84-cb39-4176-a698-752b257cb981 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-623933'] for security_group, after_delete {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:43:36.515292 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [None req-226cfd84-cb39-4176-a698-752b257cb981 admin admin] Publish callbacks [] for security_group, before_response {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:43:36.517155 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [None req-226cfd84-cb39-4176-a698-752b257cb981 admin admin] 10.222.0.62 "DELETE /v2.0/security-groups/cce1f458-84ca-4a7d-b511-147dbebf6485 HTTP/1.1" status: 204 len: 168 time: 0.1780679 Nov 23 19:43:36.524364 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-226cfd84-cb39-4176-a698-752b257cb981 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=cce1f458-84ca-4a7d-b511-147dbebf6485,revision_number=None']} {{(pid=102992) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 23 19:43:38.081370 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.wsgi [-] (102993) accepted ('10.222.0.62', 51676) {{(pid=102993) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 23 19:43:38.186658 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-32479fa5-7fef-4e34-8333-aad7e471540e admin admin] Publish callbacks [] for security_group, before_create {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:43:38.261477 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-32479fa5-7fef-4e34-8333-aad7e471540e admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:43:38.334039 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-32479fa5-7fef-4e34-8333-aad7e471540e admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-623933'] for security_group, after_create {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:43:38.377858 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [None req-32479fa5-7fef-4e34-8333-aad7e471540e admin admin] 10.222.0.62 "GET /v2.0/security-groups?tenant_id=cea3f921f7a94706b50c69508b401262&name=default HTTP/1.1" status: 200 len: 2996 time: 0.2953453 Nov 23 19:43:38.379136 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-32479fa5-7fef-4e34-8333-aad7e471540e admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=3b2b1be0-44fb-48e6-8580-69fd06d1133b,revision_number=1']} {{(pid=102993) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 23 19:43:38.380834 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.wsgi [-] (102992) accepted ('10.222.0.62', 51690) {{(pid=102992) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 23 19:43:38.430656 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [None req-72e33394-776f-4394-9cc1-f43ff27e720a admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:43:38.453388 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [None req-72e33394-776f-4394-9cc1-f43ff27e720a admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:43:38.557026 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [None req-72e33394-776f-4394-9cc1-f43ff27e720a admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-623933'] for security_group, after_delete {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:43:38.560590 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [None req-72e33394-776f-4394-9cc1-f43ff27e720a admin admin] Publish callbacks [] for security_group, before_response {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:43:38.561780 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [None req-72e33394-776f-4394-9cc1-f43ff27e720a admin admin] 10.222.0.62 "DELETE /v2.0/security-groups/3b2b1be0-44fb-48e6-8580-69fd06d1133b HTTP/1.1" status: 204 len: 168 time: 0.1798689 Nov 23 19:43:38.570052 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-72e33394-776f-4394-9cc1-f43ff27e720a admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=3b2b1be0-44fb-48e6-8580-69fd06d1133b,revision_number=None']} {{(pid=102992) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 23 19:43:38.577889 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-72e33394-776f-4394-9cc1-f43ff27e720a admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-819011-1-iscsi {{(pid=102992) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 23 19:43:38.578161 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-72e33394-776f-4394-9cc1-f43ff27e720a admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-819011-1-iscsi {{(pid=102992) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 23 19:43:38.578491 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-72e33394-776f-4394-9cc1-f43ff27e720a admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-819011-1-iscsi {{(pid=102992) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 23 19:43:38.578832 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-72e33394-776f-4394-9cc1-f43ff27e720a admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-819011-1-iscsi {{(pid=102992) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 23 19:43:38.579176 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-72e33394-776f-4394-9cc1-f43ff27e720a admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-819011-1-iscsi {{(pid=102992) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 23 19:43:38.579509 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-72e33394-776f-4394-9cc1-f43ff27e720a admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-819011-1-iscsi {{(pid=102992) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 23 19:43:38.580022 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-72e33394-776f-4394-9cc1-f43ff27e720a admin admin] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-819011-1-iscsi {{(pid=102992) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 23 19:43:38.580361 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-72e33394-776f-4394-9cc1-f43ff27e720a admin admin] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-819011-1-iscsi {{(pid=102992) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 23 19:43:38.580702 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-72e33394-776f-4394-9cc1-f43ff27e720a admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-819011-1-iscsi {{(pid=102992) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 23 19:43:38.581184 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-72e33394-776f-4394-9cc1-f43ff27e720a admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-819011-1-iscsi {{(pid=102992) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 23 19:43:38.581554 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-72e33394-776f-4394-9cc1-f43ff27e720a admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-819011-1-iscsi {{(pid=102992) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 23 19:43:38.582012 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-72e33394-776f-4394-9cc1-f43ff27e720a admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-819011-1-iscsi {{(pid=102992) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 23 19:43:39.187027 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.wsgi [-] (102992) accepted ('10.222.0.62', 51708) {{(pid=102992) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 23 19:43:39.200275 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [None req-cb8caa59-33c5-4541-a7c7-314195daa6af admin admin] Publish callbacks [] for security_group, before_create {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:43:39.274857 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [None req-cb8caa59-33c5-4541-a7c7-314195daa6af admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:43:39.322945 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [None req-cb8caa59-33c5-4541-a7c7-314195daa6af admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-623933'] for security_group, after_create {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:43:39.361458 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cb8caa59-33c5-4541-a7c7-314195daa6af admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=1b73834c-9040-4634-b197-4dead0db365d,revision_number=1']} {{(pid=102992) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 23 19:43:39.367959 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [None req-cb8caa59-33c5-4541-a7c7-314195daa6af admin admin] 10.222.0.62 "GET /v2.0/security-groups?tenant_id=c8966d34938c48cd9d31f162c7ec5880&name=default HTTP/1.1" status: 200 len: 2996 time: 0.1776264 Nov 23 19:43:39.368809 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.wsgi [-] (102992) accepted ('10.222.0.62', 51712) {{(pid=102992) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 23 19:43:39.421519 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [None req-7e6dc8fb-6f79-4787-a265-ab2d01aa1639 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:43:39.442608 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [None req-7e6dc8fb-6f79-4787-a265-ab2d01aa1639 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:43:39.556738 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [None req-7e6dc8fb-6f79-4787-a265-ab2d01aa1639 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-623933'] for security_group, after_delete {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:43:39.559449 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [None req-7e6dc8fb-6f79-4787-a265-ab2d01aa1639 admin admin] Publish callbacks [] for security_group, before_response {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:43:39.560960 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [None req-7e6dc8fb-6f79-4787-a265-ab2d01aa1639 admin admin] 10.222.0.62 "DELETE /v2.0/security-groups/1b73834c-9040-4634-b197-4dead0db365d HTTP/1.1" status: 204 len: 168 time: 0.1916640 Nov 23 19:43:39.569060 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7e6dc8fb-6f79-4787-a265-ab2d01aa1639 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=1b73834c-9040-4634-b197-4dead0db365d,revision_number=None']} {{(pid=102992) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 23 19:43:41.717637 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron_lib.callbacks.manager [None req-32489cb4-670e-49e5-95fd-9b193e2f068a None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8783631323329', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7978582'] for agent, after_update {{(pid=102994) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:43:42.011212 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.wsgi [-] (102992) accepted ('10.222.0.62', 51776) {{(pid=102992) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 23 19:43:42.115224 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [None req-02342bfa-6992-4b6e-89a2-5535e5b91ee7 admin admin] Publish callbacks [] for security_group, before_create {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:43:42.193156 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [None req-02342bfa-6992-4b6e-89a2-5535e5b91ee7 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:43:42.259683 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [None req-02342bfa-6992-4b6e-89a2-5535e5b91ee7 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-623933'] for security_group, after_create {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:43:42.299294 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [None req-02342bfa-6992-4b6e-89a2-5535e5b91ee7 admin admin] 10.222.0.62 "GET /v2.0/security-groups?tenant_id=76370d14db874b45996645da629aa7b3&name=default HTTP/1.1" status: 200 len: 2996 time: 0.2869902 Nov 23 19:43:42.301268 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-02342bfa-6992-4b6e-89a2-5535e5b91ee7 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=03714019-8ec0-4b71-b3cb-68d21b1a0184,revision_number=1']} {{(pid=102992) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 23 19:43:42.306799 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.wsgi [-] (102992) accepted ('10.222.0.62', 51784) {{(pid=102992) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 23 19:43:42.353737 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [None req-271403ed-ebe5-46e1-866d-eb94ffc9de03 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:43:42.377600 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [None req-271403ed-ebe5-46e1-866d-eb94ffc9de03 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:43:42.476930 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [None req-271403ed-ebe5-46e1-866d-eb94ffc9de03 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-623933'] for security_group, after_delete {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:43:42.479614 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [None req-271403ed-ebe5-46e1-866d-eb94ffc9de03 admin admin] Publish callbacks [] for security_group, before_response {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:43:42.480757 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [None req-271403ed-ebe5-46e1-866d-eb94ffc9de03 admin admin] 10.222.0.62 "DELETE /v2.0/security-groups/03714019-8ec0-4b71-b3cb-68d21b1a0184 HTTP/1.1" status: 204 len: 168 time: 0.1730371 Nov 23 19:43:42.489303 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-271403ed-ebe5-46e1-866d-eb94ffc9de03 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=03714019-8ec0-4b71-b3cb-68d21b1a0184,revision_number=None']} {{(pid=102992) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 23 19:43:43.003545 dv-cinder-819011-1-iscsi neutron-server[102995]: DEBUG neutron.db.agents_db [None req-84bdc9b2-57ea-4bdb-a245-07c78d37cea8 None None] Agent healthcheck: found 6 active agents {{(pid=102995) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 23 19:43:43.047589 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.wsgi [-] (102992) accepted ('10.222.0.62', 51790) {{(pid=102992) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 23 19:43:43.061659 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [None req-5a8d974a-374d-40b6-82f3-1fa4a03ace19 admin admin] Publish callbacks [] for security_group, before_create {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:43:43.134278 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [None req-5a8d974a-374d-40b6-82f3-1fa4a03ace19 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:43:43.185570 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [None req-5a8d974a-374d-40b6-82f3-1fa4a03ace19 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-623933'] for security_group, after_create {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:43:43.223871 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [None req-5a8d974a-374d-40b6-82f3-1fa4a03ace19 admin admin] 10.222.0.62 "GET /v2.0/security-groups?tenant_id=431af47064ec45749cc02f72b5433e0b&name=default HTTP/1.1" status: 200 len: 2996 time: 0.1751995 Nov 23 19:43:43.224746 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5a8d974a-374d-40b6-82f3-1fa4a03ace19 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=b636e567-c0a0-481a-be1d-8041ecd48cc0,revision_number=1']} {{(pid=102992) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 23 19:43:43.226753 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.wsgi [-] (102993) accepted ('10.222.0.62', 51794) {{(pid=102993) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 23 19:43:43.291647 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-e6458225-9acc-4a44-a8fb-cec0859d8884 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:43:43.315055 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-e6458225-9acc-4a44-a8fb-cec0859d8884 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:43:43.465221 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-e6458225-9acc-4a44-a8fb-cec0859d8884 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-623933'] for security_group, after_delete {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:43:43.467911 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-e6458225-9acc-4a44-a8fb-cec0859d8884 admin admin] Publish callbacks [] for security_group, before_response {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:43:43.469124 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [None req-e6458225-9acc-4a44-a8fb-cec0859d8884 admin admin] 10.222.0.62 "DELETE /v2.0/security-groups/b636e567-c0a0-481a-be1d-8041ecd48cc0 HTTP/1.1" status: 204 len: 168 time: 0.2412426 Nov 23 19:43:43.477442 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e6458225-9acc-4a44-a8fb-cec0859d8884 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=b636e567-c0a0-481a-be1d-8041ecd48cc0,revision_number=None']} {{(pid=102993) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 23 19:43:44.197146 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron_lib.callbacks.manager [None req-d75d3ade-80af-4cbc-ad89-bd6c7f376e9c None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8783631323329', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7978582'] for agent, after_update {{(pid=102994) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:43:45.099632 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron_lib.callbacks.manager [None req-8346ef05-f685-4c3d-af3d-a159b683bec2 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8783631323329', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7978582'] for agent, after_update {{(pid=102994) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:43:46.596483 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron_lib.callbacks.manager [None req-785c1d26-11ba-42d8-b5a6-51a8b3daeef0 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8783631323329', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7978582'] for agent, after_update {{(pid=102994) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:43:46.780111 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.wsgi [-] (102993) accepted ('10.222.0.62', 51910) {{(pid=102993) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 23 19:43:46.881707 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-74bce0b8-b5ac-4412-98b2-365fb030ad3a admin admin] Publish callbacks [] for security_group, before_create {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:43:46.954444 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-74bce0b8-b5ac-4412-98b2-365fb030ad3a admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:43:46.985068 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-74bce0b8-b5ac-4412-98b2-365fb030ad3a admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-623933'] for security_group, after_create {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:43:47.025751 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [None req-74bce0b8-b5ac-4412-98b2-365fb030ad3a admin admin] 10.222.0.62 "GET /v2.0/security-groups?tenant_id=0999014e99df4274b09d0714ca35bb91&name=default HTTP/1.1" status: 200 len: 2996 time: 0.2445095 Nov 23 19:43:47.026671 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-74bce0b8-b5ac-4412-98b2-365fb030ad3a admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=16cd884b-cdc1-47c5-8a8e-4f128e363d8c,revision_number=1']} {{(pid=102993) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 23 19:43:47.028904 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.wsgi [-] (102992) accepted ('10.222.0.62', 51914) {{(pid=102992) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 23 19:43:47.075878 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [None req-c485ad96-bfa7-4a09-90c0-d53da86625f4 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:43:47.096574 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [None req-c485ad96-bfa7-4a09-90c0-d53da86625f4 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:43:47.219555 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [None req-c485ad96-bfa7-4a09-90c0-d53da86625f4 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-623933'] for security_group, after_delete {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:43:47.222295 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [None req-c485ad96-bfa7-4a09-90c0-d53da86625f4 admin admin] Publish callbacks [] for security_group, before_response {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:43:47.223483 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [None req-c485ad96-bfa7-4a09-90c0-d53da86625f4 admin admin] 10.222.0.62 "DELETE /v2.0/security-groups/16cd884b-cdc1-47c5-8a8e-4f128e363d8c HTTP/1.1" status: 204 len: 168 time: 0.1935658 Nov 23 19:43:47.231719 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c485ad96-bfa7-4a09-90c0-d53da86625f4 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=16cd884b-cdc1-47c5-8a8e-4f128e363d8c,revision_number=None']} {{(pid=102992) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 23 19:43:47.311345 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron_lib.callbacks.manager [None req-eb87b2c3-3339-4249-8b85-e695b5b4e1f9 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8783631323329', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7978582'] for agent, after_update {{(pid=102994) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:43:47.802203 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.wsgi [-] (102992) accepted ('10.222.0.62', 51922) {{(pid=102992) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 23 19:43:47.818670 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [None req-9cda126a-1559-441d-a9c8-b25831dbf57e admin admin] Publish callbacks [] for security_group, before_create {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:43:47.890091 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [None req-9cda126a-1559-441d-a9c8-b25831dbf57e admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:43:47.922325 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [None req-9cda126a-1559-441d-a9c8-b25831dbf57e admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-623933'] for security_group, after_create {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:43:47.960443 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [None req-9cda126a-1559-441d-a9c8-b25831dbf57e admin admin] 10.222.0.62 "GET /v2.0/security-groups?tenant_id=bf9eee4d000849c597ff03e081f9b696&name=default HTTP/1.1" status: 200 len: 2996 time: 0.1571758 Nov 23 19:43:47.962397 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9cda126a-1559-441d-a9c8-b25831dbf57e admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=a9e11c96-ac3e-4b48-8742-49090e8f5c9a,revision_number=1']} {{(pid=102992) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 23 19:43:47.963116 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.wsgi [-] (102993) accepted ('10.222.0.62', 51924) {{(pid=102993) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 23 19:43:48.013148 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-abfc552a-b44a-4789-8137-58b47be5928f admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:43:48.033547 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-abfc552a-b44a-4789-8137-58b47be5928f admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:43:48.145660 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-abfc552a-b44a-4789-8137-58b47be5928f admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-623933'] for security_group, after_delete {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:43:48.148432 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-abfc552a-b44a-4789-8137-58b47be5928f admin admin] Publish callbacks [] for security_group, before_response {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:43:48.149633 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [None req-abfc552a-b44a-4789-8137-58b47be5928f admin admin] 10.222.0.62 "DELETE /v2.0/security-groups/a9e11c96-ac3e-4b48-8742-49090e8f5c9a HTTP/1.1" status: 204 len: 168 time: 0.1854985 Nov 23 19:43:48.157542 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-abfc552a-b44a-4789-8137-58b47be5928f admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=a9e11c96-ac3e-4b48-8742-49090e8f5c9a,revision_number=None']} {{(pid=102993) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 23 19:43:59.848167 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron_lib.callbacks.manager [None req-4bf48ff4-ecfb-4168-8b63-249b8c6e9f04 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8783631323329', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7978582'] for agent, after_update {{(pid=102994) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:44:11.716405 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron_lib.callbacks.manager [None req-9fe03170-1a7e-4e3a-bbea-6a11bb043b08 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8783631323329', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7978582'] for agent, after_update {{(pid=102994) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:44:11.922272 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.wsgi [-] (102993) accepted ('10.222.0.62', 52166) {{(pid=102993) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 23 19:44:12.085995 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.plugins.ml2.plugin [None req-352b0cd6-9f91-4e54-9366-f1e0bedee847 tempest-TestVolumeBootPattern-147141705 tempest-TestVolumeBootPattern-147141705-project] Deleting port ca397baf-e9c7-466c-9eb3-569e1097810f {{(pid=102993) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 23 19:44:12.086330 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-352b0cd6-9f91-4e54-9366-f1e0bedee847 tempest-TestVolumeBootPattern-147141705 tempest-TestVolumeBootPattern-147141705-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8783631423070'] for port, before_delete {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:44:12.166289 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-352b0cd6-9f91-4e54-9366-f1e0bedee847 tempest-TestVolumeBootPattern-147141705 tempest-TestVolumeBootPattern-147141705-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-927332'] for port, precommit_delete {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:44:12.166629 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-352b0cd6-9f91-4e54-9366-f1e0bedee847 tempest-TestVolumeBootPattern-147141705 tempest-TestVolumeBootPattern-147141705-project] Publish callbacks [] for floatingip, precommit_delete {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:44:12.178826 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.plugins.ml2.plugin [None req-352b0cd6-9f91-4e54-9366-f1e0bedee847 tempest-TestVolumeBootPattern-147141705 tempest-TestVolumeBootPattern-147141705-project] Calling delete_port for ca397baf-e9c7-466c-9eb3-569e1097810f owned by network:floatingip {{(pid=102993) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 23 19:44:12.385330 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-352b0cd6-9f91-4e54-9366-f1e0bedee847 tempest-TestVolumeBootPattern-147141705 tempest-TestVolumeBootPattern-147141705-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7918660', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-15067', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560168', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8783631424624', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8783631008723', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-17257496'] for port, after_delete {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:44:12.413660 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-352b0cd6-9f91-4e54-9366-f1e0bedee847 tempest-TestVolumeBootPattern-147141705 tempest-TestVolumeBootPattern-147141705-project] Pushing event deleted for resources: {'Port': ['ID=ca397baf-e9c7-466c-9eb3-569e1097810f,revision_number=None']} {{(pid=102993) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 23 19:44:12.477867 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-352b0cd6-9f91-4e54-9366-f1e0bedee847 tempest-TestVolumeBootPattern-147141705 tempest-TestVolumeBootPattern-147141705-project] Publish callbacks [] for floatingip, after_delete {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:44:12.478250 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.db.l3_db [None req-352b0cd6-9f91-4e54-9366-f1e0bedee847 tempest-TestVolumeBootPattern-147141705 tempest-TestVolumeBootPattern-147141705-project] Floating IP fa062c57-8451-4677-b877-05a9e7e1495a disassociated (deleted). External IP: 172.27.1.149, port: 7bdc59b0-f473-4d83-9bf7-b5700274a507. Nov 23 19:44:12.971254 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-352b0cd6-9f91-4e54-9366-f1e0bedee847 tempest-TestVolumeBootPattern-147141705 tempest-TestVolumeBootPattern-147141705-project] Router 0534bcc4-1e12-4026-90ce-1406543c7662 has already been hosted by L3 agent 1b20f2c4-70b6-43c3-b9bd-0062cc9e57ac {{(pid=102993) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 23 19:44:13.079951 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-352b0cd6-9f91-4e54-9366-f1e0bedee847 tempest-TestVolumeBootPattern-147141705 tempest-TestVolumeBootPattern-147141705-project] Notify agent at l3_agent.dv-cinder-819011-1-iscsi the message routers_updated {{(pid=102993) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 23 19:44:13.084774 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-352b0cd6-9f91-4e54-9366-f1e0bedee847 tempest-TestVolumeBootPattern-147141705 tempest-TestVolumeBootPattern-147141705-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-514902'] for floatingip, before_response {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:44:13.089292 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-262d73d9-a04d-414d-a13a-aa648994e6ef None None] Sync routers for ids ['0534bcc4-1e12-4026-90ce-1406543c7662'] in dv-cinder-819011-1-iscsi {{(pid=102994) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 23 19:44:13.099160 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.db.l3_dvrscheduler_db [None req-262d73d9-a04d-414d-a13a-aa648994e6ef None None] Routers {'0534bcc4-1e12-4026-90ce-1406543c7662'} bound to L3 agent in host dv-cinder-819011-1-iscsi {{(pid=102994) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 23 19:44:13.099769 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.db.l3_hamode_db [None req-262d73d9-a04d-414d-a13a-aa648994e6ef None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-819011-1-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-23T19:25:14Z,description=,heartbeat_timestamp=2021-11-23T19:43:44Z,host='dv-cinder-819011-1-iscsi',id=1b20f2c4-70b6-43c3-b9bd-0062cc9e57ac,load=0,resource_versions=,resources_synced=,started_at=2021-11-23T19:25:15Z,topic='l3_agent')) {'router_ids': ['0534bcc4-1e12-4026-90ce-1406543c7662'], 'active': True} {{(pid=102994) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 23 19:44:13.111698 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [None req-352b0cd6-9f91-4e54-9366-f1e0bedee847 tempest-TestVolumeBootPattern-147141705 tempest-TestVolumeBootPattern-147141705-project] 10.222.0.62 "DELETE /v2.0/floatingips/fa062c57-8451-4677-b877-05a9e7e1495a HTTP/1.1" status: 204 len: 168 time: 1.1884284 Nov 23 19:44:13.112434 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'f48d7898-d8c9-4cfb-b340-c3a0d0009b87', 'tag': '7bdc59b0-f473-4d83-9bf7-b5700274a507'}] {{(pid=102993) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 23 19:44:13.114735 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.62/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}9b10b92acbee16fb695be1efeed0b68f7c36a5b215ec004a8d9d707fa3d35b2c" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-cfc6e7b6-be19-43a7-a17d-3d1394c182d7" -d '{"events": [{"name": "network-changed", "server_uuid": "f48d7898-d8c9-4cfb-b340-c3a0d0009b87", "tag": "7bdc59b0-f473-4d83-9bf7-b5700274a507"}]}' {{(pid=102993) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 23 19:44:13.209523 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.db.l3_dvr_db [None req-262d73d9-a04d-414d-a13a-aa648994e6ef None None] Set router 0534bcc4-1e12-4026-90ce-1406543c7662 gateway port host: dv-cinder-819011-1-iscsi {{(pid=102994) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 23 19:44:13.274541 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Tue, 23 Nov 2021 19:44:13 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-a84be2a4-185e-4c34-a17a-028d8ac3a559 x-openstack-request-id: req-a84be2a4-185e-4c34-a17a-028d8ac3a559 {{(pid=102993) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 23 19:44:13.274845 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "f48d7898-d8c9-4cfb-b340-c3a0d0009b87", "tag": "7bdc59b0-f473-4d83-9bf7-b5700274a507", "status": "completed", "code": 200}]} {{(pid=102993) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 23 19:44:13.275103 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.62/compute/v2.1/os-server-external-events used request id req-a84be2a4-185e-4c34-a17a-028d8ac3a559 {{(pid=102993) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 23 19:44:13.275653 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'f48d7898-d8c9-4cfb-b340-c3a0d0009b87', 'tag': '7bdc59b0-f473-4d83-9bf7-b5700274a507', 'status': 'completed', 'code': 200} Nov 23 19:44:13.445948 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cfc6e7b6-be19-43a7-a17d-3d1394c182d7 req-58def281-8866-4dfd-8cca-f3e3ea30312f service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102993) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:44:13.447528 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-cfc6e7b6-be19-43a7-a17d-3d1394c182d7 req-58def281-8866-4dfd-8cca-f3e3ea30312f service neutron] 10.222.0.41 "GET /v2.0/ports?tenant_id=257b0b2e531441b4bb745e99cfd799f3&device_id=f48d7898-d8c9-4cfb-b340-c3a0d0009b87 HTTP/1.1" status: 200 len: 1098 time: 0.1473401 Nov 23 19:44:13.450910 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.db.l3_hamode_db [None req-262d73d9-a04d-414d-a13a-aa648994e6ef None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '0534bcc4-1e12-4026-90ce-1406543c7662', 'name': 'tempest-TestVolumeBootPattern-84632531-router', 'tenant_id': '257b0b2e531441b4bb745e99cfd799f3', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'a93e254e-aac9-4233-9e4d-4290fd0458e4', 'external_fixed_ips': [{'subnet_id': 'e0b32f3d-83d6-439a-bbed-01df7cf01051', 'ip_address': '172.27.1.154'}], 'enable_snat': True}, 'gw_port_id': 'c7996293-6188-4690-b614-395448e4dc25', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-23T19:35:29Z', 'updated_at': '2021-11-23T19:35:33Z', 'revision_number': 4, 'project_id': '257b0b2e531441b4bb745e99cfd799f3', 'gw_port': {'id': 'c7996293-6188-4690-b614-395448e4dc25', 'name': '', 'network_id': 'a93e254e-aac9-4233-9e4d-4290fd0458e4', 'tenant_id': '', 'mac_address': 'fa:16:3e:52:67:5e', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '0534bcc4-1e12-4026-90ce-1406543c7662', 'device_owner': 'network:router_gateway', 'standard_attr_id': 392, 'fixed_ips': [{'subnet_id': 'e0b32f3d-83d6-439a-bbed-01df7cf01051', 'ip_address': '172.27.1.154', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-819011-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-23T19:35:30Z', 'updated_at': '2021-11-23T19:35:34Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'e0b32f3d-83d6-439a-bbed-01df7cf01051', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-819011-1-iscsi', '_floatingips': [{'id': 'ea09a7d4-0775-4bc6-9310-f47e8ee059db', 'tenant_id': '257b0b2e531441b4bb745e99cfd799f3', 'floating_ip_address': '172.27.1.127', 'floating_network_id': 'a93e254e-aac9-4233-9e4d-4290fd0458e4', 'router_id': '0534bcc4-1e12-4026-90ce-1406543c7662', 'port_id': '3f7db100-6209-44d3-88c7-906fb1cec5cb', 'fixed_ip_address': '172.20.0.13', 'status': 'ACTIVE', 'standard_attr_id': 593, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '226a519f-5f3e-4d80-bb8a-0e9fc4f64828', 'mac_address': 'fa:16:3e:27:ae:a3', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '9e64d320-821f-4313-8dd0-3b327ba75634', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-23T19:39:56Z', 'updated_at': '2021-11-23T19:39:59Z', 'revision_number': 1, 'project_id': '257b0b2e531441b4bb745e99cfd799f3', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '854821af-61e0-47e7-a603-95f500a49030', 'name': '', 'network_id': '226a519f-5f3e-4d80-bb8a-0e9fc4f64828', 'tenant_id': '257b0b2e531441b4bb745e99cfd799f3', 'mac_address': 'fa:16:3e:90:11:65', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '0534bcc4-1e12-4026-90ce-1406543c7662', 'device_owner': 'network:router_interface', 'standard_attr_id': 393, 'fixed_ips': [{'subnet_id': '88de785d-c540-4651-af1e-26f27ccaee3c', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-819011-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-23T19:35:32Z', 'updated_at': '2021-11-23T19:35:37Z', 'revision_number': 5, 'project_id': '257b0b2e531441b4bb745e99cfd799f3', 'subnets': [{'id': '88de785d-c540-4651-af1e-26f27ccaee3c', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-819011-1-iscsi', False) {} {{(pid=102994) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 23 19:44:13.477596 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-262d73d9-a04d-414d-a13a-aa648994e6ef None None] Checking router: 0534bcc4-1e12-4026-90ce-1406543c7662 for host: dv-cinder-819011-1-iscsi {{(pid=102994) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 23 19:44:13.487137 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.db.l3_dvrscheduler_db [None req-262d73d9-a04d-414d-a13a-aa648994e6ef None None] Routers {'0534bcc4-1e12-4026-90ce-1406543c7662'} bound to L3 agent in host dv-cinder-819011-1-iscsi {{(pid=102994) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 23 19:44:13.487758 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.db.l3_hamode_db [None req-262d73d9-a04d-414d-a13a-aa648994e6ef None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-819011-1-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-23T19:25:14Z,description=,heartbeat_timestamp=2021-11-23T19:43:44Z,host='dv-cinder-819011-1-iscsi',id=1b20f2c4-70b6-43c3-b9bd-0062cc9e57ac,load=0,resource_versions=,resources_synced=,started_at=2021-11-23T19:25:15Z,topic='l3_agent')) {'router_ids': ['0534bcc4-1e12-4026-90ce-1406543c7662'], 'active': True} {{(pid=102994) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 23 19:44:13.553214 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cfc6e7b6-be19-43a7-a17d-3d1394c182d7 req-178911e0-32d4-442e-bea5-a57c81cf81b2 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102993) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:44:13.554899 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-cfc6e7b6-be19-43a7-a17d-3d1394c182d7 req-178911e0-32d4-442e-bea5-a57c81cf81b2 service neutron] 10.222.0.41 "GET /v2.0/networks?id=226a519f-5f3e-4d80-bb8a-0e9fc4f64828 HTTP/1.1" status: 200 len: 911 time: 0.0983284 Nov 23 19:44:13.600428 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.db.l3_dvr_db [None req-262d73d9-a04d-414d-a13a-aa648994e6ef None None] Set router 0534bcc4-1e12-4026-90ce-1406543c7662 gateway port host: dv-cinder-819011-1-iscsi {{(pid=102994) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 23 19:44:13.604715 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-cfc6e7b6-be19-43a7-a17d-3d1394c182d7 req-b6207acd-2483-4e0f-ba7f-c2cdee34f6df service neutron] 10.222.0.41 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.6&port_id=7bdc59b0-f473-4d83-9bf7-b5700274a507 HTTP/1.1" status: 200 len: 217 time: 0.0390193 Nov 23 19:44:13.637656 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cdcadee8-567d-41dc-957c-a9838458c457 req-c2341d8f-5e35-4f62-a65a-0273753baba4 tempest-TestVolumeBootPattern-147141705 tempest-TestVolumeBootPattern-147141705-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102992) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:44:13.642323 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-cdcadee8-567d-41dc-957c-a9838458c457 req-c2341d8f-5e35-4f62-a65a-0273753baba4 tempest-TestVolumeBootPattern-147141705 tempest-TestVolumeBootPattern-147141705-project] 10.222.0.62 "GET /v2.0/ports?device_id=f48d7898-d8c9-4cfb-b340-c3a0d0009b87 HTTP/1.1" status: 200 len: 945 time: 0.1176760 Nov 23 19:44:13.666985 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cfc6e7b6-be19-43a7-a17d-3d1394c182d7 req-28b75da6-4734-4496-ab04-f4d5331f9133 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102993) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:44:13.668743 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-cfc6e7b6-be19-43a7-a17d-3d1394c182d7 req-28b75da6-4734-4496-ab04-f4d5331f9133 service neutron] 10.222.0.41 "GET /v2.0/subnets?id=88de785d-c540-4651-af1e-26f27ccaee3c HTTP/1.1" status: 200 len: 849 time: 0.0544019 Nov 23 19:44:13.693326 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-cdcadee8-567d-41dc-957c-a9838458c457 req-231a7a2b-c51e-4540-b0b7-e3e625fac1f7 tempest-TestVolumeBootPattern-147141705 tempest-TestVolumeBootPattern-147141705-project] 10.222.0.62 "GET /v2.0/security-groups?id=a6e2b133-1a9b-4dde-a188-1ce8bcdb7b5c&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0471416 Nov 23 19:44:13.732684 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cfc6e7b6-be19-43a7-a17d-3d1394c182d7 req-ef34d109-6c1f-41f1-b162-a5cf42db48ff service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102993) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:44:13.734302 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-cfc6e7b6-be19-43a7-a17d-3d1394c182d7 req-ef34d109-6c1f-41f1-b162-a5cf42db48ff service neutron] 10.222.0.41 "GET /v2.0/ports?network_id=226a519f-5f3e-4d80-bb8a-0e9fc4f64828&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0573926 Nov 23 19:44:13.745967 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.wsgi [req-cfc6e7b6-be19-43a7-a17d-3d1394c182d7 req-4e421183-2ffc-49ea-8686-92af99486026 service neutron] http://10.222.0.62:9696/v2.0/extensions returned with HTTP 200 {{(pid=102993) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Nov 23 19:44:13.747068 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-cfc6e7b6-be19-43a7-a17d-3d1394c182d7 req-4e421183-2ffc-49ea-8686-92af99486026 service neutron] 10.222.0.41 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 14082 time: 0.0048642 Nov 23 19:44:13.854998 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-cfc6e7b6-be19-43a7-a17d-3d1394c182d7 req-27e346b6-13b8-432f-a14d-053bae3a9e8a service neutron] 10.222.0.41 "GET /v2.0/networks/226a519f-5f3e-4d80-bb8a-0e9fc4f64828?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0947530 Nov 23 19:44:13.951418 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-cfc6e7b6-be19-43a7-a17d-3d1394c182d7 req-cd31e1e1-8aba-4625-9edc-9e9c21ddfeb6 service neutron] 10.222.0.41 "GET /v2.0/networks/226a519f-5f3e-4d80-bb8a-0e9fc4f64828?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0884044 Nov 23 19:44:13.961343 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.db.l3_hamode_db [None req-262d73d9-a04d-414d-a13a-aa648994e6ef None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '0534bcc4-1e12-4026-90ce-1406543c7662', 'name': 'tempest-TestVolumeBootPattern-84632531-router', 'tenant_id': '257b0b2e531441b4bb745e99cfd799f3', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'a93e254e-aac9-4233-9e4d-4290fd0458e4', 'external_fixed_ips': [{'subnet_id': 'e0b32f3d-83d6-439a-bbed-01df7cf01051', 'ip_address': '172.27.1.154'}], 'enable_snat': True}, 'gw_port_id': 'c7996293-6188-4690-b614-395448e4dc25', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-23T19:35:29Z', 'updated_at': '2021-11-23T19:35:33Z', 'revision_number': 4, 'project_id': '257b0b2e531441b4bb745e99cfd799f3', 'gw_port': {'id': 'c7996293-6188-4690-b614-395448e4dc25', 'name': '', 'network_id': 'a93e254e-aac9-4233-9e4d-4290fd0458e4', 'tenant_id': '', 'mac_address': 'fa:16:3e:52:67:5e', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '0534bcc4-1e12-4026-90ce-1406543c7662', 'device_owner': 'network:router_gateway', 'standard_attr_id': 392, 'fixed_ips': [{'subnet_id': 'e0b32f3d-83d6-439a-bbed-01df7cf01051', 'ip_address': '172.27.1.154', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-819011-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-23T19:35:30Z', 'updated_at': '2021-11-23T19:35:34Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'e0b32f3d-83d6-439a-bbed-01df7cf01051', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-819011-1-iscsi', '_floatingips': [{'id': 'ea09a7d4-0775-4bc6-9310-f47e8ee059db', 'tenant_id': '257b0b2e531441b4bb745e99cfd799f3', 'floating_ip_address': '172.27.1.127', 'floating_network_id': 'a93e254e-aac9-4233-9e4d-4290fd0458e4', 'router_id': '0534bcc4-1e12-4026-90ce-1406543c7662', 'port_id': '3f7db100-6209-44d3-88c7-906fb1cec5cb', 'fixed_ip_address': '172.20.0.13', 'status': 'ACTIVE', 'standard_attr_id': 593, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '226a519f-5f3e-4d80-bb8a-0e9fc4f64828', 'mac_address': 'fa:16:3e:27:ae:a3', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '9e64d320-821f-4313-8dd0-3b327ba75634', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-23T19:39:56Z', 'updated_at': '2021-11-23T19:39:59Z', 'revision_number': 1, 'project_id': '257b0b2e531441b4bb745e99cfd799f3', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '854821af-61e0-47e7-a603-95f500a49030', 'name': '', 'network_id': '226a519f-5f3e-4d80-bb8a-0e9fc4f64828', 'tenant_id': '257b0b2e531441b4bb745e99cfd799f3', 'mac_address': 'fa:16:3e:90:11:65', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '0534bcc4-1e12-4026-90ce-1406543c7662', 'device_owner': 'network:router_interface', 'standard_attr_id': 393, 'fixed_ips': [{'subnet_id': '88de785d-c540-4651-af1e-26f27ccaee3c', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-819011-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-23T19:35:32Z', 'updated_at': '2021-11-23T19:35:37Z', 'revision_number': 5, 'project_id': '257b0b2e531441b4bb745e99cfd799f3', 'subnets': [{'id': '88de785d-c540-4651-af1e-26f27ccaee3c', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-819011-1-iscsi', False) {} {{(pid=102994) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 23 19:44:13.987195 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-262d73d9-a04d-414d-a13a-aa648994e6ef None None] The sync data for ids ['0534bcc4-1e12-4026-90ce-1406543c7662'] in dv-cinder-819011-1-iscsi is: [{'id': '0534bcc4-1e12-4026-90ce-1406543c7662', 'name': 'tempest-TestVolumeBootPattern-84632531-router', 'tenant_id': '257b0b2e531441b4bb745e99cfd799f3', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'a93e254e-aac9-4233-9e4d-4290fd0458e4', 'external_fixed_ips': [{'subnet_id': 'e0b32f3d-83d6-439a-bbed-01df7cf01051', 'ip_address': '172.27.1.154'}], 'enable_snat': True}, 'gw_port_id': 'c7996293-6188-4690-b614-395448e4dc25', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-23T19:35:29Z', 'updated_at': '2021-11-23T19:35:33Z', 'revision_number': 4, 'project_id': '257b0b2e531441b4bb745e99cfd799f3', 'gw_port': {'id': 'c7996293-6188-4690-b614-395448e4dc25', 'name': '', 'network_id': 'a93e254e-aac9-4233-9e4d-4290fd0458e4', 'tenant_id': '', 'mac_address': 'fa:16:3e:52:67:5e', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '0534bcc4-1e12-4026-90ce-1406543c7662', 'device_owner': 'network:router_gateway', 'standard_attr_id': 392, 'fixed_ips': [{'subnet_id': 'e0b32f3d-83d6-439a-bbed-01df7cf01051', 'ip_address': '172.27.1.154', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-819011-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-23T19:35:30Z', 'updated_at': '2021-11-23T19:35:34Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'e0b32f3d-83d6-439a-bbed-01df7cf01051', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-819011-1-iscsi', '_floatingips': [{'id': 'ea09a7d4-0775-4bc6-9310-f47e8ee059db', 'tenant_id': '257b0b2e531441b4bb745e99cfd799f3', 'floating_ip_address': '172.27.1.127', 'floating_network_id': 'a93e254e-aac9-4233-9e4d-4290fd0458e4', 'router_id': '0534bcc4-1e12-4026-90ce-1406543c7662', 'port_id': '3f7db100-6209-44d3-88c7-906fb1cec5cb', 'fixed_ip_address': '172.20.0.13', 'status': 'ACTIVE', 'standard_attr_id': 593, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '226a519f-5f3e-4d80-bb8a-0e9fc4f64828', 'mac_address': 'fa:16:3e:27:ae:a3', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '9e64d320-821f-4313-8dd0-3b327ba75634', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-23T19:39:56Z', 'updated_at': '2021-11-23T19:39:59Z', 'revision_number': 1, 'project_id': '257b0b2e531441b4bb745e99cfd799f3', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '854821af-61e0-47e7-a603-95f500a49030', 'name': '', 'network_id': '226a519f-5f3e-4d80-bb8a-0e9fc4f64828', 'tenant_id': '257b0b2e531441b4bb745e99cfd799f3', 'mac_address': 'fa:16:3e:90:11:65', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '0534bcc4-1e12-4026-90ce-1406543c7662', 'device_owner': 'network:router_interface', 'standard_attr_id': 393, 'fixed_ips': [{'subnet_id': '88de785d-c540-4651-af1e-26f27ccaee3c', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-819011-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-23T19:35:32Z', 'updated_at': '2021-11-23T19:35:37Z', 'revision_number': 5, 'project_id': '257b0b2e531441b4bb745e99cfd799f3', 'subnets': [{'id': '88de785d-c540-4651-af1e-26f27ccaee3c', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=102994) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 23 19:44:14.185472 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron_lib.callbacks.manager [None req-c538ea4d-0e8c-402e-b386-68a70a828ef2 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8783631323329', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7978582'] for agent, after_update {{(pid=102994) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:44:14.214427 dv-cinder-819011-1-iscsi neutron-server[102995]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-7e44d8ce-d182-4ef2-a5d5-db109ec12642 None None] New status for floating IP fa062c57-8451-4677-b877-05a9e7e1495a: DOWN {{(pid=102995) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Nov 23 19:44:14.821968 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dc67802c-10a5-4a0a-9483-4bae5b327016 req-8a123d8c-834c-43fe-8f66-274fe9640900 tempest-TestVolumeBootPattern-147141705 tempest-TestVolumeBootPattern-147141705-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102993) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:44:14.823507 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-dc67802c-10a5-4a0a-9483-4bae5b327016 req-8a123d8c-834c-43fe-8f66-274fe9640900 tempest-TestVolumeBootPattern-147141705 tempest-TestVolumeBootPattern-147141705-project] 10.222.0.62 "GET /v2.0/ports?device_id=f48d7898-d8c9-4cfb-b340-c3a0d0009b87 HTTP/1.1" status: 200 len: 945 time: 0.0552211 Nov 23 19:44:14.879892 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-dc67802c-10a5-4a0a-9483-4bae5b327016 req-9024f00a-bfe0-44e4-83b0-02366ff05d1d tempest-TestVolumeBootPattern-147141705 tempest-TestVolumeBootPattern-147141705-project] 10.222.0.62 "GET /v2.0/security-groups?id=a6e2b133-1a9b-4dde-a188-1ce8bcdb7b5c&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0492809 Nov 23 19:44:15.158132 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron_lib.callbacks.manager [None req-8346ef05-f685-4c3d-af3d-a159b683bec2 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8783631323329', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7978582'] for agent, after_update {{(pid=102994) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:44:15.417237 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0910f4ac-7309-4cae-a27c-388d4e97119b req-bb87256d-f24d-49d4-89a7-934924250ac7 tempest-TestVolumeBootPattern-147141705 tempest-TestVolumeBootPattern-147141705-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102993) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:44:15.418822 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-0910f4ac-7309-4cae-a27c-388d4e97119b req-bb87256d-f24d-49d4-89a7-934924250ac7 tempest-TestVolumeBootPattern-147141705 tempest-TestVolumeBootPattern-147141705-project] 10.222.0.41 "GET /v2.0/ports?device_id=f48d7898-d8c9-4cfb-b340-c3a0d0009b87 HTTP/1.1" status: 200 len: 945 time: 0.0494401 Nov 23 19:44:15.522626 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.plugins.ml2.plugin [req-0910f4ac-7309-4cae-a27c-388d4e97119b req-a08163d0-a934-4e76-9c5f-adfc090e20cb tempest-TestVolumeBootPattern-147141705 tempest-TestVolumeBootPattern-147141705-project] Deleting port 7bdc59b0-f473-4d83-9bf7-b5700274a507 {{(pid=102993) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 23 19:44:15.523103 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [req-0910f4ac-7309-4cae-a27c-388d4e97119b req-a08163d0-a934-4e76-9c5f-adfc090e20cb tempest-TestVolumeBootPattern-147141705 tempest-TestVolumeBootPattern-147141705-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8783631423070'] for port, before_delete {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:44:15.616045 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.plugins.ml2.db [req-0910f4ac-7309-4cae-a27c-388d4e97119b req-a08163d0-a934-4e76-9c5f-adfc090e20cb tempest-TestVolumeBootPattern-147141705 tempest-TestVolumeBootPattern-147141705-project] For port 7bdc59b0-f473-4d83-9bf7-b5700274a507, host hv-cinder-81901, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81901',level=0,port_id=7bdc59b0-f473-4d83-9bf7-b5700274a507,segment=NetworkSegment(56316385-5b81-43f5-84db-b708b46f04eb),segment_id=56316385-5b81-43f5-84db-b708b46f04eb)] {{(pid=102993) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 23 19:44:15.616320 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [req-0910f4ac-7309-4cae-a27c-388d4e97119b req-a08163d0-a934-4e76-9c5f-adfc090e20cb tempest-TestVolumeBootPattern-147141705 tempest-TestVolumeBootPattern-147141705-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-927332'] for port, precommit_delete {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:44:15.629904 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.plugins.ml2.plugin [req-0910f4ac-7309-4cae-a27c-388d4e97119b req-a08163d0-a934-4e76-9c5f-adfc090e20cb tempest-TestVolumeBootPattern-147141705 tempest-TestVolumeBootPattern-147141705-project] Calling delete_port for 7bdc59b0-f473-4d83-9bf7-b5700274a507 owned by compute:nova {{(pid=102993) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 23 19:44:15.847446 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [req-0910f4ac-7309-4cae-a27c-388d4e97119b req-a08163d0-a934-4e76-9c5f-adfc090e20cb tempest-TestVolumeBootPattern-147141705 tempest-TestVolumeBootPattern-147141705-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7918660', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-15067', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560168', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8783631424624', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8783631008723', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-17257496'] for port, after_delete {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:44:15.886922 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a08163d0-a934-4e76-9c5f-adfc090e20cb tempest-TestVolumeBootPattern-147141705 tempest-TestVolumeBootPattern-147141705-project] Pushing event deleted for resources: {'Port': ['ID=7bdc59b0-f473-4d83-9bf7-b5700274a507,revision_number=None']} {{(pid=102993) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 23 19:44:15.925455 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.db.l3_dvrscheduler_db [req-0910f4ac-7309-4cae-a27c-388d4e97119b req-a08163d0-a934-4e76-9c5f-adfc090e20cb tempest-TestVolumeBootPattern-147141705 tempest-TestVolumeBootPattern-147141705-project] No DVR routers for this DVR port 7bdc59b0-f473-4d83-9bf7-b5700274a507 on host hv-cinder-81901 {{(pid=102993) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 23 19:44:15.928006 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [req-0910f4ac-7309-4cae-a27c-388d4e97119b req-a08163d0-a934-4e76-9c5f-adfc090e20cb tempest-TestVolumeBootPattern-147141705 tempest-TestVolumeBootPattern-147141705-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-514902'] for port, before_response {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:44:15.931800 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-0910f4ac-7309-4cae-a27c-388d4e97119b req-a08163d0-a934-4e76-9c5f-adfc090e20cb tempest-TestVolumeBootPattern-147141705 tempest-TestVolumeBootPattern-147141705-project] 10.222.0.41 "DELETE /v2.0/ports/7bdc59b0-f473-4d83-9bf7-b5700274a507 HTTP/1.1" status: 204 len: 173 time: 0.5041170 Nov 23 19:44:15.932267 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'f48d7898-d8c9-4cfb-b340-c3a0d0009b87', 'name': 'network-vif-deleted', 'tag': '7bdc59b0-f473-4d83-9bf7-b5700274a507'}] {{(pid=102993) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 23 19:44:15.937957 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.62/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}9b10b92acbee16fb695be1efeed0b68f7c36a5b215ec004a8d9d707fa3d35b2c" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-82277a2a-2398-4188-a5ae-64f27842c9bf" -d '{"events": [{"server_uuid": "f48d7898-d8c9-4cfb-b340-c3a0d0009b87", "name": "network-vif-deleted", "tag": "7bdc59b0-f473-4d83-9bf7-b5700274a507"}]}' {{(pid=102993) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 23 19:44:15.974790 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 23 Nov 2021 19:44:15 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-968fa9e9-3ae3-47a9-b35e-1e7eca0e987a x-openstack-request-id: req-968fa9e9-3ae3-47a9-b35e-1e7eca0e987a {{(pid=102993) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 23 19:44:15.975253 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "f48d7898-d8c9-4cfb-b340-c3a0d0009b87", "name": "network-vif-deleted", "tag": "7bdc59b0-f473-4d83-9bf7-b5700274a507", "status": "completed", "code": 200}]} {{(pid=102993) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 23 19:44:15.975602 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.62/compute/v2.1/os-server-external-events used request id req-968fa9e9-3ae3-47a9-b35e-1e7eca0e987a {{(pid=102993) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 23 19:44:15.976099 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'f48d7898-d8c9-4cfb-b340-c3a0d0009b87', 'name': 'network-vif-deleted', 'tag': '7bdc59b0-f473-4d83-9bf7-b5700274a507', 'status': 'completed', 'code': 200} Nov 23 19:44:15.981647 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-21604b96-ca79-4c0b-9910-396bada7ba67 req-9fc1ca01-d842-417f-8eb8-f4ed5d4ee931 tempest-TestVolumeBootPattern-147141705 tempest-TestVolumeBootPattern-147141705-project] 10.222.0.62 "GET /v2.0/ports?device_id=f48d7898-d8c9-4cfb-b340-c3a0d0009b87 HTTP/1.1" status: 200 len: 210 time: 0.0280273 Nov 23 19:44:16.613220 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron_lib.callbacks.manager [None req-785c1d26-11ba-42d8-b5a6-51a8b3daeef0 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8783631323329', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7978582'] for agent, after_update {{(pid=102994) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:44:17.101421 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-0ec412b6-55fb-47f5-9f0e-83a878f78f45 req-fad34c9d-26c1-43d0-8b55-68b411e2cc5d tempest-TestVolumeBootPattern-147141705 tempest-TestVolumeBootPattern-147141705-project] 10.222.0.62 "GET /v2.0/ports?device_id=f48d7898-d8c9-4cfb-b340-c3a0d0009b87 HTTP/1.1" status: 200 len: 210 time: 0.0320771 Nov 23 19:44:17.351013 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron_lib.callbacks.manager [None req-eb87b2c3-3339-4249-8b85-e695b5b4e1f9 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8783631323329', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7978582'] for agent, after_update {{(pid=102994) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:44:19.457609 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.plugins.ml2.rpc [None req-4bf48ff4-ecfb-4168-8b63-249b8c6e9f04 None None] Device 7bdc59b0-f473-4d83-9bf7-b5700274a507 no longer exists at agent hyperv_hv-cinder-81901 {{(pid=102994) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 23 19:44:19.477559 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.plugins.ml2.plugin [None req-4bf48ff4-ecfb-4168-8b63-249b8c6e9f04 None None] No Port match for: 7bdc59b0-f473-4d83-9bf7-b5700274a507 {{(pid=102994) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 23 19:44:19.477909 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.plugins.ml2.rpc [None req-4bf48ff4-ecfb-4168-8b63-249b8c6e9f04 None None] Device 7bdc59b0-f473-4d83-9bf7-b5700274a507 not bound to the agent host hv-cinder-81901 {{(pid=102994) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 23 19:44:20.002319 dv-cinder-819011-1-iscsi neutron-server[102995]: DEBUG neutron.db.agents_db [None req-84bdc9b2-57ea-4bdb-a245-07c78d37cea8 None None] Agent healthcheck: found 6 active agents {{(pid=102995) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 23 19:44:23.799943 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.wsgi [-] (102993) accepted ('10.222.0.62', 52278) {{(pid=102993) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 23 19:44:23.963384 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.plugins.ml2.plugin [None req-3f8b036c-ecef-4dd9-b6be-eb660892e45d tempest-TestVolumeBootPattern-147141705 tempest-TestVolumeBootPattern-147141705-project] Deleting port ce917557-e28a-40ca-9c7a-f446a87153e5 {{(pid=102993) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 23 19:44:23.963731 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-3f8b036c-ecef-4dd9-b6be-eb660892e45d tempest-TestVolumeBootPattern-147141705 tempest-TestVolumeBootPattern-147141705-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8783631423070'] for port, before_delete {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:44:24.043083 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-3f8b036c-ecef-4dd9-b6be-eb660892e45d tempest-TestVolumeBootPattern-147141705 tempest-TestVolumeBootPattern-147141705-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-927332'] for port, precommit_delete {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:44:24.043331 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-3f8b036c-ecef-4dd9-b6be-eb660892e45d tempest-TestVolumeBootPattern-147141705 tempest-TestVolumeBootPattern-147141705-project] Publish callbacks [] for floatingip, precommit_delete {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:44:24.055213 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.plugins.ml2.plugin [None req-3f8b036c-ecef-4dd9-b6be-eb660892e45d tempest-TestVolumeBootPattern-147141705 tempest-TestVolumeBootPattern-147141705-project] Calling delete_port for ce917557-e28a-40ca-9c7a-f446a87153e5 owned by network:floatingip {{(pid=102993) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 23 19:44:24.265079 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-3f8b036c-ecef-4dd9-b6be-eb660892e45d tempest-TestVolumeBootPattern-147141705 tempest-TestVolumeBootPattern-147141705-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7918660', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-15067', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560168', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8783631424624', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8783631008723', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-17257496'] for port, after_delete {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:44:24.293349 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3f8b036c-ecef-4dd9-b6be-eb660892e45d tempest-TestVolumeBootPattern-147141705 tempest-TestVolumeBootPattern-147141705-project] Pushing event deleted for resources: {'Port': ['ID=ce917557-e28a-40ca-9c7a-f446a87153e5,revision_number=None']} {{(pid=102993) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 23 19:44:24.307857 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3f8b036c-ecef-4dd9-b6be-eb660892e45d tempest-TestVolumeBootPattern-147141705 tempest-TestVolumeBootPattern-147141705-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-819011-1-iscsi {{(pid=102993) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 23 19:44:24.308225 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3f8b036c-ecef-4dd9-b6be-eb660892e45d tempest-TestVolumeBootPattern-147141705 tempest-TestVolumeBootPattern-147141705-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-819011-1-iscsi {{(pid=102993) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 23 19:44:24.308568 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3f8b036c-ecef-4dd9-b6be-eb660892e45d tempest-TestVolumeBootPattern-147141705 tempest-TestVolumeBootPattern-147141705-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-819011-1-iscsi {{(pid=102993) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 23 19:44:24.309206 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3f8b036c-ecef-4dd9-b6be-eb660892e45d tempest-TestVolumeBootPattern-147141705 tempest-TestVolumeBootPattern-147141705-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-819011-1-iscsi {{(pid=102993) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 23 19:44:24.309643 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3f8b036c-ecef-4dd9-b6be-eb660892e45d tempest-TestVolumeBootPattern-147141705 tempest-TestVolumeBootPattern-147141705-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-819011-1-iscsi {{(pid=102993) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 23 19:44:24.309985 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3f8b036c-ecef-4dd9-b6be-eb660892e45d tempest-TestVolumeBootPattern-147141705 tempest-TestVolumeBootPattern-147141705-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-819011-1-iscsi {{(pid=102993) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 23 19:44:24.310321 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3f8b036c-ecef-4dd9-b6be-eb660892e45d tempest-TestVolumeBootPattern-147141705 tempest-TestVolumeBootPattern-147141705-project] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-819011-1-iscsi {{(pid=102993) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 23 19:44:24.310654 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3f8b036c-ecef-4dd9-b6be-eb660892e45d tempest-TestVolumeBootPattern-147141705 tempest-TestVolumeBootPattern-147141705-project] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-819011-1-iscsi {{(pid=102993) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 23 19:44:24.310989 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3f8b036c-ecef-4dd9-b6be-eb660892e45d tempest-TestVolumeBootPattern-147141705 tempest-TestVolumeBootPattern-147141705-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-819011-1-iscsi {{(pid=102993) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 23 19:44:24.311320 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3f8b036c-ecef-4dd9-b6be-eb660892e45d tempest-TestVolumeBootPattern-147141705 tempest-TestVolumeBootPattern-147141705-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-819011-1-iscsi {{(pid=102993) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 23 19:44:24.311646 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3f8b036c-ecef-4dd9-b6be-eb660892e45d tempest-TestVolumeBootPattern-147141705 tempest-TestVolumeBootPattern-147141705-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-819011-1-iscsi {{(pid=102993) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 23 19:44:24.311970 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3f8b036c-ecef-4dd9-b6be-eb660892e45d tempest-TestVolumeBootPattern-147141705 tempest-TestVolumeBootPattern-147141705-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-819011-1-iscsi {{(pid=102993) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 23 19:44:24.369044 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-3f8b036c-ecef-4dd9-b6be-eb660892e45d tempest-TestVolumeBootPattern-147141705 tempest-TestVolumeBootPattern-147141705-project] Publish callbacks [] for floatingip, after_delete {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:44:24.369375 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.db.l3_db [None req-3f8b036c-ecef-4dd9-b6be-eb660892e45d tempest-TestVolumeBootPattern-147141705 tempest-TestVolumeBootPattern-147141705-project] Floating IP ea09a7d4-0775-4bc6-9310-f47e8ee059db disassociated (deleted). External IP: 172.27.1.127, port: 3f7db100-6209-44d3-88c7-906fb1cec5cb. Nov 23 19:44:24.581602 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-3f8b036c-ecef-4dd9-b6be-eb660892e45d tempest-TestVolumeBootPattern-147141705 tempest-TestVolumeBootPattern-147141705-project] Router 0534bcc4-1e12-4026-90ce-1406543c7662 has already been hosted by L3 agent 1b20f2c4-70b6-43c3-b9bd-0062cc9e57ac {{(pid=102993) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 23 19:44:24.691628 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-3f8b036c-ecef-4dd9-b6be-eb660892e45d tempest-TestVolumeBootPattern-147141705 tempest-TestVolumeBootPattern-147141705-project] Notify agent at l3_agent.dv-cinder-819011-1-iscsi the message routers_updated {{(pid=102993) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 23 19:44:24.696549 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-3f8b036c-ecef-4dd9-b6be-eb660892e45d tempest-TestVolumeBootPattern-147141705 tempest-TestVolumeBootPattern-147141705-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-514902'] for floatingip, before_response {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:44:24.701363 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-8b36c744-bd3f-45fe-8a1e-0b820d2f2e57 None None] Sync routers for ids ['0534bcc4-1e12-4026-90ce-1406543c7662'] in dv-cinder-819011-1-iscsi {{(pid=102994) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 23 19:44:24.711627 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.db.l3_dvrscheduler_db [None req-8b36c744-bd3f-45fe-8a1e-0b820d2f2e57 None None] Routers {'0534bcc4-1e12-4026-90ce-1406543c7662'} bound to L3 agent in host dv-cinder-819011-1-iscsi {{(pid=102994) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 23 19:44:24.712345 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.db.l3_hamode_db [None req-8b36c744-bd3f-45fe-8a1e-0b820d2f2e57 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-819011-1-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-23T19:25:14Z,description=,heartbeat_timestamp=2021-11-23T19:44:14Z,host='dv-cinder-819011-1-iscsi',id=1b20f2c4-70b6-43c3-b9bd-0062cc9e57ac,load=0,resource_versions=,resources_synced=,started_at=2021-11-23T19:25:15Z,topic='l3_agent')) {'router_ids': ['0534bcc4-1e12-4026-90ce-1406543c7662'], 'active': True} {{(pid=102994) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 23 19:44:24.723930 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [None req-3f8b036c-ecef-4dd9-b6be-eb660892e45d tempest-TestVolumeBootPattern-147141705 tempest-TestVolumeBootPattern-147141705-project] 10.222.0.62 "DELETE /v2.0/floatingips/ea09a7d4-0775-4bc6-9310-f47e8ee059db HTTP/1.1" status: 204 len: 168 time: 0.9228590 Nov 23 19:44:24.724708 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '9e64d320-821f-4313-8dd0-3b327ba75634', 'tag': '3f7db100-6209-44d3-88c7-906fb1cec5cb'}] {{(pid=102993) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 23 19:44:24.727450 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.62/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}9b10b92acbee16fb695be1efeed0b68f7c36a5b215ec004a8d9d707fa3d35b2c" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-20d1ed78-f2a1-4098-8095-02cc6b8870d4" -d '{"events": [{"name": "network-changed", "server_uuid": "9e64d320-821f-4313-8dd0-3b327ba75634", "tag": "3f7db100-6209-44d3-88c7-906fb1cec5cb"}]}' {{(pid=102993) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 23 19:44:24.770226 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Tue, 23 Nov 2021 19:44:24 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-28a94c08-c2ca-4ed4-b851-7ef7bbe310e2 x-openstack-request-id: req-28a94c08-c2ca-4ed4-b851-7ef7bbe310e2 {{(pid=102993) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 23 19:44:24.770532 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "9e64d320-821f-4313-8dd0-3b327ba75634", "tag": "3f7db100-6209-44d3-88c7-906fb1cec5cb", "status": "completed", "code": 200}]} {{(pid=102993) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 23 19:44:24.770795 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.62/compute/v2.1/os-server-external-events used request id req-28a94c08-c2ca-4ed4-b851-7ef7bbe310e2 {{(pid=102993) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 23 19:44:24.771207 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '9e64d320-821f-4313-8dd0-3b327ba75634', 'tag': '3f7db100-6209-44d3-88c7-906fb1cec5cb', 'status': 'completed', 'code': 200} Nov 23 19:44:24.828917 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.db.l3_dvr_db [None req-8b36c744-bd3f-45fe-8a1e-0b820d2f2e57 None None] Set router 0534bcc4-1e12-4026-90ce-1406543c7662 gateway port host: dv-cinder-819011-1-iscsi {{(pid=102994) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 23 19:44:24.841257 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-20d1ed78-f2a1-4098-8095-02cc6b8870d4 req-c8082fdb-4ea1-409b-ad78-56d8e92db3a2 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102993) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:44:24.842822 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-20d1ed78-f2a1-4098-8095-02cc6b8870d4 req-c8082fdb-4ea1-409b-ad78-56d8e92db3a2 service neutron] 10.222.0.41 "GET /v2.0/ports?tenant_id=257b0b2e531441b4bb745e99cfd799f3&device_id=9e64d320-821f-4313-8dd0-3b327ba75634 HTTP/1.1" status: 200 len: 1099 time: 0.0473735 Nov 23 19:44:24.949945 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-20d1ed78-f2a1-4098-8095-02cc6b8870d4 req-df9c676b-e4cd-4abb-8ac9-83e06f88208a service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102993) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:44:24.951717 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-20d1ed78-f2a1-4098-8095-02cc6b8870d4 req-df9c676b-e4cd-4abb-8ac9-83e06f88208a service neutron] 10.222.0.41 "GET /v2.0/networks?id=226a519f-5f3e-4d80-bb8a-0e9fc4f64828 HTTP/1.1" status: 200 len: 911 time: 0.0973063 Nov 23 19:44:24.998978 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-20d1ed78-f2a1-4098-8095-02cc6b8870d4 req-930c690f-0440-491d-b29b-a023db2a65ea service neutron] 10.222.0.41 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.13&port_id=3f7db100-6209-44d3-88c7-906fb1cec5cb HTTP/1.1" status: 200 len: 217 time: 0.0369296 Nov 23 19:44:25.039887 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.db.l3_hamode_db [None req-8b36c744-bd3f-45fe-8a1e-0b820d2f2e57 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '0534bcc4-1e12-4026-90ce-1406543c7662', 'name': 'tempest-TestVolumeBootPattern-84632531-router', 'tenant_id': '257b0b2e531441b4bb745e99cfd799f3', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'a93e254e-aac9-4233-9e4d-4290fd0458e4', 'external_fixed_ips': [{'subnet_id': 'e0b32f3d-83d6-439a-bbed-01df7cf01051', 'ip_address': '172.27.1.154'}], 'enable_snat': True}, 'gw_port_id': 'c7996293-6188-4690-b614-395448e4dc25', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-23T19:35:29Z', 'updated_at': '2021-11-23T19:35:33Z', 'revision_number': 4, 'project_id': '257b0b2e531441b4bb745e99cfd799f3', 'gw_port': {'id': 'c7996293-6188-4690-b614-395448e4dc25', 'name': '', 'network_id': 'a93e254e-aac9-4233-9e4d-4290fd0458e4', 'tenant_id': '', 'mac_address': 'fa:16:3e:52:67:5e', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '0534bcc4-1e12-4026-90ce-1406543c7662', 'device_owner': 'network:router_gateway', 'standard_attr_id': 392, 'fixed_ips': [{'subnet_id': 'e0b32f3d-83d6-439a-bbed-01df7cf01051', 'ip_address': '172.27.1.154', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-819011-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-23T19:35:30Z', 'updated_at': '2021-11-23T19:35:34Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'e0b32f3d-83d6-439a-bbed-01df7cf01051', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-819011-1-iscsi', '_interfaces': [{'id': '854821af-61e0-47e7-a603-95f500a49030', 'name': '', 'network_id': '226a519f-5f3e-4d80-bb8a-0e9fc4f64828', 'tenant_id': '257b0b2e531441b4bb745e99cfd799f3', 'mac_address': 'fa:16:3e:90:11:65', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '0534bcc4-1e12-4026-90ce-1406543c7662', 'device_owner': 'network:router_interface', 'standard_attr_id': 393, 'fixed_ips': [{'subnet_id': '88de785d-c540-4651-af1e-26f27ccaee3c', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-819011-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-23T19:35:32Z', 'updated_at': '2021-11-23T19:35:37Z', 'revision_number': 5, 'project_id': '257b0b2e531441b4bb745e99cfd799f3', 'subnets': [{'id': '88de785d-c540-4651-af1e-26f27ccaee3c', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-819011-1-iscsi', False) {} {{(pid=102994) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 23 19:44:25.060552 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-20d1ed78-f2a1-4098-8095-02cc6b8870d4 req-b1a6fbd8-5226-4cf3-9f8a-09b54c6501b8 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102993) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:44:25.062243 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-20d1ed78-f2a1-4098-8095-02cc6b8870d4 req-b1a6fbd8-5226-4cf3-9f8a-09b54c6501b8 service neutron] 10.222.0.41 "GET /v2.0/subnets?id=88de785d-c540-4651-af1e-26f27ccaee3c HTTP/1.1" status: 200 len: 849 time: 0.0546584 Nov 23 19:44:25.067824 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-8b36c744-bd3f-45fe-8a1e-0b820d2f2e57 None None] Checking router: 0534bcc4-1e12-4026-90ce-1406543c7662 for host: dv-cinder-819011-1-iscsi {{(pid=102994) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 23 19:44:25.076384 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.db.l3_dvrscheduler_db [None req-8b36c744-bd3f-45fe-8a1e-0b820d2f2e57 None None] Routers {'0534bcc4-1e12-4026-90ce-1406543c7662'} bound to L3 agent in host dv-cinder-819011-1-iscsi {{(pid=102994) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 23 19:44:25.076996 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.db.l3_hamode_db [None req-8b36c744-bd3f-45fe-8a1e-0b820d2f2e57 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-819011-1-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-23T19:25:14Z,description=,heartbeat_timestamp=2021-11-23T19:44:14Z,host='dv-cinder-819011-1-iscsi',id=1b20f2c4-70b6-43c3-b9bd-0062cc9e57ac,load=0,resource_versions=,resources_synced=,started_at=2021-11-23T19:25:15Z,topic='l3_agent')) {'router_ids': ['0534bcc4-1e12-4026-90ce-1406543c7662'], 'active': True} {{(pid=102994) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 23 19:44:25.121261 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0d95b997-feb5-491c-97db-c03b647b9e26 req-74ad156f-61a3-47eb-8c7c-28a643849c68 tempest-TestVolumeBootPattern-147141705 tempest-TestVolumeBootPattern-147141705-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102992) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:44:25.121922 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-20d1ed78-f2a1-4098-8095-02cc6b8870d4 req-d929c1cf-7f1a-4160-9641-9b1848099f47 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102993) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:44:25.122696 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-0d95b997-feb5-491c-97db-c03b647b9e26 req-74ad156f-61a3-47eb-8c7c-28a643849c68 tempest-TestVolumeBootPattern-147141705 tempest-TestVolumeBootPattern-147141705-project] 10.222.0.62 "GET /v2.0/ports?device_id=9e64d320-821f-4313-8dd0-3b327ba75634 HTTP/1.1" status: 200 len: 946 time: 0.0567775 Nov 23 19:44:25.126251 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-20d1ed78-f2a1-4098-8095-02cc6b8870d4 req-d929c1cf-7f1a-4160-9641-9b1848099f47 service neutron] 10.222.0.41 "GET /v2.0/ports?network_id=226a519f-5f3e-4d80-bb8a-0e9fc4f64828&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0519402 Nov 23 19:44:25.175427 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-0d95b997-feb5-491c-97db-c03b647b9e26 req-7fac8d11-faa6-41ce-900e-54bdb815d86a tempest-TestVolumeBootPattern-147141705 tempest-TestVolumeBootPattern-147141705-project] 10.222.0.62 "GET /v2.0/security-groups?id=a6e2b133-1a9b-4dde-a188-1ce8bcdb7b5c&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0466049 Nov 23 19:44:25.190822 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.db.l3_dvr_db [None req-8b36c744-bd3f-45fe-8a1e-0b820d2f2e57 None None] Set router 0534bcc4-1e12-4026-90ce-1406543c7662 gateway port host: dv-cinder-819011-1-iscsi {{(pid=102994) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 23 19:44:25.225987 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-20d1ed78-f2a1-4098-8095-02cc6b8870d4 req-6d26498d-06fd-46a7-b746-8504a7a46023 service neutron] 10.222.0.41 "GET /v2.0/networks/226a519f-5f3e-4d80-bb8a-0e9fc4f64828?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0872123 Nov 23 19:44:25.328014 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-20d1ed78-f2a1-4098-8095-02cc6b8870d4 req-95956754-f7ed-4102-a960-943d60da0e03 service neutron] 10.222.0.41 "GET /v2.0/networks/226a519f-5f3e-4d80-bb8a-0e9fc4f64828?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0934231 Nov 23 19:44:25.392432 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.db.l3_hamode_db [None req-8b36c744-bd3f-45fe-8a1e-0b820d2f2e57 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '0534bcc4-1e12-4026-90ce-1406543c7662', 'name': 'tempest-TestVolumeBootPattern-84632531-router', 'tenant_id': '257b0b2e531441b4bb745e99cfd799f3', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'a93e254e-aac9-4233-9e4d-4290fd0458e4', 'external_fixed_ips': [{'subnet_id': 'e0b32f3d-83d6-439a-bbed-01df7cf01051', 'ip_address': '172.27.1.154'}], 'enable_snat': True}, 'gw_port_id': 'c7996293-6188-4690-b614-395448e4dc25', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-23T19:35:29Z', 'updated_at': '2021-11-23T19:35:33Z', 'revision_number': 4, 'project_id': '257b0b2e531441b4bb745e99cfd799f3', 'gw_port': {'id': 'c7996293-6188-4690-b614-395448e4dc25', 'name': '', 'network_id': 'a93e254e-aac9-4233-9e4d-4290fd0458e4', 'tenant_id': '', 'mac_address': 'fa:16:3e:52:67:5e', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '0534bcc4-1e12-4026-90ce-1406543c7662', 'device_owner': 'network:router_gateway', 'standard_attr_id': 392, 'fixed_ips': [{'subnet_id': 'e0b32f3d-83d6-439a-bbed-01df7cf01051', 'ip_address': '172.27.1.154', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-819011-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-23T19:35:30Z', 'updated_at': '2021-11-23T19:35:34Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'e0b32f3d-83d6-439a-bbed-01df7cf01051', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-819011-1-iscsi', '_interfaces': [{'id': '854821af-61e0-47e7-a603-95f500a49030', 'name': '', 'network_id': '226a519f-5f3e-4d80-bb8a-0e9fc4f64828', 'tenant_id': '257b0b2e531441b4bb745e99cfd799f3', 'mac_address': 'fa:16:3e:90:11:65', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '0534bcc4-1e12-4026-90ce-1406543c7662', 'device_owner': 'network:router_interface', 'standard_attr_id': 393, 'fixed_ips': [{'subnet_id': '88de785d-c540-4651-af1e-26f27ccaee3c', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-819011-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-23T19:35:32Z', 'updated_at': '2021-11-23T19:35:37Z', 'revision_number': 5, 'project_id': '257b0b2e531441b4bb745e99cfd799f3', 'subnets': [{'id': '88de785d-c540-4651-af1e-26f27ccaee3c', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-819011-1-iscsi', False) {} {{(pid=102994) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 23 19:44:25.421847 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-8b36c744-bd3f-45fe-8a1e-0b820d2f2e57 None None] The sync data for ids ['0534bcc4-1e12-4026-90ce-1406543c7662'] in dv-cinder-819011-1-iscsi is: [{'id': '0534bcc4-1e12-4026-90ce-1406543c7662', 'name': 'tempest-TestVolumeBootPattern-84632531-router', 'tenant_id': '257b0b2e531441b4bb745e99cfd799f3', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'a93e254e-aac9-4233-9e4d-4290fd0458e4', 'external_fixed_ips': [{'subnet_id': 'e0b32f3d-83d6-439a-bbed-01df7cf01051', 'ip_address': '172.27.1.154'}], 'enable_snat': True}, 'gw_port_id': 'c7996293-6188-4690-b614-395448e4dc25', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-23T19:35:29Z', 'updated_at': '2021-11-23T19:35:33Z', 'revision_number': 4, 'project_id': '257b0b2e531441b4bb745e99cfd799f3', 'gw_port': {'id': 'c7996293-6188-4690-b614-395448e4dc25', 'name': '', 'network_id': 'a93e254e-aac9-4233-9e4d-4290fd0458e4', 'tenant_id': '', 'mac_address': 'fa:16:3e:52:67:5e', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '0534bcc4-1e12-4026-90ce-1406543c7662', 'device_owner': 'network:router_gateway', 'standard_attr_id': 392, 'fixed_ips': [{'subnet_id': 'e0b32f3d-83d6-439a-bbed-01df7cf01051', 'ip_address': '172.27.1.154', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-819011-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-23T19:35:30Z', 'updated_at': '2021-11-23T19:35:34Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'e0b32f3d-83d6-439a-bbed-01df7cf01051', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-819011-1-iscsi', '_interfaces': [{'id': '854821af-61e0-47e7-a603-95f500a49030', 'name': '', 'network_id': '226a519f-5f3e-4d80-bb8a-0e9fc4f64828', 'tenant_id': '257b0b2e531441b4bb745e99cfd799f3', 'mac_address': 'fa:16:3e:90:11:65', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '0534bcc4-1e12-4026-90ce-1406543c7662', 'device_owner': 'network:router_interface', 'standard_attr_id': 393, 'fixed_ips': [{'subnet_id': '88de785d-c540-4651-af1e-26f27ccaee3c', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-819011-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-23T19:35:32Z', 'updated_at': '2021-11-23T19:35:37Z', 'revision_number': 5, 'project_id': '257b0b2e531441b4bb745e99cfd799f3', 'subnets': [{'id': '88de785d-c540-4651-af1e-26f27ccaee3c', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=102994) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 23 19:44:25.628028 dv-cinder-819011-1-iscsi neutron-server[102995]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-6df71cbb-6575-4ae0-9d21-e22a0a4e5638 None None] New status for floating IP ea09a7d4-0775-4bc6-9310-f47e8ee059db: DOWN {{(pid=102995) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Nov 23 19:44:26.294321 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c40e6c12-5a77-49a1-8c49-ca75a454352d req-9f380d22-32c5-4591-8083-ee526391452e tempest-TestVolumeBootPattern-147141705 tempest-TestVolumeBootPattern-147141705-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102993) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:44:26.295798 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-c40e6c12-5a77-49a1-8c49-ca75a454352d req-9f380d22-32c5-4591-8083-ee526391452e tempest-TestVolumeBootPattern-147141705 tempest-TestVolumeBootPattern-147141705-project] 10.222.0.62 "GET /v2.0/ports?device_id=9e64d320-821f-4313-8dd0-3b327ba75634 HTTP/1.1" status: 200 len: 946 time: 0.0505154 Nov 23 19:44:26.347333 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-c40e6c12-5a77-49a1-8c49-ca75a454352d req-59a8ac99-4fdc-4784-a254-dd7038283443 tempest-TestVolumeBootPattern-147141705 tempest-TestVolumeBootPattern-147141705-project] 10.222.0.62 "GET /v2.0/security-groups?id=a6e2b133-1a9b-4dde-a188-1ce8bcdb7b5c&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0453200 Nov 23 19:44:26.978270 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6d706ac2-f748-41c4-9f72-e5c8d38f93e7 req-b446a475-4739-4b13-8fb6-c1cf5f36c393 tempest-TestVolumeBootPattern-147141705 tempest-TestVolumeBootPattern-147141705-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102993) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 23 19:44:26.979706 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-6d706ac2-f748-41c4-9f72-e5c8d38f93e7 req-b446a475-4739-4b13-8fb6-c1cf5f36c393 tempest-TestVolumeBootPattern-147141705 tempest-TestVolumeBootPattern-147141705-project] 10.222.0.41 "GET /v2.0/ports?device_id=9e64d320-821f-4313-8dd0-3b327ba75634 HTTP/1.1" status: 200 len: 946 time: 0.0522695 Nov 23 19:44:27.076801 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.plugins.ml2.plugin [req-6d706ac2-f748-41c4-9f72-e5c8d38f93e7 req-e6eb984b-b3f2-4e7b-ac45-ca553d47373d tempest-TestVolumeBootPattern-147141705 tempest-TestVolumeBootPattern-147141705-project] Deleting port 3f7db100-6209-44d3-88c7-906fb1cec5cb {{(pid=102993) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 23 19:44:27.077141 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [req-6d706ac2-f748-41c4-9f72-e5c8d38f93e7 req-e6eb984b-b3f2-4e7b-ac45-ca553d47373d tempest-TestVolumeBootPattern-147141705 tempest-TestVolumeBootPattern-147141705-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8783631423070'] for port, before_delete {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:44:27.166844 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.plugins.ml2.db [req-6d706ac2-f748-41c4-9f72-e5c8d38f93e7 req-e6eb984b-b3f2-4e7b-ac45-ca553d47373d tempest-TestVolumeBootPattern-147141705 tempest-TestVolumeBootPattern-147141705-project] For port 3f7db100-6209-44d3-88c7-906fb1cec5cb, host hv-cinder-81901, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81901',level=0,port_id=3f7db100-6209-44d3-88c7-906fb1cec5cb,segment=NetworkSegment(56316385-5b81-43f5-84db-b708b46f04eb),segment_id=56316385-5b81-43f5-84db-b708b46f04eb)] {{(pid=102993) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 23 19:44:27.167135 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [req-6d706ac2-f748-41c4-9f72-e5c8d38f93e7 req-e6eb984b-b3f2-4e7b-ac45-ca553d47373d tempest-TestVolumeBootPattern-147141705 tempest-TestVolumeBootPattern-147141705-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-927332'] for port, precommit_delete {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:44:27.179536 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.plugins.ml2.plugin [req-6d706ac2-f748-41c4-9f72-e5c8d38f93e7 req-e6eb984b-b3f2-4e7b-ac45-ca553d47373d tempest-TestVolumeBootPattern-147141705 tempest-TestVolumeBootPattern-147141705-project] Calling delete_port for 3f7db100-6209-44d3-88c7-906fb1cec5cb owned by compute:nova {{(pid=102993) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 23 19:44:27.419308 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [req-6d706ac2-f748-41c4-9f72-e5c8d38f93e7 req-e6eb984b-b3f2-4e7b-ac45-ca553d47373d tempest-TestVolumeBootPattern-147141705 tempest-TestVolumeBootPattern-147141705-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7918660', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-15067', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560168', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8783631424624', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8783631008723', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-17257496'] for port, after_delete {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:44:27.443258 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-5c05f623-174b-4d06-9aac-39e277bed2ca req-837b5b9b-9e1d-4536-a179-3c7c02f068a4 tempest-TestVolumeBootPattern-147141705 tempest-TestVolumeBootPattern-147141705-project] 10.222.0.62 "GET /v2.0/ports?device_id=9e64d320-821f-4313-8dd0-3b327ba75634 HTTP/1.1" status: 200 len: 210 time: 0.0272191 Nov 23 19:44:27.451025 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e6eb984b-b3f2-4e7b-ac45-ca553d47373d tempest-TestVolumeBootPattern-147141705 tempest-TestVolumeBootPattern-147141705-project] Pushing event deleted for resources: {'Port': ['ID=3f7db100-6209-44d3-88c7-906fb1cec5cb,revision_number=None']} {{(pid=102993) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 23 19:44:27.499562 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.db.l3_dvrscheduler_db [req-6d706ac2-f748-41c4-9f72-e5c8d38f93e7 req-e6eb984b-b3f2-4e7b-ac45-ca553d47373d tempest-TestVolumeBootPattern-147141705 tempest-TestVolumeBootPattern-147141705-project] No DVR routers for this DVR port 3f7db100-6209-44d3-88c7-906fb1cec5cb on host hv-cinder-81901 {{(pid=102993) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 23 19:44:27.502463 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [req-6d706ac2-f748-41c4-9f72-e5c8d38f93e7 req-e6eb984b-b3f2-4e7b-ac45-ca553d47373d tempest-TestVolumeBootPattern-147141705 tempest-TestVolumeBootPattern-147141705-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-514902'] for port, before_response {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:44:27.505856 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [req-6d706ac2-f748-41c4-9f72-e5c8d38f93e7 req-e6eb984b-b3f2-4e7b-ac45-ca553d47373d tempest-TestVolumeBootPattern-147141705 tempest-TestVolumeBootPattern-147141705-project] 10.222.0.41 "DELETE /v2.0/ports/3f7db100-6209-44d3-88c7-906fb1cec5cb HTTP/1.1" status: 204 len: 173 time: 0.5181422 Nov 23 19:44:27.506292 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '9e64d320-821f-4313-8dd0-3b327ba75634', 'name': 'network-vif-deleted', 'tag': '3f7db100-6209-44d3-88c7-906fb1cec5cb'}] {{(pid=102993) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 23 19:44:27.508500 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.62/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}9b10b92acbee16fb695be1efeed0b68f7c36a5b215ec004a8d9d707fa3d35b2c" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-60c329d8-5bb1-4268-8da7-a0b26cb31666" -d '{"events": [{"server_uuid": "9e64d320-821f-4313-8dd0-3b327ba75634", "name": "network-vif-deleted", "tag": "3f7db100-6209-44d3-88c7-906fb1cec5cb"}]}' {{(pid=102993) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 23 19:44:27.544674 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 23 Nov 2021 19:44:27 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-a47ea81d-4f3c-4dca-82d4-b5d489e49221 x-openstack-request-id: req-a47ea81d-4f3c-4dca-82d4-b5d489e49221 {{(pid=102993) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 23 19:44:27.544975 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "9e64d320-821f-4313-8dd0-3b327ba75634", "name": "network-vif-deleted", "tag": "3f7db100-6209-44d3-88c7-906fb1cec5cb", "status": "completed", "code": 200}]} {{(pid=102993) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 23 19:44:27.545241 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.62/compute/v2.1/os-server-external-events used request id req-a47ea81d-4f3c-4dca-82d4-b5d489e49221 {{(pid=102993) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 23 19:44:27.545677 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '9e64d320-821f-4313-8dd0-3b327ba75634', 'name': 'network-vif-deleted', 'tag': '3f7db100-6209-44d3-88c7-906fb1cec5cb', 'status': 'completed', 'code': 200} Nov 23 19:44:28.479534 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.wsgi [-] (102993) accepted ('10.222.0.62', 52334) {{(pid=102993) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 23 19:44:28.558386 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [req-c27f70a3-0f8a-4375-83c4-882002cbae6b req-741b4d16-538e-4e1e-9e13-18bbeeb519d0 tempest-TestVolumeBootPattern-147141705 tempest-TestVolumeBootPattern-147141705-project] 10.222.0.62 "GET /v2.0/ports?device_id=9e64d320-821f-4313-8dd0-3b327ba75634 HTTP/1.1" status: 200 len: 210 time: 0.0297842 Nov 23 19:44:28.595791 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-b2791822-35ca-4584-b720-c470357ddb82 admin admin] Publish callbacks [] for security_group, before_create {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:44:28.686024 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-b2791822-35ca-4584-b720-c470357ddb82 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:44:28.761963 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-b2791822-35ca-4584-b720-c470357ddb82 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-623933'] for security_group, after_create {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:44:28.809169 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [None req-b2791822-35ca-4584-b720-c470357ddb82 admin admin] 10.222.0.62 "GET /v2.0/security-groups?tenant_id=3a244fb973624e6d88a80ea7d497d8e9&name=default HTTP/1.1" status: 200 len: 2996 time: 0.3259473 Nov 23 19:44:28.810001 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.wsgi [-] (102993) accepted ('10.222.0.62', 52346) {{(pid=102993) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 23 19:44:28.817484 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b2791822-35ca-4584-b720-c470357ddb82 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=2ba23ede-208c-4dd7-88b0-cc17047145fe,revision_number=1']} {{(pid=102993) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 23 19:44:28.862230 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-a2509cf0-4d0d-46eb-ac62-a57e65d47a9b admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:44:28.888721 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-a2509cf0-4d0d-46eb-ac62-a57e65d47a9b admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:44:29.019625 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-a2509cf0-4d0d-46eb-ac62-a57e65d47a9b admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-623933'] for security_group, after_delete {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:44:29.022245 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-a2509cf0-4d0d-46eb-ac62-a57e65d47a9b admin admin] Publish callbacks [] for security_group, before_response {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:44:29.023395 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [None req-a2509cf0-4d0d-46eb-ac62-a57e65d47a9b admin admin] 10.222.0.62 "DELETE /v2.0/security-groups/2ba23ede-208c-4dd7-88b0-cc17047145fe HTTP/1.1" status: 204 len: 168 time: 0.2120709 Nov 23 19:44:29.031748 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a2509cf0-4d0d-46eb-ac62-a57e65d47a9b admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=2ba23ede-208c-4dd7-88b0-cc17047145fe,revision_number=None']} {{(pid=102993) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 23 19:44:29.625035 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.wsgi [-] (102993) accepted ('10.222.0.62', 52366) {{(pid=102993) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 23 19:44:29.749658 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.plugins.ml2.plugin [None req-f5ac845f-a01f-4a13-9a5b-5fb0b4dcc244 tempest-TestVolumeBootPattern-147141705 tempest-TestVolumeBootPattern-147141705-project] Deleting port 8015e531-c494-43e3-ba77-89dce1e50d86 {{(pid=102993) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 23 19:44:29.749990 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-f5ac845f-a01f-4a13-9a5b-5fb0b4dcc244 tempest-TestVolumeBootPattern-147141705 tempest-TestVolumeBootPattern-147141705-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8783631423070'] for port, before_delete {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:44:29.832337 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-f5ac845f-a01f-4a13-9a5b-5fb0b4dcc244 tempest-TestVolumeBootPattern-147141705 tempest-TestVolumeBootPattern-147141705-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-927332'] for port, precommit_delete {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:44:29.832734 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-f5ac845f-a01f-4a13-9a5b-5fb0b4dcc244 tempest-TestVolumeBootPattern-147141705 tempest-TestVolumeBootPattern-147141705-project] Publish callbacks [] for floatingip, precommit_delete {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:44:29.847004 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.plugins.ml2.plugin [None req-f5ac845f-a01f-4a13-9a5b-5fb0b4dcc244 tempest-TestVolumeBootPattern-147141705 tempest-TestVolumeBootPattern-147141705-project] Calling delete_port for 8015e531-c494-43e3-ba77-89dce1e50d86 owned by network:floatingip {{(pid=102993) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 23 19:44:29.859082 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron_lib.callbacks.manager [None req-4bf48ff4-ecfb-4168-8b63-249b8c6e9f04 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8783631323329', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7978582'] for agent, after_update {{(pid=102994) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:44:30.059499 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-f5ac845f-a01f-4a13-9a5b-5fb0b4dcc244 tempest-TestVolumeBootPattern-147141705 tempest-TestVolumeBootPattern-147141705-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7918660', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-15067', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560168', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8783631424624', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8783631008723', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-17257496'] for port, after_delete {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:44:30.090009 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f5ac845f-a01f-4a13-9a5b-5fb0b4dcc244 tempest-TestVolumeBootPattern-147141705 tempest-TestVolumeBootPattern-147141705-project] Pushing event deleted for resources: {'Port': ['ID=8015e531-c494-43e3-ba77-89dce1e50d86,revision_number=None']} {{(pid=102993) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 23 19:44:30.152675 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-f5ac845f-a01f-4a13-9a5b-5fb0b4dcc244 tempest-TestVolumeBootPattern-147141705 tempest-TestVolumeBootPattern-147141705-project] Publish callbacks [] for floatingip, after_delete {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:44:30.155453 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-f5ac845f-a01f-4a13-9a5b-5fb0b4dcc244 tempest-TestVolumeBootPattern-147141705 tempest-TestVolumeBootPattern-147141705-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-514902'] for floatingip, before_response {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:44:30.159802 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [None req-f5ac845f-a01f-4a13-9a5b-5fb0b4dcc244 tempest-TestVolumeBootPattern-147141705 tempest-TestVolumeBootPattern-147141705-project] 10.222.0.62 "DELETE /v2.0/floatingips/58aefccd-9c9d-4966-bba8-80772da95277 HTTP/1.1" status: 204 len: 168 time: 0.5304215 Nov 23 19:44:30.654454 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.plugins.ml2.rpc [None req-4bf48ff4-ecfb-4168-8b63-249b8c6e9f04 None None] Device 3f7db100-6209-44d3-88c7-906fb1cec5cb no longer exists at agent hyperv_hv-cinder-81901 {{(pid=102994) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 23 19:44:30.675754 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.plugins.ml2.plugin [None req-4bf48ff4-ecfb-4168-8b63-249b8c6e9f04 None None] No Port match for: 3f7db100-6209-44d3-88c7-906fb1cec5cb {{(pid=102994) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 23 19:44:30.676108 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.plugins.ml2.rpc [None req-4bf48ff4-ecfb-4168-8b63-249b8c6e9f04 None None] Device 3f7db100-6209-44d3-88c7-906fb1cec5cb not bound to the agent host hv-cinder-81901 {{(pid=102994) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 23 19:44:31.573898 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.wsgi [-] (102993) accepted ('10.222.0.62', 52402) {{(pid=102993) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 23 19:44:31.631322 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-aa8327c6-2cf4-480a-bfda-8c6dd41447a6 tempest-TestVolumeBootPattern-147141705 tempest-TestVolumeBootPattern-147141705-project] Publish callbacks [] for security_group, before_delete {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:44:31.656497 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-aa8327c6-2cf4-480a-bfda-8c6dd41447a6 tempest-TestVolumeBootPattern-147141705 tempest-TestVolumeBootPattern-147141705-project] Publish callbacks [] for security_group, precommit_delete {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:44:31.766964 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-aa8327c6-2cf4-480a-bfda-8c6dd41447a6 tempest-TestVolumeBootPattern-147141705 tempest-TestVolumeBootPattern-147141705-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-623933'] for security_group, after_delete {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:44:31.769749 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-aa8327c6-2cf4-480a-bfda-8c6dd41447a6 tempest-TestVolumeBootPattern-147141705 tempest-TestVolumeBootPattern-147141705-project] Publish callbacks [] for security_group, before_response {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:44:31.771003 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [None req-aa8327c6-2cf4-480a-bfda-8c6dd41447a6 tempest-TestVolumeBootPattern-147141705 tempest-TestVolumeBootPattern-147141705-project] 10.222.0.62 "DELETE /v2.0/security-groups/a6e2b133-1a9b-4dde-a188-1ce8bcdb7b5c HTTP/1.1" status: 204 len: 168 time: 0.1960933 Nov 23 19:44:31.783182 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-aa8327c6-2cf4-480a-bfda-8c6dd41447a6 tempest-TestVolumeBootPattern-147141705 tempest-TestVolumeBootPattern-147141705-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=a6e2b133-1a9b-4dde-a188-1ce8bcdb7b5c,revision_number=None']} {{(pid=102993) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 23 19:44:31.912737 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.wsgi [-] (102993) accepted ('10.222.0.62', 52414) {{(pid=102993) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 23 19:44:32.416838 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-56b0cafc-f433-4bd5-a44f-4a736061653a admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-932931'] for router_interface, before_delete {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:44:32.942818 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.plugins.ml2.plugin [None req-56b0cafc-f433-4bd5-a44f-4a736061653a admin admin] Deleting port 854821af-61e0-47e7-a603-95f500a49030 {{(pid=102993) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 23 19:44:32.943490 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-56b0cafc-f433-4bd5-a44f-4a736061653a admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8783631423070'] for port, before_delete {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:44:33.020914 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.plugins.ml2.db [None req-56b0cafc-f433-4bd5-a44f-4a736061653a admin admin] For port 854821af-61e0-47e7-a603-95f500a49030, host dv-cinder-819011-1-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-819011-1-iscsi',level=0,port_id=854821af-61e0-47e7-a603-95f500a49030,segment=NetworkSegment(56316385-5b81-43f5-84db-b708b46f04eb),segment_id=56316385-5b81-43f5-84db-b708b46f04eb)] {{(pid=102993) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 23 19:44:33.021214 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-56b0cafc-f433-4bd5-a44f-4a736061653a admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-927332'] for port, precommit_delete {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:44:33.033247 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.plugins.ml2.plugin [None req-56b0cafc-f433-4bd5-a44f-4a736061653a admin admin] Calling delete_port for 854821af-61e0-47e7-a603-95f500a49030 owned by network:router_interface {{(pid=102993) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 23 19:44:33.281693 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-56b0cafc-f433-4bd5-a44f-4a736061653a admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7918660', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-15067', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560168', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8783631424624', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8783631008723', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-17257496'] for port, after_delete {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:44:33.311544 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-56b0cafc-f433-4bd5-a44f-4a736061653a admin admin] Pushing event deleted for resources: {'Port': ['ID=854821af-61e0-47e7-a603-95f500a49030,revision_number=None']} {{(pid=102993) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 23 19:44:33.488988 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-56b0cafc-f433-4bd5-a44f-4a736061653a admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-560161', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-933087'] for router_interface, after_delete {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:44:33.632491 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.wsgi [-] (102992) accepted ('10.222.0.62', 52436) {{(pid=102992) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 23 19:44:33.711437 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-56b0cafc-f433-4bd5-a44f-4a736061653a admin admin] Router 0534bcc4-1e12-4026-90ce-1406543c7662 has already been hosted by L3 agent 1b20f2c4-70b6-43c3-b9bd-0062cc9e57ac {{(pid=102993) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 23 19:44:33.740298 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [None req-f563b0c0-f6fc-486a-a170-734b3e5fd7cc admin admin] Publish callbacks [] for security_group, before_create {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:44:33.818155 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [None req-f563b0c0-f6fc-486a-a170-734b3e5fd7cc admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:44:33.823809 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-56b0cafc-f433-4bd5-a44f-4a736061653a admin admin] Notify agent at l3_agent.dv-cinder-819011-1-iscsi the message routers_updated {{(pid=102993) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 23 19:44:33.830043 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [None req-56b0cafc-f433-4bd5-a44f-4a736061653a admin admin] 10.222.0.62 "PUT /v2.0/routers/0534bcc4-1e12-4026-90ce-1406543c7662/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 1.9160907 Nov 23 19:44:33.832896 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.wsgi [-] (102993) accepted ('10.222.0.62', 52440) {{(pid=102993) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 23 19:44:33.835515 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-d65d24ba-5448-4740-b87b-aaa6e11748fa None None] Sync routers for ids ['0534bcc4-1e12-4026-90ce-1406543c7662'] in dv-cinder-819011-1-iscsi {{(pid=102994) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 23 19:44:33.846055 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.db.l3_dvrscheduler_db [None req-d65d24ba-5448-4740-b87b-aaa6e11748fa None None] Routers {'0534bcc4-1e12-4026-90ce-1406543c7662'} bound to L3 agent in host dv-cinder-819011-1-iscsi {{(pid=102994) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 23 19:44:33.847207 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.db.l3_hamode_db [None req-d65d24ba-5448-4740-b87b-aaa6e11748fa None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-819011-1-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-23T19:25:14Z,description=,heartbeat_timestamp=2021-11-23T19:44:14Z,host='dv-cinder-819011-1-iscsi',id=1b20f2c4-70b6-43c3-b9bd-0062cc9e57ac,load=0,resource_versions=,resources_synced=,started_at=2021-11-23T19:25:15Z,topic='l3_agent')) {'router_ids': ['0534bcc4-1e12-4026-90ce-1406543c7662'], 'active': True} {{(pid=102994) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 23 19:44:33.887562 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [None req-f563b0c0-f6fc-486a-a170-734b3e5fd7cc admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-623933'] for security_group, after_create {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:44:33.928239 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f563b0c0-f6fc-486a-a170-734b3e5fd7cc admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=e0f92e6e-195c-441a-a1fa-7cf65f720577,revision_number=1']} {{(pid=102992) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 23 19:44:33.932740 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [None req-f563b0c0-f6fc-486a-a170-734b3e5fd7cc admin admin] 10.222.0.62 "GET /v2.0/security-groups?tenant_id=1f3bd29020594feab39f27e8cd84faf9&name=default HTTP/1.1" status: 200 len: 2996 time: 0.2991786 Nov 23 19:44:33.935957 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.wsgi [-] (102992) accepted ('10.222.0.62', 52442) {{(pid=102992) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 23 19:44:33.948415 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-464665ba-5084-45d0-a537-59b8401c867c admin admin] Publish callbacks [] for router, before_delete {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:44:33.957396 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.db.l3_dvr_db [None req-d65d24ba-5448-4740-b87b-aaa6e11748fa None None] Set router 0534bcc4-1e12-4026-90ce-1406543c7662 gateway port host: dv-cinder-819011-1-iscsi {{(pid=102994) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 23 19:44:33.985592 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [None req-2afccdd9-8097-4502-b9e2-a1cd354d35be admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:44:34.006987 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [None req-2afccdd9-8097-4502-b9e2-a1cd354d35be admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:44:34.052015 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-464665ba-5084-45d0-a537-59b8401c867c admin admin] Publish callbacks [] for router_gateway, before_delete {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:44:34.115925 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [None req-2afccdd9-8097-4502-b9e2-a1cd354d35be admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-623933'] for security_group, after_delete {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:44:34.118576 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [None req-2afccdd9-8097-4502-b9e2-a1cd354d35be admin admin] Publish callbacks [] for security_group, before_response {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:44:34.119743 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [None req-2afccdd9-8097-4502-b9e2-a1cd354d35be admin admin] 10.222.0.62 "DELETE /v2.0/security-groups/e0f92e6e-195c-441a-a1fa-7cf65f720577 HTTP/1.1" status: 204 len: 168 time: 0.1827109 Nov 23 19:44:34.128791 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2afccdd9-8097-4502-b9e2-a1cd354d35be admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=e0f92e6e-195c-441a-a1fa-7cf65f720577,revision_number=None']} {{(pid=102992) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 23 19:44:34.156865 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.db.l3_hamode_db [None req-d65d24ba-5448-4740-b87b-aaa6e11748fa None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '0534bcc4-1e12-4026-90ce-1406543c7662', 'name': 'tempest-TestVolumeBootPattern-84632531-router', 'tenant_id': '257b0b2e531441b4bb745e99cfd799f3', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'a93e254e-aac9-4233-9e4d-4290fd0458e4', 'external_fixed_ips': [{'subnet_id': 'e0b32f3d-83d6-439a-bbed-01df7cf01051', 'ip_address': '172.27.1.154'}], 'enable_snat': True}, 'gw_port_id': 'c7996293-6188-4690-b614-395448e4dc25', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-23T19:35:29Z', 'updated_at': '2021-11-23T19:44:33Z', 'revision_number': 5, 'project_id': '257b0b2e531441b4bb745e99cfd799f3', 'gw_port': {'id': 'c7996293-6188-4690-b614-395448e4dc25', 'name': '', 'network_id': 'a93e254e-aac9-4233-9e4d-4290fd0458e4', 'tenant_id': '', 'mac_address': 'fa:16:3e:52:67:5e', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '0534bcc4-1e12-4026-90ce-1406543c7662', 'device_owner': 'network:router_gateway', 'standard_attr_id': 392, 'fixed_ips': [{'subnet_id': 'e0b32f3d-83d6-439a-bbed-01df7cf01051', 'ip_address': '172.27.1.154', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-819011-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-23T19:35:30Z', 'updated_at': '2021-11-23T19:35:34Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'e0b32f3d-83d6-439a-bbed-01df7cf01051', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-819011-1-iscsi'}], 'dv-cinder-819011-1-iscsi', False) {} {{(pid=102994) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 23 19:44:34.185524 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-d65d24ba-5448-4740-b87b-aaa6e11748fa None None] Checking router: 0534bcc4-1e12-4026-90ce-1406543c7662 for host: dv-cinder-819011-1-iscsi {{(pid=102994) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 23 19:44:34.188126 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.plugins.ml2.plugin [None req-464665ba-5084-45d0-a537-59b8401c867c admin admin] Deleting port c7996293-6188-4690-b614-395448e4dc25 {{(pid=102993) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 23 19:44:34.188525 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-464665ba-5084-45d0-a537-59b8401c867c admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8783631423070'] for port, before_delete {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:44:34.194620 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.db.l3_dvrscheduler_db [None req-d65d24ba-5448-4740-b87b-aaa6e11748fa None None] Routers {'0534bcc4-1e12-4026-90ce-1406543c7662'} bound to L3 agent in host dv-cinder-819011-1-iscsi {{(pid=102994) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 23 19:44:34.195234 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.db.l3_hamode_db [None req-d65d24ba-5448-4740-b87b-aaa6e11748fa None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-819011-1-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-23T19:25:14Z,description=,heartbeat_timestamp=2021-11-23T19:44:14Z,host='dv-cinder-819011-1-iscsi',id=1b20f2c4-70b6-43c3-b9bd-0062cc9e57ac,load=0,resource_versions=,resources_synced=,started_at=2021-11-23T19:25:15Z,topic='l3_agent')) {'router_ids': ['0534bcc4-1e12-4026-90ce-1406543c7662'], 'active': True} {{(pid=102994) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 23 19:44:34.278266 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.plugins.ml2.db [None req-464665ba-5084-45d0-a537-59b8401c867c admin admin] For port c7996293-6188-4690-b614-395448e4dc25, host dv-cinder-819011-1-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-819011-1-iscsi',level=0,port_id=c7996293-6188-4690-b614-395448e4dc25,segment=NetworkSegment(3cb5e60b-103a-47d0-a28b-d68e3159d032),segment_id=3cb5e60b-103a-47d0-a28b-d68e3159d032)] {{(pid=102993) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 23 19:44:34.278846 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-464665ba-5084-45d0-a537-59b8401c867c admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-927332'] for port, precommit_delete {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:44:34.286112 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.db.l3_dvr_db [None req-d65d24ba-5448-4740-b87b-aaa6e11748fa None None] Set router 0534bcc4-1e12-4026-90ce-1406543c7662 gateway port host: None {{(pid=102994) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 23 19:44:34.295177 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.plugins.ml2.plugin [None req-464665ba-5084-45d0-a537-59b8401c867c admin admin] Calling delete_port for c7996293-6188-4690-b614-395448e4dc25 owned by network:router_gateway {{(pid=102993) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 23 19:44:34.342073 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.db.l3_hamode_db [None req-d65d24ba-5448-4740-b87b-aaa6e11748fa None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '0534bcc4-1e12-4026-90ce-1406543c7662', 'name': 'tempest-TestVolumeBootPattern-84632531-router', 'tenant_id': '257b0b2e531441b4bb745e99cfd799f3', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-23T19:35:29Z', 'updated_at': '2021-11-23T19:44:34Z', 'revision_number': 6, 'project_id': '257b0b2e531441b4bb745e99cfd799f3', 'gw_port_host': None}], 'dv-cinder-819011-1-iscsi', False) {} {{(pid=102994) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 23 19:44:34.368460 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-d65d24ba-5448-4740-b87b-aaa6e11748fa None None] The sync data for ids ['0534bcc4-1e12-4026-90ce-1406543c7662'] in dv-cinder-819011-1-iscsi is: [{'id': '0534bcc4-1e12-4026-90ce-1406543c7662', 'name': 'tempest-TestVolumeBootPattern-84632531-router', 'tenant_id': '257b0b2e531441b4bb745e99cfd799f3', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-23T19:35:29Z', 'updated_at': '2021-11-23T19:44:34Z', 'revision_number': 6, 'project_id': '257b0b2e531441b4bb745e99cfd799f3', 'gw_port_host': None}] {{(pid=102994) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 23 19:44:34.550251 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-464665ba-5084-45d0-a537-59b8401c867c admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7918660', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-15067', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560168', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8783631424624', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8783631008723', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-17257496'] for port, after_delete {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:44:34.585732 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-464665ba-5084-45d0-a537-59b8401c867c admin admin] Pushing event deleted for resources: {'Port': ['ID=c7996293-6188-4690-b614-395448e4dc25,revision_number=None']} {{(pid=102993) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 23 19:44:34.642116 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-464665ba-5084-45d0-a537-59b8401c867c admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-926585'] for router_gateway, after_delete {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:44:34.734053 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-464665ba-5084-45d0-a537-59b8401c867c admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-932919', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-13457'] for router, precommit_delete {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:44:34.736634 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-464665ba-5084-45d0-a537-59b8401c867c admin admin] Publish callbacks [] for router_controller, precommit_delete_associations {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:44:34.859029 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-464665ba-5084-45d0-a537-59b8401c867c admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-926715'] for router, after_delete {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:44:34.859570 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-464665ba-5084-45d0-a537-59b8401c867c admin admin] Fanout notify agent at l3_agent the message router_deleted on router 0534bcc4-1e12-4026-90ce-1406543c7662 {{(pid=102993) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Nov 23 19:44:34.864831 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-464665ba-5084-45d0-a537-59b8401c867c admin admin] Publish callbacks [] for router, before_response {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:44:34.868852 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [None req-464665ba-5084-45d0-a537-59b8401c867c admin admin] 10.222.0.62 "DELETE /v2.0/routers/0534bcc4-1e12-4026-90ce-1406543c7662 HTTP/1.1" status: 204 len: 168 time: 1.0279951 Nov 23 19:44:34.868852 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.wsgi [-] (102993) accepted ('10.222.0.62', 52464) {{(pid=102993) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 23 19:44:34.907528 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.wsgi [-] (102993) accepted ('10.222.0.62', 52468) {{(pid=102993) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 23 19:44:34.926349 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.db.db_base_plugin_v2 [None req-575b407c-c2f5-44be-9cc2-81335aeb019d admin admin] Deleting subnet 88de785d-c540-4651-af1e-26f27ccaee3c {{(pid=102993) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Nov 23 19:44:34.929758 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-575b407c-c2f5-44be-9cc2-81335aeb019d admin admin] Publish callbacks [] for subnet, before_delete {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:44:34.967479 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-575b407c-c2f5-44be-9cc2-81335aeb019d admin admin] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-16914634'] for subnet, precommit_delete_associations {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:44:35.039947 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-d9c7ee0e-44b6-4105-9ccb-ce1cc8de9f7b admin admin] Publish callbacks [] for security_group, before_create {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:44:35.070603 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-575b407c-c2f5-44be-9cc2-81335aeb019d admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-7975863'] for subnet, precommit_delete {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:44:35.174029 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-d9c7ee0e-44b6-4105-9ccb-ce1cc8de9f7b admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:44:35.225174 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-575b407c-c2f5-44be-9cc2-81335aeb019d admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-7982148', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-554858', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560168', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-17257579', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-17772973'] for subnet, after_delete {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:44:35.254723 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-575b407c-c2f5-44be-9cc2-81335aeb019d admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-560186'] for subnet, before_response {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:44:35.259648 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [None req-575b407c-c2f5-44be-9cc2-81335aeb019d admin admin] 10.222.0.62 "DELETE /v2.0/subnets/88de785d-c540-4651-af1e-26f27ccaee3c HTTP/1.1" status: 204 len: 168 time: 0.3898547 Nov 23 19:44:35.260713 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-55666e3e-bae4-4f72-a2b4-d5b944c62249 None None] Network 226a519f-5f3e-4d80-bb8a-0e9fc4f64828 requested from dv-cinder-819011-1-iscsi {{(pid=102994) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 23 19:44:35.261161 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-575b407c-c2f5-44be-9cc2-81335aeb019d admin admin] Pushing event deleted for resources: {'Subnet': ['ID=88de785d-c540-4651-af1e-26f27ccaee3c,revision_number=None']} {{(pid=102993) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 23 19:44:35.263427 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.wsgi [-] (102992) accepted ('10.222.0.62', 52482) {{(pid=102992) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 23 19:44:35.263844 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-d9c7ee0e-44b6-4105-9ccb-ce1cc8de9f7b admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-623933'] for security_group, after_create {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:44:35.306926 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [None req-d9c7ee0e-44b6-4105-9ccb-ce1cc8de9f7b admin admin] 10.222.0.62 "GET /v2.0/security-groups?tenant_id=49db545fc0964ddba65674a055afb097&name=default HTTP/1.1" status: 200 len: 2996 time: 0.3959110 Nov 23 19:44:35.306926 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d9c7ee0e-44b6-4105-9ccb-ce1cc8de9f7b admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=07e3a515-c62e-4d6c-a985-95044756f240,revision_number=1']} {{(pid=102993) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 23 19:44:35.309352 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.wsgi [-] (102992) accepted ('10.222.0.62', 52484) {{(pid=102992) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 23 19:44:35.411880 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [None req-9fc4fb1c-1d01-4234-b701-706e48991bf9 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-8133038'] for network, before_delete {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:44:35.485856 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [None req-c9bbfeb8-722a-4a57-b41d-47c189281a3b admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:44:35.522567 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [None req-c9bbfeb8-722a-4a57-b41d-47c189281a3b admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:44:35.532550 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-5b9a4a28-7353-4f72-af80-6cda6fb3a77f None None] DHCP port deletion for 226a519f-5f3e-4d80-bb8a-0e9fc4f64828 request from dv-cinder-819011-1-iscsi {{(pid=102994) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:266}} Nov 23 19:44:35.545432 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.plugins.ml2.plugin [None req-9fc4fb1c-1d01-4234-b701-706e48991bf9 admin admin] Deleting port 1e712a26-63c0-453b-8510-11be3fce9e06 {{(pid=102992) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 23 19:44:35.545773 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [None req-9fc4fb1c-1d01-4234-b701-706e48991bf9 admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8783631423070'] for port, before_delete {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:44:35.591385 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.plugins.ml2.plugin [None req-5b9a4a28-7353-4f72-af80-6cda6fb3a77f None None] Deleting port 1e712a26-63c0-453b-8510-11be3fce9e06 {{(pid=102994) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 23 19:44:35.591764 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron_lib.callbacks.manager [None req-5b9a4a28-7353-4f72-af80-6cda6fb3a77f None None] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8783631423070'] for port, before_delete {{(pid=102994) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:44:35.634160 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.plugins.ml2.db [None req-9fc4fb1c-1d01-4234-b701-706e48991bf9 admin admin] For port 1e712a26-63c0-453b-8510-11be3fce9e06, host dv-cinder-819011-1-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-819011-1-iscsi',level=0,port_id=1e712a26-63c0-453b-8510-11be3fce9e06,segment=NetworkSegment(56316385-5b81-43f5-84db-b708b46f04eb),segment_id=56316385-5b81-43f5-84db-b708b46f04eb)] {{(pid=102992) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 23 19:44:35.634663 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [None req-9fc4fb1c-1d01-4234-b701-706e48991bf9 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-927332'] for port, precommit_delete {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:44:35.653688 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.plugins.ml2.plugin [None req-9fc4fb1c-1d01-4234-b701-706e48991bf9 admin admin] Calling delete_port for 1e712a26-63c0-453b-8510-11be3fce9e06 owned by network:dhcp {{(pid=102992) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 23 19:44:35.657818 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.plugins.ml2.db [None req-5b9a4a28-7353-4f72-af80-6cda6fb3a77f None None] For port 1e712a26-63c0-453b-8510-11be3fce9e06, host dv-cinder-819011-1-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-819011-1-iscsi',level=0,port_id=1e712a26-63c0-453b-8510-11be3fce9e06,segment=NetworkSegment(56316385-5b81-43f5-84db-b708b46f04eb),segment_id=56316385-5b81-43f5-84db-b708b46f04eb)] {{(pid=102994) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 23 19:44:35.658416 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron_lib.callbacks.manager [None req-5b9a4a28-7353-4f72-af80-6cda6fb3a77f None None] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-927332'] for port, precommit_delete {{(pid=102994) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:44:35.671980 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.plugins.ml2.plugin [None req-5b9a4a28-7353-4f72-af80-6cda6fb3a77f None None] Calling delete_port for 1e712a26-63c0-453b-8510-11be3fce9e06 owned by network:dhcp {{(pid=102994) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 23 19:44:35.709704 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [None req-c9bbfeb8-722a-4a57-b41d-47c189281a3b admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-623933'] for security_group, after_delete {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:44:35.712363 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [None req-c9bbfeb8-722a-4a57-b41d-47c189281a3b admin admin] Publish callbacks [] for security_group, before_response {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:44:35.715990 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [None req-c9bbfeb8-722a-4a57-b41d-47c189281a3b admin admin] 10.222.0.62 "DELETE /v2.0/security-groups/07e3a515-c62e-4d6c-a985-95044756f240 HTTP/1.1" status: 204 len: 168 time: 0.3993690 Nov 23 19:44:35.725033 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c9bbfeb8-722a-4a57-b41d-47c189281a3b admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=07e3a515-c62e-4d6c-a985-95044756f240,revision_number=None']} {{(pid=102992) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 23 19:44:35.812857 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [None req-9fc4fb1c-1d01-4234-b701-706e48991bf9 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7918660', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-15067', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560168', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8783631424624', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8783631008723', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-25199805'] for port, after_delete {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:44:35.821172 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron_lib.callbacks.manager [None req-5b9a4a28-7353-4f72-af80-6cda6fb3a77f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7918660', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-15067', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560168', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8783631424624', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8783631008723'] for port, after_delete {{(pid=102994) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:44:35.845321 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5b9a4a28-7353-4f72-af80-6cda6fb3a77f None None] Pushing event deleted for resources: {'Port': ['ID=1e712a26-63c0-453b-8510-11be3fce9e06,revision_number=None']} {{(pid=102994) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 23 19:44:35.851439 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9fc4fb1c-1d01-4234-b701-706e48991bf9 admin admin] Pushing event deleted for resources: {'Port': ['ID=1e712a26-63c0-453b-8510-11be3fce9e06,revision_number=None']} {{(pid=102992) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 23 19:44:35.851817 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.db.l3_dvrscheduler_db [None req-9fc4fb1c-1d01-4234-b701-706e48991bf9 admin admin] No DVR routers for this DVR port 1e712a26-63c0-453b-8510-11be3fce9e06 on host dv-cinder-819011-1-iscsi {{(pid=102992) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 23 19:44:35.855506 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5b9a4a28-7353-4f72-af80-6cda6fb3a77f None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-819011-1-iscsi {{(pid=102994) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 23 19:44:35.856089 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5b9a4a28-7353-4f72-af80-6cda6fb3a77f None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-819011-1-iscsi {{(pid=102994) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 23 19:44:35.856619 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5b9a4a28-7353-4f72-af80-6cda6fb3a77f None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-819011-1-iscsi {{(pid=102994) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 23 19:44:35.857129 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5b9a4a28-7353-4f72-af80-6cda6fb3a77f None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-819011-1-iscsi {{(pid=102994) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 23 19:44:35.857485 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5b9a4a28-7353-4f72-af80-6cda6fb3a77f None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-819011-1-iscsi {{(pid=102994) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 23 19:44:35.857971 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5b9a4a28-7353-4f72-af80-6cda6fb3a77f None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-819011-1-iscsi {{(pid=102994) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 23 19:44:35.858523 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5b9a4a28-7353-4f72-af80-6cda6fb3a77f None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-819011-1-iscsi {{(pid=102994) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 23 19:44:35.859035 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5b9a4a28-7353-4f72-af80-6cda6fb3a77f None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-819011-1-iscsi {{(pid=102994) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 23 19:44:35.859372 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5b9a4a28-7353-4f72-af80-6cda6fb3a77f None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-819011-1-iscsi {{(pid=102994) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 23 19:44:35.859709 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5b9a4a28-7353-4f72-af80-6cda6fb3a77f None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-819011-1-iscsi {{(pid=102994) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 23 19:44:35.860041 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5b9a4a28-7353-4f72-af80-6cda6fb3a77f None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-819011-1-iscsi {{(pid=102994) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 23 19:44:35.860367 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5b9a4a28-7353-4f72-af80-6cda6fb3a77f None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-819011-1-iscsi {{(pid=102994) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 23 19:44:35.863805 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.db.l3_dvrscheduler_db [None req-5b9a4a28-7353-4f72-af80-6cda6fb3a77f None None] No DVR routers for this DVR port 1e712a26-63c0-453b-8510-11be3fce9e06 on host dv-cinder-819011-1-iscsi {{(pid=102994) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 23 19:44:35.928055 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [None req-9fc4fb1c-1d01-4234-b701-706e48991bf9 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-7977576', 'neutron.services.segments.db._delete_segments_for_network-8783631323320'] for network, precommit_delete {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:44:35.948873 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.services.segments.db [None req-9fc4fb1c-1d01-4234-b701-706e48991bf9 admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['226a519f-5f3e-4d80-bb8a-0e9fc4f64828']}} {{(pid=102992) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 23 19:44:35.958314 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.services.segments.db [None req-9fc4fb1c-1d01-4234-b701-706e48991bf9 admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '56316385-5b81-43f5-84db-b708b46f04eb') {'for_net_delete': True} {{(pid=102992) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 23 19:44:35.958610 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.services.segments.db [None req-9fc4fb1c-1d01-4234-b701-706e48991bf9 admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '56316385-5b81-43f5-84db-b708b46f04eb') {} {{(pid=102992) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 23 19:44:35.967817 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [None req-9fc4fb1c-1d01-4234-b701-706e48991bf9 admin admin] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8783631432524', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-25272530'] for segment, before_delete {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:44:35.980699 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [None req-9fc4fb1c-1d01-4234-b701-706e48991bf9 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7982218'] for segment, precommit_delete {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:44:35.986611 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-9fc4fb1c-1d01-4234-b701-706e48991bf9 admin admin] Releasing vlan 800 on physical network physnet1 to pool {{(pid=102992) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Nov 23 19:44:35.986984 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [None req-9fc4fb1c-1d01-4234-b701-706e48991bf9 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7982218', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-25200492'] for segment, after_delete {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:44:35.989238 dv-cinder-819011-1-iscsi neutron-server[102992]: Traceback (most recent call last): Nov 23 19:44:35.989238 dv-cinder-819011-1-iscsi neutron-server[102992]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Nov 23 19:44:35.989238 dv-cinder-819011-1-iscsi neutron-server[102992]: timer() Nov 23 19:44:35.989238 dv-cinder-819011-1-iscsi neutron-server[102992]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 23 19:44:35.989238 dv-cinder-819011-1-iscsi neutron-server[102992]: cb(*args, **kw) Nov 23 19:44:35.989238 dv-cinder-819011-1-iscsi neutron-server[102992]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Nov 23 19:44:35.989238 dv-cinder-819011-1-iscsi neutron-server[102992]: return func(*args, **kwargs) Nov 23 19:44:35.989238 dv-cinder-819011-1-iscsi neutron-server[102992]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 23 19:44:35.989238 dv-cinder-819011-1-iscsi neutron-server[102992]: self._notify() Nov 23 19:44:35.989238 dv-cinder-819011-1-iscsi neutron-server[102992]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 23 19:44:35.989238 dv-cinder-819011-1-iscsi neutron-server[102992]: self.callback(batched_events) Nov 23 19:44:35.989238 dv-cinder-819011-1-iscsi neutron-server[102992]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 23 19:44:35.989238 dv-cinder-819011-1-iscsi neutron-server[102992]: event.method(event) Nov 23 19:44:35.989238 dv-cinder-819011-1-iscsi neutron-server[102992]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Nov 23 19:44:35.989238 dv-cinder-819011-1-iscsi neutron-server[102992]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 23 19:44:35.989238 dv-cinder-819011-1-iscsi neutron-server[102992]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Nov 23 19:44:35.989238 dv-cinder-819011-1-iscsi neutron-server[102992]: aggregate_uuid = self.p_client.list_aggregates( Nov 23 19:44:35.989238 dv-cinder-819011-1-iscsi neutron-server[102992]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Nov 23 19:44:35.989238 dv-cinder-819011-1-iscsi neutron-server[102992]: return f(self, *a, **k) Nov 23 19:44:35.989238 dv-cinder-819011-1-iscsi neutron-server[102992]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 23 19:44:35.989238 dv-cinder-819011-1-iscsi neutron-server[102992]: return self._get(url).json() Nov 23 19:44:35.989238 dv-cinder-819011-1-iscsi neutron-server[102992]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 23 19:44:35.989238 dv-cinder-819011-1-iscsi neutron-server[102992]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 23 19:44:35.989238 dv-cinder-819011-1-iscsi neutron-server[102992]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Nov 23 19:44:35.989238 dv-cinder-819011-1-iscsi neutron-server[102992]: return self.request(url, 'GET', **kwargs) Nov 23 19:44:35.989238 dv-cinder-819011-1-iscsi neutron-server[102992]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Nov 23 19:44:35.989238 dv-cinder-819011-1-iscsi neutron-server[102992]: base_url = self.get_endpoint(auth, allow=allow, Nov 23 19:44:35.989238 dv-cinder-819011-1-iscsi neutron-server[102992]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Nov 23 19:44:35.989238 dv-cinder-819011-1-iscsi neutron-server[102992]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 23 19:44:35.989238 dv-cinder-819011-1-iscsi neutron-server[102992]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Nov 23 19:44:35.989238 dv-cinder-819011-1-iscsi neutron-server[102992]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 23 19:44:35.989238 dv-cinder-819011-1-iscsi neutron-server[102992]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 23 19:44:36.121781 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [None req-9fc4fb1c-1d01-4234-b701-706e48991bf9 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-7977567', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-554949', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560168', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-926557'] for network, after_delete {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:44:36.128233 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [None req-9fc4fb1c-1d01-4234-b701-706e48991bf9 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-560186'] for network, before_response {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:44:36.132633 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [None req-9fc4fb1c-1d01-4234-b701-706e48991bf9 admin admin] 10.222.0.62 "DELETE /v2.0/networks/226a519f-5f3e-4d80-bb8a-0e9fc4f64828 HTTP/1.1" status: 204 len: 168 time: 0.8678160 Nov 23 19:44:36.135678 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.wsgi [-] (102993) accepted ('10.222.0.62', 52524) {{(pid=102993) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 23 19:44:36.145502 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9fc4fb1c-1d01-4234-b701-706e48991bf9 admin admin] Pushing event deleted for resources: {'Network': ['ID=226a519f-5f3e-4d80-bb8a-0e9fc4f64828,revision_number=None']} {{(pid=102992) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 23 19:44:36.294158 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.plugins.ml2.rpc [None req-eb87b2c3-3339-4249-8b85-e695b5b4e1f9 None None] Device 854821af-61e0-47e7-a603-95f500a49030 no longer exists at agent ovs-agent-dv-cinder-819011-1-iscsi {{(pid=102994) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 23 19:44:36.315885 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.plugins.ml2.plugin [None req-eb87b2c3-3339-4249-8b85-e695b5b4e1f9 None None] No Port match for: 854821af-61e0-47e7-a603-95f500a49030 {{(pid=102994) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 23 19:44:36.316259 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.plugins.ml2.rpc [None req-eb87b2c3-3339-4249-8b85-e695b5b4e1f9 None None] Device 854821af-61e0-47e7-a603-95f500a49030 not bound to the agent host dv-cinder-819011-1-iscsi {{(pid=102994) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 23 19:44:36.316687 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.plugins.ml2.rpc [None req-eb87b2c3-3339-4249-8b85-e695b5b4e1f9 None None] Device c7996293-6188-4690-b614-395448e4dc25 no longer exists at agent ovs-agent-dv-cinder-819011-1-iscsi {{(pid=102994) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 23 19:44:36.336232 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.plugins.ml2.plugin [None req-eb87b2c3-3339-4249-8b85-e695b5b4e1f9 None None] No Port match for: c7996293-6188-4690-b614-395448e4dc25 {{(pid=102994) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 23 19:44:36.336579 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.plugins.ml2.rpc [None req-eb87b2c3-3339-4249-8b85-e695b5b4e1f9 None None] Device c7996293-6188-4690-b614-395448e4dc25 not bound to the agent host dv-cinder-819011-1-iscsi {{(pid=102994) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 23 19:44:36.336997 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.plugins.ml2.rpc [None req-eb87b2c3-3339-4249-8b85-e695b5b4e1f9 None None] Device 1e712a26-63c0-453b-8510-11be3fce9e06 no longer exists at agent ovs-agent-dv-cinder-819011-1-iscsi {{(pid=102994) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 23 19:44:36.355802 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.plugins.ml2.plugin [None req-eb87b2c3-3339-4249-8b85-e695b5b4e1f9 None None] No Port match for: 1e712a26-63c0-453b-8510-11be3fce9e06 {{(pid=102994) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 23 19:44:36.356151 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.plugins.ml2.rpc [None req-eb87b2c3-3339-4249-8b85-e695b5b4e1f9 None None] Device 1e712a26-63c0-453b-8510-11be3fce9e06 not bound to the agent host dv-cinder-819011-1-iscsi {{(pid=102994) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 23 19:44:36.499107 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-f81f2d9f-626a-4961-9ca6-3a2a0ecae3f6 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-932931'] for router_interface, before_delete {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:44:36.749986 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.plugins.ml2.plugin [None req-f81f2d9f-626a-4961-9ca6-3a2a0ecae3f6 admin admin] Deleting port c822f8fa-fca4-481d-b3b9-e84f0deaed5a {{(pid=102993) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 23 19:44:36.750319 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-f81f2d9f-626a-4961-9ca6-3a2a0ecae3f6 admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8783631423070'] for port, before_delete {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:44:36.828487 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.plugins.ml2.db [None req-f81f2d9f-626a-4961-9ca6-3a2a0ecae3f6 admin admin] For port c822f8fa-fca4-481d-b3b9-e84f0deaed5a, host dv-cinder-819011-1-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-819011-1-iscsi',level=0,port_id=c822f8fa-fca4-481d-b3b9-e84f0deaed5a,segment=NetworkSegment(89776fd7-6ee8-49b6-aa38-04444322cfc6),segment_id=89776fd7-6ee8-49b6-aa38-04444322cfc6)] {{(pid=102993) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 23 19:44:36.828868 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-f81f2d9f-626a-4961-9ca6-3a2a0ecae3f6 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-927332'] for port, precommit_delete {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:44:36.841510 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.plugins.ml2.plugin [None req-f81f2d9f-626a-4961-9ca6-3a2a0ecae3f6 admin admin] Calling delete_port for c822f8fa-fca4-481d-b3b9-e84f0deaed5a owned by network:router_interface {{(pid=102993) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 23 19:44:37.064673 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-f81f2d9f-626a-4961-9ca6-3a2a0ecae3f6 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7918660', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-15067', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560168', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8783631424624', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8783631008723', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-17257496'] for port, after_delete {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:44:37.089728 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f81f2d9f-626a-4961-9ca6-3a2a0ecae3f6 admin admin] Pushing event deleted for resources: {'Port': ['ID=c822f8fa-fca4-481d-b3b9-e84f0deaed5a,revision_number=None']} {{(pid=102993) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 23 19:44:37.540854 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-f81f2d9f-626a-4961-9ca6-3a2a0ecae3f6 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-560161', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-933087'] for router_interface, after_delete {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:44:37.759729 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-f81f2d9f-626a-4961-9ca6-3a2a0ecae3f6 admin admin] Router 1f81a2e4-42a5-4a27-ab4f-d5d6928fc891 has already been hosted by L3 agent 1b20f2c4-70b6-43c3-b9bd-0062cc9e57ac {{(pid=102993) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 23 19:44:37.870570 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-f81f2d9f-626a-4961-9ca6-3a2a0ecae3f6 admin admin] Notify agent at l3_agent.dv-cinder-819011-1-iscsi the message routers_updated {{(pid=102993) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 23 19:44:37.875688 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [None req-f81f2d9f-626a-4961-9ca6-3a2a0ecae3f6 admin admin] 10.222.0.62 "PUT /v2.0/routers/1f81a2e4-42a5-4a27-ab4f-d5d6928fc891/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 1.7382591 Nov 23 19:44:37.878895 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.wsgi [-] (102993) accepted ('10.222.0.62', 52544) {{(pid=102993) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 23 19:44:37.881480 dv-cinder-819011-1-iscsi neutron-server[102995]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-db00327f-4ec4-46ba-9fb2-ab5d5b201b8d None None] Sync routers for ids ['1f81a2e4-42a5-4a27-ab4f-d5d6928fc891'] in dv-cinder-819011-1-iscsi {{(pid=102995) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 23 19:44:37.891570 dv-cinder-819011-1-iscsi neutron-server[102995]: DEBUG neutron.db.l3_dvrscheduler_db [None req-db00327f-4ec4-46ba-9fb2-ab5d5b201b8d None None] Routers {'1f81a2e4-42a5-4a27-ab4f-d5d6928fc891'} bound to L3 agent in host dv-cinder-819011-1-iscsi {{(pid=102995) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 23 19:44:37.892182 dv-cinder-819011-1-iscsi neutron-server[102995]: DEBUG neutron.db.l3_hamode_db [None req-db00327f-4ec4-46ba-9fb2-ab5d5b201b8d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-819011-1-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-23T19:25:14Z,description=,heartbeat_timestamp=2021-11-23T19:44:14Z,host='dv-cinder-819011-1-iscsi',id=1b20f2c4-70b6-43c3-b9bd-0062cc9e57ac,load=0,resource_versions=,resources_synced=,started_at=2021-11-23T19:25:15Z,topic='l3_agent')) {'router_ids': ['1f81a2e4-42a5-4a27-ab4f-d5d6928fc891'], 'active': True} {{(pid=102995) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 23 19:44:37.984262 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-489f1ec0-f760-4d79-9ec8-1170972f72e2 admin admin] Publish callbacks [] for router, before_delete {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:44:37.998440 dv-cinder-819011-1-iscsi neutron-server[102995]: DEBUG neutron.db.l3_dvr_db [None req-db00327f-4ec4-46ba-9fb2-ab5d5b201b8d None None] Set router 1f81a2e4-42a5-4a27-ab4f-d5d6928fc891 gateway port host: dv-cinder-819011-1-iscsi {{(pid=102995) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 23 19:44:38.086606 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-489f1ec0-f760-4d79-9ec8-1170972f72e2 admin admin] Publish callbacks [] for router_gateway, before_delete {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:44:38.187147 dv-cinder-819011-1-iscsi neutron-server[102995]: DEBUG neutron.db.l3_hamode_db [None req-db00327f-4ec4-46ba-9fb2-ab5d5b201b8d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '1f81a2e4-42a5-4a27-ab4f-d5d6928fc891', 'name': 'tempest-TestVolumeBootPattern-1496802758-router', 'tenant_id': '1e70ae5f657c4aebb6c283d99f5ccde0', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'a93e254e-aac9-4233-9e4d-4290fd0458e4', 'external_fixed_ips': [{'subnet_id': 'e0b32f3d-83d6-439a-bbed-01df7cf01051', 'ip_address': '172.27.1.23'}], 'enable_snat': True}, 'gw_port_id': '73dcb0d3-92dc-4f06-8f5e-6b11c077207d', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-23T19:35:36Z', 'updated_at': '2021-11-23T19:44:36Z', 'revision_number': 5, 'project_id': '1e70ae5f657c4aebb6c283d99f5ccde0', 'gw_port': {'id': '73dcb0d3-92dc-4f06-8f5e-6b11c077207d', 'name': '', 'network_id': 'a93e254e-aac9-4233-9e4d-4290fd0458e4', 'tenant_id': '', 'mac_address': 'fa:16:3e:9c:b1:7d', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '1f81a2e4-42a5-4a27-ab4f-d5d6928fc891', 'device_owner': 'network:router_gateway', 'standard_attr_id': 404, 'fixed_ips': [{'subnet_id': 'e0b32f3d-83d6-439a-bbed-01df7cf01051', 'ip_address': '172.27.1.23', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-819011-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-23T19:35:37Z', 'updated_at': '2021-11-23T19:35:42Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'e0b32f3d-83d6-439a-bbed-01df7cf01051', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-819011-1-iscsi'}], 'dv-cinder-819011-1-iscsi', False) {} {{(pid=102995) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 23 19:44:38.213692 dv-cinder-819011-1-iscsi neutron-server[102995]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-db00327f-4ec4-46ba-9fb2-ab5d5b201b8d None None] Checking router: 1f81a2e4-42a5-4a27-ab4f-d5d6928fc891 for host: dv-cinder-819011-1-iscsi {{(pid=102995) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 23 19:44:38.222868 dv-cinder-819011-1-iscsi neutron-server[102995]: DEBUG neutron.db.l3_dvrscheduler_db [None req-db00327f-4ec4-46ba-9fb2-ab5d5b201b8d None None] Routers {'1f81a2e4-42a5-4a27-ab4f-d5d6928fc891'} bound to L3 agent in host dv-cinder-819011-1-iscsi {{(pid=102995) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 23 19:44:38.223539 dv-cinder-819011-1-iscsi neutron-server[102995]: DEBUG neutron.db.l3_hamode_db [None req-db00327f-4ec4-46ba-9fb2-ab5d5b201b8d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-819011-1-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-23T19:25:14Z,description=,heartbeat_timestamp=2021-11-23T19:44:14Z,host='dv-cinder-819011-1-iscsi',id=1b20f2c4-70b6-43c3-b9bd-0062cc9e57ac,load=0,resource_versions=,resources_synced=,started_at=2021-11-23T19:25:15Z,topic='l3_agent')) {'router_ids': ['1f81a2e4-42a5-4a27-ab4f-d5d6928fc891'], 'active': True} {{(pid=102995) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 23 19:44:38.233324 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.plugins.ml2.plugin [None req-489f1ec0-f760-4d79-9ec8-1170972f72e2 admin admin] Deleting port 73dcb0d3-92dc-4f06-8f5e-6b11c077207d {{(pid=102993) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 23 19:44:38.233697 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-489f1ec0-f760-4d79-9ec8-1170972f72e2 admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8783631423070'] for port, before_delete {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:44:38.339317 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.plugins.ml2.db [None req-489f1ec0-f760-4d79-9ec8-1170972f72e2 admin admin] For port 73dcb0d3-92dc-4f06-8f5e-6b11c077207d, host dv-cinder-819011-1-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-819011-1-iscsi',level=0,port_id=73dcb0d3-92dc-4f06-8f5e-6b11c077207d,segment=NetworkSegment(3cb5e60b-103a-47d0-a28b-d68e3159d032),segment_id=3cb5e60b-103a-47d0-a28b-d68e3159d032)] {{(pid=102993) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 23 19:44:38.339615 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-489f1ec0-f760-4d79-9ec8-1170972f72e2 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-927332'] for port, precommit_delete {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:44:38.353322 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.plugins.ml2.plugin [None req-489f1ec0-f760-4d79-9ec8-1170972f72e2 admin admin] Calling delete_port for 73dcb0d3-92dc-4f06-8f5e-6b11c077207d owned by network:router_gateway {{(pid=102993) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 23 19:44:38.443091 dv-cinder-819011-1-iscsi neutron-server[102995]: DEBUG neutron.db.l3_dvr_db [None req-db00327f-4ec4-46ba-9fb2-ab5d5b201b8d None None] Set router 1f81a2e4-42a5-4a27-ab4f-d5d6928fc891 gateway port host: None {{(pid=102995) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 23 19:44:38.494269 dv-cinder-819011-1-iscsi neutron-server[102995]: DEBUG neutron.db.l3_hamode_db [None req-db00327f-4ec4-46ba-9fb2-ab5d5b201b8d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '1f81a2e4-42a5-4a27-ab4f-d5d6928fc891', 'name': 'tempest-TestVolumeBootPattern-1496802758-router', 'tenant_id': '1e70ae5f657c4aebb6c283d99f5ccde0', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-23T19:35:36Z', 'updated_at': '2021-11-23T19:44:38Z', 'revision_number': 6, 'project_id': '1e70ae5f657c4aebb6c283d99f5ccde0', 'gw_port_host': None}], 'dv-cinder-819011-1-iscsi', False) {} {{(pid=102995) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 23 19:44:38.525255 dv-cinder-819011-1-iscsi neutron-server[102995]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-db00327f-4ec4-46ba-9fb2-ab5d5b201b8d None None] The sync data for ids ['1f81a2e4-42a5-4a27-ab4f-d5d6928fc891'] in dv-cinder-819011-1-iscsi is: [{'id': '1f81a2e4-42a5-4a27-ab4f-d5d6928fc891', 'name': 'tempest-TestVolumeBootPattern-1496802758-router', 'tenant_id': '1e70ae5f657c4aebb6c283d99f5ccde0', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-23T19:35:36Z', 'updated_at': '2021-11-23T19:44:38Z', 'revision_number': 6, 'project_id': '1e70ae5f657c4aebb6c283d99f5ccde0', 'gw_port_host': None}] {{(pid=102995) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 23 19:44:38.567609 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-489f1ec0-f760-4d79-9ec8-1170972f72e2 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7918660', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-15067', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560168', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8783631424624', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8783631008723', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-17257496'] for port, after_delete {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:44:38.593348 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-489f1ec0-f760-4d79-9ec8-1170972f72e2 admin admin] Pushing event deleted for resources: {'Port': ['ID=73dcb0d3-92dc-4f06-8f5e-6b11c077207d,revision_number=None']} {{(pid=102993) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 23 19:44:38.658642 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-489f1ec0-f760-4d79-9ec8-1170972f72e2 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-926585'] for router_gateway, after_delete {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:44:38.750358 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-489f1ec0-f760-4d79-9ec8-1170972f72e2 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-932919', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-13457'] for router, precommit_delete {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:44:38.752467 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-489f1ec0-f760-4d79-9ec8-1170972f72e2 admin admin] Publish callbacks [] for router_controller, precommit_delete_associations {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:44:38.870372 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-489f1ec0-f760-4d79-9ec8-1170972f72e2 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-926715'] for router, after_delete {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:44:38.870919 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-489f1ec0-f760-4d79-9ec8-1170972f72e2 admin admin] Fanout notify agent at l3_agent the message router_deleted on router 1f81a2e4-42a5-4a27-ab4f-d5d6928fc891 {{(pid=102993) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Nov 23 19:44:38.875718 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-489f1ec0-f760-4d79-9ec8-1170972f72e2 admin admin] Publish callbacks [] for router, before_response {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:44:38.876947 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [None req-489f1ec0-f760-4d79-9ec8-1170972f72e2 admin admin] 10.222.0.62 "DELETE /v2.0/routers/1f81a2e4-42a5-4a27-ab4f-d5d6928fc891 HTTP/1.1" status: 204 len: 168 time: 0.9970756 Nov 23 19:44:38.879634 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.wsgi [-] (102993) accepted ('10.222.0.62', 52548) {{(pid=102993) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 23 19:44:38.929815 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.db.db_base_plugin_v2 [None req-cb71f5e2-2bc2-47d3-a698-7a1e5503f6f7 admin admin] Deleting subnet 56f5fba5-4cd3-476d-bc1c-2e0c8f45bb10 {{(pid=102993) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Nov 23 19:44:38.933063 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-cb71f5e2-2bc2-47d3-a698-7a1e5503f6f7 admin admin] Publish callbacks [] for subnet, before_delete {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:44:38.968377 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-cb71f5e2-2bc2-47d3-a698-7a1e5503f6f7 admin admin] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-16914634'] for subnet, precommit_delete_associations {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:44:39.045164 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-cb71f5e2-2bc2-47d3-a698-7a1e5503f6f7 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-7975863'] for subnet, precommit_delete {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:44:39.150527 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-cb71f5e2-2bc2-47d3-a698-7a1e5503f6f7 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-7982148', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-554858', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560168', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-17257579', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-17772973'] for subnet, after_delete {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:44:39.181250 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cb71f5e2-2bc2-47d3-a698-7a1e5503f6f7 admin admin] Pushing event deleted for resources: {'Subnet': ['ID=56f5fba5-4cd3-476d-bc1c-2e0c8f45bb10,revision_number=None']} {{(pid=102993) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 23 19:44:39.185933 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-cb71f5e2-2bc2-47d3-a698-7a1e5503f6f7 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-560186'] for subnet, before_response {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:44:39.191982 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-c0f5fe39-8ffe-4656-9e51-d9bf8cf21ead None None] Network a79fa83e-69fd-41d9-9001-545f7467c26a requested from dv-cinder-819011-1-iscsi {{(pid=102994) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 23 19:44:39.193077 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.wsgi [-] (102992) accepted ('10.222.0.62', 52552) {{(pid=102992) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 23 19:44:39.193565 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [None req-cb71f5e2-2bc2-47d3-a698-7a1e5503f6f7 admin admin] 10.222.0.62 "DELETE /v2.0/subnets/56f5fba5-4cd3-476d-bc1c-2e0c8f45bb10 HTTP/1.1" status: 204 len: 168 time: 0.3123550 Nov 23 19:44:39.263536 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [None req-ac7c393a-bd8e-4191-b200-992e550786e6 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-8133038'] for network, before_delete {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:44:39.353946 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.plugins.ml2.plugin [None req-ac7c393a-bd8e-4191-b200-992e550786e6 admin admin] Deleting port f244284e-32a3-4378-aeca-176afb29edd9 {{(pid=102992) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 23 19:44:39.354502 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [None req-ac7c393a-bd8e-4191-b200-992e550786e6 admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8783631423070'] for port, before_delete {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:44:39.420855 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-7d5cb0e7-5c57-4acf-869c-e1ad818df12a None None] DHCP port deletion for a79fa83e-69fd-41d9-9001-545f7467c26a request from dv-cinder-819011-1-iscsi {{(pid=102994) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:266}} Nov 23 19:44:39.436252 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.plugins.ml2.db [None req-ac7c393a-bd8e-4191-b200-992e550786e6 admin admin] For port f244284e-32a3-4378-aeca-176afb29edd9, host dv-cinder-819011-1-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-819011-1-iscsi',level=0,port_id=f244284e-32a3-4378-aeca-176afb29edd9,segment=NetworkSegment(89776fd7-6ee8-49b6-aa38-04444322cfc6),segment_id=89776fd7-6ee8-49b6-aa38-04444322cfc6)] {{(pid=102992) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 23 19:44:39.436607 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [None req-ac7c393a-bd8e-4191-b200-992e550786e6 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-927332'] for port, precommit_delete {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:44:39.450811 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.plugins.ml2.plugin [None req-ac7c393a-bd8e-4191-b200-992e550786e6 admin admin] Calling delete_port for f244284e-32a3-4378-aeca-176afb29edd9 owned by network:dhcp {{(pid=102992) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 23 19:44:39.610298 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.plugins.ml2.plugin [None req-7d5cb0e7-5c57-4acf-869c-e1ad818df12a None None] Deleting port f244284e-32a3-4378-aeca-176afb29edd9 {{(pid=102994) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 23 19:44:39.610678 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron_lib.callbacks.manager [None req-7d5cb0e7-5c57-4acf-869c-e1ad818df12a None None] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8783631423070'] for port, before_delete {{(pid=102994) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:44:39.618927 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [None req-ac7c393a-bd8e-4191-b200-992e550786e6 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7918660', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-15067', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560168', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8783631424624', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8783631008723', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-25199805'] for port, after_delete {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:44:39.650792 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ac7c393a-bd8e-4191-b200-992e550786e6 admin admin] Pushing event deleted for resources: {'Port': ['ID=f244284e-32a3-4378-aeca-176afb29edd9,revision_number=None']} {{(pid=102992) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 23 19:44:39.653000 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.db.l3_dvrscheduler_db [None req-ac7c393a-bd8e-4191-b200-992e550786e6 admin admin] No DVR routers for this DVR port f244284e-32a3-4378-aeca-176afb29edd9 on host dv-cinder-819011-1-iscsi {{(pid=102992) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 23 19:44:39.661497 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ac7c393a-bd8e-4191-b200-992e550786e6 admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-819011-1-iscsi {{(pid=102992) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 23 19:44:39.661856 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ac7c393a-bd8e-4191-b200-992e550786e6 admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-819011-1-iscsi {{(pid=102992) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 23 19:44:39.662198 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ac7c393a-bd8e-4191-b200-992e550786e6 admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-819011-1-iscsi {{(pid=102992) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 23 19:44:39.662542 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ac7c393a-bd8e-4191-b200-992e550786e6 admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-819011-1-iscsi {{(pid=102992) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 23 19:44:39.663338 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ac7c393a-bd8e-4191-b200-992e550786e6 admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-819011-1-iscsi {{(pid=102992) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 23 19:44:39.663338 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ac7c393a-bd8e-4191-b200-992e550786e6 admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-819011-1-iscsi {{(pid=102992) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 23 19:44:39.663937 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ac7c393a-bd8e-4191-b200-992e550786e6 admin admin] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-819011-1-iscsi {{(pid=102992) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 23 19:44:39.663937 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ac7c393a-bd8e-4191-b200-992e550786e6 admin admin] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-819011-1-iscsi {{(pid=102992) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 23 19:44:39.664153 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ac7c393a-bd8e-4191-b200-992e550786e6 admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-819011-1-iscsi {{(pid=102992) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 23 19:44:39.664468 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ac7c393a-bd8e-4191-b200-992e550786e6 admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-819011-1-iscsi {{(pid=102992) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 23 19:44:39.664795 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ac7c393a-bd8e-4191-b200-992e550786e6 admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-819011-1-iscsi {{(pid=102992) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 23 19:44:39.665117 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ac7c393a-bd8e-4191-b200-992e550786e6 admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-819011-1-iscsi {{(pid=102992) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 23 19:44:39.678073 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.plugins.ml2.db [None req-7d5cb0e7-5c57-4acf-869c-e1ad818df12a None None] For port f244284e-32a3-4378-aeca-176afb29edd9, host dv-cinder-819011-1-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-819011-1-iscsi',level=0,port_id=f244284e-32a3-4378-aeca-176afb29edd9,segment=NetworkSegment(89776fd7-6ee8-49b6-aa38-04444322cfc6),segment_id=89776fd7-6ee8-49b6-aa38-04444322cfc6)] {{(pid=102994) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 23 19:44:39.678474 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron_lib.callbacks.manager [None req-7d5cb0e7-5c57-4acf-869c-e1ad818df12a None None] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-927332'] for port, precommit_delete {{(pid=102994) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:44:39.694373 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.plugins.ml2.plugin [None req-7d5cb0e7-5c57-4acf-869c-e1ad818df12a None None] Calling delete_port for f244284e-32a3-4378-aeca-176afb29edd9 owned by network:dhcp {{(pid=102994) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 23 19:44:39.740437 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [None req-ac7c393a-bd8e-4191-b200-992e550786e6 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-7977576', 'neutron.services.segments.db._delete_segments_for_network-8783631323320'] for network, precommit_delete {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:44:39.760063 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.services.segments.db [None req-ac7c393a-bd8e-4191-b200-992e550786e6 admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['a79fa83e-69fd-41d9-9001-545f7467c26a']}} {{(pid=102992) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 23 19:44:39.769927 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.services.segments.db [None req-ac7c393a-bd8e-4191-b200-992e550786e6 admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '89776fd7-6ee8-49b6-aa38-04444322cfc6') {'for_net_delete': True} {{(pid=102992) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 23 19:44:39.770224 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.services.segments.db [None req-ac7c393a-bd8e-4191-b200-992e550786e6 admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '89776fd7-6ee8-49b6-aa38-04444322cfc6') {} {{(pid=102992) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 23 19:44:39.780643 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [None req-ac7c393a-bd8e-4191-b200-992e550786e6 admin admin] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8783631432524', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-25272530'] for segment, before_delete {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:44:39.781740 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron_lib.callbacks.manager [None req-7d5cb0e7-5c57-4acf-869c-e1ad818df12a None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7918660', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-15067', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560168', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8783631424624', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8783631008723'] for port, after_delete {{(pid=102994) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:44:39.797515 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [None req-ac7c393a-bd8e-4191-b200-992e550786e6 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7982218'] for segment, precommit_delete {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:44:39.806137 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-ac7c393a-bd8e-4191-b200-992e550786e6 admin admin] Releasing vlan 837 on physical network physnet1 to pool {{(pid=102992) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Nov 23 19:44:39.806137 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [None req-ac7c393a-bd8e-4191-b200-992e550786e6 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-7982218', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-25200492'] for segment, after_delete {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:44:39.806137 dv-cinder-819011-1-iscsi neutron-server[102992]: Traceback (most recent call last): Nov 23 19:44:39.806137 dv-cinder-819011-1-iscsi neutron-server[102992]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Nov 23 19:44:39.806137 dv-cinder-819011-1-iscsi neutron-server[102992]: timer() Nov 23 19:44:39.806137 dv-cinder-819011-1-iscsi neutron-server[102992]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 23 19:44:39.806137 dv-cinder-819011-1-iscsi neutron-server[102992]: cb(*args, **kw) Nov 23 19:44:39.806137 dv-cinder-819011-1-iscsi neutron-server[102992]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Nov 23 19:44:39.806137 dv-cinder-819011-1-iscsi neutron-server[102992]: return func(*args, **kwargs) Nov 23 19:44:39.806137 dv-cinder-819011-1-iscsi neutron-server[102992]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 23 19:44:39.806137 dv-cinder-819011-1-iscsi neutron-server[102992]: self._notify() Nov 23 19:44:39.806137 dv-cinder-819011-1-iscsi neutron-server[102992]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 23 19:44:39.806137 dv-cinder-819011-1-iscsi neutron-server[102992]: self.callback(batched_events) Nov 23 19:44:39.806137 dv-cinder-819011-1-iscsi neutron-server[102992]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 23 19:44:39.806137 dv-cinder-819011-1-iscsi neutron-server[102992]: event.method(event) Nov 23 19:44:39.806137 dv-cinder-819011-1-iscsi neutron-server[102992]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Nov 23 19:44:39.806137 dv-cinder-819011-1-iscsi neutron-server[102992]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 23 19:44:39.806137 dv-cinder-819011-1-iscsi neutron-server[102992]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Nov 23 19:44:39.806137 dv-cinder-819011-1-iscsi neutron-server[102992]: aggregate_uuid = self.p_client.list_aggregates( Nov 23 19:44:39.806137 dv-cinder-819011-1-iscsi neutron-server[102992]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Nov 23 19:44:39.806137 dv-cinder-819011-1-iscsi neutron-server[102992]: return f(self, *a, **k) Nov 23 19:44:39.806137 dv-cinder-819011-1-iscsi neutron-server[102992]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 23 19:44:39.806137 dv-cinder-819011-1-iscsi neutron-server[102992]: return self._get(url).json() Nov 23 19:44:39.806137 dv-cinder-819011-1-iscsi neutron-server[102992]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 23 19:44:39.806137 dv-cinder-819011-1-iscsi neutron-server[102992]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 23 19:44:39.806137 dv-cinder-819011-1-iscsi neutron-server[102992]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Nov 23 19:44:39.806137 dv-cinder-819011-1-iscsi neutron-server[102992]: return self.request(url, 'GET', **kwargs) Nov 23 19:44:39.806137 dv-cinder-819011-1-iscsi neutron-server[102992]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Nov 23 19:44:39.806137 dv-cinder-819011-1-iscsi neutron-server[102992]: base_url = self.get_endpoint(auth, allow=allow, Nov 23 19:44:39.806137 dv-cinder-819011-1-iscsi neutron-server[102992]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Nov 23 19:44:39.806137 dv-cinder-819011-1-iscsi neutron-server[102992]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 23 19:44:39.806137 dv-cinder-819011-1-iscsi neutron-server[102992]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Nov 23 19:44:39.806137 dv-cinder-819011-1-iscsi neutron-server[102992]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 23 19:44:39.806137 dv-cinder-819011-1-iscsi neutron-server[102992]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 23 19:44:39.809014 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7d5cb0e7-5c57-4acf-869c-e1ad818df12a None None] Pushing event deleted for resources: {'Port': ['ID=f244284e-32a3-4378-aeca-176afb29edd9,revision_number=None']} {{(pid=102994) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 23 19:44:39.811753 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.db.l3_dvrscheduler_db [None req-7d5cb0e7-5c57-4acf-869c-e1ad818df12a None None] No DVR routers for this DVR port f244284e-32a3-4378-aeca-176afb29edd9 on host dv-cinder-819011-1-iscsi {{(pid=102994) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 23 19:44:39.933483 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [None req-ac7c393a-bd8e-4191-b200-992e550786e6 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-7977567', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-554949', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560168', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-926557'] for network, after_delete {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:44:39.939224 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [None req-ac7c393a-bd8e-4191-b200-992e550786e6 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-560186'] for network, before_response {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:44:39.947021 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [None req-ac7c393a-bd8e-4191-b200-992e550786e6 admin admin] 10.222.0.62 "DELETE /v2.0/networks/a79fa83e-69fd-41d9-9001-545f7467c26a HTTP/1.1" status: 204 len: 168 time: 0.7482209 Nov 23 19:44:39.953556 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ac7c393a-bd8e-4191-b200-992e550786e6 admin admin] Pushing event deleted for resources: {'Network': ['ID=a79fa83e-69fd-41d9-9001-545f7467c26a,revision_number=None']} {{(pid=102992) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 23 19:44:40.232938 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.wsgi [-] (102992) accepted ('10.222.0.62', 52558) {{(pid=102992) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 23 19:44:40.274333 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [None req-21f86230-e7cc-4bd2-8921-c7668bd5a11b admin admin] 10.222.0.62 "GET /v2.0/security-groups?tenant_id=257b0b2e531441b4bb745e99cfd799f3&name=default HTTP/1.1" status: 200 len: 2996 time: 0.0401309 Nov 23 19:44:40.276817 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.wsgi [-] (102992) accepted ('10.222.0.62', 52560) {{(pid=102992) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 23 19:44:40.293470 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.plugins.ml2.rpc [None req-eb87b2c3-3339-4249-8b85-e695b5b4e1f9 None None] Device f244284e-32a3-4378-aeca-176afb29edd9 no longer exists at agent ovs-agent-dv-cinder-819011-1-iscsi {{(pid=102994) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 23 19:44:40.314168 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.plugins.ml2.plugin [None req-eb87b2c3-3339-4249-8b85-e695b5b4e1f9 None None] No Port match for: f244284e-32a3-4378-aeca-176afb29edd9 {{(pid=102994) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 23 19:44:40.314655 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.plugins.ml2.rpc [None req-eb87b2c3-3339-4249-8b85-e695b5b4e1f9 None None] Device f244284e-32a3-4378-aeca-176afb29edd9 not bound to the agent host dv-cinder-819011-1-iscsi {{(pid=102994) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 23 19:44:40.315086 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.plugins.ml2.rpc [None req-eb87b2c3-3339-4249-8b85-e695b5b4e1f9 None None] Device c822f8fa-fca4-481d-b3b9-e84f0deaed5a no longer exists at agent ovs-agent-dv-cinder-819011-1-iscsi {{(pid=102994) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 23 19:44:40.334680 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [None req-d3c1c28c-cb88-4569-8626-3c87ef080056 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:44:40.337456 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.plugins.ml2.plugin [None req-eb87b2c3-3339-4249-8b85-e695b5b4e1f9 None None] No Port match for: c822f8fa-fca4-481d-b3b9-e84f0deaed5a {{(pid=102994) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 23 19:44:40.337810 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.plugins.ml2.rpc [None req-eb87b2c3-3339-4249-8b85-e695b5b4e1f9 None None] Device c822f8fa-fca4-481d-b3b9-e84f0deaed5a not bound to the agent host dv-cinder-819011-1-iscsi {{(pid=102994) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 23 19:44:40.338238 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.plugins.ml2.rpc [None req-eb87b2c3-3339-4249-8b85-e695b5b4e1f9 None None] Device 73dcb0d3-92dc-4f06-8f5e-6b11c077207d no longer exists at agent ovs-agent-dv-cinder-819011-1-iscsi {{(pid=102994) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 23 19:44:40.356728 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [None req-d3c1c28c-cb88-4569-8626-3c87ef080056 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:44:40.360858 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.plugins.ml2.plugin [None req-eb87b2c3-3339-4249-8b85-e695b5b4e1f9 None None] No Port match for: 73dcb0d3-92dc-4f06-8f5e-6b11c077207d {{(pid=102994) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 23 19:44:40.361207 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron.plugins.ml2.rpc [None req-eb87b2c3-3339-4249-8b85-e695b5b4e1f9 None None] Device 73dcb0d3-92dc-4f06-8f5e-6b11c077207d not bound to the agent host dv-cinder-819011-1-iscsi {{(pid=102994) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 23 19:44:40.464592 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [None req-d3c1c28c-cb88-4569-8626-3c87ef080056 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-623933'] for security_group, after_delete {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:44:40.467196 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron_lib.callbacks.manager [None req-d3c1c28c-cb88-4569-8626-3c87ef080056 admin admin] Publish callbacks [] for security_group, before_response {{(pid=102992) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:44:40.468374 dv-cinder-819011-1-iscsi neutron-server[102992]: INFO neutron.wsgi [None req-d3c1c28c-cb88-4569-8626-3c87ef080056 admin admin] 10.222.0.62 "DELETE /v2.0/security-groups/1837229a-e26a-4243-bdd7-8391c7eafa8b HTTP/1.1" status: 204 len: 168 time: 0.1905413 Nov 23 19:44:40.476956 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d3c1c28c-cb88-4569-8626-3c87ef080056 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=1837229a-e26a-4243-bdd7-8391c7eafa8b,revision_number=None']} {{(pid=102992) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 23 19:44:41.054106 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.wsgi [-] (102993) accepted ('10.222.0.62', 52568) {{(pid=102993) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 23 19:44:41.100853 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [None req-78367dee-d7dc-409d-9803-756e8da6c29f admin admin] 10.222.0.62 "GET /v2.0/security-groups?tenant_id=1e70ae5f657c4aebb6c283d99f5ccde0&name=default HTTP/1.1" status: 200 len: 2996 time: 0.0384252 Nov 23 19:44:41.100853 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.wsgi [-] (102993) accepted ('10.222.0.62', 52570) {{(pid=102993) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 23 19:44:41.142735 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-8f8396a6-f8f4-414a-9710-abf5e73a7f01 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:44:41.164021 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-8f8396a6-f8f4-414a-9710-abf5e73a7f01 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:44:41.287225 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-8f8396a6-f8f4-414a-9710-abf5e73a7f01 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-623933'] for security_group, after_delete {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:44:41.289857 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-8f8396a6-f8f4-414a-9710-abf5e73a7f01 admin admin] Publish callbacks [] for security_group, before_response {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:44:41.291037 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [None req-8f8396a6-f8f4-414a-9710-abf5e73a7f01 admin admin] 10.222.0.62 "DELETE /v2.0/security-groups/e6172580-cd29-420e-9dc0-33b702f5b55e HTTP/1.1" status: 204 len: 168 time: 0.1930163 Nov 23 19:44:41.298773 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8f8396a6-f8f4-414a-9710-abf5e73a7f01 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=e6172580-cd29-420e-9dc0-33b702f5b55e,revision_number=None']} {{(pid=102993) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 23 19:44:41.744226 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron_lib.callbacks.manager [None req-eff1c6d4-fee4-44be-ae5e-e742ef8d174b None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8783631323329', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7978582'] for agent, after_update {{(pid=102994) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:44:44.230127 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron_lib.callbacks.manager [None req-922e0443-00e2-41dd-8593-336cf841db7e None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8783631323329', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7978582'] for agent, after_update {{(pid=102994) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:44:45.115543 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron_lib.callbacks.manager [None req-8346ef05-f685-4c3d-af3d-a159b683bec2 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8783631323329', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7978582'] for agent, after_update {{(pid=102994) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:44:46.618286 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron_lib.callbacks.manager [None req-785c1d26-11ba-42d8-b5a6-51a8b3daeef0 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8783631323329', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7978582'] for agent, after_update {{(pid=102994) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:44:47.338292 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron_lib.callbacks.manager [None req-eb87b2c3-3339-4249-8b85-e695b5b4e1f9 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8783631323329', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7978582'] for agent, after_update {{(pid=102994) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:44:57.001601 dv-cinder-819011-1-iscsi neutron-server[102995]: DEBUG neutron.db.agents_db [None req-84bdc9b2-57ea-4bdb-a245-07c78d37cea8 None None] Agent healthcheck: found 6 active agents {{(pid=102995) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 23 19:44:59.881051 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron_lib.callbacks.manager [None req-4bf48ff4-ecfb-4168-8b63-249b8c6e9f04 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8783631323329', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7978582'] for agent, after_update {{(pid=102994) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:45:07.860062 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.wsgi [-] (102993) accepted ('10.222.0.62', 52682) {{(pid=102993) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 23 19:45:07.962834 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-c7559dcd-0228-4de8-8503-f8860c71c496 admin admin] Publish callbacks [] for security_group, before_create {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:45:08.033745 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-c7559dcd-0228-4de8-8503-f8860c71c496 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:45:08.115694 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-c7559dcd-0228-4de8-8503-f8860c71c496 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-623933'] for security_group, after_create {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:45:08.155473 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c7559dcd-0228-4de8-8503-f8860c71c496 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=e95522e4-b03b-4bc4-ae2b-ec8b2f220224,revision_number=1']} {{(pid=102993) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 23 19:45:08.159755 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [None req-c7559dcd-0228-4de8-8503-f8860c71c496 admin admin] 10.222.0.62 "GET /v2.0/security-groups?tenant_id=ca3f87d08ab34bc9b71a9ba8c20bf15c&name=default HTTP/1.1" status: 200 len: 2996 time: 0.2986772 Nov 23 19:45:08.163206 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.wsgi [-] (102993) accepted ('10.222.0.62', 52686) {{(pid=102993) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 23 19:45:08.210131 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-a5e70c38-4618-47eb-a1f3-b15a563a2615 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:45:08.231151 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-a5e70c38-4618-47eb-a1f3-b15a563a2615 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:45:08.332281 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-a5e70c38-4618-47eb-a1f3-b15a563a2615 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-623933'] for security_group, after_delete {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:45:08.336107 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron_lib.callbacks.manager [None req-a5e70c38-4618-47eb-a1f3-b15a563a2615 admin admin] Publish callbacks [] for security_group, before_response {{(pid=102993) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:45:08.337261 dv-cinder-819011-1-iscsi neutron-server[102993]: INFO neutron.wsgi [None req-a5e70c38-4618-47eb-a1f3-b15a563a2615 admin admin] 10.222.0.62 "DELETE /v2.0/security-groups/e95522e4-b03b-4bc4-ae2b-ec8b2f220224 HTTP/1.1" status: 204 len: 168 time: 0.1731501 Nov 23 19:45:08.345242 dv-cinder-819011-1-iscsi neutron-server[102993]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a5e70c38-4618-47eb-a1f3-b15a563a2615 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=e95522e4-b03b-4bc4-ae2b-ec8b2f220224,revision_number=None']} {{(pid=102993) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 23 19:45:11.737886 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron_lib.callbacks.manager [None req-c66e668c-d489-46e1-b25d-99755a1cb807 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8783631323329', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7978582'] for agent, after_update {{(pid=102994) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:45:14.206918 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron_lib.callbacks.manager [None req-5f090ebf-233d-41df-bf54-7b7edafab6d8 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8783631323329', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7978582'] for agent, after_update {{(pid=102994) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:45:15.126944 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron_lib.callbacks.manager [None req-8346ef05-f685-4c3d-af3d-a159b683bec2 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8783631323329', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7978582'] for agent, after_update {{(pid=102994) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:45:16.612214 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron_lib.callbacks.manager [None req-785c1d26-11ba-42d8-b5a6-51a8b3daeef0 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8783631323329', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7978582'] for agent, after_update {{(pid=102994) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:45:17.337322 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron_lib.callbacks.manager [None req-eb87b2c3-3339-4249-8b85-e695b5b4e1f9 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8783631323329', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7978582'] for agent, after_update {{(pid=102994) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:45:29.874675 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron_lib.callbacks.manager [None req-4bf48ff4-ecfb-4168-8b63-249b8c6e9f04 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8783631323329', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7978582'] for agent, after_update {{(pid=102994) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:45:34.001273 dv-cinder-819011-1-iscsi neutron-server[102995]: DEBUG neutron.db.agents_db [None req-84bdc9b2-57ea-4bdb-a245-07c78d37cea8 None None] Agent healthcheck: found 6 active agents {{(pid=102995) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 23 19:45:41.742771 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron_lib.callbacks.manager [None req-1af19191-36e0-42f2-853d-052d58492336 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8783631323329', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7978582'] for agent, after_update {{(pid=102994) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:45:44.188659 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron_lib.callbacks.manager [None req-f08d9741-b164-4d8b-9241-50dd4222cd84 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8783631323329', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7978582'] for agent, after_update {{(pid=102994) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:45:45.211553 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron_lib.callbacks.manager [None req-8346ef05-f685-4c3d-af3d-a159b683bec2 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8783631323329', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7978582'] for agent, after_update {{(pid=102994) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:45:46.645593 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron_lib.callbacks.manager [None req-785c1d26-11ba-42d8-b5a6-51a8b3daeef0 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8783631323329', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7978582'] for agent, after_update {{(pid=102994) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:45:47.309278 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron_lib.callbacks.manager [None req-eb87b2c3-3339-4249-8b85-e695b5b4e1f9 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8783631323329', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7978582'] for agent, after_update {{(pid=102994) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:45:59.874250 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron_lib.callbacks.manager [None req-4bf48ff4-ecfb-4168-8b63-249b8c6e9f04 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8783631323329', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7978582'] for agent, after_update {{(pid=102994) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:46:11.000994 dv-cinder-819011-1-iscsi neutron-server[102995]: DEBUG neutron.db.agents_db [None req-84bdc9b2-57ea-4bdb-a245-07c78d37cea8 None None] Agent healthcheck: found 6 active agents {{(pid=102995) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 23 19:46:11.742619 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron_lib.callbacks.manager [None req-84830ccd-f3dd-4490-9e04-29bc57b3dd86 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8783631323329', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7978582'] for agent, after_update {{(pid=102994) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:46:14.205475 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron_lib.callbacks.manager [None req-3e2f3b7b-e7d6-4d92-8f3b-bcd9a4a07888 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8783631323329', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7978582'] for agent, after_update {{(pid=102994) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:46:15.171632 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron_lib.callbacks.manager [None req-8346ef05-f685-4c3d-af3d-a159b683bec2 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8783631323329', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7978582'] for agent, after_update {{(pid=102994) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:46:16.622951 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron_lib.callbacks.manager [None req-785c1d26-11ba-42d8-b5a6-51a8b3daeef0 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8783631323329', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7978582'] for agent, after_update {{(pid=102994) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:46:17.327951 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron_lib.callbacks.manager [None req-eb87b2c3-3339-4249-8b85-e695b5b4e1f9 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8783631323329', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7978582'] for agent, after_update {{(pid=102994) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:46:29.896376 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron_lib.callbacks.manager [None req-4bf48ff4-ecfb-4168-8b63-249b8c6e9f04 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8783631323329', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7978582'] for agent, after_update {{(pid=102994) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:46:41.736706 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron_lib.callbacks.manager [None req-0d430a3a-4441-4add-837b-b7c6336efae3 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8783631323329', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7978582'] for agent, after_update {{(pid=102994) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:46:44.193943 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron_lib.callbacks.manager [None req-b1b99554-58b3-4c2c-82c7-3334e04e57f9 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8783631323329', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7978582'] for agent, after_update {{(pid=102994) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:46:45.114490 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron_lib.callbacks.manager [None req-8346ef05-f685-4c3d-af3d-a159b683bec2 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8783631323329', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7978582'] for agent, after_update {{(pid=102994) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:46:46.627795 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron_lib.callbacks.manager [None req-785c1d26-11ba-42d8-b5a6-51a8b3daeef0 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8783631323329', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7978582'] for agent, after_update {{(pid=102994) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:46:47.313871 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron_lib.callbacks.manager [None req-eb87b2c3-3339-4249-8b85-e695b5b4e1f9 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8783631323329', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7978582'] for agent, after_update {{(pid=102994) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:46:48.000355 dv-cinder-819011-1-iscsi neutron-server[102995]: DEBUG neutron.db.agents_db [None req-84bdc9b2-57ea-4bdb-a245-07c78d37cea8 None None] Agent healthcheck: found 6 active agents {{(pid=102995) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 23 19:46:59.901794 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron_lib.callbacks.manager [None req-4bf48ff4-ecfb-4168-8b63-249b8c6e9f04 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8783631323329', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7978582'] for agent, after_update {{(pid=102994) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:47:11.725879 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron_lib.callbacks.manager [None req-984a1a85-19b2-49ef-8147-e4ef7477be6d None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8783631323329', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7978582'] for agent, after_update {{(pid=102994) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:47:14.204602 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron_lib.callbacks.manager [None req-b11a3a3c-776e-42bf-b131-126f7989f9b8 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8783631323329', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7978582'] for agent, after_update {{(pid=102994) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:47:15.165220 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron_lib.callbacks.manager [None req-8346ef05-f685-4c3d-af3d-a159b683bec2 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8783631323329', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7978582'] for agent, after_update {{(pid=102994) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:47:16.658112 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron_lib.callbacks.manager [None req-785c1d26-11ba-42d8-b5a6-51a8b3daeef0 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8783631323329', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7978582'] for agent, after_update {{(pid=102994) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:47:17.324752 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron_lib.callbacks.manager [None req-eb87b2c3-3339-4249-8b85-e695b5b4e1f9 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8783631323329', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7978582'] for agent, after_update {{(pid=102994) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:47:24.999254 dv-cinder-819011-1-iscsi neutron-server[102995]: DEBUG neutron.db.agents_db [None req-84bdc9b2-57ea-4bdb-a245-07c78d37cea8 None None] Agent healthcheck: found 6 active agents {{(pid=102995) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 23 19:47:29.907266 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron_lib.callbacks.manager [None req-4bf48ff4-ecfb-4168-8b63-249b8c6e9f04 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8783631323329', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7978582'] for agent, after_update {{(pid=102994) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:47:41.753127 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron_lib.callbacks.manager [None req-6f718fe4-5fbd-4ec5-9743-fe544d4a2fa4 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8783631323329', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7978582'] for agent, after_update {{(pid=102994) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:47:44.204269 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron_lib.callbacks.manager [None req-24144fff-ad7c-45fd-bef4-5639ba8b48fa None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8783631323329', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7978582'] for agent, after_update {{(pid=102994) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:47:45.136785 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron_lib.callbacks.manager [None req-8346ef05-f685-4c3d-af3d-a159b683bec2 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8783631323329', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7978582'] for agent, after_update {{(pid=102994) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:47:46.622210 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron_lib.callbacks.manager [None req-785c1d26-11ba-42d8-b5a6-51a8b3daeef0 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8783631323329', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7978582'] for agent, after_update {{(pid=102994) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:47:47.313016 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron_lib.callbacks.manager [None req-eb87b2c3-3339-4249-8b85-e695b5b4e1f9 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8783631323329', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7978582'] for agent, after_update {{(pid=102994) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:47:59.958360 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron_lib.callbacks.manager [None req-4bf48ff4-ecfb-4168-8b63-249b8c6e9f04 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8783631323329', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7978582'] for agent, after_update {{(pid=102994) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:48:01.998207 dv-cinder-819011-1-iscsi neutron-server[102995]: DEBUG neutron.db.agents_db [None req-84bdc9b2-57ea-4bdb-a245-07c78d37cea8 None None] Agent healthcheck: found 6 active agents {{(pid=102995) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 23 19:48:11.724186 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron_lib.callbacks.manager [None req-87eb535c-f3dc-42da-b2d8-6f0d233d3e9f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8783631323329', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7978582'] for agent, after_update {{(pid=102994) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:48:14.187160 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron_lib.callbacks.manager [None req-0d267ead-2004-4675-b413-5164d5a47d2c None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8783631323329', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7978582'] for agent, after_update {{(pid=102994) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:48:15.175660 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron_lib.callbacks.manager [None req-8346ef05-f685-4c3d-af3d-a159b683bec2 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8783631323329', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7978582'] for agent, after_update {{(pid=102994) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:48:16.633027 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron_lib.callbacks.manager [None req-785c1d26-11ba-42d8-b5a6-51a8b3daeef0 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8783631323329', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7978582'] for agent, after_update {{(pid=102994) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:48:17.323923 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron_lib.callbacks.manager [None req-eb87b2c3-3339-4249-8b85-e695b5b4e1f9 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8783631323329', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7978582'] for agent, after_update {{(pid=102994) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:48:29.929755 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron_lib.callbacks.manager [None req-4bf48ff4-ecfb-4168-8b63-249b8c6e9f04 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8783631323329', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7978582'] for agent, after_update {{(pid=102994) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:48:38.998504 dv-cinder-819011-1-iscsi neutron-server[102995]: DEBUG neutron.db.agents_db [None req-84bdc9b2-57ea-4bdb-a245-07c78d37cea8 None None] Agent healthcheck: found 6 active agents {{(pid=102995) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 23 19:48:41.740827 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron_lib.callbacks.manager [None req-bceae30c-fb5c-4a07-96b9-ae638caa76e3 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8783631323329', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7978582'] for agent, after_update {{(pid=102994) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:48:44.198100 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron_lib.callbacks.manager [None req-dd41a329-b522-44ac-aed2-71437faa742f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8783631323329', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7978582'] for agent, after_update {{(pid=102994) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:48:45.152576 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron_lib.callbacks.manager [None req-8346ef05-f685-4c3d-af3d-a159b683bec2 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8783631323329', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7978582'] for agent, after_update {{(pid=102994) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:48:46.615149 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron_lib.callbacks.manager [None req-785c1d26-11ba-42d8-b5a6-51a8b3daeef0 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8783631323329', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7978582'] for agent, after_update {{(pid=102994) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:48:47.312483 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron_lib.callbacks.manager [None req-eb87b2c3-3339-4249-8b85-e695b5b4e1f9 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8783631323329', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7978582'] for agent, after_update {{(pid=102994) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:48:59.952604 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron_lib.callbacks.manager [None req-4bf48ff4-ecfb-4168-8b63-249b8c6e9f04 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8783631323329', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7978582'] for agent, after_update {{(pid=102994) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:49:11.740876 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron_lib.callbacks.manager [None req-e3bbf48d-c063-41f6-8dcd-f51e9ab3b050 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8783631323329', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7978582'] for agent, after_update {{(pid=102994) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:49:14.203666 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron_lib.callbacks.manager [None req-0d754739-fdfb-41c1-96e6-82148ab16dd5 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8783631323329', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7978582'] for agent, after_update {{(pid=102994) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:49:15.249224 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron_lib.callbacks.manager [None req-8346ef05-f685-4c3d-af3d-a159b683bec2 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8783631323329', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7978582'] for agent, after_update {{(pid=102994) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:49:15.997140 dv-cinder-819011-1-iscsi neutron-server[102995]: DEBUG neutron.db.agents_db [None req-84bdc9b2-57ea-4bdb-a245-07c78d37cea8 None None] Agent healthcheck: found 6 active agents {{(pid=102995) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 23 19:49:16.661174 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron_lib.callbacks.manager [None req-785c1d26-11ba-42d8-b5a6-51a8b3daeef0 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8783631323329', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7978582'] for agent, after_update {{(pid=102994) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:49:17.300478 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron_lib.callbacks.manager [None req-eb87b2c3-3339-4249-8b85-e695b5b4e1f9 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8783631323329', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7978582'] for agent, after_update {{(pid=102994) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:49:29.945850 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron_lib.callbacks.manager [None req-4bf48ff4-ecfb-4168-8b63-249b8c6e9f04 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8783631323329', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7978582'] for agent, after_update {{(pid=102994) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:49:41.711972 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron_lib.callbacks.manager [None req-0eabf239-b126-47ab-82fa-4246f651a7be None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8783631323329', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7978582'] for agent, after_update {{(pid=102994) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:49:44.214670 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron_lib.callbacks.manager [None req-997e5b15-d0c5-4eba-b464-f85fd37e7cb8 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8783631323329', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7978582'] for agent, after_update {{(pid=102994) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:49:45.146278 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron_lib.callbacks.manager [None req-8346ef05-f685-4c3d-af3d-a159b683bec2 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8783631323329', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7978582'] for agent, after_update {{(pid=102994) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:49:46.643782 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron_lib.callbacks.manager [None req-785c1d26-11ba-42d8-b5a6-51a8b3daeef0 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8783631323329', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7978582'] for agent, after_update {{(pid=102994) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:49:47.311991 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron_lib.callbacks.manager [None req-eb87b2c3-3339-4249-8b85-e695b5b4e1f9 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8783631323329', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7978582'] for agent, after_update {{(pid=102994) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:49:52.995192 dv-cinder-819011-1-iscsi neutron-server[102995]: DEBUG neutron.db.agents_db [None req-84bdc9b2-57ea-4bdb-a245-07c78d37cea8 None None] Agent healthcheck: found 6 active agents {{(pid=102995) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 23 19:49:59.946361 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron_lib.callbacks.manager [None req-4bf48ff4-ecfb-4168-8b63-249b8c6e9f04 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8783631323329', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7978582'] for agent, after_update {{(pid=102994) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:50:11.746363 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron_lib.callbacks.manager [None req-07715546-e4ef-45bf-9f9e-80ea9626e598 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8783631323329', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7978582'] for agent, after_update {{(pid=102994) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:50:14.214562 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron_lib.callbacks.manager [None req-6cf13d7c-7292-43ab-8d7f-84c52a9c7048 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8783631323329', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7978582'] for agent, after_update {{(pid=102994) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:50:15.197070 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron_lib.callbacks.manager [None req-8346ef05-f685-4c3d-af3d-a159b683bec2 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8783631323329', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7978582'] for agent, after_update {{(pid=102994) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:50:16.643372 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron_lib.callbacks.manager [None req-785c1d26-11ba-42d8-b5a6-51a8b3daeef0 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8783631323329', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7978582'] for agent, after_update {{(pid=102994) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:50:17.318041 dv-cinder-819011-1-iscsi neutron-server[102994]: DEBUG neutron_lib.callbacks.manager [None req-eb87b2c3-3339-4249-8b85-e695b5b4e1f9 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8783631323329', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-7978582'] for agent, after_update {{(pid=102994) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 23 19:50:20.749631 dv-cinder-819011-1-iscsi neutron-server[102992]: DEBUG neutron.wsgi [req-49b63e6e-2b70-41f2-b156-80fb360e2256 req-4300fe71-6d5b-4f19-a9dc-8798c1d2e102 service neutron] (102992) timed out ('10.222.0.41', 51776) {{(pid=102992) process_request /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:842}}